https://yoojin-kim.github.io/ 2026-01-29T21:31:32+01:00 Yoojin Kim https://yoojin-kim.github.io/ Jekyll © 2026 Yoojin Kim /assets/img/favicons/favicon.ico /assets/img/favicons/favicon-96x96.png 2026-01-29T21:00:00+01:00 2026-01-29T21:00:00+01:00 https://yoojin-kim.github.io/posts/d27/ Yoojin Kim

📝 논문 Literature Review 준비 새 채팅에서 다음을 준비하면 좋겠습니다: 필요한 정보: 논문 제목: “Empirical Study of Autoregressive State Space Models for Software Development” 주요 섹션: Related Work (SSMs, Code Models) Background (Mamba, BiGS) Methodology Experiments & Results 핵심 Reference 논문들: Mamba: Structured State Space Models BiGS: Bidirectional Gated SSM CodeXGLUE Benchmarks Transformer baselines (CodeGPT, CodeT5) ...

2026-01-27T15:30:00+01:00 2026-01-27T15:30:00+01:00 https://yoojin-kim.github.io/posts/d29/ Yoojin Kim

오늘 미팅 내용이 아주 좋지 않았다…잡도리…

2026-01-26T20:00:00+01:00 2026-01-26T20:00:00+01:00 https://yoojin-kim.github.io/posts/d30/ Yoojin Kim

#Token-level Fine-tuning <==> Raw results; <BiGS> (_) [kim@slurm-login causal]$ cat token_completion_py150/test_results.json { "eval_loss": 1.1523972749710083, "eval_accuracy": 0.727497134796791, "eval_runtime": 7.1555, "eval_samples_per_second": 13.975, "eval_steps_per_second": 1.817, "epoch": 5.0 }(_) [kim@slurm-login causal]$ cat token_completion_java/test_results.js...

2026-01-20T21:00:00+01:00 2026-01-20T21:00:00+01:00 https://yoojin-kim.github.io/posts/d36/ Yoojin Kim

📋 작업 요약 (2026-01-20) 🎯 목표 BiGS와 Mamba 모델을 CodeXGLUE line completion 태스크로 fine-tuning 🔴 발견된 문제들 Dataset 문제 (Root Cause) code_x_glue_cc_code_completion_line 데이터셋의 gt 필드가 완전히 비어있음 결과: loss=0.0, eval_loss=NaN Context Truncation 문제 긴 코드가 max_length=512로 잘리면서 target(gt)이 사라짐 39%의 샘플에서 valid labels가 0개 API 호환성 문제 HuggingFace Trainer의 log() 메서드 시그니처 변경 start_time 파라미터 필수화 ✅ 해결 방법 데이터셋 전환: code_...

2026-01-16T21:00:00+01:00 2026-01-16T21:00:00+01:00 https://yoojin-kim.github.io/posts/d40/ Yoojin Kim

line completion token completion and then code generation https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/CodeCompletion-line https://github.com/ishuoliu/ASE-CMamba/tree/main