콘텐츠로 이동

Large Language Models Course

인하대학교 · 2026년 봄학기

본 강의는 대규모 언어 모델(Large Language Model; LLM)의 전반을 이해하는 것을 목표로 합니다. Transformer 및 LLM의 아키텍쳐부터 LLM의 학습과 인퍼런스, GPU 시스템 및 RL 기반 post-training까지 LLM을 이해하는 데 필요한 주요 내용을 학습합니다.
참고: 인하대학교에서 개설된 공식 강의명은 Multimodal VLM (ECE7115)이지만, 실제 강의 내용은 LLM을 중심으로 구성되어 있습니다.
강의자: 안남혁 (인하대학교 전기전자공학부)

강의 스케쥴 & 자료

날짜 내용 Slides YouTube
3/2 No class (National holiday)
3/9 No class
3/16 Week 1. Introduction + Transformer
- Course introduction
- Resource accounting
- Transformer
0. Course Introduction
1. Resource accounting
2. Transformer
1. Course Introduction + Resource accounting
2. Transformer
3/23 Week 2. LLM Basics
- Pre-training
- Post-training
- Fine-tuning, Prompting
3. LLM Basics 3-1. LLM Basics (1)
3-2. LLM Basics (2)
3/30 Week 3. LLM Architecture (1)
- Modern LLM models
- Attention variants
4. Modern LLM Architecture 4-1. Modern LLM Architecture
4-2. Attention Variants
4/6 Week 4. LLM Architecture (2)
- Mixture-of-experts
- Scaling Laws
5. Mixture-of-Experts
6. Scaling Laws
5. Mixture-of-Experts
6. Scaling Laws
4/13 No class
4/20 Week 5. LLM Case Study
- Recent model architectures
7. LLM Case Study 7. LLM Case Study
4/27 Week 6. Understanding GPUs
- GPUs
- FlashAttention
8. Understanding GPUs 8. Understanding GPUs & FlashAttention
5/4 Week 7. Parallelism
- Multi-GPU/machine training
9. Parallelism 9. Parallelism
5/11 Week 8. Inference, Evaluation
- Inference cost & techniques
- Evaluation metrics
10. Inference
11. Evaluation
10. Inference
11. Evaluation
5/18 Week 9. Dataset, SFT
- Training dataset
- Supervised fine-tuning
12. Dataset & SFT 12. Dataset & SFT
5/25 No Class (National Holiday)
6/1 Week 10. RLHF
- Introduction to RL
- RL from human feedback
13. RLHF 13. RLHF
6/8 Week 11. Reasoning
- Reasoning without Training
- Training reasoning (RLVR)
14. Reasoning 14. Reasoning
6/15 Week 12. Modern Post-Training
- Modern approach
- Case study
- Agentic systems