Day 4 - Large Language Models

7-Day AI Research Training Workshop

Bridging Deep Learning Theory with Practical Implementation for Vision & Language Research
Day 4 - Large Language Models I: Foundations and Fine-Tuning
Morning Session (9:00 AM - 1:00 PM)
9:00 - 10:00 AM
Understanding Representation Spaces
Analyze contrastive learning model embeddings and understand semantic structure.
10:00 - 11:00 AM
Inside GPT-Style Models
Architecture and text generation mechanisms behind Large Language Models.
11:00 - 12:00 PM
Hands-On: Training GPT-2 from Scratch
Prepare the OpenWebText dataset and train a baseline model for text generation.
12:00 - 1:00 PM
Instruction Fine-Tuning in Practice
Explore Conversational AI and programming-focused fine-tuning for domain adaptation.