How to Train Your (Chat)GPT Assistant: An Emerging Recipe
Upload by JustinThis document discusses the training pipeline for GPT Assistant, including pretraining, supervised finetuning, reward modeling, and reinforcement learning. It emphasizes the importance of data collection and transforming text into integers for training.
GPT Assistant
Training Pipeline
Pretraining
Supervised Finetuning
Reward Modeling