A crash-course and 7-step guide to fine tuning gpt-3.5-turbo.
Resources:
OpenAI Fine-tuning Guide: https://platform.openai.com/docs/guid...
OpenAI API Docs: https://platform.openai.com/docs/api-...
Python Data Preparation and Analysis Scripts
Purchase here: https://buy.stripe.com/00g3cYcWh4PF2g...
0:00 Fine-tune gpt 3.5 in seven steps
0:08 Should I use fine-tuning?
0:20 When does fine-tuning work?
1:09 Step 1 - Preparing data for fine-tuning
1:20 How much data do I need for fine-tuning?
1:59 Fine-tuning on Twitter or blog data
2:30 Step 2 - Using rewinder to automatically generate prompts for fine-tuning
3:15 Step 3 - Prepare messages for OpenAI api
4:25 Step 4 - Data validation for fine-tuning
5:00 How much does fine-tuning cost with OpenAI?
5:28 Step 5 - Running a fine-tuning job
6:45 How long does fine-tuning take?
7:00 Step 6 - Saving and visualising fine-tuning results
8:30 Plotting and analysing fine-tuning results
9:38 Step 7 - Manual inspection of results
10:54 How do I know if fine-tuning worked?
11:15 Where to find scripts for fine-tuning with OpenAi