The Fine-tuning Index: Benchmarks comparing 13 fine-tuned open-source LLMs against OpenAI on 31 distinct tasks - from
Key Takeaways
- LoRA Fine-tuned models outperform GPT-4 on specialized tasks
- LoRA Fine-tuned models are fast and cheap to train and serve, averaging less than $8 each
- Specialized tasks are ideal for LoRA fine-tuning Their research team also recently published an Arxiv paper going into the process and finding in much more depth and we link to it on the Index.