
New research suggests that fine-tuning AI models can indeed be worthwhile, even when using retrieval-augmented (RAG) setups—but only in specific cases. While fine-tuning large models hasn’t consistently proven valuable for legal applications, recent findings show that focusing on smaller models can yield substantial improvements, especially in tasks like information retrieval and accuracy in legal work.