People think they can use Fine-Tune for Knowledge Injection. People are Wrong

https://news.ycombinator.com/item?id=44242737

If fine-tuning is a risky solution, what’s the alternative? The answer lies in modularity and augmentation. Techniques such as retrieval-augmented generation (RAG), external memory banks, and adapter modules provide more robust ways to incorporate new information without overwriting the existing network’s knowledge base.