Long-context approaches are no substitute for structured knowledge bases—I’ll stick with RAG/folders when appropriate, and just feed in the full text otherwise.

Last Friday, I helped a classmate review the customer service knowledge base Q&A. He crammed all the support tickets from the past two years, the product manual, and the FAQs into a single 200K context window and asked, “Log in...”.

IvesFeng
October 28, 2026