Quite a decent hit. Local models don't perform very well in long contexts. We're...

		tifa2up 3 months ago \| parent \| context \| favorite \| on: Production RAG: what I learned from processing 5M+... Quite a decent hit. Local models don't perform very well in long contexts. We're planning to support a local-only offline set-up for people to host w/o additional dependencies