Struggle with RAG and Crew · AI Developer Accelerator

Mar 17 • CrewAI

Struggle with RAG and Crew

I have lots of structure json files with title and description (could be job listing, property listing etc.). I'm trying to get a crew to return the top matching items for a given query title. All the examples I've seen work on a small example set but fail to handle large collections of documents like above. I use local LLM and often get warnings that the input prompt token count exceeded the limit. Tried the pro tools approach vs. the noob, but still struggles.

A working example would be nice.

6 comments