Context Fatigue · The AI Advantage

Context Fatigue

I've been working on building out an Executive Assistant/Project Manager. I've got a very detailed instruction set that works miricles -- for a while. But they the AI starts getting dumber and dumber. After a while it is completely useless.

I've tried both ChatGPT and Gemini Pro. Gemini lasts longer that ChatGPT but 'context fatigue' eventually kills it. I've been working around in Gemini by periodically having it dump all the projects/tasks/events to one big JSON export then pasting that into a new instance of the chat.

This works -- sort a -- some things are still getting dropped. But it is extremely inconvenient to be constantly respawning the agent. Further, although the JSON is preserving the core tasks/events/projects, the details of things we worked on together are lost with every respawn.

I know some of you are working on building your own executive assistant agents. Have ya'll had similar problems?

0 comments