Chatbot agent exceed token limit · AI Developer Accelerator

Chatbot agent exceed token limit

Hello everyone!

I’m working on the LangChain Master Class for Beginners 2024 video, and I’m struggling with rag_conversational. Instead of using the provided text files, I input a large document (The Capital, Volume I—around 500 pages) and attempted to request a summary of Chapter 1 using OpenAI. However, I encountered an error message.

Does anyone have any ideas on how to resolve this issue?

message': 'Request too large for gpt-4o in organization org-aVsRZmS23mqZY3EFUoQNNDCw on tokens per min (TPM): Limit 30000, Requested 542017. The input or output tokens must be reduced in order to run successfully. Visit https://platform.openai.com/account/rate-limits to learn more.', 'type': 'tokens', 'param': None, 'code': 'rate_limit_exceeded'

3 comments