LLM context windows · Data Alchemy

LLM context windows

I am trying to build my own LLM driven chatbot, without the use of Langchain, LlamaIndex or other modules. One of the things one needs to account for is the context window of the LLM, so the user is aware they are reaching the limit beyond which the LLM forgets the beginning of their conversation.

Having tried the info pages on Huggingface with very limited success, I am turning to you: where can I find the context windows for Open Source LLMs? No, Huggingface is not an answer :)

6 comments