Mar '24 • 🛠️ dev-help
How to deploy Langchain server
I have built a langchain agent api using FastAPI. It works fine for one request, but when 2 users request simultaneously, it takes very long and till then I get a "Time Out" response in my frontend.
Can anyone please help me deploying such an application in production, so that multiple users can use it?
I am using the free open ai api with rate limits. Can that be an issue?
1
2 comments
How to deploy Langchain server
skool.com/learn-ai
Learn and become genuinely proficient in AI to get paid for it. From the creators of the AI Automation Agency model.
Leaderboard (30-day)
1
+398
2
+368
3
+358
4
+267
5
+243
Powered by