Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More
Memberships
AI Developer Accelerator
10.8k members • Free
2 contributions to AI Developer Accelerator
Aug '24 •
LLM production deployment
Hi, any one got an idea how to calculate the GPU size for serve like 50-100 users when I have local server for LLama3.1-70B model, what parameters I shall use, and how to calculate step by step?
1 like • Aug '24
@Tom Welsh Due to information security concerns, my company cannot use any cloud services. Therefore, we plan to set up a local GPU server. We need to evaluate its capacity—specifically, will 8 L40 GPUs be sufficient to serve 100 users? Besides, I find that AI Agents consumes tokens a lot
1 like • Aug '24
@Adisak Sukul Thanks a lot for your sharing, I think our 4*L40 GPU server will be enough☺️
Aug '24 •
How CrewAI assign different tasks to sub-agents
Hi everyone, 👋I’m currently developing a CrewAI system with multiple functions. One function extracts data from MongoDB and plots graphs, while another fetches data from same Mongo and generates analysis reports. My issue is that after assigning a manager, it doesn’t seem to know which agent to use based on the user’s input. It’s unclear how to correctly assign tasks to the appropriate agent. I’ve considered revising the architecture by assigning different tools to one agent and having it decide which tool to use, but that doesn’t seem to work either. Does anyone have any suggestions? I want to scale this agent system in the future, but it could become chaotic if the agents don’t know which tools to use or if the manager doesn’t know which agent to assign.🤕
1 like • Aug '24
@Maksym Liamin I forgot to mention that I have another agent designed to create APIs and automatically fetch data from MongoDB. The project's goal is to enable users to query the database using natural language and perform tasks like plotting graphs and generating reports automatically. In the future, we plan to scale the system to include more functions, which is why it's crucial for the agents to accurately identify user requirements and know exactly which tool or agent to utilize.
1-2 of 2
Active 432d ago
Joined Jul 25, 2024
Powered by