biggest challenge - the hardware needed to run crews
In my opinion, the most challenging aspect of running crews of AI agents is the hardware needed to do this. As costs can easily add up while testing various modifications in the code. - having a powerful machine seems to be a must (using services like Lightning AI could be only a temporary solution, as paying $ 50-100 daily can easily be the case) - another cost can be generated by using paid models (like Open AI) - also here bills can sky rocket quickly - using Lightning AI in combination with Open AI would be extremely expensive (1) The best case scenario is running open source models locally. But not all models would work on various machines. In this setup, usually the smallest models can be used. (2) Second best option would be either running paid models locally or running (more advanced) open source models on virtual machines in the cloud. (3) The most expensive situation would be running paid models on virtual machines in the cloud. But the trick is finding the right model, for each project. In order to do so, lots of testing is needed... Which will eventually (potentially) generate quite high costs. Personally, I only managed to replicate only one crewai example, using Lightining AI studio (free plan). After running it once, most of the free credits were gone... 😆 So if I plan to run it again, I would need to buy a subscription... What are your thoughts on this ?