OpenAI Announces Assistants API v2

Apr '24 (edited) • Announcements 📣

Happy Saturday and 4/20 🍃 (for those who celebrate) and happy Earth day 🌎

OpenAI has released a new version of its Assistant API called v2 Beta, with lots of improvements and new stuff.

Here’s a non technical summary;

They made a tool called file_search much better.
Now, it can handle up to 10,000 files per assistant, which is a huge upgrade from before.
It works faster, can look at multiple files at once, and does a better job of finding what you need.
They also added something called vector_store, which helps organize files and makes it easier to find things across different assistants and conversations.
Now, you can control how many "tokens" each run uses. This helps manage costs better.
You can also set limits on how much history the AI looks at when making responses.
They added a feature where you can tell the AI to use specific tools like file retrieval or code interpreter for certain tasks.
You can now create custom conversation histories, which is pretty neat.
The AI now understands more settings like temperature, response format, etc.
The AI can now handle streaming, which is great for real-time interactions.
They also added some helpers to make it easier to use the AI in programming languages like Node and Python.