I just watched the Jake Van Cleef breakdown, and the biggest thing that stood out to me was how easy it is to use different llms. It clicked because I am trying out different local llms, and having a system which is this easy to set up and maintain is really a game changer.
My main takeaway was a reminder, that the foundation matters. You need to document the processes and context and update it with the thing you learn on the way. And if you do this, you can come a pretty long way with quite small models. Which is essential for my work.
Going forward, I'm going to document the foundations which currently resides mainly between my ears 🧠.