Make JSON output consistent for your LLM Apps to leverage

Jun '24 (edited) • Full Stack Development with AI

My big win this week was using the brilliant Python library Instructor https://python.useinstructor.com/ . As a comparative newbie Python coder, I needed to spend a lot of effort with my LLM apps parsing the inconsistent output of LLM apps because they would not return responses in a consistent way. Pydantic is the typical gatekeeper tool to ensure output meets your requirements and errors if it does not meet this metric. The problem is that you still need to do a lot of work with the output to cleanse it to meet this requirement with Instructor this work is pretty much removed. For a quick overview see -

7 comments