Build AI agent or workflow
hi guys, I want to create a solution that automate this process:
  • take every LLM output of a client for 1-4 different queries
  • compare the previous vs last output semantically to see if changed the output (especially if there's no mention about legal cases)
  • send notification to the client only if the output chaged
I've already automatized the gathering of the data which go into a google sheet
(one sheet fot gemini and one for chatgpt)
the problem is how compare the texts.
I'm trying with the AI agent with the google sheets as tools but it retrieves the wrong dates and only compare outputs randomly even if i described in detail in the prompts how it should compare.
I don't know how to get reliable comparisons.
Should I store the output in a vector DB to get more consistent results and if so how?
Should I use an ai agent or create an AI workflow?
How would you approach it?
ps: it would be cool to highlight significant differences too
2
0 comments
Andrea Mugnano
2
Build AI agent or workflow
AI Automation Society
skool.com/ai-automation-society
A community built to master no-code AI automations. Join to learn, discuss, and build the systems that will shape the future of work.
Leaderboard (30-day)
Powered by