7 Day Challenge Day 2 · AI Automation Society

7 Day Challenge Day 2

I used Firecrawl to help scrape saved html files from various travel sites for a hotel. Many of the travel sites block scraping, so I worked in additional tool that saved the rendered html to file that firecrawl then scraped, ran the results of the scrape through Ollama to further normalize and analyze the data into an excel workbook with various metrics including content parity and raw content by channel. Tool still needs lots of work as there are lots of inaccuracies, likely need more work on how the content is normalized.

0 comments