Web AI Scrapper · AI Automation Society

Web AI Scrapper

Hello! Any ideas on how to create an AI agent that can scrape an online web catalog and extract data from it? I was investigating this can be made with Selenium, but it implies that you need to investigate the web page structure javascript and css in order to create a script for that. I was thinking more of an AI that can be instructed with some kind of prompt like this:

"You are a catalog finder and your job is to navigate through this website (url) and extract the information of every item, like name, quantity, price and description, and save that info into a csv file"

Just trying to streamline the process of web scrapping.

Thanks.

6 comments