Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More

Memberships

AI Developer Accelerator

10.8k members โ€ข Free

2 contributions to AI Developer Accelerator
Has anyone worked with transcriptions already?
Hey guys, I'm a beginner in Python, and crewAI, and I have this project for my company. I have more than 300 video tutorials recorded to provide support to my clients. I want to create a crew to transcribe the tutorials, create help center articles, and maybe store it somewhere. Has anyone worked with any tool to transcribe video audio into text? After this process, I want to create another crewAI using the latest RAG tutorial from codewithbrandon to create a support chatbot to automate my customer inquiries! If anyone has ever used a tool for that, I would be really glad to start a conversation!
1 like โ€ข Jul '24
Hey Lucas, yes I have worked on a single project where I extracted the transcription, gtt the embeddings and created a basic chatbot just by using similarity search function (LLM was GPT3.5). Doing the same exact thing with CrewAI seems cool, maybe we can work on this together if you'd like.
0 likes โ€ข Aug '24
@Lucas Mariano no worries, I have sent you a message
How to leverage CrewAI for scraping?
Hey everyone, I am working on a really cool project which I shared with some of you in yesterday's call. I was able to collect really good information from the call yesterday. Thank you everyone. Ok, so now, I want some data to be scraped from Google. A quick reminder about the project that I am working on: So, we are creating a platform where its easier for students to choose the right University based on different factors and for that, we need a lot of data and a lot of automation. There are about 5400 Universities in the US and for now, I've got 1700 Universities basic data (such as names and ALIAS etc). What I wanna do now is that I want to build a scraper that takes the name of the University and search the following query: "What programs does {name} offer?" and I will see all of the programs there are to offer by that University. I want that data! Here's the flow that I understood: - Get the name - Search the query - Get the URL (generated after the search query is searched) of the web page. - Use bs4 to get the HTML and then its easy as there's similar names used for <divs> for all the Universities. I have attached a screenshot too so that you guys can see in detail about what I am talking about. My questions: - How can I use crewAI to do this for me? - Should I use crewAI just to the URL of the webpage or should I leverage crewAI to give me all of the programs too. - If I use CrewAI, should I use openAI or any open source (maybe 7b) LLM to reduce the cost etc? If any one of you could gimme a roadmap, it would be amazing because as of now, I have to use selenium just to get the target URL. The main concern for me right now, is the target URL. Its hard to get.
0
0
How to leverage CrewAI for scraping?
1-2 of 2
Afaq Khan
1
4points to level up
@afaq-khan-6666
AI Engineer | NLP

Active 490d ago
Joined Jul 4, 2024
Powered by