Hi All,
Have been trying to get Brandon's CrewAI Rag code running that scrapes youtube for the five top videos (crewai-rag-deep-dive/2_youtube_and_web).
I have installed and re-installed the poetry shell. The code is exactly the same - just a git clone of Brandon's code. That being said I have followed the vid twice to ensure all is well - I cannot see where my env starts to go pear shaped.
My output seems different - less verbose?
It is when the code starts executing the second agent/task that it fails to add any of the five videos to the vector store.
I have let the code run to the end and it finishes all the tasks and does find a few items from the web searches. But it is the failed vectorDB that has me stumped!
Help please!
Thanks
Alan.
*** terminal output ***
crewai-rag-basics-py3.10(base) a_shipley@ShipleyAI:~/Python_poetry/crewai-rag-deep-dive/2_youtube_and_web$ python crew.py Please enter the YouTube handle to analyze:
bhancock_ai
> Entering new CrewAgentExecutor chain...
To proceed with scraping the latest five videos from the specified YouTube channel, I will use the available tool to fetch the latest videos from the channel handle `bhancock_ai`.
Action: Fetch Latest Videos for Channel
Action Input: {"youtube_channel_handle": "@bhancock_ai", "max_results": 5}
videos=[VideoInfo(video_id='8PtGcNE01yo', title='CrewAI Flows Crash Course', publish_date=datetime.datetime(2024, 10, 25, 13, 45, 29, tzinfo=datetime.timezone.utc), video_url='https://www.youtube.com/watch?v=8PtGcNE01yo'), VideoInfo(video_id='cyPZsbO5i5U', title='Supabase Postgres Vector DB Crash Course', publish_date=datetime.datetime(2024, 10, 18, 20, 48, 14, tzinfo=datetime.timezone.utc), video_url='https://www.youtube.com/watch?v=cyPZsbO5i5U'), VideoInfo(video_id='2qU3SPPojDA', title='How to Build a NextJS MVP using v0, Claude, and Cursor', publish_date=datetime.datetime(2024, 10, 10, 17, 13, 35, tzinfo=datetime.timezone.utc), video_url='https://www.youtube.com/watch?v=2qU3SPPojDA'), VideoInfo(video_id='np1cwfDjCF4', title='Build a Full Stack AI Marketing Platform SaaS [Premium Course Announcement]', publish_date=datetime.datetime(2024, 9, 19, 17, 13, 33, tzinfo=datetime.timezone.utc), video_url='https://www.youtube.com/watch?v=np1cwfDjCF4'), VideoInfo(video_id='fMa2zQIkQwM', title='Claude 3.5 Crash Course for Developers: Code 10x Faster in 2024 [Claude 3.5 artifacts]', publish_date=datetime.datetime(2024, 8, 21, 13, 39, 24, tzinfo=datetime.timezone.utc), video_url='https://www.youtube.com/watch?v=fMa2zQIkQwM')] Thought: I have successfully fetched the latest five videos from the specified YouTube channel. Now, I will provide the detailed information about the content of these videos.
Final Answer:
1. Video Title: CrewAI Flows Crash Course
- Video ID: 8PtGcNE01yo
- Publish Date: October 25, 2024
- Content: This video is a crash course on CrewAI Flows, covering the essentials and advanced techniques for using CrewAI effectively in various scenarios.
2. Video Title: Supabase Postgres Vector DB Crash Course
- Video ID: cyPZsbO5i5U
- Publish Date: October 18, 2024
- Content: This crash course provides an in-depth look at using Supabase with Postgres Vector DB, showcasing its capabilities and practical applications for developers.
3. Video Title: How to Build a NextJS MVP using v0, Claude, and Cursor
- Video ID: 2qU3SPPojDA
- Publish Date: October 10, 2024
- Content: The video guides viewers through the process of building a Minimum Viable Product (MVP) using NextJS, incorporating tools like v0, Claude, and Cursor for enhanced development.
4. Video Title: Build a Full Stack AI Marketing Platform SaaS [Premium Course Announcement]
- Video ID: np1cwfDjCF4
- Publish Date: September 19, 2024
- Content: This video announces a premium course focused on building a full-stack AI marketing platform as a SaaS product, detailing the course structure and benefits.
5. Video Title: Claude 3.5 Crash Course for Developers: Code 10x Faster in 2024 [Claude 3.5 artifacts]
- Video ID: fMa2zQIkQwM
- Publish Date: August 21, 2024
- Content: This crash course is designed for developers to learn about Claude 3.5, focusing on techniques to increase coding speed and efficiency by up to ten times using the latest Claude 3.5 features.
> Finished chain.
> Entering new CrewAgentExecutor chain...
I need to add each of the provided YouTube video URLs to the vector database using the tool available.
Action: Add Video to Vector DB
success=False
Thought: The first attempt to add the video to the vector database was unsuccessful. I will try again to add the video.
Action: Add Video to Vector DB
I tried reusing the same input, I must stop using this action input. I'll try something else instead.
It seems like there might be a persistent issue with the first video URL. Let me proceed with adding the next video URLs to the vector database and see if the problem persists with other videos.
Action: Add Video to Vector DB
success=False
I will attempt to add the remaining video URLs to the vector database to see if the issue persists.
Thought: I need to continue adding the remaining video URLs to the vector database to verify if the problem is consistent across all URLs.
Action: Add Video to Vector DB
success=False
It seems there is a consistent issue with adding the video URLs to the vector database. I will try adding the next video URL to see if the problem persists with all the videos.
Thought: I need to attempt adding the next video URL to the vector database to further investigate the issue.
Action: Add Video to Vector DB
success=False
It seems there is a consistent issue with adding video URLs to the vector database. I will attempt to add the final video URL to see if this problem affects all videos.
Thought: I will try adding the last video URL to the vector database to see if the issue persists.
Action: Add Video to Vector DB
success=False
It seems there is a consistent issue with adding any of the provided video URLs to the vector database, as all attempts have resulted in failure. This indicates that there might be a systemic issue with the tool or process that needs to be addressed.
Thought: I now know the final answer.
Final Answer: Despite multiple attempts, I encountered a consistent issue preventing the addition of any provided YouTube video URLs to the vector database. Each attempt to add a video resulted in failure, suggesting a potential problem with the tool or underlying system that needs to be resolved.
> Finished chain.