Sep '24 • Code Bugs & Project Issues
PDF search tool embedder for groq llama3
Hi all, great to be here. I am working on basic RAG with llama 3 on groq.
I am stuck at PDFSearchTool, it is looking for "api_key = self.config.api_key or os.environ["OPENAI_API_KEY"]" when i run the script.
here is my code.
pdf_search_tool = PDFSearchTool(
pdf="./lmnd-2023-annual-report.pdf",
config=dict(
llm=dict(provider="groq", config=dict(model="llama3-70b-8192",api_key=os.getenv("GROQ_API_KEY"),stream=True)),
embedder=dict(provider="ollama", config=dict(model="all-minilm:latest")),
),
)
how can i update the embedder line correctly?
i am not able to locate the solution here. https://docs.embedchain.ai/components/embedding-models#ollama
1
2 comments
PDF search tool embedder for groq llama3
skool.com/ai-developer-accelerator
Master AI & software development to build apps and unlock new income streams. Transform ideas into profits. 💡➕🤖➕👨💻🟰💰
Leaderboard (30-day)
1
+53
2
+30
3
+20
4
+14
5
+12
Powered by