Anyone know why Firecrawl isn't pulling back two different pages?

and

Im looking at you tow, or any others that are familiar with FireCrawl

I have this simple Python script that uses the FireCrawl API to pull back 2 pages from https://books.toscrape.com, but when I execute the script, it pulls back the front page twice.

I run this locally on my PC, not the firecrawl cloud.

I have added the script and the output below.

Scrape.txt is the result of the scrape the script performs.

Line 5 and 445 show that it is Page 1

Lines 453 & 436, and lines 875 & 876 show the results are page 1 of a possible 50 pages, and that the next page should be catalouge/page-2.html

I was expecting the script to bring pages 1 and 2 to me.

6 comments

AI Developer Accelerator

skool.com/ai-developer-accelerator

Master AI & software development to build apps and unlock new income streams. Transform ideas into profits. 💡➕🤖➕👨‍💻🟰💰

Leaderboard (30-day)

+10

+10