Tools tagged with "Web Scraping"

Firecrawl is a web data API for searching, scraping, and interacting with the web at scale. It extracts content as clean Markdown or structured data for AI agents and apps, and is open source with a hosted service.

Crawl4AI is an open-source web crawler and scraper for LLMs and AI agents. It turns any website into clean, LLM-ready Markdown for RAG, agents, and data pipelines, and can also be used hosted with one key.

Lightpanda is a headless browser engine written in Zig, built from scratch for AI agents and automation. It executes JavaScript without graphical rendering, offering fast, scalable web automation with a minimal memory footprint—9x faster