AI Atlasby Verbito
Explore › Work smarter

Collect web data

Collect and clean data from websites automatically. Every tool here is free and open source.

Free alternative to Apify, Bright Data, Octoparse, Browse AI

35 tools

  1. Turn any website into clean text for AI
    ★ 198kstars
    firecrawl by firecrawl · Free alternative to Apify, Bright Data
    Some setupSelf-hosted appHealthy
  2. Collect data from websites, even ones that block bots
    ★ 95.1kstars
    Scrapling by D4Vinci
    For developersCode libraryHealthy
  3. Turn websites into clean text for AI tools
    ★ 86.9kstars
    crawl4ai by unclecode · Free alternative to Apify
    For developersCode libraryHealthy
  4. Collect data from websites at scale with Python
    ★ 65.2kstars
    scrapy by scrapy · Free alternative to Octoparse
    For developersCode libraryHealthy
  5. Scrape websites by describing what you want
    ★ 32.5kstars
    Scrapegraph-ai by ScrapeGraphAI · Free alternative to Browse AI
    For developersCode libraryHealthy
  6. Build reliable web scrapers in JavaScript
    ★ 26.3kstars
    crawlee by apify · Free alternative to Apify
    For developersCode libraryHealthy
  7. Turn a website into a knowledge file for your own GPT
    ★ 22.4kstars
    gpt-crawler by BuilderIO
    Some setupCommand-line toolFair
  8. Download TikTok, Douyin and Bilibili videos without watermarks
    ★ 21.1kstars
    Douyin_TikTok_Download_API by Evil0ctal
    Some setupSelf-hosted appHealthy
  9. Turn any website into a structured data feed
    ★ 18.1kstars
    maxun by getmaxun · Free alternative to Browse AI, Octoparse
    Some setupSelf-hosted appHealthy
  10. Monitor Xianyu listings and get AI-filtered alerts (Chinese)
    ★ 16.7kstars
    ai-goofish-monitor by Usagi-org
    Some setupSelf-hosted appHealthy
  11. Let AI agents collect data from social media, maps and shops
    ★ 14.6kstars
    apify-mcp-server by apify
    Some setupSelf-hosted appHealthy
  12. Automate and test browsers in Python
    ★ 13.2kstars
    SeleniumBase by seleniumbase
    For developersCode libraryHealthy
  13. Download posts from Xiaohongshu (RED)
    ★ 13.2kstars
    XHS-Downloader by JoeanAmier
    Some setupSelf-hosted appHealthy
  14. Turn any web page into clean text for AI by adding one prefix
    ★ 12.2kstars
    reader by jina-ai · Free alternative to Firecrawl Cloud
    No codingWebsite▶ Try onlineHealthy
  15. Build reliable web scrapers in Python
    ★ 9.6kstars
    crawlee-python by apify
    For developersCode libraryHealthy
  16. Mine the web and analyze text in Python
    ★ 8.9kstars
    pattern by clips
    For developersCode libraryUse with careArchived
  17. Scrape a website by showing an example of what you want
    ★ 8.1kstars
    autoscraper by alirezamika
    For developersCode libraryFair
  18. Let AI assistants search and scrape the web
    ★ 7.8kstars
    firecrawl-mcp-server by firecrawl
    Some setupSelf-hosted appHealthy
  19. Collect business listings from Google Maps
    ★ 7.3kstars
    google-maps-scraper by gosom
    Some setupCommand-line toolHealthy
  20. Extract clean text from web pages
    ★ 7.1kstars
    trafilatura by adbar
    Some setupCommand-line toolHealthy
  21. Turn any web page into structured data with AI
    ★ 7kstars
    llm-scraper by mishushakov
    For developersCode libraryHealthy
  22. Collect job listings from LinkedIn, Indeed and more
    ★ 4.6kstars
    JobSpy by speedyapply
    For developersCode libraryHealthy
  23. Block AI crawlers from your website
    ★ 4.2kstars
    ai.robots.txt by ai-robots-txt
    No codingGuide or readingHealthy
  24. Turn websites into clean Markdown or JSON
    ★ 3.9kstars
    anakin by Anakin-Inc
    Some setupSelf-hosted appFair
  25. Turn websites into AI-ready data
    ★ 3.5kstars
    AnyCrawl by any4ai
    Some setupSelf-hosted appHealthy
  26. Collect ChatGPT answers at scale
    ★ 3.4kstars
    chatgpt-scraper by oxylabs
    For developersCode libraryFair
  27. Scrape websites with AI
    ★ 3.3kstars
    CyberScraper-2077 by itsOwen
    Some setupSelf-hosted appHealthy
  28. Give AI agents access to the public web
    ★ 2.7kstars
    brightdata-mcp by brightdata
    Some setupSelf-hosted appHealthy
  29. Give agents Apify scraping skills
    ★ 2.5kstars
    agent-skills by apify
    Some setupAdd-onFair
  30. Extract web content for AI, fast and locally
    ★ 2.4kstars
    webclaw by 0xMassi
    Some setupCommand-line toolFair
  31. Scrape web pages to build large text datasets
    ★ 2.3kstars
    lazynlp by chiphuyen
    For developersCode libraryUse with care
  32. Turn web content into AI-ready data
    ★ 2.2kstars
    WaterCrawl by watercrawl
    Some setupSelf-hosted appFair
  33. Collect business leads from Google Maps
    ★ 2.2kstars
    google-maps-scraper-kit by Mahanaicoach
    Some setupCommand-line toolFair
  34. Read TikTok LIVE comments and gifts in your code
    ★ 1.6kstars
    TikTokLive by isaackogan
    For developersCode libraryHealthy
  35. Run your own search API for AI agents
    ★ 1.6kstars
    openserp by karust
    Some setupSelf-hosted appHealthy