# scraping

このトピックのトレンドリポジトリ(4件)

firecrawl/firecrawl

firecrawl/firecrawlOtherTypeScript
165.5k3回登場

The context API to search, scrape, and interact with the web at scale. 🔥

aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping

D4Vinci/Scrapling

D4Vinci/ScraplingOtherPython
96.1k11回登場

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here:https://discord.gg/EMgGbDceNQand follow here for daily tips and tricks:https://x.com/Scrapling_dev

aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath

soxoj/maigret

soxoj/maigretOtherPython
34.1k11回登場

🕵️‍♂️ Collect a dossier on a person by username from 3000+ sites

clicybersecurityidentificationinformation-gatheringinfosecinvestigationopen-sourceosintosint-frameworkosint-pythonpentestingpythonpython3reconnaissanceredteamscrapingsherlocksocial-networksocmintusername

jo-inc/camofox-browser

jo-inc/camofox-browserOtherJavaScript
10.2k2回登場

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

ai-agentanti-botantidetect-browserautomationbot-detectionbrowser-automationcloudflare-bypassheadless-browserjavascriptnodejsplaywrightpuppeteerscrapingstealth-browserweb-scraping