firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. ๐ฅ
Topic: web-data
177 repositories
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
spider-rs/spider
Foundational low latency web data collecting in Rust
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Florents-Tselai/WarcDB
WarcDB: Web crawl data as SQLite databases.
diffbot/diffbot-python
Python client library for Diffbot APIs
smrfeld/export-safari-reading-list
Export Safari reading list to JSON or CSV
ZenRows/cli
Zero-config CLI that gives AI agents reliable access to protected web data through Zenrows โ Fetch, Extract, Batch, and Browser Sessions, plus MCP setup and agent skills. No API key needed to start.
spidra-io/spidra-js
The official Node.js SDK for Spidra.
mkearney/wibble
Web Data Frames
ClawCap/ManoBrowser
Agent skill that gives it hands in the browser. 25+ tools to navigate, extract data, execute scripts, intercept APIs โ all in user's own Chrome with their login sessions. No passwords needed. ็ปAgentไธๅๆ๏ผๅ็จๆทไธๆ ทไฝฟ็จๆต่งๅจ๏ผ25+่ชๅจๅๅทฅๅ ท๏ผๆฐๆฎๅฎๅ จๆฌๅฐๅค็ใ
asche910/SuperSpider
็ฎไนฆ่ถ ็บง็ฌ่ซ, ๅ ๆฌๆ็ซ .็จๆทไฟกๆฏ.่ฏ่ฎบ็ญ
scavio-ai/skills
51 Agent Skills for the Scavio web data API: one umbrella skill plus one per platform for Google, Amazon, TikTok, LinkedIn, YouTube, Instagram, Reddit and 40 more, as structured JSON
danishashko/amazon-data-analysis
Amazon product data analysis with Python & Jupyter. Includes cleaning, stats, and visualizations of categories, prices, ratings, and availability.
TeneoProtocolAI/teneo-beacon-cli
Headless Teneo Beacon for Raspberry Pi, Linux servers, NAS and macOS. One-line install, QR pairing, runs 24/7 as a service and earns Fragments.
GoAnyAPI/goanyapi-mcp
Official GoAnyAPI MCP server โ connect AI agents to web data, Google Search, SEO, backlinks, Google Ads Transparency, traffic, domain intelligence, and more APIs.
Develop-Packt/Web-Scraping-with-Jupyter-Notebooks
Analyze and parse HTML responses, programmatically scrape web data, and utilize Pandas DataFrames to store, transform, and merge tables.
Scrape-Technology/MarkUDown-Engine
High-performance web scraping engine that converts any web page into clean markdown --- with 3-layer fallback (Cheerio --> Playwright --> Abrasio) and AI-powered structured extraction
data-scrape/web-scraper
Web Scraper - Turn public web pages into structured, source-aware records for research workflows
api-evangelist/bright-data
Bright Data โ independent third-party profile of a public API surface, by API Evangelist. Bright Data is an Israeli web data platform and operator of the world's largest legitimate residential proxy network (400M+ IPs across 195 countries). The platform combines proxy infrastructure (residential, ISP, datacenter, mobile) with higher-level web-acces
Coresignal-com/coresignal-mcp
Coresignal MCP - fresh company, employee, and jobs records in real time
Talordata/talordata-mcp
MCP server that connects AI agents to the Talordata SERP API for real-time structured search data.
Talordata/talordata
Reliable web data infrastructure for AI agents, SERP monitoring, and global data collection.
Synoppy/synoppy-mcp
Synoppy MCP server โ give your AI agent the whole web. Read, crawl, map, extract, classify & enrich live pages from Claude, Cursor, or any MCP client.
Talordata/talordata-serp-golang
Go SDK for retrieving structured search-result data with the Talordata SERP API.
social-freak-ltd/socialfetch-mcp
Let AI agents fetch live social media and web data with the official Social Fetch MCP server.
Talordata/talordata-serp-javascript
JavaScript and Node.js SDK for retrieving structured search-result data with the Talordata SERP API.
Synoppy/synoppy-go
Official Go SDK for Synoppy โ the web-data layer for AI agents. Read, crawl, map, extract, classify & enrich any website on one key. Standard library only.
Synoppy/synoppy-ruby
Official Ruby SDK for Synoppy โ the web-data layer for AI agents. Read, crawl, map, extract, classify & enrich any site on one key. Pure net/http, zero deps.
Synoppy/synoppy-python
Official Python SDK for Synoppy โ the web-data layer for AI agents. Read, crawl, map, extract, classify & enrich any website on a single API key.