web-data

The context API to search, scrape, and interact with the web at scale. 🔥

Python scraper based on AI

Get web data for AI agents and LLMs

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

WarcDB: Web crawl data as SQLite databases.

Python client library for Diffbot APIs

Export Safari reading list to JSON or CSV

Zero-config CLI that gives AI agents reliable access to protected web data through Zenrows — Fetch, Extract, Batch, and Browser Sessions, plus MCP setup and agent skills. No API key needed to start.

The official Node.js SDK for Spidra.

Web Data Frames

Agent skill that gives it hands in the browser. 25+ tools to navigate, extract data, execute scripts, intercept APIs — all in user's own Chrome with their login sessions. No passwords needed. 给Agent一双手，像用户一样使用浏览器，25+自动化工具，数据完全本地处理。

简书超级爬虫, 包括文章.用户信息.评论等

Amazon product data analysis with Python & Jupyter. Includes cleaning, stats, and visualizations of categories, prices, ratings, and availability.

Analyze and parse HTML responses, programmatically scrape web data, and utilize Pandas DataFrames to store, transform, and merge tables.

High-performance web scraping engine that converts any web page into clean markdown --- with 3-layer fallback (Cheerio --> Playwright --> Abrasio) and AI-powered structured extraction

Coresignal MCP - fresh company, employee, and jobs records in real time

Bright Data is an Israeli web data platform and operator of the world's largest legitimate residential proxy network (400M+ IPs across 195 countries). The platform combines proxy infrastructure (residential, ISP, datacenter, mobile) with higher-level web-access APIs — Web Unlocker, SERP API, Web Scraper API, Scraping Browser, Deep Lookup, and Web…

Web Scraper - Turn public web pages into structured, source-aware records for research workflows

MCP server that connects AI agents to the Talordata SERP API for real-time structured search data.

Benchmark comparing Zenrows and Firecrawl's /scrape endpoint across 7 target URLs