自适应网页抓取框架,从单次请求到全站爬取都能扛
网页抓取
网页抓取、数据提取与爬虫工具
全部场景·数据处理·按 Star 数展示前 30 个匹配项目
小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 百度贴吧评论回复爬虫 | 知乎问答文章|评论爬虫
为 Agent 与抓取而生的无头浏览器
UAParser.js - The Essential Web Development Tool for User-Agent Detection. Detect Browsers, OS, Devices, Bots, Apps, AI Crawlers, and more.
GEO 优先的 AI 搜索优化技能:可引用性评分与品牌权威分析
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Model Context Protocol Server for Mobile Automation and Scraping (iOS, Android, Emulators, Simulators and Real Devices)
收录最全、更新最快的技能Skills商店:416个精选原创技能包(涵盖文档处理、内容创作、编程开发、机器学习、自动化工作流),全部打包好可直接安装使用!同时自动抓取GitHub上万个Skills项目,按分类、更新时间、Star数量整理。
抓取 Google 地图商家数据:名称、地址、电话、评分与评论
Exa MCP for web search and web crawling!
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural lan
Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.
Get web data for AI agents and LLMs
🔥 Visual workflow builder for AI agents powered by Firecrawl - drag-and-drop web scraping pipelines with real-time execution
公众号文章全流程 AI Skill for Claude Code — 热点抓取 → 选题 → 写作 → SEO → 视觉AI → 排版 → 微信草稿箱
Production ready MCP server with real-time search, extract, map & crawl.
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants
Social media research skills for AI agents powered by ScrapeCreators
Multi-service toolkit for Tavily and Firecrawl signup automation, key validation, and isolated proxy pools.
Library of Growth & GTM skills + data APIs for Claude Code, Codex, Cursor to run ads, social, content, lead gen, seo and data scraping
AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI sc
A local Apple Documentation crawler and MCP server. Written in Swift.
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-c
cli for Discord with sqlite backend
2026 年编程导航 AI 编程实战新项目,基于 Node.js + Express + React + OpenRouter 的 AI 热点监控工具,支持多信息源聚合抓取(Twitter / Bing / HackerNews / B 站等 7+ 平台)、AI 查询扩展、AI
Open-source Claude Code skills for cold email and outbound sales. Grade campaigns, export Prospeo searches, scrape Google Maps — all from Cl
A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP A
