Search & Data ExtractionPython

pragmar/mcp-server-webcrawl

Advanced search and retrieval for web crawler data. Supports WARC, wget, Katana, SiteOne, and InterroBot crawlers.

pragmar View Repository

search-data-extractionlocal-service

Quick Start

Clone the repository:

git clone https://github.com/pragmar/mcp-server-webcrawl

Claude Desktop configuration example:

{
  "mcpServers": {
    "mcp-server-webcrawl": {
      "command": "npx",
      "args": [
        "-y",
        "pragmar/mcp-server-webcrawl"
      ]
    }
  }
}

Check the repository README for specific installation and configuration instructions.

Details

More Search & Data Extraction Servers

0xdaef0f/job-searchoor

An MCP server for searching job listings with filters for date, keywords, remote work options, and more.

TypeScript

hanselhansel/aeo-cli

Audit URLs for AI crawler readiness — checks robots.txt, llms.txt, JSON-LD schema, and content density with 0-100 AEO scoring.

Python

Aas-ee/open-webSearch

Web search using free multi-engine search (NO API KEYS REQUIRED) — Supports Bing, Baidu, DuckDuckGo, Brave, Exa, and CSDN.

Python/TypeScript

ac3xx/mcp-servers-kagi

Kagi search API integration

TypeScript

adawalli/nexus

AI-powered web search server using Perplexity Sonar models with source citations. Zero-install setup via NPX.

TypeScript

ananddtyagi/webpage-screenshot-mcp

A MCP server for taking screenshots of webpages to use as feedback during UI developement.

TypeScript