Skip to content
jevcrawl

jevcrawlMCP Server

Released
v0.2.0
Apache-2.0

Summary

Goal-directed web crawler MCP server that returns only the passages answering your agent's question, verbatim and with sources.

Features

  • crawl, scrape and map tools
  • Verbatim passages with URL, heading path and offsets
  • Page text is scored, never followed
  • Cost and page budgets per crawl
  • Optional JavaScript rendering via Chromium

Installation

Set up this MCP server in your favorite AI agent — copy a ready-made configuration below.

Any MCP-compatible agent

Most agents (Claude, Cursor, Windsurf, VS Code, and more) read a standard mcpServers configuration.

  1. Open your agent's MCP configuration file.
  2. Merge the snippet below into it, filling in the environment variables with your own values.
  3. Restart the agent — the "jevcrawl" tools will be available.
{
  "mcpServers": {
    "jevcrawl": {
      "command": "uvx",
      "args": [
        "jevcrawl"
      ],
      "env": {
        "TYPESAFE_API_KEY": "<your key>"
      }
    }
  }
}

Description

jevcrawl is a Python MCP server and CLI that crawls a website on behalf of an AI agent and returns only what answers the question. A small decision model scores every link and passage, so your agent's own LLM reads a few thousand relevant tokens instead of tens of thousands of raw pages. Passages are copied verbatim with their URL, heading path and character offsets, and page text is only ever scored, never followed, which keeps it resistant to prompt injection.

Tools
  • crawl follows links from a start URL toward a goal within page, time and cost budgets.
  • scrape reads one known page, optionally filtered to a goal.
  • map returns ranked URLs so the agent can decide what to scrape.

The README reports 40% correct answers on 50 WebWalkerQA tasks at about $0.025 per task, against 30% and $0.194 when Claude picks every link; these are the author's own benchmarks. It needs a Jev API key and uv; JavaScript-rendered pages are optional through the js extra with Chromium. Apache-2.0 licensed.

Related MCP Servers

MCP: Firecrawl

by Firecrawl

Search, scrape, crawl, and extract structured data from the web — with JS rendering, batch scraping, and LLM-powered extraction.

New

Official SerpApi MCP server: real-time Google, Bing, YouTube and other search results as structured JSON or token-saving markdown.

MCP: Crawlbase MCP

by Crawlbase

Official Crawlbase MCP server giving agents live web access — fetch any URL as raw HTML, clean Markdown or a screenshot, with JS rendering and proxy rotation handled for you.

MCP: wigolo

by KnockOutEZ

Local-first web MCP server for AI agents — search, fetch, crawl, extract and deep research with no API keys, no cloud round-trip and no per-query bill.

Browse all MCP servers →