Searxng Crawl4ai Mcp
Self-hosted MCP server with SearXNG + Crawl4AI for fast search and reliable web scraping in Claude C
Rating
Votes
0
score
Downloads
0
total
Price
Free
Access token required
Works With
About
SearXNG + Crawl4AI MCP Server
A self-hosted MCP (Model Context Protocol) server providing fast search and reliable web scraping using SearXNG + Crawl4AI stack.
🚀 Why This Solution?
This project evolved from limitations found in self-hosted Firecrawl:
- ❌ Firecrawl's search API doesn't work in self-hosted mode
- ❌ Missing Fire-engine features in self-hosted version
- ❌ Authentication issues and poor documentation
Our solution provides:
- ✅ Truly self-hosted search via SearXNG (aggregates 70+ search engines)
- ✅ Superior scraping via Crawl4AI (50k+ GitHub stars)
- ✅ 3x faster than Claude Code native search tools
- ✅ 100% reliable vs failing native WebFetch
- ✅ Complete privacy - no external API dependencies
🏗️ Architecture
┌─────────────┐ ┌──────────────┐ ┌─────────────┐
│ │ │ │ │ │
│ SearXNG │ │ Crawl4AI │ │ Redis │
│ (Search) │ │ (Scraping) │ │ (Cache) │
│ │ │ │ │ │
│ Port 8081 │ │ Port 8001 │ │ Port 6380 │
└─────────────┘ └──────────────┘ └─────────────┘
│ │ │
└───────────────────┼───────────────────┘
│
┌──────────────┐
│ │
│ MCP Server │
│ (TypeScript) │
│ │
└──────────────┘
│
┌─────────────┐
│ │
│ Claude Code │
│ │
└─────────────┘📦 Features
- 🔍 Fast Search: SearXNG aggregates 70+ search engines (Google, Bing, DuckDuckGo, etc.)
- 🕷️ Advanced Scraping: Crawl4AI with Playwright for JavaScript-heavy sites
- ⚡ High Performance: Sub-second search, reliable scraping
- 🐳 Docker Ready: Complete Docker Compose orchestration
- 🔄 Proxy Support: Built-in rotating IP proxy integration
- 📊 MCP Integration: 3 powerful tools for Claude Code
- 🛡️ Privacy First: All processing happens locally
🚀 Quick Start
1. Clone and Setup
git clone https://github.com/yourusername/searxng-crawl4ai-mcp
cd searxng-crawl4ai-mcp
npm install
npm run build2. Start Docker Services
# Start all services (SearXNG, Crawl4AI, Redis)
docker compose up -d
# Verify services are running
curl http://localhost:8081/search?q=test&format=json # SearXNG
curl http://localhost:8001/health # Crawl4AI3. Configure Claude Code MCP
Simple Configuration (No Proxy):
{
"mcpServers": {
"searxng-crawl4ai": {
"command": "node",
"args": ["fixed-mcp-server.js"],
"cwd": "/absolute/path/to/your/project"
}
}
}Don't lose this
Three weeks from now, you'll want Searxng Crawl4ai Mcp again. Will you remember where to find it?
Save it to your library and the next time you need Searxng Crawl4ai Mcp, it’s one tap away — from any AI app you use. Group it into a bench with the rest of the team for that kind of task and you can pull the whole stack at once.
⚡ Pro tip for geeks: add a-gnt 🤵🏻♂️ as a custom connector in Claude or a custom GPT in ChatGPT — one click and your library is right there in the chat. Or, if you’re in an editor, install the a-gnt MCP server and say “use my [bench name]” in Claude Code, Cursor, VS Code, or Windsurf.
a-gnt's Take
Our honest review
This plugs directly into your AI and gives it new abilities it didn't have before. Self-hosted MCP server with SearXNG + Crawl4AI for fast search and reliable web scraping in Claude C. Once connected, just ask your AI to use it. It's completely free and works across most major AI apps. This one just landed in the catalog — worth trying while it's fresh.
Tips for getting started
Tap "Get" above, pick your AI app, and follow the steps. Most installs take under 30 seconds.
What's New
Imported from GitHub
Ratings & Reviews
0.0
out of 5
0 ratings
No reviews yet. Be the first to share your experience.