Web Scout is a web search and content extraction tool that enables AI assistants to search the internet via DuckDuckGo and retrieve clean, readable text from webpages. It handles multiple URLs simultaneously with built-in throttling and memory management for reliable research workflows. Key features of Web Scout: - DuckDuckGo-powered web search for privacy-focused results - Clean text extraction from webpages with readable formatting - Parallel processing of multiple URLs for faster data collection - Intelligent rate limiting to prevent API blocks and ensure reliability - Memory optimization to handle large-scale scraping without crashes - Robust error handling for uninterrupted research sessions

[](https://mseep.ai/app/pinkpixel-dev-web-scout-mcp)

Web Scout MCP Server

An MCP server for web search using DuckDuckGo and content extraction, with support for multiple URLs and memory optimizations.

✨ Features

📦 Installation

Installing via Smithery

To install Web Scout for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @pinkpixel-dev/web-scout-mcp --client claude

Global Installation

npm install -g @pinkpixel/web-scout-mcp

Local Installation

npm install @pinkpixel/web-scout-mcp

🚀 Usage

Command Line

After installing globally, run:

web-scout-mcp

With MCP Clients

Add this to your MCP client's config.json (Claude Desktop, Cursor, etc.):

{
  "mcpServers": {
    "web-scout": {
      "command": "npx",
      "args": [
        "-y",
        "@pinkpixel/web-scout-mcp@latest"
      ]
    }
  }
}

Environment Variables

Set the WEB_SCOUT_DISABLE_AUTOSTART=1 environment variable when embedding the package and calling createServer() yourself. By default running the published entrypoint (for example node dist/index.js or npx @pinkpixel/web-scout-mcp) automatically bootstraps the stdio transport.

🧰 Tools

The server provides the following MCP tools:

🔍 DuckDuckGoWebSearch

Initiates a web search query using the DuckDuckGo search engine and returns a well-structured list of findings.

Input:

Example:

{
  "query": "latest advancements in AI",
  "maxResults": 5
}

Output: A formatted list of search results with titles, URLs, and snippets.

📄 UrlContentExtractor

Fetches and extracts clean, readable content from web pages by removing unnecessary elements like scripts, styles, and navigation.

Input:

Example (single URL):

{
  "url": "https://example.com/article"
}

Example (multiple URLs):

{
  "url": [
    "https://example.com/article1",
    "https://example.com/article2"
  ]
}

Output: Extracted text content from the specified URL(s).

🛠️ Development

# Clone the repository
git clone https://github.com/pinkpixel-dev/web-scout-mcp.git
cd web-scout-mcp
Install dependencies
npm install
Build
npm run build
Run
npm start

📚 Documentation

For more detailed information about the project, check out these resources:

📋 Requirements

📄 License

This project is licensed under the Apache 2.0 License.

Made with ❤️ by Pink Pixel ✨ Dream it, Pixel it ✨