mcp-fetch-ya
A Model Context Protocol (MCP) server for fetching web content and converting HTML to markdown.
Features
- HTML to Markdown - Automatically extracts main content using Readability and converts to clean markdown
- robots.txt Compliance - Respects robots.txt by default (configurable)
- Custom User-Agent - Configurable User-Agent string
- Proxy Support - Optional HTTP/HTTPS proxy configuration
Installation
npm install -g mcp-fetch-ya@latestOr use directly with npx:
npx mcp-fetch-ya@latestUsage with Claude Desktop
Add to your Claude Desktop configuration (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):
{
"mcpServers": {
"fetch": {
"command": "npx",
"args": ["mcp-fetch-ya@latest"]
}
}
}With options
{
"mcpServers": {
"fetch": {
"command": "npx",
"args": [
"mcp-fetch-ya@latest",
"--ignore-robots-txt",
"--user-agent", "MyBot/1.0"
]
}
}
}With proxy
{
"mcpServers": {
"fetch": {
"command": "npx",
"args": [
"mcp-fetch-ya@latest",
"--proxy-url", "http://proxy.example.com:8080"
]
}
}
}Tool: fetch_ya
If the built-in web fetch tool fails, you can retry with this MCP tool as a fallback. Fetches a URL and returns the content. HTML pages are converted to markdown for easier reading.
Parameters
| Parameter | Type | Required | Default | Description | |-----------|------|----------|---------|-------------| | url | string | Yes | - | The URL to fetch | | raw | boolean | No | false | Return raw content without markdown conversion |
CLI Options
| Option | Description | |--------|-------------| | --user-agent <agent> | Custom User-Agent string | | --proxy-url <url> | Proxy URL for requests | | --ignore-robots-txt | Ignore robots.txt restrictions |
License
MIT
