Search & Web

LLMs.txt Explorer

Name: LLMs.txt Explorer
Author: thedaviddias

by thedaviddias

Explore websites using llms.txt files with LLMs.txt Explorer. Fetch and parse site-specific language model instructions

Installation

Paste the snippet below into your client's config.

Installation

Quick info

Category: Search & Web
Transport: STDIO
License: NOASSERTION
GitHub stars: 74
Views: 348

Compatible with

Claude Code
Claude Desktop
codex
Cursor
gemini-cli
VS Code
Windsurf

GitHub repo

Found in: mcp.directory

Overview

Provides a bridge for exploring websites with llms.txt files, enabling fetching and parsing of website-specific language model instructions for context-aware interactions in web-based environments.

Related servers

Serper Search and Scrape

by marcopesani

Integrate Serper Search and Scrape to easily perform web searches and internet scraping for content extraction, research

152Claude CodeClaude Desktopcodex

Airbnb

by openbnb-org

Integrate with Airbnb for effortless vacation rental search and detailed property info—no API keys needed. Ideal for ren

437Claude CodeClaude Desktopcodex

Mini Search

by rebers

Mini Search offers a lightweight google web search api solution, connecting effortlessly to OpenAI or OpenRouter.ai sear

79,942Claude CodeClaude Desktopcodex

SearXNG Search

by secretiveshell

Use SearXNG metasearch engine for private web searches, a great alternative to the Duck Duck Go search engine and browse

117Claude CodeClaude Desktopcodex

Search1API

by fatwang2

Discover Search1API for web searches, news API, and newspaper API capabilities. Power content extraction and stay inform

172Claude CodeClaude Desktopcodex

Official

Exa Search

by exa

Empower AI with the Exa MCP Server—an AI research tool for real-time web search, academic data, and smarter, up-to-date

4,344Claude DesktopCursorVS Code