Marketplaces and travel
Airbnb agent readiness report
airbnb.com · re-scanned every Monday
This site is essentially invisible to AI agents.
#11 of 15 in the benchmark
Scanned 2026-07-08
Score history
Airbnb is the dominant marketplace for short-term rentals, and trip planning is one of the categories AI assistants are already being asked to help with directly: find a place, check availability, compare prices. Whether an agent can actually reach Airbnb's own listings, rather than working from stale third-party data, matters to how those requests get answered.
This is a partial report: the scanner was blocked by bot protection before several checks could run. What stands out is the deliberateness of what did pass: robots.txt does not just avoid blocking crawlers by default, it explicitly names GPTBot, ClaudeBot, and PerplexityBot as allowed, a more intentional signal than most sites in this scan. A sitemap is reachable through robots.txt, and HTTPS redirects cleanly. But the homepage itself returned a 200 with a body that reads as a bot-challenge page to the scanner, so the explicit permissions in robots.txt do not translate into the site actually letting agents through. Four more checks, structured data, meta tags, content negotiation, and readability, could not be evaluated because of that block.
Naming AI crawlers in robots.txt is a real, deliberate step most sites in this scan haven't taken. A bot-challenge page one layer downstream undoes it in practice: the stated welcome and the actual response do not match.
What Airbnb gets right
- robots.txt explicitly names GPTBot, ClaudeBot, and PerplexityBot as allowed, not just a default non-block.
- A sitemap is referenced from robots.txt and reachable.
- HTTPS is reachable and HTTP redirects to it cleanly.
What is missing
- The homepage returns a bot-challenge page to the scanner even though robots.txt explicitly names GPTBot, ClaudeBot, and PerplexityBot as allowed, so the stated intent and the actual response do not match.
- No agents.md, llms.txt, or llms-full.txt, so an agent that gets past the challenge still has no plain-language guide to Airbnb.
- No MCP server card and no .well-known/verified.md, so nothing verifies Airbnb's identity to an agent or lets it interact with the site as a service.
- Structured data, meta tags, content negotiation, and readability could not be evaluated at all, because the bot challenge blocked the scanner before it reached the page.
3 of 10 checks passing
Partial scan: this site's bot protection blocked some checks. The real score may be higher.
Same category
Market context
Gartner predicted in February 2024 that traditional search volume would fall 25% by 2026 as AI chatbots and virtual agents substitute for search. Source: Gartner, Feb 2024.
Your site can outscore Airbnb in 5 days.
95 or higher, guaranteed, or your money back.