wal.sh Bot

Field Value
Bot Walsh-Research
Version 1.0
Contract v2026.1
Operator Jason Walsh
Contact j@wal.sh

User-Agent

Mozilla/5.0 (compatible; Walsh-Research/1.0; +https://wal.sh/bot/)

What it does

  • Fetches public data from government sources (e.g., FAA ATCSCC advisory counts) for research analysis
  • Runs infrequently (daily or less)
  • Does not follow links or crawl recursively
  • Does not download images, scripts, or stylesheets

What it does not do

  • Does not train AI models
  • Does not index content for search
  • Does not redistribute or republish fetched content
  • Does not store content beyond what is needed for analysis

Crawl behavior

  • Honors robots.txt (RFC 9309) including Crawl-delay
  • Maximum 1 request per second per domain
  • Serial requests only (no concurrent connections)
  • Honors HTTP 429 with exponential backoff
  • Respects Retry-After headers

How to opt out

Add to your robots.txt:

User-agent: Walsh-Research
Disallow: /

Or email j@wal.sh and we will add your domain to our blocklist.

More information