wal.sh
home > bot · May 24, 2026

wal.sh Bot

Field Value
Bot Walsh-Research
Version 1.2
Operator Jason Walsh
Contact j@wal.sh

User-Agent

Mozilla/5.0 (compatible; Walsh-Research/1.2; +https://wal.sh/bot/)

What it does

  • Fetches public RSS feeds and government data for research
  • Runs infrequently (daily or less)
  • Does not follow links or crawl recursively

What it does not do

  • Does not train AI models
  • Does not index content for search
  • Does not redistribute fetched content

Crawl behavior

  • Honors robots.txt (RFC 9309) including Crawl-delay
  • Maximum 1 request per second per domain
  • Respects Retry-After headers
  • Serial requests only

How to opt out

Add to your robots.txt: 

User-agent: Walsh-Research
Disallow: /

Or email j@wal.sh to be added to our blocklist.

More