# /robots.txt file for http://www.webbender.net/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /genealogy Disallow: /bender Disallow: /news Disallow: /newsdesk Disallow: /Steph Disallow: /files Disallow: /admin Disallow: /start Disallow: /ndiyp Disallow: /banners Disallow: /advert_data