## robots.txt for http://www.amazement.com.au/## Please note: There are a lot of pages on this site, and there are# some misbehaved spiders out there that go _way_ too fast. If you're# irresponsible, your access to the site may be blocked.#User-agent: *Disallow: /BootstrapDisallow: /wp-login.phpDisallow: /wp-adminDisallow: /wp-includesDisallow: /wp-content/Disallow: /wp-content/themesDisallow: /wp-mail.phpDisallow: /tmp/Disallow: /xmlrpc/Disallow: /plugins/Disallow: /default.phpDisallow: /wp-activate.phpDisallow: /wp-app.phpDisallow: /wp-blog-header.phpDisallow: /wp-comments-post.phpDisallow: /wp-config.phpDisallow: /wp-cron.phpDisallow: /wp-links-opml.phpDisallow: /wp-load.phpDisallow: /wp-mail.phpDisallow: /wp-pass.phpDisallow: /wp-register.phpDisallow: /wp-settings.phpDisallow: /wp-signup.phpDisallow: /wp-trackback.phpDisallow: /wp-trackback.php# advertising-related bots:User-agent: Mediapartners-Google*Disallow: /# Wikipedia work bots:User-agent: IsraBotDisallow:User-agent: OrthogaffeDisallow:# Crawlers that are kind enough to obey, but which we'd rather not have# unless they're feeding search engines.User-agent: UbiCrawlerDisallow: /User-agent: DOCDisallow: /User-agent: ZaoDisallow: /# Some bots are known to be trouble, particularly those designed to copy# entire sites. Please obey robots.txt.User-agent: sitecheck.internetseer.comDisallow: /User-agent: ZealbotDisallow: /User-agent: MSIECrawlerDisallow: /User-agent: SiteSnaggerDisallow: /User-agent: WebStripperDisallow: /User-agent: WebCopierDisallow: /User-agent: FetchDisallow: /User-agent: Offline ExplorerDisallow: /User-agent: TeleportDisallow: /User-agent: TeleportProDisallow: /User-agent: WebZIPDisallow: /User-agent: linkoDisallow: /User-agent: HTTrackDisallow: /User-agent: Microsoft.URL.ControlDisallow: /User-agent: XenuDisallow: /User-agent: larbinDisallow: /User-agent: libwwwDisallow: /User-agent: ZyBORGDisallow: /User-agent: Download NinjaDisallow: /User-agent: wgetDisallow: /User-agent: grub-clientDisallow: /## Doesn't follow robots.txt anyway, but...#User-agent: k2spiderDisallow: /## Hits many times per second, not acceptable# http://www.nameprotect.com/botinfo.htmlUser-agent: NPBotDisallow: /# A capture bot, downloads gazillions of pages with no public benefit# http://www.webreaper.net/User-agent: WebReaperDisallow: /
Sitemap: http://amazement.com.au/sitemap.xml