# CRELoaded Generated Robots.txt# Robot Exclusion File -- robots.txt# Author:  CRELoaded Team # Last Updated : September 11th, 2007User-Agent: *Disallow: /admin/Disallow: /cache/Disallow: /cert/Disallow: /debug/Disallow: /download/Disallow: /ext/Disallow: /includes/Disallow: /pear/Disallow: /pub/Disallow: /temp/Disallow: /templates/Disallow: /tmp/
Disallow: /personal/#To prevent only a select bots from any scans#User-agent: crawlers.looksmart.com#Disallow: /#To prenet any images from being scanned#Disallow: *.gif#Disallow: *.jpg#Disallow: *.png#To block main page due to size from bots#Disallow: /index.php#To shut down site completely from bots use# Disallow: /#Block out things that are secure or login oriented#These are based on not using any rewrite rulesDisallow: /account.phpDisallow: /account_edit.phpDisallow: /account_history.phpDisallow: /account_history_info.phpDisallow: /account_password.phpDisallow: /address_book.phpDisallow: /address_book_process.phpDisallow: /checkout_confirmation.phpDisallow: /checkout_payment.phpDisallow: /checkout_payment_address.phpDisallow: /checkout_process.phpDisallow: /checkout_shipping.phpDisallow: /checkout_shipping_address.phpDisallow: /checkout_success.phpDisallow: /cookie_usage.phpDisallow: /create_account.phpDisallow: /create_account_success.phpDisallow: /ipn.phpDisallow: /login.phpDisallow: /logoff.phpDisallow: /password_forgotten.phpDisallow: /paypal_notify.phpDisallow: /redirect.phpDisallow: /shipping_estimator_popup.phpDisallow: /ssl_check.phpDisallow: /vvc_display.phpDisallow: /wpcallback.php# IF YOU DO NOT WISH TO HAVE THE GOOGLE IMAGE BOT SCAN YOUR DOMAIN FOR IMAGES# THEN YOU CAN INCLUDE THE FOLLOWING IN YOUR ROBOTS FILE.# I FOUND THAT MY BANDWIDTH USAGE DROPPED BY A MASSIVE AMOUNT AFTER I GOT RID# OF THE GOOGLE IMAGE BOT. ALL I HAD WAS IMAGE HUNTERS STEALING PRODUCT SHOTS# AND NOT EVEN BROWSING THE SITE.#User-agent: Googlebot-Image#Disallow: /
Sitemap: http://www.ijam.com.au/sitemaps.xml