User-agent: * Disallow: User-agent : 50.nu/bot.html Disallow : / User-agent :80legs.com/spider Disallow : / User-agent :(bot; http://) Disallow : / User-agent :ac-baidubot Disallow : / User-agent :acontbot Disallow : / User-agent :aihitbot-ds Disallow : / User-agent :aihitbot Disallow : / User-agent :aisearchbot Disallow : / User-agent :arste.info_bot Disallow : / User-agent :askpeter_jeanie_2009_bot Disallow : / User-agent :atraxbot Disallow : / User-agent :bitlybot Disallow : / User-agent :bmdspider Disallow : / User-agent :bot(www.cuwhois.com) Disallow : / User-agent :bottracer Disallow : / User-agent :cazoodlebot Disallow : / User-agent :clush-thumbnail-bot Disallow : / User-agent :comtorbot Disallow : / User-agent :ddetailsbot Disallow : / User-agent :diffbot Disallow : / User-agent :feedtrace-bot Disallow : / User-agent :flatlandbot Disallow : / User-agent :followsite bot Disallow : / User-agent :forumseek.net/ bot_2.1; Disallow : / User-agent :fspbot Disallow : / User-agent :google.com/bot.html Disallow : / User-agent :imrd-shotbot Disallow : / User-agent :internetbot Disallow : / User-agent :keyword density analyzer Disallow : / User-agent :kmok-bot Disallow : / User-agent :knipbot Disallow : / User-agent :linguee bot Disallow : / User-agent :localbot/1.1 Disallow : / User-agent :marketdefenderbot Disallow : / User-agent :memigo spider Disallow : / User-agent :miggibot Disallow : / User-agent :nb-bot Disallow : / User-agent :nmg spider Disallow : / User-agent :orangebot-mobile Disallow : / User-agent :ovalebot3 Disallow : / User-agent :pingdom.com_bot Disallow : / User-agent :plukkie Disallow : / User-agent :rootlinkbot Disallow : / User-agent :seexie.com_bot Disallow : / User-agent :semager-bots Disallow : / User-agent :seochat::bot Disallow : / User-agent :sitequality bot Disallow : / User-agent :smarte bot Disallow : / User-agent :socialspider-finder Disallow : / User-agent :spider Disallow : / User-agent :spiderpig Disallow : / User-agent :sqwidgebot Disallow : / User-agent :ss spider Disallow : / User-agent :taptubot Disallow : / User-agent :tasapspider Disallow : / User-agent :tweetmemebot Disallow : / User-agent :web.nl_bot Disallow : / User-agent :webot Disallow : / User-agent :websitedbspider Disallow : / User-agent :wepbot Disallow : / User-agent :who.is bot Disallow : / User-agent :yanga worldsearch bot Disallow : / User-agent :zenbot Disallow : / User-agent :MOS_Benchmark Disallow : / User-agent :ipMonitor Disallow : /