Is there a way to block bots that don’t respect my robots.txt file?
]
Answer this Question
You must be Logged In to post an Answer.
Not a member yet? Sign Up Now »
MENU
You must be Logged In to post an Answer.
Not a member yet? Sign Up Now »
Answer #1
There sure is! We recently published an article that may be helpful in regards to how to block disrespectful bots automatically.
For more information on how to do this, please see the following link…
http://kb.site5.com/security/how-to-bock-bots-that-dont-respect-your-robots-txt-file/
If you have any questions, please feel free to leave a comment here.
Happy Hosting!