Community Q&A:
Crawl Delay
I'm trying to add Crawl Delay which was recommended by you but when I add it I get a 500 error
User-agent: *
Crawl-delay: 30
Never Mind. I put it in the .htacces file instead of the robots.txt file..
User-agent: *
Crawl-delay: 30
Never Mind. I put it in the .htacces file instead of the robots.txt file..
Best answer chosen by Web Hosting Hub staff
|
0
|
Hi MacBros, I recommend our article on troubleshooting 500 internal server errors. It covers issues in the .htaccess. It sounds like you got this one sorted out on your own, and updated your question? We're here if you need any further support, simply ask! Thanks, - Brad |
Want to share this Question?
Tweet
Help Center Login
Related Articles
It looks like there are no related articles.
Would you like to ask a question about this page? If so, click the button below!
