Comments on: Apache Web Server Over Optimization: A Cautionary Tale http://vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/ Phoenix Arizona Search Engine Optimization Sun, 28 Mar 2010 15:27:20 +0000 hourly 1 http://wordpress.org/?v=3.3.2 By: Glenn Jimerson http://vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/#comment-8 Glenn Jimerson Sun, 28 Mar 2010 15:27:20 +0000 http://www.vistawebmedia.com/?p=451#comment-8 Ouch! Banning Google bot has definitely got to hurt. I'd say your first move would be to flush your APF blocked IP's list and restart APF so you've cleaned out any blocked Google Bot Ip's. The next step would be to register your site with Google Webmaster Tools: http://www.google.com/webmasters/ . Once you get done verifying your site you can tell Google just how fast you want them to crawl your site: http://www.google.com/support/webmasters/bin/answer.py?answer=48620&hl=en. It may take a couple tweaks given how large your site it but it's a step in the right direction. Ouch! Banning Google bot has definitely got to hurt. I’d say your first move would be to flush your APF blocked IP’s list and restart APF so you’ve cleaned out any blocked Google Bot Ip’s. The next step would be to register your site with Google Webmaster Tools: http://www.google.com/webmasters/ . Once you get done verifying your site you can tell Google just how fast you want them to crawl your site: http://www.google.com/support/webmasters/bin/answer.py?answer=48620&hl=en. It may take a couple tweaks given how large your site it but it’s a step in the right direction.

]]> By: Mridul http://vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/#comment-7 Mridul Sun, 28 Mar 2010 01:41:58 +0000 http://www.vistawebmedia.com/?p=451#comment-7 I have a similar situation with DDOS. It is the google bot that is getting banned. My site has more than 50K feeds, and DDOS is now banning google bot... :-( Any idea how to solve this ? I have a similar situation with DDOS. It is the google bot that is getting banned. My site has more than 50K feeds, and DDOS is now banning google bot… :-( Any idea how to solve this ?

]]> By: Glenn Jimerson http://vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/#comment-6 Glenn Jimerson Tue, 09 Feb 2010 07:28:44 +0000 http://www.vistawebmedia.com/?p=451#comment-6 Thank you for the tip Nick! I'll definitely check it out. Thank you for the tip Nick! I’ll definitely check it out.

]]> By: Nick Hammond http://vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/#comment-5 Nick Hammond Tue, 09 Feb 2010 05:47:14 +0000 http://www.vistawebmedia.com/?p=451#comment-5 Take a look at nginx too, performs very well under high load. The server configuration is also a little cleaner too. http://nginx.org/ Take a look at nginx too, performs very well under high load. The server configuration is also a little cleaner too.

http://nginx.org/

]]> By: Glenn Jimerson http://vistawebmedia.com/apache-web-server-over-optimization-a-cautionary-tale/#comment-4 Glenn Jimerson Wed, 18 Nov 2009 21:49:15 +0000 http://www.vistawebmedia.com/?p=451#comment-4 If you want to optimize your sever the right way check out this outstanding article from Ask Apache: http://www.askapache.com/linux-unix/optimize-nice-ionice.html If you want to optimize your sever the right way check out this outstanding article from Ask Apache: http://www.askapache.com/linux-unix/optimize-nice-ionice.html

]]>