|
USCITY.NET Shuts the Door on AlltheWeb.com Crawler USCITY.NET has blocked questionable activity by Overture's AlltheWeb.com crawlers for not playing by the rules. (PRWEB) May 8, 2004 -- USCITY.NET has blocked questionable activity by Overture's AlltheWeb.com crawlers for not playing by the rules. "USCITY.NET has been crawled 24/7 for the past 3 months by the spiders of AlltheWeb.com, owned by Overture," said USCITY.NET's Mary Crawford. "Despite all of their interest in our site, USCITY.NET fails to show up in a search of their databases."
USCITY.NET has logged over 22 gigabytes of data pulled by AlltheWeb's crawlers attempting to harvest USCITY.NET's member links. AlltheWeb's dysfunctional crawlers also generated over 12,000 errors on USCITY.NET servers scavenging for pages that don't exist. Repeated attempts to contact AlltheWeb and Overture about it's questionable crawling yielded no response.
USCITY.NET is the architect of one of the most powerful and successful membership based directories on the internet. The company has been building its national directory for more than five years and now have over 630,000 G-rated quality links to businesses across America. A business can be located geographically down to the city and category in only three clicks from the home page.
# # #
|
© Copyright 1997-2008, Vocus PRW Holdings, LLC. |