Back to Results
First PageMeta Content
World Wide Web / Uniform resource identifier / Uniform resource locator / Robots exclusion standard / Port / Sitemaps / Web crawlers / Information science / Computing


Mercator: A Scalable, Extensible Web Crawler Allan Heydon and Marc Najork Compaq Systems Research Center 130 Lytton Ave. Palo Alto, CA 94301 {heydon,najork}@pa.dec.com
Add to Reading List

Document Date: 2006-09-08 22:19:53

Open Document

File Size: 109,95 KB

Share Result on Facebook
UPDATE