Information retrieval
Web crawler
Link rot
Uniform resource identifier
Sitemaps
Web harvesting
Uniform resource locator
Information science
World Wide Web