Bug 31549 - Sitemaps for patchwork
Summary: Sitemaps for patchwork
Status: NEW
Alias: None
Product: sourceware
Classification: Unclassified
Component: Infrastructure (show other bugs)
Version: unspecified
: P2 normal
Target Milestone: ---
Assignee: overseers mailing list
Depends on:
Reported: 2024-03-25 00:05 UTC by Mark Wielaard
Modified: 2024-03-25 00:24 UTC (History)
0 users

See Also:
Last reconfirmed:


Note You need to log in before you can comment on or make changes to this bug.
Description Mark Wielaard 2024-03-25 00:05:46 UTC
Currently we try to keep spiders out by adding various lists to robots.txt:

Disallow: /project/*/list/?*order=
Disallow: /project/*/list/?*series=
Disallow: /project/*/list/?*submitter=
Disallow: /project/*/list/?*delegate=
Disallow: /project/*/list/?*param=

The idea is that we do like the patches to be indexed so they can be easily found. But we don't like spiders going through the patches through all the possible listing results.

With sitemaps we would have a list for search engines and can don't need complicated robots.txt rules.