[Cygwin] package-grep on Sourceware
Frank Ch. Eigler
fche@elastic.org
Mon Nov 25 00:37:00 GMT 2019
Hi -
> you've made changes to the package-grep CGI script on sourceware
> that pretty much remove its originally intended functionality. The
> original was searching the index of the package _contents_ as it
> would get installed on the disk, while the JSON file you search now
> only has the metadata for the packages. That's not even
> superficially the same thing. [...]
OK. As you may be aware, this simplification was done because the
previous code's workload was too high (grepping through 600MB+ of text
per cgi call), and we at overseers@ weren't told otherwise.
> I've looked into what could be done to do that in a more
> server-friendly way, but it turns out that there either isn't
> anything that's ready-made for this or I can't find it. [...]
Thanks for looking into it. A few other possibilities to
ameliorate the impact of restoring the previous version:
- using xargs grep to use our extra cores, to reduce latency
- to impose a mod_qos concurrency limit on package-grep.cgi
- FChE
More information about the Overseers
mailing list