[Cygwin] package-grep on Sourceware

Frank Ch. Eigler fche@elastic.org
Mon Nov 25 00:37:00 GMT 2019


Hi -

> you've made changes to the package-grep CGI script on sourceware
> that pretty much remove its originally intended functionality.  The
> original was searching the index of the package _contents_ as it
> would get installed on the disk, while the JSON file you search now
> only has the metadata for the packages.  That's not even
> superficially the same thing.  [...]

OK.  As you may be aware, this simplification was done because the
previous code's workload was too high (grepping through 600MB+ of text
per cgi call), and we at overseers@ weren't told otherwise.


> I've looked into what could be done to do that in a more
> server-friendly way, but it turns out that there either isn't
> anything that's ready-made for this or I can't find it. [...]

Thanks for looking into it.  A few other possibilities to
ameliorate the impact of restoring the previous version:

- using xargs grep to use our extra cores, to reduce latency
- to impose a mod_qos concurrency limit on package-grep.cgi


- FChE



More information about the Overseers mailing list