[RFC] Statistics of non-ASCII characters in strings

[Alexander Monakov]

On Tue, 23 Dec 2014, Florian Weimer wrote:
> Why can't you do the equivalent of
> 
>   X = ((X & 0x80) >> 1) | (X & 0x7F);
> 
> before the new check?  Does this lengthen the dependency chain too much?

If understood the previous discussion correctly, there's another possibility.
Wilco's proposal is to use a zero byte matcher that would give a false
positive on byte 0x80.  One can use such matcher to skip from the beginning of
string to the first occurence of either 0x0 or 0x80 in the string, and then
continue with normal strlen from there.

Alexander