[Bug bunsen/25091] New: [v1.0] analysis: which regressions are truly new?

[me at serhei dot io]

https://sourceware.org/bugzilla/show_bug.cgi?id=25091

            Bug ID: 25091
           Summary: [v1.0] analysis: which regressions are truly new?
           Product: bunsen
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: bunsen
          Assignee: bunsen at sourceware dot org
          Reporter: me at serhei dot io
  Target Milestone: ---

Due to flaky tests flipping back and forth, the regression info generated by
+diff_commits is very noisy. In my presentation I described the next step as
'identifying and filtering out flaky testcases', but a more useful and simple
approach might be to search the entire history (by regression) and then
identify when a new regression *first* appears (is 'truly new').

This could be done either for the entire history, or for an n-month or n-commit
sliding window over the history (i.e. show a regression if it hasn't appeared
during previous n months/commits).

-- 
You are receiving this mail because:
You are the assignee for the bug.