Commit Graph

12 Commits

Author SHA1 Message Date
Andrew Burgess
c9a41202b2 contrib: Handle GDB specific test result types
This commit is for the benefit of GDB, but as the binutils-gdb
repository shares the contrib/ directory with gcc, this commit must
first be applied to gcc then copied back to binutils-gdb.

This commit extends the two scripts contrib/dg-extract-results.{py,sh}
to handle some new, GDB specific test result types.  These test
results types should never appear in GCC, or any other tool that
shares the contrib/ directly, so this change should be harmless.

In this patch series:
  https://sourceware.org/pipermail/gdb-patches/2020-April/167847.html
changes were made in GDB's use of Dejagnu so that two additional
conditions could be detected, these are:

  1. Test names that contain either the build or source paths.  Such
  test names make it difficult to compare the results of two test runs
  of GDB from two different directories, and

  2. Duplicate test names.  Duplicates make it difficult to track down
  exactly which test has failed.

When running Dejagnu on GDB we can now (sometimes) see two additional
test result types matching the above conditions, these are '# of paths
in test names' and '# of duplicate test names'.

If the test is run in parallel mode (make -j...) then these extra test
results will appear in the individual test summary files, but are not
merged into the final summary file.

Additionally, within the summary file there are now two new types of
test summary line, these are 'PATH: ...' and 'DUPLICATE: ...', these
allow users to quickly search the test summary to track down where the
offending test names are.  These lines are similarly not merged into
the unified gdb.sum file after a parallel test run.

This commit extends the dg-extract-results.* scripts to calculate the
totals for the two new result types, and to copy the new test summary
lines into the unified summary file.

contrib/ChangeLog:

	* dg-extract-results.py: Handle GDB specific test types.
	* dg-extract-results.sh: Likewise.
2020-05-15 11:19:15 +01:00
Andrew Burgess
aa7710cb6c contrib: Add KPASS support to dg-extract-results.{sh,py}
Extend dg-extract-results.sh and dg-extract-results.py to support the
KPASS test result status.  This is required by GDB which uses a copy
of the dg-extract-results.{sh,py} scripts that it tries to keep in
sync with GCC.

ChangeLog:

        * contrib/dg-extract-results.sh: Add support for KPASS.
        * contrib/dg-extract-results.py: Likewise.

From-SVN: r277260
2019-10-21 13:41:29 +01:00
Jakub Jelinek
ec60715d39 dg-extract-results.sh: Only handle WARNING: program timed out lines specially in "$MODE" == "sum".
* dg-extract-results.sh: Only handle WARNING: program timed out
	lines specially in "$MODE" == "sum".  Restore previous behavior
	for "$MODE" != "sum".  Clear has_timeout and timeout_cnt if in
	a different variant or curfile is empty.
	* dg-extract-results.py: Fix a typo.

From-SVN: r270415
2019-04-17 19:57:02 +02:00
Christophe Lyon
0a7b752172 dg-extract-results.py: Handle case where a WARNING happens with the first test of a harness.
2019-03-05  Christophe Lyon  <christophe.lyon@linaro.org>

	contrib/
	* dg-extract-results.py: Handle case where a WARNING happens with
	the first test of a harness.

From-SVN: r269394
2019-03-05 17:29:19 +01:00
Christophe Lyon
f874089d31 contrib/dg-extract-results: Handle timeout warnings
2019-02-04  Christophe Lyon  <christophe.lyon@linaro.org>

	contrib/
	* dg-extract-results.py: Keep timeout warnings next to their
	matching test.
	* dg-extract-results.sh: Likewise.

From-SVN: r268511
2019-02-04 09:55:00 +01:00
Christophe Lyon
aa9baacfc9 Report DejaGnu ERROR messages in dg-extract-results.
2016-09-20  Christophe Lyon  <christophe.lyon@linaro.org>

	* dg-extract-results.py: Report DejaGnu error in the final
	summary.
	* dg-extract-results.sh: Likewise.

From-SVN: r240289
2016-09-20 22:15:30 +02:00
Segher Boessenkool
c19adb17ef dg-extract-results.py (output_variation): Always sort if do_sum.
2014-10-02  Segher Boessenkool  <segher@kernel.crashing.org>

	* dg-extract-results.py (output_variation): Always sort if do_sum.

From-SVN: r215817
2014-10-02 20:24:07 +02:00
Segher Boessenkool
813271fc4e dg-extract-results.py (Prog.result_re): Include options in test name.
2014-09-19  Segher Boessenkool  <segher@kernel.crashing.org>

	* dg-extract-results.py (Prog.result_re): Include options in test name.

From-SVN: r215400
2014-09-19 18:57:04 +02:00
Richard Sandiford
e6120abeb0 dg-extract-results.py: For Python 3, force sys.stdout to handle surrogate escape sequences.
contrib/
	* dg-extract-results.py: For Python 3, force sys.stdout to handle
	surrogate escape sequences.
	(safe_open): New function.
	(output_segment, main): Use it.

From-SVN: r211666
2014-06-14 09:49:07 +00:00
Richard Sandiford
ae242e3ff2 dg-extract-results.py (Named): Remove __cmp__ method.
contrib/
	* dg-extract-results.py (Named): Remove __cmp__ method.
	(output_variation): Use a key to sort variation.harnesses.

From-SVN: r210913
2014-05-25 09:35:15 +00:00
Richard Sandiford
768b94bc2d dg-extract-results.py (parse_run): Handle warnings that are printed before a test harness is run.
contrib/
	* dg-extract-results.py (parse_run): Handle warnings that are printed
	before a test harness is run.

From-SVN: r210637
2014-05-20 10:08:59 +00:00
Richard Sandiford
0af7b53a8b dg-extract-results.py: New file.
contrib/
	* dg-extract-results.py: New file.
	* dg-extract-results.sh: Use it if the environment seems suitable.

From-SVN: r210243
2014-05-08 20:24:33 +00:00