Commit Graph

45 Commits

Author SHA1 Message Date
cb055227b7 parser/gotest: Improve gotest output handling
The reportBuilder has been updated to use the ordered output collector
to keep track of go test output. This makes it possible to include
benchmark output in the generated report and makes sure that output is
preserved when deleting subtest parents from the report.
2022-06-08 23:01:01 +01:00
5331b9b8d6 parser/gotest: Create output collector that preserves the line order 2022-06-08 23:01:01 +01:00
d2480a6059 parser/gotest: Skip ID 0 when searching for existing tests or benchmarks 2022-06-08 23:01:01 +01:00
2f7bf7c3bc parser/gotest: Set unique Test, Benchmark and Error ID's
This will be used later to collect and store output for the right tests.
2022-06-08 23:01:01 +01:00
c87388ae59 parser/gotest,junit: Move benchmark grouping to parser/gotest package
Having multiple benchmarks for a single name is something specific to
the gotest output, so grouping benchmarks by name is not something that
belongs in the junit package.
2022-06-08 23:01:01 +01:00
84074a188c parser/gotest: remove debugging printf from reportBuilder 2022-05-22 00:50:12 +01:00
1b7027fde7 parser/gotest: add SubtestMode to configure how to deal with subtests 2022-05-22 00:32:17 +01:00
6c038bc425 parser/gotest: never reset nextID in report builder to ensure unique ids 2022-05-21 23:29:24 +01:00
01f41237f7 parser/gotest: continue with next item when we find a test or benchmark 2022-05-21 23:19:41 +01:00
b5d2695c26 parser/gotest: return a separate bool instead of a negative id in find* 2022-05-21 22:26:00 +01:00
f97910c4b9 parser/gotest: Make reportBuilder options private 2022-05-21 22:16:55 +01:00
ae7e71c599 parser/gotest: rename Id -> ID 2022-05-21 18:48:07 +01:00
a4c479dbbb gtr: Reset builder state after the end of a test or benchmark
The consequence of this is that any output emitted after the test or
benchmark result, will no longer belong to the last test. Instead it
will be appended to the global log. This is necessary to correctly
attribute output to the correct test or benchmark, for example in cases
where both tests and benchmarks appear.

In the past, Go test output printed test logs after the test result.
However, from Go 1.14 this behaviour was changed and test logs are now
printed before the test result.

With this commit, we effectively no longer support the old behaviour in
Go1.13 and earlier. The output will still appear in the generated
report, however it will no longer belong to the correct test.
2022-05-14 23:25:41 +01:00
df7394c77c Fix cmp.Diff argument order in tests 2022-05-13 21:45:38 +01:00
d84b066208 Move packages out of pkg/ 2022-04-20 19:39:05 +01:00
01c1e1fc30 Remove v1 parser and formatter packages
These packages are no longer used in go-junit-report and are no longer
maintained. They are still available in the most recent v1 version in
case you rely on them.
2022-03-22 22:05:16 +00:00
1b8b67371c Report testsuite failures even if all tests succeeded
Fixes #87
2019-10-03 23:53:41 +01:00
6315b3013b Parse package name output when test binary name is included
Sometimes, the text after "# " shows the name of the test binary
("<package>.test") in addition to the package
e.g.: "# package/name [package/name.test]".
This change ensures that the packages' build outputs are associated
correctly in this case.
2019-09-18 17:44:54 -07:00
9c3d9dadf6 Include test output and stdout in test failures 2018-12-21 13:39:33 -05:00
b4d81a975b Regex captures benchmarks with or without CPU suffix. 2018-06-07 22:19:32 -07:00
56afb484ae Move -count parameter to bench example and a little cleanup 2018-06-03 22:49:01 +01:00
1c2c0a00fe Adds multi-package benchmark support, simplifies merge benchmark averaging. Addressing code review comments. 2018-06-03 12:28:48 -07:00
260b47cabe Addressing code review comments.
Mainly:
* Moving the averaging/merging of benchmarks from the parser to the formatter package
* Tightening up the regex so it only captures the numeric values (no more of trimming spaces and the ns/op)
* Deleting the writing up in xml file the benchmark memory sections of B/op and Allocs/op

Also added a test case for parseNanoseconds().
2018-05-29 21:05:13 -07:00
b2f467b67c Adds ability to parse benchmarking information, and (optional) with memory information and with -count specified. Includes a number of unit tests. Issue #70. 2018-05-22 20:18:03 -07:00
1ce4b93a20 Deprecated Time field, use a time.Duration instead.
The parser.Package.Time and parser.Test.Time fields are currently still
supported, but will be removed in the future.
2018-04-21 18:15:02 +01:00
6e1ccef4d8 Add support for cached tests 2018-04-21 18:15:02 +01:00
766f2ff9bb Merge pull request #67 from mattdelco/upstream 2018-03-17 19:42:25 +00:00
d9db44172d Remove \s* prefix from regexStatus 2018-02-03 23:50:50 +00:00
0e171eb667 [rvelaz] Fix test report when the program writes to stdout 2018-01-05 17:25:13 +01:00
a009038a63 Set test output directly when parsing the result 2017-07-28 21:43:03 +01:00
862454a821 Add state to ignore trailing output 2017-07-26 08:06:07 +02:00
0f1caf6c3e Revert changes to coverage regexps
Add expected test output instead
2017-07-25 09:25:47 +02:00
01656fa7f4 Capture more test output, e.g. race detection results 2017-07-25 09:07:29 +02:00
15422cf504 Add support for -coverpkg output
Fixes #59
2017-07-24 21:45:57 +01:00
cce73b4996 Change findTest to return the most recently added test
Whenever we encounter a result line in the test output, we would find
the first test with the matching name and update it. However, in some
cases it's possible for the same test name to appear multiple times in
the output. To prevent us from always updating the oldest test, the
order in which findTests searches for a matching test is reversed so
that it always returns the most recently added test.

Fixes #54.
2017-05-11 22:22:43 +01:00
2a5fd0eeb0 Include failing packages without tests in report
If a package compiles correctly, but panics before it has a chance to
run any tests it would previously be ignored. Any failing packages
without tests but with some output will now be included in the report
with a dummy test.

Fixes #52
2017-04-27 23:21:54 +01:00
4e217bedba Detect setup error as a failing test
Fixes #50
2017-04-19 15:59:40 +03:00
e9729a3e7e Fix CR comments
* Change regexpCapture to HasPrefix function
* Use same addition pattern of the faild build test
* Fix readme
2017-04-01 08:36:21 +03:00
d10c0632c7 Use test level failure to indicate build failure
- Use single regex for package result line
- Add capturing of package build failure output
2017-03-30 21:46:08 +03:00
3c05bc8cb6 Fail package in case of build error
In case of build error, the unittest fail, but the junit-report
with the set-exit-code flag on returns status code 0.
This commit will make it return the right status code.
2017-01-22 10:13:01 +02:00
faed36da23 Fix 1.7 compatbility 2016-09-12 13:54:45 -07:00
24d394d799 Add go 1.7 compatibility
* Subtests and nested subtests have spaces at the beginning of their
PASS statements. This has been added to the regexp.
2016-09-12 13:54:45 -07:00
1b60a11396 Add support for Go 1.5 test results
An alternate approach that does not involve regular expressions.

Fixes #15
2015-08-23 10:55:52 -07:00
afd084b9d1 Merge branch 'subpackage' 2015-07-01 22:31:23 +02:00
a30d4886ed moving parser into subpackage 2015-05-14 17:07:05 -06:00