Commit Graph

30 Commits

Author SHA1 Message Date
Thom Wiggers
87c40ab558 Disable SPHINCS+ test taking too much RAM in ASAN 2021-03-24 21:02:50 +00:00
Thom Wiggers
578a9d66ce Disable asan if clang is mentioned in CC (like in 'ccache clang') 2021-03-24 21:02:50 +00:00
Thom Wiggers
f5b1c258c4 Disable skipping slow tests 2021-03-24 21:02:50 +00:00
Thom Wiggers
ea5ede6e80 Make sure tests respond to undefined behaviour 2021-03-24 21:02:46 +00:00
Thom Wiggers
2eaf382689 Add support for specifying architecture and feature limits (#224)
* Add support for specifying architecture and feature limits

* cpuinfo not supported on ppc

* Detect 32-bit python interpreter on 64-bit CPU

* Fix bugs in isolated tests

* Also support restricting operating system
2019-09-06 12:01:44 +02:00
Thom Wiggers
78a65d6ec9 Parallel tests (#206)
* Do tests with pytest to run them in parallel

* attempt to handle merge commits better for PR test path

Similar to how we solved this for travis

* Clean up imports

* don't run valgrind if not specified slow_test

* Fix functest after initializer rename

* upload tests results as junit

* Upload test-common files since #200 got merged

* Catch test results upload failure
2019-07-29 10:38:25 +02:00
Thom Wiggers
65d43df241
Change permit test into a decorator
This way we can properly raise skiptest
2019-04-18 11:26:28 +02:00
Thom Wiggers
3e95b0b4d7
Add slow test annotator 2019-04-17 11:17:46 +02:00
Thom Wiggers
546d9e41f2
Make output of sanitizer nicer 2019-04-16 13:28:43 +02:00
Thom Wiggers
327429b625
Make sure -fsanitizer binaries are always cleaned up 2019-04-16 13:28:43 +02:00
Thom Wiggers
9c4aebd8e3
sanitizers don't need valgrind 2019-04-16 12:39:14 +02:00
Thom Wiggers
09a35993da
Skip Valgrind on OSX 2019-04-15 16:21:44 +02:00
Thom Wiggers
a5e906a306
Fix sanitizer test 2019-04-15 16:05:20 +02:00
Douglas Stebila
42a5e0e4ad Use environment variables to selectively filter tests 2019-04-10 17:03:02 -04:00
Thom Wiggers
1399c7fd1f
Only ignore missing helper programs if not on CI
use randombytes in functest

Got dropped by the rebase

Work around missing clang-tidy on Travis

Also check if valgrind is available
2019-03-07 08:43:13 +01:00
Thom Wiggers
f25824246f
small improvements of reporting 2019-03-06 17:14:36 +01:00
Thom Wiggers
7ad19a30a4
First start of windows test support 2019-03-06 17:14:31 +01:00
Thom Wiggers
75be658074
Clean up tests
Modify the tests to no longer construct the classes multiple times and
to have them make use of the new helpers.make() function.
2019-03-04 17:02:46 +01:00
Thom Wiggers
dac7235643
Only skip ASAN on ppc with Clang 2019-02-28 16:44:10 +01:00
Thom Wiggers
53591961c9
Fix supported platform debug print 2019-02-28 16:32:24 +01:00
Thom Wiggers
ea47ab3dad
Fix arm platform names 2019-02-28 16:18:06 +01:00
Thom Wiggers
1180de5d30
Add environment to sanitizers on ARM 2019-02-28 16:17:58 +01:00
Thom Wiggers
73197c6516
Add sanitizers to functests 2019-02-28 16:17:06 +01:00
Douglas Stebila
c6dd00c6fa
Allow to easily run individual test modules and add instructions to README (#39)
Allow to easily run individual test modules and add instructions to README
2019-02-18 08:48:13 -05:00
Thom Wiggers
7168644c40
Also support nose2 2019-02-18 13:51:01 +01:00
Thom Wiggers
685098ce33
Allow to run the test modules as python3 module.py 2019-02-18 13:39:11 +01:00
Thom Wiggers
90071bfb97
Flake8ify python files 2019-02-18 13:04:59 +01:00
Douglas Stebila
ba359473b9 Remove old license check and reduce re-building 2019-02-14 11:36:24 -05:00
Douglas Stebila
72d514a6fe Call nose differently and add test documentation 2019-02-13 22:31:37 -05:00
Douglas Stebila
f64a7e0dd4 Reimplement Python tests using nose framework 2019-02-13 22:25:34 -05:00