2017-03-09 15:53:26 +01:00
|
|
|
The [functional](/test/functional/) folder contains a script test_runner
|
|
|
|
to call multiple functional tests from its folder.
|
2015-11-18 00:26:07 +01:00
|
|
|
|
|
|
|
Every pull request to the bitcoin repository is built and run through
|
|
|
|
the regression test suite. You can also run all or only individual
|
|
|
|
tests locally.
|
|
|
|
|
2016-03-10 12:12:40 +01:00
|
|
|
Test dependencies
|
|
|
|
=================
|
|
|
|
Before running the tests, the following must be installed.
|
|
|
|
|
|
|
|
Unix
|
|
|
|
----
|
2016-03-19 20:58:06 +01:00
|
|
|
The python3-zmq library is required. On Ubuntu or Debian it can be installed via:
|
2016-03-10 12:12:40 +01:00
|
|
|
```
|
2016-03-19 20:58:06 +01:00
|
|
|
sudo apt-get install python3-zmq
|
2016-03-10 12:12:40 +01:00
|
|
|
```
|
|
|
|
|
2016-06-24 09:32:48 +02:00
|
|
|
OS X
|
|
|
|
------
|
|
|
|
```
|
|
|
|
pip3 install pyzmq
|
|
|
|
```
|
|
|
|
|
2015-11-18 00:26:07 +01:00
|
|
|
Running tests
|
|
|
|
=============
|
2015-11-16 15:33:40 +01:00
|
|
|
|
2016-04-30 00:03:06 +02:00
|
|
|
You can run any single test by calling
|
2015-11-16 15:33:40 +01:00
|
|
|
|
2017-03-09 15:53:26 +01:00
|
|
|
test/functional/test_runner.py <testname>
|
2015-11-16 15:33:40 +01:00
|
|
|
|
2016-04-30 00:03:06 +02:00
|
|
|
Or you can run any combination of tests by calling
|
2015-11-16 15:33:40 +01:00
|
|
|
|
2017-03-09 15:53:26 +01:00
|
|
|
test/functional/test_runner.py <testname1> <testname2> <testname3> ...
|
2015-11-16 15:33:40 +01:00
|
|
|
|
2016-04-30 00:03:06 +02:00
|
|
|
Run the regression test suite with
|
|
|
|
|
2017-03-09 15:53:26 +01:00
|
|
|
test/functional/test_runner.py
|
2016-04-30 00:03:06 +02:00
|
|
|
|
|
|
|
Run all possible tests with
|
|
|
|
|
2017-03-09 15:53:26 +01:00
|
|
|
test/functional/test_runner.py --extended
|
2016-04-30 00:03:06 +02:00
|
|
|
|
2016-08-30 05:01:38 +02:00
|
|
|
By default, tests will be run in parallel. To specify how many jobs to run,
|
2017-02-20 02:45:32 +01:00
|
|
|
append `--jobs=n` (default n=4).
|
2016-04-29 12:51:15 +02:00
|
|
|
|
2017-02-20 02:45:32 +01:00
|
|
|
If you want to create a basic coverage report for the RPC test suite, append `--coverage`.
|
2016-04-30 00:03:06 +02:00
|
|
|
|
|
|
|
Possible options, which apply to each individual test run:
|
2015-11-16 15:33:40 +01:00
|
|
|
|
|
|
|
```
|
|
|
|
-h, --help show this help message and exit
|
|
|
|
--nocleanup Leave bitcoinds and test.* datadir on exit or error
|
|
|
|
--noshutdown Don't stop bitcoinds after the test execution
|
|
|
|
--srcdir=SRCDIR Source directory containing bitcoind/bitcoin-cli
|
|
|
|
(default: ../../src)
|
|
|
|
--tmpdir=TMPDIR Root directory for datadirs
|
|
|
|
--tracerpc Print out all RPC calls as they are made
|
|
|
|
--coveragedir=COVERAGEDIR
|
|
|
|
Write tested RPC commands into this directory
|
|
|
|
```
|
|
|
|
|
2015-11-18 00:26:07 +01:00
|
|
|
If you set the environment variable `PYTHON_DEBUG=1` you will get some debug
|
2017-03-09 15:53:26 +01:00
|
|
|
output (example: `PYTHON_DEBUG=1 test/functional/test_runner.py wallet`).
|
2015-11-16 15:33:40 +01:00
|
|
|
|
|
|
|
A 200-block -regtest blockchain and wallets for four nodes
|
|
|
|
is created the first time a regression test is run and
|
|
|
|
is stored in the cache/ directory. Each node has 25 mature
|
|
|
|
blocks (25*50=1250 BTC) in its wallet.
|
|
|
|
|
|
|
|
After the first run, the cache/ blockchain and wallets are
|
|
|
|
copied into a temporary directory and used as the initial
|
|
|
|
test state.
|
|
|
|
|
|
|
|
If you get into a bad state, you should be able
|
|
|
|
to recover with:
|
|
|
|
|
|
|
|
```bash
|
|
|
|
rm -rf cache
|
|
|
|
killall bitcoind
|
|
|
|
```
|
|
|
|
|
2015-11-18 00:26:07 +01:00
|
|
|
Writing tests
|
|
|
|
=============
|
|
|
|
You are encouraged to write tests for new or existing features.
|
2017-03-09 15:44:57 +01:00
|
|
|
Further information about the test framework and individual functional
|
|
|
|
tests is found in [test/functional](/test/functional).
|