dash/src/test
Wladimir J. van der Laan 2be67c7605 Merge #12324: speed up Unserialize_impl for prevector
86b47fa741408b061ab0bda784b8678bfd7dfa88 speed up Unserialize_impl for prevector (Akio Nakamura)

Pull request description:

  The unserializer for prevector uses `resize()` for reserve the area, but it's prefer to use `reserve()` because `resize()` have overhead to call its constructor many times.

  However, `reserve()` does not change the value of `_size` (a private member of prevector).

  This PR make the logic of read from stream to callback function, and prevector handles initilizing new values with that call-back and ajust the value of `_size`.

  The changes are as follows:
  1. prevector.h
  Add a public member function named 'append'.
  This function has 2 params, number of elemenst to append and call-back function that initilizing new appended values.

  2. serialize.h
  In the following two function:
  - `Unserialize_impl(Stream& is, prevector<N, T>& v, const unsigned char&)`
  - `Unserialize_impl(Stream& is, prevector<N, T>& v, const V&)`
  Make a callback function from each original logic of reading values from stream, and call prevector's `append()`.

  3. test/prevector_tests.cpp
  Add a test for `append()`.

  ## A benchmark result is following:
  [Machine]
  MacBook Pro (macOS 10.13.3/i7 2.2GHz/mem 16GB/SSD)

  [result]
  DeserializeAndCheckBlockTest  => 22% faster
  DeserializeBlockTest => 29% faster

  [before PR]
      # Benchmark, evals, iterations, total, min, max, median
      DeserializeAndCheckBlockTest, 60, 160, 94.4901, 0.0094644, 0.0104715, 0.0098339
      DeserializeBlockTest, 60, 130, 65.0964, 0.00800362, 0.00895134, 0.00824187

  [After PR]
      # Benchmark, evals, iterations, total, min, max, median
      DeserializeAndCheckBlockTest, 60, 160, 77.1597, 0.00767013, 0.00858959, 0.00805757
      DeserializeBlockTest, 60, 130, 49.9443, 0.00613926, 0.00691187, 0.00635527

ACKs for top commit:
  laanwj:
    utACK 86b47fa741408b061ab0bda784b8678bfd7dfa88

Tree-SHA512: 62ea121ccd45a306fefc67485a1b03a853435af762607dae2426a87b15a3033d802c8556e1923727ddd1023a1837d0e5f6720c2c77b38196907e750e15fbb902
2019-10-02 15:25:27 +02:00
..
data Merge #10792: Replace MAX_OPCODE for OP_NOP10. 2019-08-12 09:07:03 -05:00
addrman_tests.cpp #10483 scripted-diff: Use the C++11 keyword nullptr to denote the pointer literal instead of the macro NULL 2019-08-12 09:07:03 -05:00
allocator_tests.cpp Merge #10631: Use the override specifier (C++11) where we expect to be overriding the virtual function of a base class 2019-07-17 10:05:12 -05:00
amount_tests.cpp Merge #9279: Consensus: Move CFeeRate out of libconsensus 2019-06-26 15:26:07 -05:00
arith_uint256_tests.cpp Merge #10633: doc: Fix various typos 2019-07-11 10:34:46 -05:00
base32_tests.cpp
base58_tests.cpp Merge #10546: Remove 33 unused Boost includes 2019-07-08 13:50:05 -05:00
base64_tests.cpp
bip32_tests.cpp scripted diff: #10502 Fully remove BOOST_FOREACH 2019-07-09 13:08:21 -05:00
bip39_tests.cpp Update copyright date (2019) (#2970) 2019-06-11 14:46:07 +03:00
blockencodings_tests.cpp Merge #10321: Use FastRandomContext for all tests 2019-07-08 10:24:27 -05:00
bloom_tests.cpp Merge #10546: Remove 33 unused Boost includes 2019-07-08 13:50:05 -05:00
bls_tests.cpp CBLSWrapper::SetHexStr() should not accept non-hex strings (#2843) 2019-04-08 08:07:26 +03:00
bswap_tests.cpp
cachemap_tests.cpp Update copyright date (2019) (#2970) 2019-06-11 14:46:07 +03:00
cachemultimap_tests.cpp Update copyright date (2019) (#2970) 2019-06-11 14:46:07 +03:00
checkqueue_tests.cpp Merge #10521: Limit variable scope 2019-07-08 13:50:05 -05:00
coins_tests.cpp Merge #9544: [trivial] Add end of namespace comments. Improve consistency. 2019-07-11 10:34:46 -05:00
compress_tests.cpp
crypto_tests.cpp Merge #15649: Add ChaCha20Poly1305@Bitcoin AEAD 2019-07-23 09:14:30 -05:00
cuckoocache_tests.cpp Merge #10546: Remove 33 unused Boost includes 2019-07-08 13:50:05 -05:00
dbwrapper_tests.cpp Merge #11422: qa: Verify DBWrapper iterators are taking snapshots 2019-09-24 17:47:35 +02:00
DoS_tests.cpp Remove uses of NODE_WITNESS 2019-09-29 12:42:14 +02:00
evo_deterministicmns_tests.cpp A couple of fixes 2019-09-20 11:10:07 +02:00
evo_simplifiedmns_tests.cpp Multiple speed optimizations for deterministic MN list handling (#2972) 2019-06-13 12:01:26 +03:00
getarg_tests.cpp #10193 scripted-diff: Remove #include <boost/foreach.hpp> 2019-07-24 11:59:09 -05:00
governance_validators_tests.cpp Update copyright date (2019) (#2970) 2019-06-11 14:46:07 +03:00
hash_tests.cpp Merge #10321: Use FastRandomContext for all tests 2019-07-08 10:24:27 -05:00
key_tests.cpp Merge #9987: Remove unused code 2019-05-06 14:51:44 -05:00
limitedmap_tests.cpp Collection of minor performance optimizations (#2855) 2019-04-11 15:42:14 +03:00
main_tests.cpp Some cleanup (mostly trivial) (#2038) 2018-04-20 13:53:23 +03:00
Makefile
mempool_tests.cpp Merge bitcoin#9602: Remove coin age priority and free transactions - implementation (#2768) 2019-03-14 17:44:42 +03:00
merkle_tests.cpp Merge #10321: Use FastRandomContext for all tests 2019-07-08 10:24:27 -05:00
miner_tests.cpp #10483 scripted-diff: Use the C++11 keyword nullptr to denote the pointer literal instead of the macro NULL 2019-08-12 09:07:03 -05:00
multisig_tests.cpp Merge #11116: [script] Unit tests for script/standard and IsMine functions. 2019-09-24 17:47:35 +02:00
net_tests.cpp Merge #10478: rpc: Add listen address to incoming connections in getpeerinfo 2019-06-26 12:44:45 -05:00
netbase_tests.cpp Merge #10812: [utils] Allow bitcoin-cli's -rpcconnect option to be used with square brackets 2019-07-17 19:01:41 -05:00
pmt_tests.cpp Merge #10545: Use list initialization (C++11) for maps/vectors instead of boost::assign::map_list_of/list_of 2019-07-08 10:24:30 -05:00
policyestimator_tests.cpp Merge #10706: Improve wallet fee logic and fix GUI bugs 2019-09-03 22:40:26 -05:00
pow_tests.cpp #10483 scripted-diff: Use the C++11 keyword nullptr to denote the pointer literal instead of the macro NULL 2019-08-12 09:07:03 -05:00
prevector_tests.cpp Merge #12324: speed up Unserialize_impl for prevector 2019-10-02 15:25:27 +02:00
raii_event_tests.cpp #10483 scripted-diff: Use the C++11 keyword nullptr to denote the pointer literal instead of the macro NULL 2019-08-12 09:07:03 -05:00
random_tests.cpp Merge #10321: Use FastRandomContext for all tests 2019-07-08 10:24:27 -05:00
ratecheck_tests.cpp Update copyright date (2019) (#2970) 2019-06-11 14:46:07 +03:00
README.md Merge bitcoin#9956: Reorganise qa directory (#2912) 2019-05-19 23:20:34 +03:00
reverselock_tests.cpp
rpc_tests.cpp Merge #10999: Fix amounts formatting in decoderawtransaction 2019-08-12 09:07:03 -05:00
sanity_tests.cpp
scheduler_tests.cpp Merge #10547: [tests] Use FastRandomContext instead of boost::random::{mt19937,uniform_int_distribution} 2019-07-08 10:24:29 -05:00
script_P2PK_tests.cpp Remove remaining using namespace std 2018-02-21 22:32:13 +03:00
script_P2PKH_tests.cpp Fix p2pkh tests asserts (#2153) 2018-06-29 01:23:25 +03:00
script_P2SH_tests.cpp BIP143: Signing logic 2019-09-20 11:09:59 +02:00
script_standard_tests.cpp Remove more SegWit related tests from script_standard_tests.cpp 2019-09-27 09:59:55 +02:00
script_tests.cpp BIP143: Signing logic 2019-09-20 11:09:59 +02:00
scriptnum10.h
scriptnum_tests.cpp
serialize_tests.cpp
sighash_tests.cpp BIP143: Verification logic 2019-09-19 21:04:36 +02:00
sigopcount_tests.cpp Merge bitcoin#8329: Consensus: MOVEONLY: Move functions for tx verification (#3030) 2019-07-23 12:20:23 +03:00
skiplist_tests.cpp #10483 scripted-diff: Use the C++11 keyword nullptr to denote the pointer literal instead of the macro NULL 2019-08-12 09:07:03 -05:00
streams_tests.cpp Merge #10546: Remove 33 unused Boost includes 2019-07-08 13:50:05 -05:00
subsidy_tests.cpp Merge #8855: Use a proper factory for creating chainparams 2019-06-26 12:45:10 -05:00
test_dash_fuzzy.cpp Code Review fixes 2019-08-25 00:17:19 -05:00
test_dash_main.cpp Merge #9974: Add basic Qt wallet test 2019-05-06 14:51:43 -05:00
test_dash.cpp Merge #11560: Connect to a new outbound peer if our tip is stale 2019-09-29 12:42:14 +02:00
test_dash.h Merge #11560: Connect to a new outbound peer if our tip is stale 2019-09-29 12:42:14 +02:00
timedata_tests.cpp
torcontrol_tests.cpp change include 2019-06-24 11:39:34 -05:00
transaction_tests.cpp Refactor script validation to observe amounts 2019-09-19 21:04:36 +02:00
txvalidationcache_tests.cpp A couple of fixes 2019-09-20 11:10:07 +02:00
uint256_tests.cpp
univalue_tests.cpp Add univalue test for real numbers (#2460) 2018-11-22 06:09:58 +01:00
util_tests.cpp Merge #10357: Allow setting nMinimumChainWork on command line 2019-09-29 12:42:14 +02:00
versionbits_tests.cpp #10483 scripted-diff: Use the C++11 keyword nullptr to denote the pointer literal instead of the macro NULL 2019-08-12 09:07:03 -05:00

Compiling/running unit tests

Unit tests will be automatically compiled if dependencies were met in ./configure and tests weren't explicitly disabled.

After configuring, they can be run with make check.

To run the dashd tests manually, launch src/test/test_dash.

To add more dashd tests, add BOOST_AUTO_TEST_CASE functions to the existing .cpp files in the test/ directory or add new .cpp files that implement new BOOST_AUTO_TEST_SUITE sections.

To run the dash-qt tests manually, launch src/qt/test/test_dash-qt

To add more dash-qt tests, add them to the src/qt/test/ directory and the src/qt/test/test_main.cpp file.

Running individual tests

test_dash has some built-in command-line arguments; for example, to run just the getarg_tests verbosely:

test_dash --log_level=all --run_test=getarg_tests

... or to run just the doubledash test:

test_dash --run_test=getarg_tests/doubledash

Run test_dash --help for the full list.

Note on adding test cases

The sources in this directory are unit test cases. Boost includes a unit testing framework, and since Dash Core already uses boost, it makes sense to simply use this framework rather than require developers to configure some other framework (we want as few impediments to creating unit tests as possible).

The build system is setup to compile an executable called test_dash that runs all of the unit tests. The main source file is called test_dash.cpp. To add a new unit test file to our test suite you need to add the file to src/Makefile.test.include. The pattern is to create one test file for each class or source file for which you want to create unit tests. The file naming convention is <source_filename>_tests.cpp and such files should wrap their tests in a test suite called <source_filename>_tests. For an example of this pattern, examine uint256_tests.cpp.

For further reading, I found the following website to be helpful in explaining how the boost unit test framework works: http://www.alittlemadness.com/2009/03/31/c-unit-testing-with-boosttest/.