2016-05-06 11:23:48 +02:00
|
|
|
#!/usr/bin/env python3
|
|
|
|
# Copyright (c) 2014-2016 The Bitcoin Core developers
|
2014-11-24 21:18:05 +01:00
|
|
|
# Distributed under the MIT software license, see the accompanying
|
|
|
|
# file COPYING or http://www.opensource.org/licenses/mit-license.php.
|
2019-01-07 10:55:35 +01:00
|
|
|
"""Test mempool re-org scenarios.
|
2014-11-24 21:18:05 +01:00
|
|
|
|
2019-01-07 10:55:35 +01:00
|
|
|
Test re-org scenarios with a mempool that contains transactions
|
|
|
|
that spend (directly or indirectly) coinbase transactions.
|
|
|
|
"""
|
2014-11-24 21:18:05 +01:00
|
|
|
|
Merge #13669: Tests: Cleanup create_transaction implementations
44bbceeef1 [Tests] Cleanup feature_block.py, remove unnecessary PreviousSpendableOutput object (Conor Scott)
736f941424 [Tests] Cleanup extra instances of create_transaction (Conor Scott)
157651855f [Tests] Rename create_tx and move to blocktools.py (Conor Scott)
Pull request description:
There currently exist seven ([1](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_cltv.py#L52-L60), [2](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_csv_activation.py#L88-L95) [3](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_dersig.py#L40-L48), [4](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_nulldummy.py#L100-L108), [5](https://github.com/bitcoin/bitcoin/blob/master/test/functional/test_framework/util.py#L529-L535), [6](https://github.com/bitcoin/bitcoin/blob/master/test/functional/test_framework/blocktools.py#L120-L129), [7](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_block.py#L1218-L1220)) implementations of a function called something similar to `create_transaction` in the functional tests, some of which are exact copies of each other.
This PR aims to clean this up into [three different cases implemented in blocktools.py](https://github.com/conscott/bitcoin/blob/create_tx_cleanup/test/functional/test_framework/blocktools.py#L121-L149)
1. `create_tx_with_script`: Return transaction object spending generic tx output optionally specifying scriptSig and scriptPubKey
2. `create_transaction`: Return transaction object spending coinbase tx
2. `create_raw_transaction`: Return raw transaction (hex string) spending coinbase tx
I am not committed to any of these function names, so I'll gladly take suggestions on there.
Additionally there are some related cleanups to feature_block.py tests, specifically removing the [PreviousSpendableOutput](https://github.com/conscott/bitcoin/blob/master/test/functional/feature_block.py#L51-L54) object, which seems like an unnecessary layer given that every instance spends the 0 output.
Tree-SHA512: 63c6233b6f0942c81ba1ca67ea6770809b8c9409314c6d4cf8e5a3991cb9ee92b22bebe88c0dde45cd71e754eb351230c4c404b70ff118f5f43c034452ada65c
2018-08-09 18:09:27 +02:00
|
|
|
from test_framework.blocktools import create_raw_transaction
|
Merge #13054: tests: Enable automatic detection of undefined names in Python tests scripts. Remove wildcard imports.
68400d8b96 tests: Use explicit imports (practicalswift)
Pull request description:
Enable automatic detection of undefined names in Python tests scripts. Remove wildcard imports.
Wildcard imports make it unclear which names are present in the namespace, confusing both readers and many automated tools.
An additional benefit of not using wildcard imports in tests scripts is that readers of a test script then can infer the rough testing scope just by looking at the imports.
Before this commit:
```
$ contrib/devtools/lint-python.sh | head -10
./test/functional/feature_rbf.py:8:1: F403 'from test_framework.util import *' used; unable to detect undefined names
./test/functional/feature_rbf.py:9:1: F403 'from test_framework.script import *' used; unable to detect undefined names
./test/functional/feature_rbf.py:10:1: F403 'from test_framework.mininode import *' used; unable to detect undefined names
./test/functional/feature_rbf.py:15:12: F405 bytes_to_hex_str may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
./test/functional/feature_rbf.py:17:58: F405 CScript may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
./test/functional/feature_rbf.py:25:13: F405 COIN may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
./test/functional/feature_rbf.py:26:31: F405 satoshi_round may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
./test/functional/feature_rbf.py:26:60: F405 COIN may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
./test/functional/feature_rbf.py:30:41: F405 satoshi_round may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
./test/functional/feature_rbf.py:30:68: F405 COIN may be undefined, or defined from star imports: test_framework.mininode, test_framework.script, test_framework.util
$
```
After this commit:
```
$ contrib/devtools/lint-python.sh | head -10
$
```
Tree-SHA512: 3f826d39cffb6438388e5efcb20a9622ff8238247e882d68f7b38609877421b2a8e10e9229575f8eb6a8fa42dec4256986692e92922c86171f750a0e887438d9
2018-08-13 14:24:43 +02:00
|
|
|
from test_framework.test_framework import BitcoinTestFramework
|
|
|
|
from test_framework.util import assert_equal, assert_raises_rpc_error
|
2014-11-24 21:18:05 +01:00
|
|
|
|
2018-08-11 12:45:29 +02:00
|
|
|
|
2014-11-24 21:18:05 +01:00
|
|
|
class MempoolCoinbaseTest(BitcoinTestFramework):
|
2017-09-01 18:47:13 +02:00
|
|
|
def set_test_params(self):
|
2016-05-20 15:16:51 +02:00
|
|
|
self.num_nodes = 2
|
2014-11-24 21:18:05 +01:00
|
|
|
|
|
|
|
alert_filename = None # Set by setup_network
|
|
|
|
|
|
|
|
def run_test(self):
|
2017-03-16 11:57:09 +01:00
|
|
|
# Start with a 200 block chain
|
|
|
|
assert_equal(self.nodes[0].getblockcount(), 200)
|
2014-11-24 21:18:05 +01:00
|
|
|
|
2017-03-16 11:57:09 +01:00
|
|
|
# Mine four blocks. After this, nodes[0] blocks
|
2014-11-24 21:18:05 +01:00
|
|
|
# 101, 102, and 103 are spend-able.
|
2015-04-01 05:28:28 +02:00
|
|
|
new_blocks = self.nodes[1].generate(4)
|
2014-11-24 21:18:05 +01:00
|
|
|
self.sync_all()
|
|
|
|
|
|
|
|
node0_address = self.nodes[0].getnewaddress()
|
|
|
|
node1_address = self.nodes[1].getnewaddress()
|
|
|
|
|
|
|
|
# Three scenarios for re-orging coinbase spends in the memory pool:
|
|
|
|
# 1. Direct coinbase spend : spend_101
|
|
|
|
# 2. Indirect (coinbase spend in chain, child in mempool) : spend_102 and spend_102_1
|
|
|
|
# 3. Indirect (coinbase and child both in chain) : spend_103 and spend_103_1
|
|
|
|
# Use invalidatblock to make all of the above coinbase spends invalid (immature coinbase),
|
|
|
|
# and make sure the mempool code behaves correctly.
|
2015-08-27 03:15:04 +02:00
|
|
|
b = [ self.nodes[0].getblockhash(n) for n in range(101, 105) ]
|
2014-11-24 21:18:05 +01:00
|
|
|
coinbase_txids = [ self.nodes[0].getblock(h)['tx'][0] for h in b ]
|
Merge #13669: Tests: Cleanup create_transaction implementations
44bbceeef1 [Tests] Cleanup feature_block.py, remove unnecessary PreviousSpendableOutput object (Conor Scott)
736f941424 [Tests] Cleanup extra instances of create_transaction (Conor Scott)
157651855f [Tests] Rename create_tx and move to blocktools.py (Conor Scott)
Pull request description:
There currently exist seven ([1](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_cltv.py#L52-L60), [2](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_csv_activation.py#L88-L95) [3](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_dersig.py#L40-L48), [4](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_nulldummy.py#L100-L108), [5](https://github.com/bitcoin/bitcoin/blob/master/test/functional/test_framework/util.py#L529-L535), [6](https://github.com/bitcoin/bitcoin/blob/master/test/functional/test_framework/blocktools.py#L120-L129), [7](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_block.py#L1218-L1220)) implementations of a function called something similar to `create_transaction` in the functional tests, some of which are exact copies of each other.
This PR aims to clean this up into [three different cases implemented in blocktools.py](https://github.com/conscott/bitcoin/blob/create_tx_cleanup/test/functional/test_framework/blocktools.py#L121-L149)
1. `create_tx_with_script`: Return transaction object spending generic tx output optionally specifying scriptSig and scriptPubKey
2. `create_transaction`: Return transaction object spending coinbase tx
2. `create_raw_transaction`: Return raw transaction (hex string) spending coinbase tx
I am not committed to any of these function names, so I'll gladly take suggestions on there.
Additionally there are some related cleanups to feature_block.py tests, specifically removing the [PreviousSpendableOutput](https://github.com/conscott/bitcoin/blob/master/test/functional/feature_block.py#L51-L54) object, which seems like an unnecessary layer given that every instance spends the 0 output.
Tree-SHA512: 63c6233b6f0942c81ba1ca67ea6770809b8c9409314c6d4cf8e5a3991cb9ee92b22bebe88c0dde45cd71e754eb351230c4c404b70ff118f5f43c034452ada65c
2018-08-09 18:09:27 +02:00
|
|
|
spend_101_raw = create_raw_transaction(self.nodes[0], coinbase_txids[1], node1_address, 499.99)
|
|
|
|
spend_102_raw = create_raw_transaction(self.nodes[0], coinbase_txids[2], node0_address, 499.99)
|
|
|
|
spend_103_raw = create_raw_transaction(self.nodes[0], coinbase_txids[3], node0_address, 499.99)
|
2015-08-27 03:15:04 +02:00
|
|
|
|
2017-03-16 11:57:09 +01:00
|
|
|
# Create a transaction which is time-locked to two blocks in the future
|
2018-01-15 08:26:15 +01:00
|
|
|
timelock_tx = self.nodes[0].createrawtransaction([{"txid": coinbase_txids[0], "vout": 0}], {node0_address: 499.9})
|
2015-08-27 03:15:04 +02:00
|
|
|
# Set the time lock
|
2016-12-15 17:03:23 +01:00
|
|
|
timelock_tx = timelock_tx.replace("ffffffff", "11111191", 1)
|
2015-08-27 03:15:04 +02:00
|
|
|
timelock_tx = timelock_tx[:-8] + hex(self.nodes[0].getblockcount() + 2)[2:] + "000000"
|
2018-02-20 03:29:22 +01:00
|
|
|
timelock_tx = self.nodes[0].signrawtransactionwithwallet(timelock_tx)["hex"]
|
2017-03-16 11:57:09 +01:00
|
|
|
# This will raise an exception because the timelock transaction is too immature to spend
|
2019-09-25 11:34:51 +02:00
|
|
|
assert_raises_rpc_error(-26, "non-final", self.nodes[0].sendrawtransaction, timelock_tx)
|
2014-11-24 21:18:05 +01:00
|
|
|
|
|
|
|
# Broadcast and mine spend_102 and 103:
|
|
|
|
spend_102_id = self.nodes[0].sendrawtransaction(spend_102_raw)
|
|
|
|
spend_103_id = self.nodes[0].sendrawtransaction(spend_103_raw)
|
2015-04-01 05:28:28 +02:00
|
|
|
self.nodes[0].generate(1)
|
2017-03-16 11:57:09 +01:00
|
|
|
# Time-locked transaction is still too immature to spend
|
2019-09-25 11:34:51 +02:00
|
|
|
assert_raises_rpc_error(-26,'non-final', self.nodes[0].sendrawtransaction, timelock_tx)
|
2014-11-24 21:18:05 +01:00
|
|
|
|
|
|
|
# Create 102_1 and 103_1:
|
Merge #13669: Tests: Cleanup create_transaction implementations
44bbceeef1 [Tests] Cleanup feature_block.py, remove unnecessary PreviousSpendableOutput object (Conor Scott)
736f941424 [Tests] Cleanup extra instances of create_transaction (Conor Scott)
157651855f [Tests] Rename create_tx and move to blocktools.py (Conor Scott)
Pull request description:
There currently exist seven ([1](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_cltv.py#L52-L60), [2](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_csv_activation.py#L88-L95) [3](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_dersig.py#L40-L48), [4](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_nulldummy.py#L100-L108), [5](https://github.com/bitcoin/bitcoin/blob/master/test/functional/test_framework/util.py#L529-L535), [6](https://github.com/bitcoin/bitcoin/blob/master/test/functional/test_framework/blocktools.py#L120-L129), [7](https://github.com/bitcoin/bitcoin/blob/master/test/functional/feature_block.py#L1218-L1220)) implementations of a function called something similar to `create_transaction` in the functional tests, some of which are exact copies of each other.
This PR aims to clean this up into [three different cases implemented in blocktools.py](https://github.com/conscott/bitcoin/blob/create_tx_cleanup/test/functional/test_framework/blocktools.py#L121-L149)
1. `create_tx_with_script`: Return transaction object spending generic tx output optionally specifying scriptSig and scriptPubKey
2. `create_transaction`: Return transaction object spending coinbase tx
2. `create_raw_transaction`: Return raw transaction (hex string) spending coinbase tx
I am not committed to any of these function names, so I'll gladly take suggestions on there.
Additionally there are some related cleanups to feature_block.py tests, specifically removing the [PreviousSpendableOutput](https://github.com/conscott/bitcoin/blob/master/test/functional/feature_block.py#L51-L54) object, which seems like an unnecessary layer given that every instance spends the 0 output.
Tree-SHA512: 63c6233b6f0942c81ba1ca67ea6770809b8c9409314c6d4cf8e5a3991cb9ee92b22bebe88c0dde45cd71e754eb351230c4c404b70ff118f5f43c034452ada65c
2018-08-09 18:09:27 +02:00
|
|
|
spend_102_1_raw = create_raw_transaction(self.nodes[0], spend_102_id, node1_address, 499.98)
|
|
|
|
spend_103_1_raw = create_raw_transaction(self.nodes[0], spend_103_id, node1_address, 499.98)
|
2014-11-24 21:18:05 +01:00
|
|
|
|
|
|
|
# Broadcast and mine 103_1:
|
|
|
|
spend_103_1_id = self.nodes[0].sendrawtransaction(spend_103_1_raw)
|
2015-08-27 03:15:04 +02:00
|
|
|
last_block = self.nodes[0].generate(1)
|
2017-03-16 11:57:09 +01:00
|
|
|
# Time-locked transaction can now be spent
|
2015-08-27 03:15:04 +02:00
|
|
|
timelock_tx_id = self.nodes[0].sendrawtransaction(timelock_tx)
|
2014-11-24 21:18:05 +01:00
|
|
|
|
|
|
|
# ... now put spend_101 and spend_102_1 in memory pools:
|
|
|
|
spend_101_id = self.nodes[0].sendrawtransaction(spend_101_raw)
|
|
|
|
spend_102_1_id = self.nodes[0].sendrawtransaction(spend_102_1_raw)
|
|
|
|
|
|
|
|
self.sync_all()
|
|
|
|
|
2015-12-02 18:12:23 +01:00
|
|
|
assert_equal(set(self.nodes[0].getrawmempool()), {spend_101_id, spend_102_1_id, timelock_tx_id})
|
2015-08-27 03:15:04 +02:00
|
|
|
|
|
|
|
for node in self.nodes:
|
|
|
|
node.invalidateblock(last_block[0])
|
2017-03-16 11:57:09 +01:00
|
|
|
# Time-locked transaction is now too immature and has been removed from the mempool
|
|
|
|
# spend_103_1 has been re-orged out of the chain and is back in the mempool
|
2015-12-02 18:12:23 +01:00
|
|
|
assert_equal(set(self.nodes[0].getrawmempool()), {spend_101_id, spend_102_1_id, spend_103_1_id})
|
2014-11-24 21:18:05 +01:00
|
|
|
|
|
|
|
# Use invalidateblock to re-org back and make all those coinbase spends
|
|
|
|
# immature/invalid:
|
|
|
|
for node in self.nodes:
|
|
|
|
node.invalidateblock(new_blocks[0])
|
|
|
|
|
|
|
|
self.sync_all()
|
|
|
|
|
|
|
|
# mempool should be empty.
|
|
|
|
assert_equal(set(self.nodes[0].getrawmempool()), set())
|
|
|
|
|
|
|
|
if __name__ == '__main__':
|
|
|
|
MempoolCoinbaseTest().main()
|