aboutsummaryrefslogtreecommitdiffstats
path: root/eth/downloader/downloader_test.go
Commit message (Collapse)AuthorAgeFilesLines
* core, eth/downloader: commit block data using batches (#15115)Felix Lange2017-09-101-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * ethdb: add Putter interface and Has method * ethdb: improve docs and add IdealBatchSize * ethdb: remove memory batch lock Batches are not safe for concurrent use. * core: use ethdb.Putter for Write* functions This covers the easy cases. * core/state: simplify StateSync * trie: optimize local node check * ethdb: add ValueSize to Batch * core: optimize HasHeader check This avoids one random database read get the block number. For many uses of HasHeader, the expectation is that it's actually there. Using Has avoids a load + decode of the value. * core: write fast sync block data in batches Collect writes into batches up to the ideal size instead of issuing many small, concurrent writes. * eth/downloader: commit larger state batches Collect nodes into a batch up to the ideal size instead of committing whenever a node is received. * core: optimize HasBlock check This avoids a random database read to get the number. * core: use numberCache in HasHeader numberCache has higher capacity, increasing the odds of finding the header without a database lookup. * core: write imported block data using a batch Restore batch writes of state and add blocks, tx entries, receipts to the same batch. The change also simplifies the miner. This commit also removes posting of logs when a forked block is imported. * core: fix DB write error handling * ethdb: use RLock for Has * core: fix HasBlock comment
* eth/downloader: fix race in downloadTesterPeer (#14942)Ivan Daniluk2017-08-091-7/+25
| | | | | | | | * eth/downloader: fix race in downloadTesterPeer Signed-off-by: Ivan Daniluk <ivan.daniluk@gmail.com> * eth/downloader: minor datarace fix cleanup
* eth: fix megacheck warningsEgon Elbre2017-08-081-10/+9
|
* eth/downloader, les, light: Changes in response to reviewNick Johnson2017-07-031-1/+1
|
* eth, les: Refactor downloader peer to use structsNick Johnson2017-06-291-126/+136
|
* eth, les, light: Refactor downloader to use blockchain interfaceNick Johnson2017-06-281-37/+35
|
* core/state: access trie through Database interface, track errors (#14589)Felix Lange2017-06-271-1/+1
| | | | | | | | | With this commit, core/state's access to the underlying key/value database is mediated through an interface. Database errors are tracked in StateDB and returned by CommitTo or the new Error method. Motivation for this change: We can remove the light client's duplicated copy of core/state. The light client now supports node iteration, so tracing and storage enumeration can work with the light client (not implemented in this commit).
* core, eth, les: support resuming fast sync on heavy rollback (#3743)Péter Szilágyi2017-03-221-2/+2
|
* params: core, core/vm, miner: 64bit gas instructionsJeffrey Wilcke2017-02-141-1/+1
| | | | | | | | | | | | | | | | | Reworked the EVM gas instructions to use 64bit integers rather than arbitrary size big ints. All gas operations, be it additions, multiplications or divisions, are checked and guarded against 64 bit integer overflows. In additon, most of the protocol paramaters in the params package have been converted to uint64 and are now constants rather than variables. * common/math: added overflow check ops * core: vmenv, env renamed to evm * eth, internal/ethapi, les: unmetered eth_call and cancel methods * core/vm: implemented big.Int pool for evm instructions * core/vm: unexported intPool methods & verification methods * core/vm: added memoryGasCost overflow check and test
* Revert "params: core, core/vm, miner: 64bit gas instructions (#3514)"Jeffrey Wilcke2017-02-131-1/+1
| | | | This reverts commit 8b57c494908637a5c0e74f8f7a13b3218e026757.
* params: core, core/vm, miner: 64bit gas instructions (#3514)Jeffrey Wilcke2017-02-021-1/+1
| | | | | | | | | | | | | | | | Reworked the EVM gas instructions to use 64bit integers rather than arbitrary size big ints. All gas operations, be it additions, multiplications or divisions, are checked and guarded against 64 bit integer overflows. In additon, most of the protocol paramaters in the params package have been converted to uint64 and are now constants rather than variables. * common/math: added overflow check ops * core: vmenv, env renamed to evm * eth, internal/ethapi, les: unmetered eth_call and cancel methods * core/vm: implemented big.Int pool for evm instructions * core/vm: unexported intPool methods & verification methods * core/vm: added memoryGasCost overflow check and test
* all: fix ineffectual assignments and remove uses of crypto.Sha3Felix Lange2017-01-091-1/+1
| | | | | go get github.com/gordonklaus/ineffassign ineffassign .
* core/types: remove redundant SignECDSA wrappers, rename to SignTxFelix Lange2017-01-051-1/+1
|
* core/types, params: EIP#155Jeffrey Wilcke2016-11-131-1/+2
|
* core, core/state, trie: EIP158, reprice & skip empty account writeJeffrey Wilcke2016-11-131-1/+1
| | | | | | | | | | | | | | | This commit implements EIP158 part 1, 2, 3 & 4 1. If an account is empty it's no longer written to the trie. An empty account is defined as (balance=0, nonce=0, storage=0, code=0). 2. Delete an empty account if it's touched 3. An empty account is redefined as either non-existent or empty. 4. Zero value calls and zero value suicides no longer consume the 25k reation costs. params: moved core/config to params Signed-off-by: Jeffrey Wilcke <jeffrey@ethereum.org>
* cmd, eth: added light client and light server modeszsfelfoldi2016-11-091-1/+1
|
* eth/downloader: reduce fast sync block requirements, fix testPéter Szilágyi2016-10-311-10/+21
|
* core/state, eth/downloader, trie: reset fast-failure on progressPéter Szilágyi2016-10-311-141/+180
|
* trie, core/state: improve memory usage and performance (#3135)Felix Lange2016-10-151-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * trie: store nodes as pointers This avoids memory copies when unwrapping node interface values. name old time/op new time/op delta Get 388ns ± 8% 215ns ± 2% -44.56% (p=0.000 n=15+15) GetDB 363ns ± 3% 202ns ± 2% -44.21% (p=0.000 n=15+15) UpdateBE 1.57µs ± 2% 1.29µs ± 3% -17.80% (p=0.000 n=13+15) UpdateLE 1.92µs ± 2% 1.61µs ± 2% -16.25% (p=0.000 n=14+14) HashBE 2.16µs ± 6% 2.18µs ± 6% ~ (p=0.436 n=15+15) HashLE 7.43µs ± 3% 7.21µs ± 3% -2.96% (p=0.000 n=15+13) * trie: close temporary databases in GetDB benchmark * trie: don't keep []byte from DB load around Nodes decoded from a DB load kept hashes and values as sub-slices of the DB value. This can be a problem because loading from leveldb often returns []byte with a cap that's larger than necessary, increasing memory usage. * trie: unload old cached nodes * trie, core/state: use cache unloading for account trie * trie: use explicit private flags (fixes Go 1.5 reflection issue). * trie: fixup cachegen overflow at request of nick * core/state: rename journal size constant
* ethereum, ethclient: add SyncProgress API endpointPéter Szilágyi2016-09-061-32/+32
|
* eth, eth/downloader: better remote head trackingPéter Szilágyi2016-07-251-3/+14
|
* eth, eth/downloader, eth/fetcher: delete eth/61 codeFelix Lange2016-07-221-118/+4
| | | | | The eth/61 protocol was disabled in #2776, this commit removes its message handlers and hash-chain sync logic.
* accounts, core, eth: pass chain config for chain maker to test DAOPéter Szilágyi2016-07-151-1/+1
|
* eth/downloader: fix occasional fast sync critical section test failsPéter Szilágyi2016-06-131-1/+3
|
* eth/downloader: adaptive quality of service tuningPéter Szilágyi2016-06-061-4/+54
|
* eth/downloader: make fast sync resilient to critical section failsPéter Szilágyi2016-06-021-12/+58
|
* eth/downloader: ensure cancel channel is closed post syncPéter Szilágyi2016-05-301-1/+11
|
* eth/downloader: stream partial skeleton filling to processorPéter Szilágyi2016-05-171-0/+1
|
* eth/downloader: implement concurrent header downloadsPéter Szilágyi2016-05-171-23/+24
|
* eth/downloader: bound fork ancestry and allow heavy short forksPéter Szilágyi2016-05-131-32/+144
|
* eth: various typosLeif Jurvetson2016-03-161-3/+3
|
* eth/downloader: bump the download queue size to prevent starvationPéter Szilágyi2016-02-231-0/+5
|
* eth, eth/downloader, jsre: surface state sync progress through the APIPéter Szilágyi2016-02-101-16/+16
|
* core, eth/downloader: ensure state presence in ancestor lookupPéter Szilágyi2016-01-041-3/+14
|
* eth/downloader: throttling tests are time-sensitive, don't run parallelPéter Szilágyi2015-12-301-3/+1
|
* eth/downloader: fix negative balance issue in testsFelix Lange2015-12-181-2/+5
| | | | | | | | | | The test chain generated by makeChainFork included invalid uncle headers, crashing the generator during the state commit. The headers were invalid because they used the iteration counter as the block number, even though makeChainFork uses a block with number > 0 as the parent. Fix this by introducing BlockGen.Number, which allows accessing the actual number of the block being generated.
* eth/downloader: run tests in parallelFelix Lange2015-11-191-0/+29
|
* eth/downloader: don't hang for spurious deliveriesFelix Lange2015-11-191-34/+72
| | | | | | | | | | | | | | | | Unexpected deliveries could block indefinitely if they arrived at the right time. The fix is to ensure that the cancellation channel is always closed when the sync ends, unblocking any deliveries. Also remove the atomic check for whether a sync is currently running because it doesn't help and can be misleading. Cancelling always seems to break the tests though. The downloader spawned d.process whenever new data arrived, making it somewhat hard to track when block processing was actually done. Fix this by running d.process in a dedicated goroutine that is tied to the lifecycle of the sync. d.process gets notified of new work by the queue instead of being invoked all the time. This removes a ton of weird workaround code, including a hairy use of atomic CAS.
* core, eth, trie: fix data races and merge/review issuesPéter Szilágyi2015-10-211-210/+254
|
* core, eth: roll back uncertain headers in failed fast syncsPéter Szilágyi2015-10-191-1/+77
|
* eth/downloader: concurrent receipt and state processingPéter Szilágyi2015-10-191-2/+2
|
* core, eth, trie: direct state trie synchronizationPéter Szilágyi2015-10-191-34/+89
|
* core, eth: receipt chain reconstructionPéter Szilágyi2015-10-191-92/+133
|
* eth/downloader: add fast and light sync strategiesPéter Szilágyi2015-10-191-287/+452
|
* eth/downloader: match capabilities when querying idle peersPéter Szilágyi2015-10-021-3/+46
|
* eth/downloader: header-chain order and ancestry checkPéter Szilágyi2015-09-151-4/+61
|
* eth, rpc: standardize the chain sync progress countersPéter Szilágyi2015-09-151-4/+337
|
* core: split out TD from database and all internalsPéter Szilágyi2015-09-111-13/+31
|
* eth: port the synchronisation algo to eth/62Péter Szilágyi2015-08-251-78/+259
|
* eth: kill off protocol eth/60 in preparation for eth/62Péter Szilágyi2015-08-241-378/+2
|
* eth, eth/downloader: don't report stall if fetcher filled the blockPéter Szilágyi2015-07-291-32/+42
|
* all: fix license headers one more timeFelix Lange2015-07-241-1/+1
| | | | I forgot to update one instance of "go-ethereum" in commit 3f047be5a.
* all: update license headers to distiguish GPL/LGPLFelix Lange2015-07-231-4/+4
| | | | | All code outside of cmd/ is licensed as LGPL. The headers now reflect this by calling the whole work "the go-ethereum library".
* eth/downloader: drop peer if advertised TD but won't delvierPéter Szilágyi2015-07-091-99/+36
|
* all: update license informationFelix Lange2015-07-071-0/+16
|
* eth/downloader: fix a rare test race on the OSX CIPéter Szilágyi2015-07-031-1/+7
|
* eth, eth/downloader: transition to eth 61Péter Szilágyi2015-07-011-37/+200
|
* eth, eth/downloader: pass the eth protocol version throughPéter Szilágyi2015-07-011-32/+38
|
* eth/downloader, eth/fetcher: use core.GenerateChain in testsFelix Lange2015-06-301-156/+97
| | | | | | TestMadeupParentBlockChainAttack has been deleted because it was too hard to port and the attack that it checks the prevention of is being averted in a different way (through a protocol change).
* core/types: make blocks immutableFelix Lange2015-06-301-1/+4
|
* eth/fetcher: fix timer reset bug, add initial testsPéter Szilágyi2015-06-181-3/+5
|
* eth/downloader: extend slow test to fix even slower CI server...Péter Szilágyi2015-06-181-1/+1
|
* eth/downloader: always reenter processing if not exitingPéter Szilágyi2015-06-181-16/+15
|
* eth, eth/downloader: fix processing interrupt caused by temp cancelPéter Szilágyi2015-06-181-2/+2
|
* eth/downloader: fix #1280, overlapping (good/bad) delivery hangPéter Szilágyi2015-06-171-0/+34
|
* eth, eth/downloader: do async block fetches, add dl testsPéter Szilágyi2015-06-151-3/+45
|
* eth/downloader: sanity test for multi peer syncsPéter Szilágyi2015-06-151-0/+31
|
* eth, eth/downloader: move block processing into the downlaoderPéter Szilágyi2015-06-151-122/+130
|
* eth/downloader: add valid peer during attacks (check interference)Péter Szilágyi2015-06-151-93/+140
|
* eth/downloader: instreument and test the sync peer dropPéter Szilágyi2015-06-151-4/+57
|
* eth/downloader: support individual peers in the test suitePéter Szilágyi2015-06-151-112/+113
|
* eth/downloader: remove uneeded testing functionsPéter Szilágyi2015-06-151-7/+2
|
* eth, eth/downloader: move peer removal into downloaderPéter Szilágyi2015-06-151-16/+16
|
* eth/downloader: test registration rejection on head banPéter Szilágyi2015-06-081-2/+10
|
* eth/downloader: cap the hash ban set, add test for itPéter Szilágyi2015-06-081-0/+43
|
* eth/downloader: fix throttling test to be less timing dependentPéter Szilágyi2015-06-081-3/+7
|
* eth/downloader: preallocate the block cachePéter Szilágyi2015-06-081-1/+1
|
* eth/downloader: update test for shitty travisPéter Szilágyi2015-06-081-1/+1
|
* eth/downloader: accumulating hash bans for reconnecting attackersPéter Szilágyi2015-06-081-0/+35
|
* eth/downloader: clean up tests and unused variablesPéter Szilágyi2015-06-081-114/+75
|
* eth/downloader: add a basic block download congestion controlPéter Szilágyi2015-06-031-11/+11
|
* eth, eth/downloader: surface downloaded block origin, drop on errorPéter Szilágyi2015-05-261-4/+4
|
* Merge pull request #1064 from karalabe/downloader-attacksJeffrey Wilcke2015-05-221-2/+59
|\ | | | | Fix two additional download vulnerabilities
| * eth, eth/downloader: remove duplicate consts, bump hash fetch to 2KPéter Szilágyi2015-05-211-1/+1
| |
| * eth/downloader: circumvent a forged block chain with known parent attackPéter Szilágyi2015-05-211-1/+35
| |
| * eth/downloader: prevent a peer from dripping bad hashesPéter Szilágyi2015-05-211-1/+24
| |
* | eth/downloader: fix test to it doesn't time out on a slow machinePéter Szilágyi2015-05-201-1/+1
|/
* eth/downloader: fix #992, where tests may time out on a slow machinePéter Szilágyi2015-05-161-0/+6
|
* eth/downloader: circumvent a fake blockchain attackPéter Szilágyi2015-05-151-15/+49
|
* eth, eth/downloader: detect and handle madeup hash attacksPéter Szilágyi2015-05-151-6/+39
|
* eth/downloader: circumvent hash reordering attacksPéter Szilágyi2015-05-151-28/+62
|
* eth/downloader: check sync after failed attacksPéter Szilágyi2015-05-151-6/+18
|
* eth/downloader: add a test for detecting missing blocksPéter Szilágyi2015-05-151-5/+23
|
* eth, eth/downloader: prevent hash repeater attackPéter Szilágyi2015-05-151-0/+29
|
* eth/downloader: fixed testobscuren2015-05-151-1/+3
|
* eth/downloader: add a small additional check to the testPéter Szilágyi2015-05-141-0/+3
|
* eth, eth/downloader: remove parent verification from the downlaoderPéter Szilágyi2015-05-141-17/+9
|
* eth, eth/downloader: handle a potential unknown parent attackPéter Szilágyi2015-05-141-17/+83
|
* eth/downloader: fix active peer shadowing, polish func namesPéter Szilágyi2015-05-131-4/+4
|
* eth/downloader: fix #910, thread safe peers & polishesPéter Szilágyi2015-05-111-1/+2
|
* eth: added a cancel method for the downloaderobscuren2015-05-101-0/+43
| | | | | | | | | Added a cancel method to the downloader which gracefully shuts down any active syncing process (hash fetching or block downloading) and resets the queue and remove any pending blocks. Issue with the downloader which would stall because of an active ongoing process when an invalid block was found.
* eth, eth/downloader: handle sync errors a bit more gracefullyPéter Szilágyi2015-05-081-3/+3
|
* eth, eth/downloader: make synchronize thread safePéter Szilágyi2015-05-081-1/+1
|
* eth/downloader: fix priority queue reset, add throttling testPéter Szilágyi2015-05-071-0/+48
|
* eth/downloader: prioritize block fetch based on chain position, cap memory usePéter Szilágyi2015-05-071-2/+2
|
* downloader: hash downloading recoveryobscuren2015-05-031-10/+17
| | | | | | If a peer fails to respond (disconnect, etc) during hash downloading switch to a different peer which has it's current_hash in the queue's peer set.
* eth/downloader: added additional testsobscuren2015-05-031-4/+11
|
* eth, eth/downloader: Moved block processing & graceful shutdownobscuren2015-05-011-20/+35
| | | | | | | The downloader is no longer responsible for processing blocks. The eth-protocol handler now takes care of this instead. Added graceful shutdown during block processing. Closes #846
* core: fixed tetst to reflect (int, error) return by insertChainobscuren2015-04-291-2/+2
|
* eth/downloader: fixed testsobscuren2015-04-241-12/+8
|
* eth, eth/downloader: don't require td on downloader. Fixed testsobscuren2015-04-241-17/+17
|
* downloader: fixed tests with low ttlobscuren2015-04-191-0/+1
|
* downloader: moved chunk ignoring. Fixes issue with catching upobscuren2015-04-191-2/+4
|
* downloader: added missing blocks catchup functionalityobscuren2015-04-131-5/+32
| | | | | When a parent is missing in the block list an attempt should be made to fetch the missing parent and grandparents.
* downloader: implemented new downloaderobscuren2015-04-121-0/+128