aboutsummaryrefslogtreecommitdiffstats
path: root/swarm/storage
Commit message (Collapse)AuthorAgeFilesLines
* Change import go github.com/dexon-foundation/dexonWei-Ning Huang2019-06-1257-130/+130
|
* swarm/storage/netstore: add fetcher cancellation on shutdown (#19049)Elad2019-02-191-1/+19
| | | | | | | swarm/network/stream: remove netstore internal wg swarm/network/stream: run individual tests with t.Run (cherry picked from commit 3ee09ba03511ad9a49e37c58f0c35b9c9771dd6f)
* swarm/storage: fix influxdb gc metrics report (#19102)Elad2019-02-191-5/+3
| | | | (cherry picked from commit 5b8ae7885eaa033aaf1fb1d5959b7f1c86761d6d)
* swarm: fix network/stream data races (#19051)Janoš Guljaš2019-02-191-1/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * swarm/network/stream: newStreamerTester cleanup only if err is nil * swarm/network/stream: raise newStreamerTester waitForPeers timeout * swarm/network/stream: fix data races in GetPeerSubscriptions * swarm/storage: prevent data race on LDBStore.batchesC https://github.com/ethersphere/go-ethereum/issues/1198#issuecomment-461775049 * swarm/network/stream: fix TestGetSubscriptionsRPC data race https://github.com/ethersphere/go-ethereum/issues/1198#issuecomment-461768477 * swarm/network/stream: correctly use Simulation.Run callback https://github.com/ethersphere/go-ethereum/issues/1198#issuecomment-461783804 * swarm/network: protect addrCountC in Kademlia.AddrCountC function https://github.com/ethersphere/go-ethereum/issues/1198#issuecomment-462273444 * p2p/simulations: fix a deadlock calling getRandomNode with lock https://github.com/ethersphere/go-ethereum/issues/1198#issuecomment-462317407 * swarm/network/stream: terminate disconnect goruotines in tests * swarm/network/stream: reduce memory consumption when testing data races * swarm/network/stream: add watchDisconnections helper function * swarm/network/stream: add concurrent counter for tests * swarm/network/stream: rename race/norace test files and use const * swarm/network/stream: remove watchSim and its panic * swarm/network/stream: pass context in watchDisconnections * swarm/network/stream: add concurrent safe bool for watchDisconnections * swarm/storage: fix LDBStore.batchesC data race by not closing it (cherry picked from commit 3fd6db2bf63ce90232de445c7f33943406a5e634)
* swarm/storage: fix HashExplore concurrency bug ethersphere#1211 (#19028)holisticode2019-02-191-9/+17
| | | | | | | | | | | | | | * swarm/storage: fix HashExplore concurrency bug ethersphere#1211 * swarm/storage: lock as value not pointer * swarm/storage: wait for to complete * swarm/storage: fix linter problems * swarm/storage: append to nil slice (cherry picked from commit 3d22a46c94f1d842dbada665b36a453362adda74)
* swarm: CI race detector test adjustments (#19017)Ferenc Szabo2019-02-193-80/+56
| | | | (cherry picked from commit 27e3f968194e2723279b60f71c79d4da9fc7577f)
* swarm/network, swarm/storage: Preserve opentracing contexts (#19022)lash2019-02-194-17/+23
| | | | (cherry picked from commit 0c10d376066cb7e57d3bfc03f950c7750cd90640)
* swarm/storage: fix test timeout with -race by increasing mget timeoutFerenc Szabo2019-02-191-2/+3
| | | | (cherry picked from commit 1c3aa8d9b12d6104ccddecc1711bc6be2f5b269d)
* swarm/storage/localstore: new localstore package (#19015)Janoš Guljaš2019-02-1917-0/+4244
| | | | (cherry picked from commit 4f3d22f06c546f36487b33dfb6b5cb4df3ecf073)
* swarm: Debug API and HasChunks() API endpoint (#18980)holisticode2019-02-197-1/+80
| | | | (cherry picked from commit 41597c2856d6ac7328baca1340c3e36ab0edd382)
* cmd/swarm: hashes command (#19008)holisticode2019-02-192-14/+10
| | | | (cherry picked from commit 7f55b0cbd8618a1b0de8d7e37d2b0143ebae4abf)
* swarm/storage: Get all chunk references for a given file (#19002)holisticode2019-02-192-0/+76
| | | | (cherry picked from commit 3eff652a7b606f25d43bef6ccb998b8e306f8a75)
* swarm: bootnode-mode, new bootnodes and no p2p package discovery (#18498)Anton Evangelatov2019-02-191-7/+0
| | | | (cherry picked from commit bbd120354a8d226b446591eeda9f9462cb9b690a)
* swarm/storage: fix mockNetFetcher data races (#18462)Janoš Guljaš2019-02-191-0/+4
| | | | | fixes: ethersphere/go-ethereum#1117 (cherry picked from commit f728837ee6b48a2413437f54057b4552b7e77494)
* swarm: Fix T.Fatal inside a goroutine in tests (#18409)Janoš Guljaš2019-01-091-39/+83
| | | | | | | | | | | | * swarm/storage: fix T.Fatal inside a goroutine * swarm/network/simulation: fix T.Fatal inside a goroutine * swarm/network/stream: fix T.Fatal inside a goroutine * swarm/network/simulation: consistent failures in TestPeerEventsTimeout * swarm/network/simulation: rename sendRunSignal to triggerSimulationRun
* swarm/storage/mock/test: fix T.Fatal inside a goroutine (#18399)Janoš Guljaš2019-01-071-3/+8
|
* vendor, crypto, swarm: switch over to upstream sha3 packageDave McGregor2019-01-044-10/+10
|
* swarm/storage: change Proximity function and add TestProximity test (#18379)Janoš Guljaš2019-01-032-3/+186
|
* swarm: remove unused/dead code (#18351)Anton Evangelatov2018-12-248-124/+6
|
* swarm/storage: remove unused methods from Chunk interface (#18283)Javier Peletier2018-12-183-21/+4
|
* swarm/storage/feed: remove unused code (#18324)Anton Evangelatov2018-12-173-30/+4
|
* swarm/storage: simplify ChunkValidator interface (#18285)Javier Peletier2018-12-127-18/+20
|
* cmd/swarm, metrics, swarm/api/client, swarm/storage, swarm/metrics, ↵Elad2018-12-111-0/+8
| | | | swarm/api/http: add instrumentation (#18274)
* swarm: add database abstractions (shed package) (#18183)Janoš Guljaš2018-11-275-0/+89
|
* swarm/storage: move 'running migrations for' log line (#18120)Ferenc Szabo2018-11-201-3/+4
| | | So that we only see the log message when we actually have to migrate.
* swarm/storage: speed up garbage collection and rpc tests (#18128)Anton Evangelatov2018-11-192-5/+6
|
* swarm/storage: Batched database migration (#18113)lash2018-11-152-28/+127
|
* cmd/swarm, swarm/api/http, swarm/bmt, swarm/fuse, swarm/network/stream, ↵Alexey Sharov2018-11-145-43/+30
| | | | | | swarm/storage, swarm/storage/encryption, swarm/testutil: use pseudo-random instead of crypto-random for test files content generation (#18083) - Replace "crypto/rand" to "math/rand" for files content generation - Remove swarm/network_test.go.Shuffle and swarm/btm/btm_test.go.Shuffle - because go1.9 support dropped (see https://github.com/ethereum/go-ethereum/pull/17807 and comments to swarm/network_test.go.Shuffle)
* swarm/storage: fix garbage collector index skew (#18080)Ferenc Szabo2018-11-134-54/+268
| | | | | | | | | | | | | On file access LDBStore's tryAccessIdx() function created a faulty GC Index Data entry, because not indexing the ikey correctly. That caused the chunk addresses/hashes to start with '00' and the last two digits were dropped. => Incorrect chunk address. Besides the fix, the commit also contains a schema change which will run the CleanGCIndex() function to clean the GC index from erroneous entries. Note: CleanGCIndex() rebuilds the index from scratch which can take a really-really long time with a huge DB (possibly an hour).
* swarm/storage: fix access count on dbstore after cache hit (#17978)Ferenc Szabo2018-11-134-17/+138
| | | | | | | Access count was not incremented when chunk was retrieved from cache. So the garbage collector might have deleted the most frequently accessed chunk from disk. Co-authored-by: Ferenc Szabo <ferenc.szabo@ethereum.org>
* swarm, cmd/swarm: address ineffectual assignments (#18048)Anton Evangelatov2018-11-081-4/+1
| | | | | | | | * swarm, cmd/swarm: address ineffectual assignments * swarm/network: remove unused vars from testHandshake * swarm/storage/feed: revert cursor changes
* swarm: clean up unused private types and functions (#17989)Ferenc Szabo2018-10-274-44/+13
| | | | | | | | | | | * swarm: clean up unused private types and functions Those that were identified by code inspection tool. * swarm/storage: move/add Proximity GoDoc from deleted private function The mentioned proximity() private function was deleted in: 1ca8fc1e6fa0ab4ab1aaca06d6fb32e173cd5f2f
* swarm/storage: Add accessCnt for GC (#17845)lash2018-10-122-143/+358
|
* swarm, swarm/storage: lower constants for faster tests (#17876)Anton Evangelatov2018-10-094-16/+13
| | | | | | | | * swarm/storage: lower constants for faster tests * swarm: reduce test size for TestLocalStoreAndRetrieve * swarm: reduce nodes for dec_inc_node_count
* swarm/storage/feed: Expose MaxUpdateDataLength constant (#17858)Javier Peletier2018-10-082-4/+6
|
* swarm/storage: extract isValid. correctly remove invalid chunks from store ↵Anton Evangelatov2018-10-041-21/+21
| | | | on migration (#17835)
* Merge pull request #17796 from epiclabs-io/mru-feedsViktor Trón2018-10-0328-385/+379
|\ | | | | swarm/storage/feeds: Renamed MRU to Swarm Feeds
| * swarm/storage/feed: Renamed packageJavier Peletier2018-10-0326-31/+31
| |
| * swarm/storage/feeds: renamed vars that can conflict with package nameJavier Peletier2018-10-032-13/+13
| |
| * swarm/storage/feeds: removed capital Feed throughoutJavier Peletier2018-10-0310-31/+31
| |
| * swarm/storage/feeds: Final package rename and moved filesJavier Peletier2018-10-0326-51/+51
| |
| * swarm/storage/mru: Renamed rest of MRU referencesJavier Peletier2018-10-036-11/+11
| |
| * swarm/storage/mru: Renamed all comments to FeedsJavier Peletier2018-10-0314-102/+96
| |
| * swarm/storage/mru: Renamed all identifiers to FeedsJavier Peletier2018-10-0316-214/+214
| |
* | swarm: schemas and migrations (#17813)Anton Evangelatov2018-10-034-11/+76
|/
* swarm/storage: ensure 64bit hasherStore struct alignment (#17766)Janoš Guljaš2018-09-291-1/+4
|
* swarm/storage: make linter happyAnton Evangelatov2018-09-283-7/+5
|
* Swarm MRUs: Adaptive frequency / Predictable lookups / API simplification ↵Javier Peletier2018-09-2833-2562/+2648
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (#17559) * swarm/storage/mru: Adaptive Frequency swarm/storage/mru/lookup: fixed getBaseTime Added NewEpoch constructor swarm/api/client: better error handling in GetResource() swarm/storage/mru: Renamed structures. Renamed ResourceMetadata to ResourceID. Renamed ResourceID.Name to ResourceID.Topic swarm/storage/mru: Added binarySerializer interface and test tools swarm/storage/mru/lookup: Changed base time to time and + marshallers swarm/storage/mru: Added ResourceID (former resourceMetadata) swarm/storage/mru: Added ResourceViewId and serialization tests swarm/storage/mru/lookup: fixed epoch unmarshaller. Added Epoch Equals swarm/storage/mru: Fixes as per review comments cmd/swarm: reworded resource create/update help text regarding topic swarm/storage/mru: Added UpdateLookup and serializer tests swarm/storage/mru: Added UpdateHeader, serializers and tests swarm/storage/mru: changed UpdateAddr / epoch to Base() swarm/storage/mru: Added resourceUpdate serializer and tests swarm/storage/mru: Added SignedResourceUpdate tests and serializers swarm/storage/mru/lookup: fixed GetFirstEpoch bug swarm/storage/mru: refactor, comments, cleanup Also added tests for Topic swarm/storage/mru: handler tests pass swarm/storage/mru: all resource package tests pass swarm/storage/mru: resource test pass after adding timestamp checking support swarm/storage/mru: Added JSON serializers to ResourceIDView structures swarm/storage/mru: Sever, client, API test pass swarm/storage/mru: server test pass swarm/storage/mru: Added topic length check swarm/storage/mru: removed some literals, improved "previous lookup" test case swarm/storage/mru: some fixes and comments as per review swarm/storage/mru: first working version without metadata chunk swarm/storage/mru: Various fixes as per review swarm/storage/mru: client test pass swarm/storage/mru: resource query strings and manifest-less queries swarm/storage/mru: simplify naming swarm/storage/mru: first autofreq working version swarm/storage/mru: renamed ToValues to AppendValues swarm/resource/mru: Added ToValues / FromValues for URL query strings swarm/storage/mru: Changed POST resource to work with query strings. No more JSON. swarm/storage/mru: removed resourceid swarm/storage/mru: Opened up structures swarm/storage/mru: Merged Request and SignedResourceUpdate swarm/storage/mru: removed initial data from CLI resource create swarm/storage/mru: Refactor Topic as a direct fixed-length array swarm/storage/mru/lookup: Comprehensive GetNextLevel tests swarm/storage/mru: Added comments Added length checks in Topic swarm/storage/mru: fixes in tests and some code comments swarm/storage/mru/lookup: new optimized lookup algorithm swarm/api: moved getResourceView to api out of server swarm/storage/mru: Lookup algorithm working swarm/storage/mru: comments and renamed NewLookupParams Deleted commented code swarm/storage/mru/lookup: renamed Epoch.LaterThan to After swarm/storage/mru/lookup: Comments and tidying naming swarm/storage/mru: fix lookup algorithm swarm/storage/mru: exposed lookup hint removed updateheader swarm/storage/mru/lookup: changed GetNextEpoch for initial values swarm/storage/mru: resource tests pass swarm/storage/mru: valueSerializer interface and tests swarm/storage/mru/lookup: Comments, improvements, fixes, more tests swarm/storage/mru: renamed UpdateLookup to ID, LookupParams to Query swarm/storage/mru: renamed query receiver var swarm/cmd: MRU CLI tests * cmd/swarm: remove rogue fmt * swarm/storage/mru: Add version / header for future use * swarm/storage/mru: Fixes/comments as per review cmd/swarm: remove rogue fmt swarm/storage/mru: Add version / header for future use- * swarm/storage/mru: fix linter errors * cmd/swarm: Speeded up TestCLIResourceUpdate
* swarm: prevent forever running retrieve request loopsBalint Gabor2018-09-263-5/+15
|
* all: new p2p node representation (#17643)Felix Lange2018-09-253-16/+14
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Package p2p/enode provides a generalized representation of p2p nodes which can contain arbitrary information in key/value pairs. It is also the new home for the node database. The "v4" identity scheme is also moved here from p2p/enr to remove the dependency on Ethereum crypto from that package. Record signature handling is changed significantly. The identity scheme registry is removed and acceptable schemes must be passed to any method that needs identity. This means records must now be validated explicitly after decoding. The enode API is designed to make signature handling easy and safe: most APIs around the codebase work with enode.Node, which is a wrapper around a valid record. Going from enr.Record to enode.Node requires a valid signature. * p2p/discover: port to p2p/enode This ports the discovery code to the new node representation in p2p/enode. The wire protocol is unchanged, this can be considered a refactoring change. The Kademlia table can now deal with nodes using an arbitrary identity scheme. This requires a few incompatible API changes: - Table.Lookup is not available anymore. It used to take a public key as argument because v4 protocol requires one. Its replacement is LookupRandom. - Table.Resolve takes *enode.Node instead of NodeID. This is also for v4 protocol compatibility because nodes cannot be looked up by ID alone. - Types Node and NodeID are gone. Further commits in the series will be fixes all over the the codebase to deal with those removals. * p2p: port to p2p/enode and discovery changes This adapts package p2p to the changes in p2p/discover. All uses of discover.Node and discover.NodeID are replaced by their equivalents from p2p/enode. New API is added to retrieve the enode.Node instance of a peer. The behavior of Server.Self with discovery disabled is improved. It now tries much harder to report a working IP address, falling back to 127.0.0.1 if no suitable address can be determined through other means. These changes were needed for tests of other packages later in the series. * p2p/simulations, p2p/testing: port to p2p/enode No surprises here, mostly replacements of discover.Node, discover.NodeID with their new equivalents. The 'interesting' API changes are: - testing.ProtocolSession tracks complete nodes, not just their IDs. - adapters.NodeConfig has a new method to create a complete node. These changes were needed to make swarm tests work. Note that the NodeID change makes the code incompatible with old simulation snapshots. * whisper/whisperv5, whisper/whisperv6: port to p2p/enode This port was easy because whisper uses []byte for node IDs and URL strings in the API. * eth: port to p2p/enode Again, easy to port because eth uses strings for node IDs and doesn't care about node information in any way. * les: port to p2p/enode Apart from replacing discover.NodeID with enode.ID, most changes are in the server pool code. It now deals with complete nodes instead of (Pubkey, IP, Port) triples. The database format is unchanged for now, but we should probably change it to use the node database later. * node: port to p2p/enode This change simply replaces discover.Node and discover.NodeID with their new equivalents. * swarm/network: port to p2p/enode Swarm has its own node address representation, BzzAddr, containing both an overlay address (the hash of a secp256k1 public key) and an underlay address (enode:// URL). There are no changes to the BzzAddr format in this commit, but certain operations such as creating a BzzAddr from a node ID are now impossible because node IDs aren't public keys anymore. Most swarm-related changes in the series remove uses of NewAddrFromNodeID, replacing it with NewAddr which takes a complete node as argument. ToOverlayAddr is removed because we can just use the node ID directly.
* swarm/storage: Implement global timeout for fetcher (#17702)Balint Gabor2018-09-191-1/+3
|
* all: simplify s[:] to s where s is a slice (#17673)Emil2018-09-153-7/+7
|
* swarm: Chunk refactor (#17659)Balint Gabor2018-09-1327-1322/+1765
| | | | | | Co-authored-by: Janos Guljas <janos@resenje.org> Co-authored-by: Balint Gabor <balint.g@gmail.com> Co-authored-by: Anton Evangelatov <anton.evangelatov@gmail.com> Co-authored-by: Viktor Trón <viktor.tron@gmail.com>
* swarm/storage: remove redundant increments for dataIdx and entryCnt (#17484)Anton Evangelatov2018-09-122-31/+35
| | | | | | | | * swarm/storage: remove redundant increments for dataIdx and entryCnt * swarm/storage: add Delete to LDBStore * swarm/storage: wait for garbage collection
* Encryption async api (#17603)Viktor Trón2018-09-113-115/+158
| | | | | | | | | | * swarm/storage/encryption: async segmentwise encryption/decryption * swarm/storage: adapt hasherstore to encryption API change * swarm/api: adapt RefEncryption for AC to new Encryption API * swarm/storage/encryption: address review comments
* swarm/storage: added metrics for db entry count (#17589)Elad2018-09-061-0/+6
|
* swarm/storage: cleanup task - remove bigger chunks (#17424)Anton Evangelatov2018-08-201-22/+45
|
* swarm/network, swarm/storage: validate chunk size (#17397)Anton Evangelatov2018-08-1411-57/+49
| | | | | | | | | | | | | | | | | | * swarm/network, swarm/storage: validate default chunk size * swarm/bmt, swarm/network, swarm/storage: update BMT hash initialisation * swarm/bmt: move segmentCount to tests * swarm/chunk: change chunk.DefaultSize to be untyped const * swarm/storage: add size validator * swarm/storage: add chunk size validation to localstore * swarm/storage: move validation from localstore to validator * swarm/storage: global chunk rules in MRU
* swarm/storage/mru: HOTFIX - fix panic in Handler.update (#17313)Javier Peletier2018-08-071-1/+1
|
* swarm/storage/mru: Client-side MRU signatures (#784)Javier Peletier2018-07-2319-1348/+2805
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * swarm/storage/mru: Add embedded publickey and remove ENS dep This commit breaks swarm, swarm/api... but tests in swarm/storage/mru pass * swarm: Refactor swarm, swarm/api to mru changes, make tests pass * swarm/storage/mru: Remove self from recv, remove test ens vldtr * swarm/storage/mru: Remove redundant test, expose ResourceHash mthd * swarm/storage/mru: Make HeaderGetter mandatory + godoc fixes * swarm/storage: Remove validator prefix for metadata chunk * swarm/storage/mru: Use Address instead of PublicKey * swarm/storage/mru: Change index from name to metadata chunk addr * swarm/storage/mru: Refactor swarm/api/... to MRU index changes * swarm/storage/mru: Refactor cleanup * swarm/storage/mru: Rebase cleanup * swarm: Use constructor for GenericSigner MRU in swarm.go * swarm/storage: Change to BMTHash for MRU hashing * swarm/storage: Reduce loglevel on chunk validator logs * swarm/storage/mru: Delint * swarm: MRU Rebase cleanup * swarm/storage/mru: client-side mru signatures Rebase to PR #668 and fix all conflicts * swarm/storage/mru: refactor and documentation * swarm/resource/mru: error-checking tests for parseUpdate/newUpdateChunk * swarm/storage/mru: Added resourcemetadata tests * swarm/storage/mru: Added tests for UpdateRequest * swarm/storage/mru: more test coverage for UpdateRequest and comments * swarm/storage/mru: Avoid fake chunks in parseUpdate() * swarm/storage/mru: Documented resource.go extensively moved some functions where they make most sense * swarm/storage/mru: increase test coverage for UpdateRequest and variable name changes throughout to increase consistency * swarm/storage/mru: moved default timestamp to NewCreateRequest- * swarm/storage/mru: lookup refactor * swarm/storage/mru: added comments and renamed raw flag to rawmru * swarm/storage/mru: fix receiver typo * swarm/storage/mru: refactored update chunk new/create * swarm/storage/mru: refactored signature digest to avoid malleability * swarm/storage/mru: optimize update data serialization * swarm/storage/mru: refactor and cleanup * swarm/storage/mru: add timestamp struct and serialization * swarm/storage/mru: fix lint error and mark some old code for deletion * swarm/storage/mru: remove unnecessary variable * swarm/storage/mru: Added more comments throughout * swarm/storage/mru: Refactored metadata chunk layout + extensive error... * swarm/storage/mru: refactor cli parser Changed resource info output to JSON * swarm/storage/mru: refactor serialization for extensibility refactored error messages to NewErrorf * swarm/storage/mru: Moved Signature to resource_sign. Check Sign errors in server tests * swarm/storage/mru: Remove isSafeName() checks * swarm/storage/mru: scrubbed off all references to "block" for time * swarm/storage/mru: removed superfluous isSynced() call. * swarm/storage/mru: remove isMultihash() and ToSafeName functions * swarm/storage/mru: various fixes and comments * swarm/storage/mru: decoupled cli for independent create/update * Made resource name optional * Removed unused LookupPrevious * swarm/storage/mru: Decoupled resource create / update & refactor * swarm/storage/mru: Fixed some comments as per issues raised in PR #743 * swarm/storage/mru: Cosmetic changes as per #743 comments * swarm/storage/mru: refct request encoder/decoder > marshal/unmarshal * swarm/storage/mru: Cosmetic changes as per review in #748 * swarm/storage/mru: removed timestamp proof placeholder * swarm/storage/mru: cosmetic/doc/fixes changes as per comments in #704 * swarm/storage/mru: removed unnecessary check in Handler.update * swarm/storage/mru: Implemented Marshaler/Unmarshaler iface in Request * swarm/storage/mru: Fixed linter error * swarm/storage/mru: removed redundant address in signature digest * swarm/storage/mru: fixed bug: LookupLatestVersionInPeriod not working * swarm/storage/mru: Unfold Request creation API for create or update+create set common time source for mru package * swarm/api/http: fix HandleGetResource error variable shadowed when requesting a resource that does not exist * swarm/storage/mru: Add simple check to detect duplicate updates * swarm/storage/mru: moved Multihash() to the right place. * cmd/swarm: remove unneeded clientaccountmanager.go * swarm/storage/mru: Changed some comments as per reviews in #784 * swarm/storage/mru: Made SignedResourceUpdate.GetDigest() public * swarm/storage/mru: cosmetic changes as per comments in #784 * cmd/swarm: Inverted --multihash flag default * swarm/storage/mru: removed Verify from SignedResourceUpdate.fromChunk * swarm/storage/mru: Moved validation code out of serializer Cosmetic / comment changes * swarm/storage/mru: Added unit tests for UpdateLookup * swarm/storage/mru: Increased coverage of metadata serialization * swarm/storage/mru: Increased test coverage of updateHeader serializers * swarm/storage/mru: Add resourceUpdate serializer test
* swarm: integrate OpenTracing; propagate ctx to internal APIs (#17169)Anton Evangelatov2018-07-1319-105/+179
| | | | | | * swarm: propagate ctx, enable opentracing * swarm/tracing: log error when tracing is misconfigured
* swarm: ctx propagation; bmt fixes; pss generic notification framework (#17150)Anton Evangelatov2018-07-099-52/+94
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * cmd/swarm: minor cli flag text adjustments * swarm/api/http: sticky footer for swarm landing page using flex * swarm/api/http: sticky footer for error pages and fix for multiple choices * cmd/swarm, swarm/storage, swarm: fix mingw on windows test issues * cmd/swarm: update description of swarm cmd * swarm: added network ID test * cmd/swarm: support for smoke tests on the production swarm cluster * cmd/swarm/swarm-smoke: simplify cluster logic as per suggestion * swarm: propagate ctx to internal apis (#754) * swarm/metrics: collect disk measurements * swarm/bmt: fix io.Writer interface * Write now tolerates arbitrary variable buffers * added variable buffer tests * Write loop and finalise optimisation * refactor / rename * add tests for empty input * swarm/pss: (UPDATE) Generic notifications package (#744) swarm/pss: Generic package for creating pss notification svcs * swarm: Adding context to more functions * swarm/api: change colour of landing page in templates * swarm/api: change landing page to react to enter keypress
* swarm: network rewrite mergeethersphere2018-06-2240-2407/+7099
|
* build: enable goimports and varcheck linters (#16446)thomasmodeneis2018-04-182-6/+0
|
* compression/rle: delete RLE compression (#16468)Felix Lange2018-04-091-13/+2
|
* swarm/storage: disable treechunker test while it is flaky (#16254)Anton Evangelatov2018-03-061-1/+1
|
* swarm: initial instrumentation (#15969)Anton Evangelatov2018-02-234-0/+53
| | | | | | | | | | | | | | | | | | * swarm: initial instrumentation with go-metrics * swarm: initialise metrics collection and add ResettingTimer to HTTP requests * swarm: update metrics flags names. remove redundant Timer. * swarm: rename method for periodically updating gauges * swarm: finalise metrics after feedback * swarm/network: always init kad metrics containers * swarm/network: off-by-one index in metrics containers * swarm, metrics: resolved conflicts
* various: remove redundant parentheses (#15793)Furkan KAMACI2018-01-032-5/+5
|
* all: use gometalinter.v2, fix new gosimple issues (#15650)Zach2017-12-132-10/+10
|
* cmd/swarm: add config file (#15548)holisticode2017-12-121-2/+8
| | | | | | | | | | | | | | | | | This commit adds a TOML configuration option to swarm. It reuses the TOML configuration structure used in geth with swarm customized items. The commit: * Adds a "dumpconfig" command to the swarm executable which allows printing the (default) configuration to stdout, which then can be redirected to a file in order to customize it. * Adds a "--config <file>" option to the swarm executable which will allow to load a configuration file in TOML format from the specified location in order to initialize the Swarm node The override priorities are like follows: environment variables override command line arguments override config file override default config.
* build: enable unconvert linter (#15456)ferhat elmas2017-11-113-5/+5
| | | | | | | | | * build: enable unconvert linter - fixes #15453 - update code base for failing cases * cmd/puppeth: replace syscall.Stdin with os.Stdin.Fd() for unconvert linter
* all: gofmt -w -s (#15419)ferhat elmas2017-11-082-11/+8
|
* core, swarm: typo fixesferhat elmas2017-10-301-2/+2
|
* swarm/storage: pyramid chunker re-write (#14382)Zahoor Mohamed2017-09-2210-233/+1005
|
* bmt: Binary Merkle Tree Hash (#14334)Viktor Trón2017-09-052-1/+3
| | | | | | bmt is a new package that provides hashers for binary merkle tree hashes on size-limited chunks. the main motivation is that using BMT hash as the chunk hash of the swarm hash offers logsize inclusion proofs for arbitrary files on a 32-byte resolution completely viable to use in challenges on the blockchain.
* swarm: fix megacheck warningsEgon Elbre2017-08-148-59/+13
|
* cmd/swarm: support exporting, importing chunk db (#14868)Lewis Marshall2017-07-311-0/+82
|
* swarm/storage: remove panic on invalid chunkaron2017-06-251-1/+1
|
* all: blidly swap out glog to our log15, logs need reworkPéter Szilágyi2017-02-235-40/+38
|
* swarm/network: fix chunk integrity checks (#3665)Viktor Trón2017-02-132-9/+59
| | | | | | | | | | * swarm/network: integrity on incoming known chunks * swarm/network: fix integrity check for incoming chunks * swarm/storage: imrpoved integrity checking on chunks * dbstore panics on corrupt chunk entry an prompts user to run cleandb * memstore adds logging for garbage collection * dbstore refactor item delete. correct partial deletes in Get * cmd/swarm: added cleandb subcommand
* swarm/storage: release chunk storage after stop swarm (#3651)Maksim2017-02-097-4/+25
| | | closes #3650
* all: fix ineffectual assignments and remove uses of crypto.Sha3Felix Lange2017-01-093-5/+4
| | | | | go get github.com/gordonklaus/ineffassign ineffassign .
* all: fix spelling errorsPéter Szilágyi2017-01-072-2/+2
|
* all: fix issues reported by honnef.co/go/simple/cmd/gosimpleFelix Lange2017-01-072-2/+2
|
* all: gofmt -w -sFelix Lange2017-01-061-2/+2
|
* swarm/storage: call size before seek-from-end (#3469)Aron Fischer2016-12-221-2/+5
|
* internal/debug, internal/ethapi, rpc, swarm/storage: Ran "go fmt"Kenji Siu2016-11-011-1/+0
|
* swarm/storage: Allow EOF at the end of the reader in the chunker. Handle the ↵Daniel A. Nagy2016-10-141-5/+8
| | | | case when Read returns less than length of target slice
* swarm/storage: fix chunker when reader is brokenaron2016-10-114-101/+89
| | | | | | | | * brokenLimitedReader gives error after half size * TestRandomBrokenData tests chunker with broken reader * add blocking quitC (instead of errC) and use errC only for errors * don't close chunkC in tester Split, * use quitC to quit chunk storage loop
* swarm: plan bee for content storage and distribution on web3ΞTHΞЯSPHΞЯΞ2016-08-3114-0/+3092
This change imports the Swarm protocol codebase. Compared to the 'swarm' branch, a few mostly cosmetic changes had to be made: * The various redundant log message prefixes are gone. * All files now have LGPLv3 license headers. * Minor code changes were needed to please go vet and make the tests pass on Windows. * Further changes were required to adapt to the go-ethereum develop branch and its new Go APIs. Some code has not (yet) been brought over: * swarm/cmd/bzzhash: will reappear as cmd/bzzhash later * swarm/cmd/bzzup.sh: will be reimplemented in cmd/bzzup * swarm/cmd/makegenesis: will reappear somehow * swarm/examples/album: will move to a separate repository * swarm/examples/filemanager: ditto * swarm/examples/files: will not be merged * swarm/test/*: will not be merged * swarm/services/swear: will reappear as contracts/swear when needed
generated by cgit v1.2.3 (git 2.25.1) at 2024-08-26 18:24:42 +0800