0c10d37606
swarm/network, swarm/storage: Preserve opentracing contexts ( #19022 )
2019-02-08 16:57:48 +01:00
4f3d22f06c
swarm/storage/localstore: new localstore package ( #19015 )
2019-02-07 18:40:26 +01:00
41597c2856
swarm: Debug API and HasChunks() API endpoint ( #18980 )
2019-02-07 15:49:19 +01:00
33d0a0efa6
cmd/swarm/global-store: global store cmd ( #19014 )
2019-02-07 15:46:58 +01:00
7f55b0cbd8
cmd/swarm: hashes command ( #19008 )
2019-02-07 13:51:24 +01:00
53b823afc8
contracts/*: golint updates for this or self warning
2019-02-07 13:15:14 +02:00
3eff652a7b
swarm/storage: Get all chunk references for a given file ( #19002 )
2019-02-06 12:16:43 +01:00
7c60d0a6a2
swarm/pss: Remove pss service leak in test ( #18992 )
2019-02-05 14:35:20 +01:00
1c3aa8d9b1
swarm/storage: fix test timeout with -race by increasing mget timeout
2019-02-05 14:34:34 +01:00
597597e8b2
swarm/network: refactor simulation tests bootstrap ( #18975 )
2019-02-01 09:58:46 +01:00
43e1b7b124
swarm: GetPeerSubscriptions RPC ( #18972 )
2019-01-30 21:03:08 +01:00
592bf6a59c
swarm: fix flaky delivery tests ( #18971 )
2019-01-30 14:03:11 +01:00
f9401ae011
swarm/network: Remove extra random peer, connect test sanity, comments ( #18964 )
2019-01-30 09:49:58 +01:00
f4094d09cd
params, swarm/version: Geth v1.9.0 unstable, Swarm v0.3.11-unstable
2019-01-29 17:43:13 +01:00
21acf0bc8d
cmd/utils: allow for multiple influxdb tags ( #18520 )
...
This PR is replacing the metrics.influxdb.host.tag cmd-line flag with metrics.influxdb.tags - a comma-separated key/value tags, that are passed to the InfluxDB reporter, so that we can index measurements with multiple tags, and not just one host tag.
This will be useful for Swarm, where we want to index measurements not just with the host tag, but also with bzzkey and git commit version (for long-running deployments).
2019-01-29 09:14:24 +01:00
104e6b2050
swarm/pss/notify: shutdown net in TestStart to fix OOM issue ( #18953 )
2019-01-28 16:08:33 +01:00
2209fede4e
swarm/pss: fix data race on topicHandlerCaps map ( #18523 )
2019-01-25 20:18:28 +01:00
f28da4f602
swarm/metrics: Send the accounting registry to InfluxDB ( #18470 )
2019-01-24 18:57:20 +01:00
2abeb35d54
p2p/testing, swarm: remove unused testing.T in protocol tester ( #18500 )
2019-01-24 17:23:34 +01:00
6167dd65b5
swarm/pss: fix data race in notify_test.go (TestStart) ( #18518 )
2019-01-24 17:07:43 +01:00
ad13d2d407
swarm/version: commit version added ( #18510 )
2019-01-24 12:35:10 +01:00
3591fc603f
swarm/storage: Fix race in TestLDBStoreCollectGarbage. Disable testLDBStoreRemoveThenCollectGarbage ( #18512 )
2019-01-24 12:34:12 +01:00
fa34429a26
swarm: fix a data race on startTime ( #18511 )
2019-01-24 12:02:47 +01:00
bbd120354a
swarm: bootnode-mode, new bootnodes and no p2p package discovery ( #18498 )
2019-01-24 12:02:18 +01:00
105008b6a1
swarm/pss: fixing race condition ( #18487 )
2019-01-21 15:22:51 +01:00
15b9b39e6c
swarm/network: unskip tests previously skipped due to suggestPeer issues ( #18477 )
2019-01-19 08:12:57 +01:00
19bfcbf911
swarm/network: fix data race in fetcher_test.go ( #18469 )
2019-01-17 16:45:36 +01:00
4f8ec44565
swarm/network: fix data race in stream.(*Peer).handleOfferedHashesMsg() ( #18468 )
...
* swarm/network: fix data race in stream.(*Peer).handleOfferedHashesMsg()
handleOfferedHashesMsg() contained a data race:
- read => in a goroutine, call to c.batchDone()
- write => in the main thread, write to c.sessionAt
c.batchDone() contained a call to c.AddInterval(). Client was a value
receiver for AddInterval. So on c.AddInterval() call the whole client
struct got copied (read) while one of its field was modified in
handleOfferedHashesMsg() (write).
fixes ethersphere/go-ethereum#1086
* swarm/network: simplify some trivial statements
2019-01-17 14:44:29 +01:00
81e26d5a48
swarm/network: fix data race warning on TestBzzHandshakeLightNode ( #18459 )
2019-01-17 11:38:23 +01:00
bcb2594151
swarm/network: rewrite of peer suggestion engine, fix skipped tests ( #18404 )
...
* swarm/network: fix skipped tests related to suggestPeer
* swarm/network: rename depth to radius
* swarm/network: uncomment assertHealth and improve comments
* swarm/network: remove commented code
* swarm/network: kademlia suggestPeer algo correction
* swarm/network: kademlia suggest peer
* simplify suggest Peer code
* improve peer suggestion algo
* add comments
* kademlia testing improvements
* assertHealth -> checkHealth (test helper)
* testSuggestPeer -> checkSuggestPeer (test helper)
* remove testSuggestPeerBug and TestKademliaCase
* swarm/network: kademlia suggestPeer cleanup, improved comments
* swarm/network: minor comment, discovery test default arg
2019-01-17 07:29:34 +01:00
34f11e752f
cmd/swarm/swarm-snapshot: swarm snapshot generator ( #18453 )
...
* cmd/swarm/swarm-snapshot: add binary to create network snapshots
* cmd/swarm/swarm-snapshot: refactor and extend tests
* p2p/simulations: remove unused triggerChecks func and fix linter
* internal/cmdtest: raise the timeout for killing TestCmd
* cmd/swarm/swarm-snapshot: add more comments and other minor adjustments
* cmd/swarm/swarm-snapshot: remove redundant check in createSnapshot
* cmd/swarm/swarm-snapshot: change comment wording
* p2p/simulations: revert Simulation.Run from master
https://github.com/ethersphere/go-ethereum/pull/1077/files#r247078904
* cmd/swarm/swarm-snapshot: address pr comments
* swarm/network/simulations/discovery: removed snapshot write to file
* cmd/swarm/swarm-snapshot, swarm/network/simulations: removed redundant connection event check, fixed lint error
2019-01-16 14:33:02 +01:00
f728837ee6
swarm/storage: fix mockNetFetcher data races ( #18462 )
...
fixes : ethersphere/go-ethereum#1117
2019-01-16 14:31:32 +01:00
96c7c18b18
swarm/network: fix data race in TestNetworkID test ( #18460 )
2019-01-16 12:56:34 +01:00
24d66944cb
params, swarm: begin Geth v1.8.22 and Swarm v0.3.10 cycle
2019-01-15 22:52:47 +02:00
9dc5d1a915
params, swarm: release Geth v1.8.21 and Swarm v0.3.9
2019-01-15 22:51:31 +02:00
4aeeecfded
swarm/pot: each() functions refactored ( #18452 )
2019-01-15 11:51:33 +01:00
1636d9574b
swarm/pot: pot.remove fixed ( #18431 )
...
* swarm/pot: refactored pot.remove(), updated comments
* swarm/pot: comments updated
2019-01-11 20:42:33 +01:00
88168ff5c5
Stream subscriptions ( #18355 )
...
* swarm/network: eachBin now starts at kaddepth for nn
* swarm/network: fix Kademlia.EachBin
* swarm/network: fix kademlia.EachBin
* swarm/network: correct EachBin implementation according to requirements
* swarm/network: less addresses simplified tests
* swarm: calc kad depth outside loop in EachBin test
* swarm/network: removed printResults
* swarm/network: cleanup imports
* swarm/network: remove kademlia.EachBin; fix RequestSubscriptions and add unit test
* swarm/network/stream: address PR comments
* swarm/network/stream: package-wide subscriptionFunc
* swarm/network/stream: refactor to kad.EachConn
2019-01-11 15:08:09 +01:00
2eb838ed97
p2p/simulations: eliminate concept of pivot ( #18426 )
2019-01-11 10:23:45 +01:00
7240f4d800
swarm/network: Rename minproxbinsize, add as member of simulation ( #18408 )
...
* swarm/network: Rename minproxbinsize, add as member of simulation
* swarm/network: Deactivate WaitTillHealthy, unreliable pending suggestpeer
2019-01-10 12:33:51 +01:00
6df3e4eeb0
swarm/network: remove isproxbin bool from kad.Each* iterfunc ( #18239 )
...
* swarm/network, swarm/pss: remove isproxbin bool from kad.Each* iterfunc
* swarm/network: restore comment and unskip snapshot sync tests
2019-01-10 03:36:19 +01:00
d70c4faf20
swarm: Fix T.Fatal inside a goroutine in tests ( #18409 )
...
* swarm/storage: fix T.Fatal inside a goroutine
* swarm/network/simulation: fix T.Fatal inside a goroutine
* swarm/network/stream: fix T.Fatal inside a goroutine
* swarm/network/simulation: consistent failures in TestPeerEventsTimeout
* swarm/network/simulation: rename sendRunSignal to triggerSimulationRun
2019-01-09 07:05:55 +01:00
ae857e74bf
swarm, p2p/protocols: Stream accounting ( #18337 )
...
* swarm: completed 1st phase of swap accounting
* swarm, p2p/protocols: added stream pricing
* swarm/network/stream: gofmt simplify stream.go
* swarm: fixed review comments
* swarm: used snapshots for swap tests
* swarm: custom retrieve for swap (less cascaded requests at any one time)
* swarm: addressed PR comments
* swarm: log output formatting
* swarm: removed parallelism in swap tests
* swarm: swap tests simplification
* swarm: removed swap_test.go
* swarm/network/stream: added prefix space for comments
* swarm/network/stream: unit test for prices
* swarm/network/stream: don't hardcode price
* swarm/network/stream: fixed invalid price check
2019-01-08 00:59:00 +01:00
56a3f6c03c
swarm/storage/mock/test: fix T.Fatal inside a goroutine ( #18399 )
2019-01-07 14:32:01 +01:00
356c49fa7e
swarm: Shed Index and Uint64Field additions ( #18398 )
2019-01-07 13:20:11 +01:00
fe03b76ffe
A few minor code inspection fixes ( #18393 )
...
* swarm/network: fix code inspection problems
- typos
- redundant import alias
* p2p/simulations: fix code inspection problems
- typos
- unused function parameters
- redundant import alias
- code style issue: snake case
* swarm/network: fix unused method parameters inspections
2019-01-06 11:58:57 +01:00
33d233d3e1
vendor, crypto, swarm: switch over to upstream sha3 package
2019-01-04 09:26:07 +02:00
49975264a8
swarm/docker: Dockerfile for swarm:edge docker image ( #18386 )
2019-01-03 15:32:58 +01:00
1d284c201d
swarm/storage: change Proximity function and add TestProximity test ( #18379 )
2019-01-03 06:17:59 +01:00
9e9fc87e70
swarm: remove unused/dead code ( #18351 )
2018-12-23 17:31:32 +01:00
5e4fd8e7db
swarm/network: Revised depth and health for Kademlia ( #18354 )
...
* swarm/network: Revised depth calculation with tests
* swarm/network: WIP remove redundant "full" function
* swarm/network: WIP peerpot refactor
* swarm/network: Make test methods submethod of peerpot and embed kad
* swarm/network: Remove commented out code
* swarm/network: Rename health test functions
* swarm/network: Too many n's
* swarm/network: Change hive Healthy func to accept addresses
* swarm/network: Add Healthy proxy method for api in hive
* swarm/network: Skip failing test out of scope for PR
* swarm/network: Skip all tests dependent on SuggestPeers
* swarm/network: Remove commented code and useless kad Pof member
* swarm/network: Remove more unused code, add counter on depth test errors
* swarm/network: WIP Create Healthy assertion tests
* swarm/network: Roll back health related methods receiver change
* swarm/network: Hardwire network minproxbinsize in swarm sim
* swarm/network: Rework Health test to strict
Pending add test for saturation
And add test for as many as possible up to saturation
* swarm/network: Skip discovery tests (dependent on SuggestPeer)
* swarm/network: Remove useless minProxBinSize in stream
* swarm/network: Remove unnecessary testing.T param to assert health
* swarm/network: Implement t.Helper() in checkHealth
* swarm/network: Rename check back to assert now that we have helper magic
* swarm/network: Revert WaitTillHealthy change (deferred to nxt PR)
* swarm/network: Kademlia tests GotNN => ConnectNN
* swarm/network: Renames and comments
* swarm/network: Add comments
2018-12-22 06:53:30 +01:00
880de230b4
p2p/protocols: accounting metrics rpc ( #18336 )
...
* p2p/protocols: accounting metrics rpc added (#847 )
* p2p/protocols: accounting api documentation added (#847 )
* p2p/protocols: accounting api doc updated (#847 )
* p2p/protocols: accounting api doc update (#847 )
* p2p/protocols: accounting api doc update (#847 )
* p2p/protocols: fix file is not gofmted
* fix lint error
* updated comments after review
* add account balance to rpc
* naming changed after review
2018-12-22 06:04:03 +01:00
ca7c13ba8f
swarm/pss: forwarding function refactoring ( #18353 )
2018-12-21 18:04:18 +01:00
e1edfe0689
p2p/simulation: Test snapshot correctness and minimal benchmark ( #18287 )
...
* p2p/simulation: WIP minimal snapshot test
* p2p/simulation: Add snapshot create, load and verify to snapshot test
* build: add test tag for tests
* p2p/simulations, build: Revert travis change, build test sym always
* p2p/simulations: Add comments, timeout check on additional events
* p2p/simulation: Add benchmark template for minimal peer protocol init
* p2p/simulations: Remove unused code
* p2p/simulation: Correct timer reset
* p2p/simulations: Put snapshot check events in buffer and call blocking
* p2p/simulations: TestSnapshot fail if Load function returns early
* p2p/simulations: TestSnapshot wait for all connections before returning
* p2p/simulation: Revert to before wait for snap load (5e75594)
* p2p/simulations: add "conns after load" subtest to TestSnapshot
and nudge
2018-12-21 06:22:11 +01:00
fe86a707d8
swarm/storage: remove unused methods from Chunk interface ( #18283 )
2018-12-18 15:25:02 +01:00
b01cfce362
swarm/pss: Reduce input vulnerabilities ( #18304 )
2018-12-18 15:23:32 +01:00
de4265fa02
swarm/network/simulation:commented out unreachable code-avoid vet errors ( #18263 )
2018-12-18 07:24:59 +01:00
90ea542e9e
Update visualized snapshot test ( #18286 )
...
* swarm/network/stream: fix visualized_snapshot_sync_sim_test
* swarm/network/stream: updated visualized snapshot-test;data in p2p event
* swarm/network/stream: cleanup visualized snapshot sync test
* swarm/network/stream: re-enable t.Skip for visualized test
* swarm/network/stream: addressed PR comments
2018-12-18 07:20:59 +01:00
472c23a801
p2p/simulation: move connection methods from swarm/network/simulation ( #18323 )
2018-12-17 12:19:01 +01:00
d322c9d550
swarm/storage/feed: remove unused code ( #18324 )
2018-12-17 11:32:55 +01:00
4e6f53ac33
swarm/storage: simplify ChunkValidator interface ( #18285 )
2018-12-12 16:22:17 +01:00
ebbf3dfafb
swarm/shed: add metrics to each shed db ( #18277 )
...
* swarm/shed: add metrics to each shed db
* swarm/shed: push metrics prefix up
* swarm/shed: rename prefix to metricsPrefix
* swarm/shed: unexport Meter, remove Mutex for quit channel
2018-12-12 07:51:29 +01:00
1e190a3b1c
params, swarm: begin Geth v1.9.0 family, Swarm v0.3.9 cycle
2018-12-11 14:23:57 +02:00
24d727b6d6
params, swarm: release Geth v1.8.20 and Swarm v0.3.8
2018-12-11 14:20:21 +02:00
bb724080ca
cmd/swarm, metrics, swarm/api/client, swarm/storage, swarm/metrics, swarm/api/http: add instrumentation ( #18274 )
2018-12-11 09:21:58 +01:00
dd98d1da94
swarm/network: Correct ambiguity in compared addresses ( #18251 )
2018-12-10 14:56:01 +02:00
661809714e
swarm: snapshot load improvement ( #18220 )
...
* swarm/network: Hive - do not notify peer if discovery is disabled
* p2p/simulations: validate all connections on loading a snapshot
* p2p/simulations: track all connections in on snapshot loading
* p2p/simulations: add snapshotLoadTimeout variable
* p2p/simulations: ignore control events in snapshot load
* p2p/simulations: simplify event loop synchronization
* p2p/simulations: return already connected error from Load function
* p2p/simulations: log warning on snapshot loading disconnection
2018-12-07 06:51:40 +01:00
3ac633ba84
swarm/api/http: add resetting timer metrics to requests ( #18249 )
2018-12-05 11:20:55 +01:00
b98d2e9a1c
swarm/network/stream: Debug log instead of Warn for retrieval failure ( #18246 )
2018-12-04 18:29:51 +01:00
085f89172f
swarm/pss: Add same api interface for all Send* methods ( #18218 )
2018-12-01 07:07:18 +01:00
7e7781ffaa
cmd/swarm: add flag for application name (swarm or swarm-private) ( #18189 )
...
* cmd/swarm: add flag for application name (swarm or swarm-private)
* cmd/swarm/swarm-smoke: return correct exit code
* cmd/swarm/swarm-smoke: remove colorable
* remove swarm/grafana_dashboards
2018-11-29 18:43:15 +02:00
a7501d0c41
params, swarm: start Geth v1.8.20 and Swarm v0.3.8 release cycle
2018-11-28 14:44:00 +02:00
dae82f0985
params, swarm: release Geth v1.8.19 and Swarm v0.3.7
2018-11-28 14:42:37 +02:00
695a5cce1e
Increase bzz version ( #18184 )
...
* swarm/network/stream/: added stream protocol version match tests
* Increase BZZ version due to streamer version change; version tests
* swarm/network: increased hive and test protocol version
2018-11-26 19:34:40 +01:00
c207edf2a3
swarm: add database abstractions (shed package) ( #18183 )
2018-11-26 18:49:01 +01:00
1cd007ecae
swarm/network: Correct neighborhood depth ( #18066 )
2018-11-26 17:13:59 +01:00
bba5fd8192
Accounting metrics reporter ( #18136 )
2018-11-26 17:05:18 +01:00
2714e8f091
Remove multihash from Swarm bzz:// for Feeds ( #18175 )
2018-11-26 16:10:22 +01:00
197d609b9a
swarm/pss: Message handler refactor ( #18169 )
2018-11-26 13:52:04 +01:00
f5e6634fd2
swarm/api: improve not found error msg ( #18171 )
2018-11-26 12:53:15 +01:00
93854bbad4
swarm/network/simulation: fix New function for-loop scope ( #18161 )
2018-11-26 12:39:38 +01:00
070caec4bd
swarm/network/stream: use swarm/mock/mem as mock global store ( #18157 )
2018-11-21 20:49:13 +01:00
4c181e4fb9
swarm/state: refactor InmemoryStore ( #18143 )
2018-11-21 14:36:56 +01:00
d876f214e5
swarm/storage: move 'running migrations for' log line ( #18120 )
...
So that we only see the log message when we actually have to migrate.
2018-11-20 08:30:38 +01:00
3333fe660f
swarm/storage: speed up garbage collection and rpc tests ( #18128 )
2018-11-19 12:26:45 +01:00
51e2e78d26
swarm/api/http: change request served msg log level ( #18127 )
2018-11-18 10:54:03 +01:00
ffe2fc3bc4
Swarm accounting ( #18050 )
...
* swarm: completed 1st phase of swap accounting
* swarm: swap accounting for swarm with p2p accounting
* swarm/swap: addressed PR comments
* swarm/swap: ignore ErrNotFound on stateStore.Get()
* swarm/swap: GetPeerBalance test; add TODO for chequebook API check
* swarm/network/stream: fix NewRegistry calls with new arguments
* swarm/swap: address @justelad's PR comments
2018-11-15 23:41:19 +01:00
324027640b
swarm/network/simulation: use simulations.Event instead p2p.PeerEvent ( #18098 )
2018-11-15 21:06:27 +01:00
a6942b9f25
swarm/storage: Batched database migration ( #18113 )
2018-11-15 14:57:03 +01:00
48b4e8069c
params, swarm: begin Geth v1.8.19 and Swarm v0.3.7 cycle
2018-11-14 10:27:30 +02:00
58632d4402
params, swarm: release Geth v1.8.18 and Swarm v0.3.6
2018-11-14 10:25:19 +02:00
eb8fa3cc89
cmd/swarm, swarm/api/http, swarm/bmt, swarm/fuse, swarm/network/stream, swarm/storage, swarm/storage/encryption, swarm/testutil: use pseudo-random instead of crypto-random for test files content generation ( #18083 )
...
- Replace "crypto/rand" to "math/rand" for files content generation
- Remove swarm/network_test.go.Shuffle and swarm/btm/btm_test.go.Shuffle - because go1.9 support dropped (see https://github.com/ethereum/go-ethereum/pull/17807 and comments to swarm/network_test.go.Shuffle)
2018-11-14 09:21:14 +01:00
c41e1bd1eb
swarm/storage: fix garbage collector index skew ( #18080 )
...
On file access LDBStore's tryAccessIdx() function created a faulty
GC Index Data entry, because not indexing the ikey correctly.
That caused the chunk addresses/hashes to start with '00' and the last
two digits were dropped. => Incorrect chunk address.
Besides the fix, the commit also contains a schema change which will
run the CleanGCIndex() function to clean the GC index from erroneous
entries.
Note: CleanGCIndex() rebuilds the index from scratch which can take
a really-really long time with a huge DB (possibly an hour).
2018-11-13 15:22:53 +01:00
8080265f3f
swarm/storage: fix access count on dbstore after cache hit ( #17978 )
...
Access count was not incremented when chunk was retrieved
from cache. So the garbage collector might have deleted the most
frequently accessed chunk from disk.
Co-authored-by: Ferenc Szabo <ferenc.szabo@ethereum.org>
2018-11-13 07:41:01 +01:00
201a0bf181
p2p/simulations, swarm/network: Custom services in snapshot ( #17991 )
...
* p2p/simulations: Add custom services to simnodes + remove sim down conn objs
* p2p/simulation, swarm/network: Add selective services to discovery sim
* p2p/simulations, swarm/network: Remove useless comments
* p2p/simulations, swarm/network: Clean up mess from rebase
* p2p/simulation: Add sleep to prevent connect flakiness in http test
* p2p/simulations: added concurrent goroutines to prevent sleeps on simulation connect/disconnect
* p2p/simulations, swarm/network/simulations: address pr comments
* reinstated dummy service
* fixed http snapshot test
2018-11-12 14:57:17 +01:00
cf3b187bde
swarm, cmd/swarm: address ineffectual assignments ( #18048 )
...
* swarm, cmd/swarm: address ineffectual assignments
* swarm/network: remove unused vars from testHandshake
* swarm/storage/feed: revert cursor changes
2018-11-07 20:39:08 +01:00
81533deae5
swarm/network: light nodes are not dialed, saved and requested from ( #17975 )
...
* RequestFromPeers does not use peers marked as lightnode
* fix warning about variable name
* write tests for RequestFromPeers
* lightnodes should be omitted from the addressbook
* resolve pr comments regarding logging, formatting and comments
* resolve pr comments regarding comments and added a missing newline
* add assertions to check peers in live connections
2018-11-07 20:33:36 +01:00
36ca85fa1c
swarm/api: Fix #18007 , missing signature should return HTTP 400 ( #18008 )
2018-11-07 14:49:42 +01:00
79c7a69ac8
swarm: Better syncing and retrieval option definition ( #17986 )
...
* swarm: Better syncing and retrieval option definition
* swarm/network/stream: better comments
* swarm/network/stream: addressed PR comments
2018-11-07 00:04:18 +01:00
53eb4e0b0f
swarm/api: unexport Respond methods ( #18037 )
2018-11-06 12:34:34 +01:00
lash
Janoš Guljaš
holisticode
Kiel barry
Ferenc Szabo
Anton Evangelatov
Felix Lange
Jerzy Lasyk
Elad
gluk256
Viktor Trón
Péter Szilágyi
Dave McGregor
Javier Peletier
Alexey Sharov
Mark Vujevits