cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
// Copyright 2022 The go-ethereum Authors
|
|
|
|
// This file is part of the go-ethereum library.
|
|
|
|
//
|
|
|
|
// The go-ethereum library is free software: you can redistribute it and/or modify
|
|
|
|
// it under the terms of the GNU Lesser General Public License as published by
|
|
|
|
// the Free Software Foundation, either version 3 of the License, or
|
|
|
|
// (at your option) any later version.
|
|
|
|
//
|
|
|
|
// The go-ethereum library is distributed in the hope that it will be useful,
|
|
|
|
// but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
|
|
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
|
|
// GNU Lesser General Public License for more details.
|
|
|
|
//
|
|
|
|
// You should have received a copy of the GNU Lesser General Public License
|
|
|
|
// along with the go-ethereum library. If not, see <http://www.gnu.org/licenses/>.
|
|
|
|
|
|
|
|
package trie
|
|
|
|
|
|
|
|
import (
|
|
|
|
"github.com/ethereum/go-ethereum/common"
|
cmd, core/state, eth, tests, trie: improve state reader (#27428)
The state availability is checked during the creation of a state reader.
- In hash-based database, if the specified root node does not exist on disk disk, then
the state reader won't be created and an error will be returned.
- In path-based database, if the specified state layer is not available, then the
state reader won't be created and an error will be returned.
This change also contains a stricter semantics regarding the `Commit` operation: once it has been performed, the trie is no longer usable, and certain operations will return an error.
2023-06-20 14:31:45 -05:00
|
|
|
"github.com/ethereum/go-ethereum/core/types"
|
|
|
|
"github.com/ethereum/go-ethereum/log"
|
all: activate pbss as experimental feature (#26274)
* all: activate pbss
* core/rawdb: fix compilation error
* cma, core, eth, les, trie: address comments
* cmd, core, eth, trie: polish code
* core, cmd, eth: address comments
* cmd, core, eth, les, light, tests: address comment
* cmd/utils: shorten log message
* trie/triedb/pathdb: limit node buffer size to 1gb
* cmd/utils: fix opening non-existing db
* cmd/utils: rename flag name
* cmd, core: group chain history flags and fix tests
* core, eth, trie: fix memory leak in snapshot generation
* cmd, eth, internal: deprecate flags
* all: enable state tests for pathdb, fixes
* cmd, core: polish code
* trie/triedb/pathdb: limit the node buffer size to 256mb
---------
Co-authored-by: Martin Holst Swende <martin@swende.se>
Co-authored-by: Péter Szilágyi <peterke@gmail.com>
2023-08-10 14:21:36 -05:00
|
|
|
"github.com/ethereum/go-ethereum/trie/triestate"
|
cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
)
|
|
|
|
|
2023-04-24 02:38:52 -05:00
|
|
|
// Reader wraps the Node method of a backing trie store.
|
cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
type Reader interface {
|
2023-08-01 07:17:32 -05:00
|
|
|
// Node retrieves the trie node blob with the provided trie identifier, node path and
|
|
|
|
// the corresponding node hash. No error will be returned if the node is not found.
|
|
|
|
//
|
|
|
|
// When looking up nodes in the account trie, 'owner' is the zero hash. For contract
|
|
|
|
// storage trie nodes, 'owner' is the hash of the account address that containing the
|
|
|
|
// storage.
|
|
|
|
//
|
|
|
|
// TODO(rjl493456442): remove the 'hash' parameter, it's redundant in PBSS.
|
2023-04-24 02:38:52 -05:00
|
|
|
Node(owner common.Hash, path []byte, hash common.Hash) ([]byte, error)
|
cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
}
|
|
|
|
|
|
|
|
// trieReader is a wrapper of the underlying node reader. It's not safe
|
|
|
|
// for concurrent usage.
|
|
|
|
type trieReader struct {
|
|
|
|
owner common.Hash
|
|
|
|
reader Reader
|
|
|
|
banned map[string]struct{} // Marker to prevent node from being accessed, for tests
|
|
|
|
}
|
|
|
|
|
|
|
|
// newTrieReader initializes the trie reader with the given node reader.
|
cmd, core/state, eth, tests, trie: improve state reader (#27428)
The state availability is checked during the creation of a state reader.
- In hash-based database, if the specified root node does not exist on disk disk, then
the state reader won't be created and an error will be returned.
- In path-based database, if the specified state layer is not available, then the
state reader won't be created and an error will be returned.
This change also contains a stricter semantics regarding the `Commit` operation: once it has been performed, the trie is no longer usable, and certain operations will return an error.
2023-06-20 14:31:45 -05:00
|
|
|
func newTrieReader(stateRoot, owner common.Hash, db *Database) (*trieReader, error) {
|
|
|
|
if stateRoot == (common.Hash{}) || stateRoot == types.EmptyRootHash {
|
|
|
|
if stateRoot == (common.Hash{}) {
|
|
|
|
log.Error("Zero state root hash!")
|
|
|
|
}
|
|
|
|
return &trieReader{owner: owner}, nil
|
|
|
|
}
|
|
|
|
reader, err := db.Reader(stateRoot)
|
|
|
|
if err != nil {
|
|
|
|
return nil, &MissingNodeError{Owner: owner, NodeHash: stateRoot, err: err}
|
cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
}
|
|
|
|
return &trieReader{owner: owner, reader: reader}, nil
|
|
|
|
}
|
|
|
|
|
|
|
|
// newEmptyReader initializes the pure in-memory reader. All read operations
|
|
|
|
// should be forbidden and returns the MissingNodeError.
|
|
|
|
func newEmptyReader() *trieReader {
|
|
|
|
return &trieReader{}
|
|
|
|
}
|
|
|
|
|
|
|
|
// node retrieves the rlp-encoded trie node with the provided trie node
|
|
|
|
// information. An MissingNodeError will be returned in case the node is
|
|
|
|
// not found or any error is encountered.
|
2023-04-24 02:38:52 -05:00
|
|
|
func (r *trieReader) node(path []byte, hash common.Hash) ([]byte, error) {
|
cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
// Perform the logics in tests for preventing trie node access.
|
|
|
|
if r.banned != nil {
|
|
|
|
if _, ok := r.banned[string(path)]; ok {
|
|
|
|
return nil, &MissingNodeError{Owner: r.owner, NodeHash: hash, Path: path}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if r.reader == nil {
|
|
|
|
return nil, &MissingNodeError{Owner: r.owner, NodeHash: hash, Path: path}
|
|
|
|
}
|
2023-04-24 02:38:52 -05:00
|
|
|
blob, err := r.reader.Node(r.owner, path, hash)
|
cmd, core, eth, les, light: track deleted nodes (#25757)
* cmd, core, eth, les, light: track deleted nodes
* trie: add docs
* trie: address comments
* cmd, core, eth, les, light, trie: trie id
* trie: add tests
* trie, core: updates
* trie: fix imports
* trie: add utility print-method for nodeset
* trie: import err
* trie: fix go vet warnings
Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-09-27 03:01:02 -05:00
|
|
|
if err != nil || len(blob) == 0 {
|
|
|
|
return nil, &MissingNodeError{Owner: r.owner, NodeHash: hash, Path: path, err: err}
|
|
|
|
}
|
|
|
|
return blob, nil
|
|
|
|
}
|
all: activate pbss as experimental feature (#26274)
* all: activate pbss
* core/rawdb: fix compilation error
* cma, core, eth, les, trie: address comments
* cmd, core, eth, trie: polish code
* core, cmd, eth: address comments
* cmd, core, eth, les, light, tests: address comment
* cmd/utils: shorten log message
* trie/triedb/pathdb: limit node buffer size to 1gb
* cmd/utils: fix opening non-existing db
* cmd/utils: rename flag name
* cmd, core: group chain history flags and fix tests
* core, eth, trie: fix memory leak in snapshot generation
* cmd, eth, internal: deprecate flags
* all: enable state tests for pathdb, fixes
* cmd, core: polish code
* trie/triedb/pathdb: limit the node buffer size to 256mb
---------
Co-authored-by: Martin Holst Swende <martin@swende.se>
Co-authored-by: Péter Szilágyi <peterke@gmail.com>
2023-08-10 14:21:36 -05:00
|
|
|
|
|
|
|
// trieLoader implements triestate.TrieLoader for constructing tries.
|
|
|
|
type trieLoader struct {
|
|
|
|
db *Database
|
|
|
|
}
|
|
|
|
|
|
|
|
// OpenTrie opens the main account trie.
|
|
|
|
func (l *trieLoader) OpenTrie(root common.Hash) (triestate.Trie, error) {
|
|
|
|
return New(TrieID(root), l.db)
|
|
|
|
}
|
|
|
|
|
|
|
|
// OpenStorageTrie opens the storage trie of an account.
|
|
|
|
func (l *trieLoader) OpenStorageTrie(stateRoot common.Hash, addrHash, root common.Hash) (triestate.Trie, error) {
|
|
|
|
return New(StorageTrieID(stateRoot, addrHash, root), l.db)
|
|
|
|
}
|