smeb_y/0g-storage-node
1
0
Fork 0
mirror of https://github.com/0glabs/0g-storage-node.git synced 2025-04-04 15:35:18 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
283 Commits 13 Branches 36 Tags 17 MiB
8ab8321741
Commit Graph

18 Commits

Author SHA1 Message Date
Helen Grachtz
26cc19b92d
Fix code comments and bug report errors () 
fix typos
 2025-02-11 16:56:40 +08:00
Bo QIU
8790fe1d66
Sync recent announced files with priority () 
* Upgrade rust toolchain to avoid macro-proc issue of latest rust analyzer

* Update random sync metrics

* Adjust default config for sync layer

* Cache the recent announced file for random sync with priority

* Fix clippy

* fix auto sync failure reason issue

* Add cached ready txs info in rpc

* fix lint
 2024-12-18 18:40:54 +08:00
Bo QIU
d3a2118985
Sync file from neighbors by default () 
* sync from neighbors by default

* change p2p protocol version

* minor fix for crash python test

* Fix pubsub message id issue

* fix python tests
 2024-12-09 16:04:55 +08:00
Bo QIU
b9e6431a4d
Add shard config in STATUS message and only dail to shard config matched peers () 
* Add shard config in status message

* verify shard config for status message

* Notify peer connected to sync layer after status message exchanged

* Do not dial to shard config mismatched peers

* Upgrade network protocol version

* disconnect peer instead of ban peer if shard config mismatch

* Add python test for TCP connection by shard config
 2024-11-25 10:15:30 +08:00
0g-peterzhb
96f846073f
increase db_max_num_sectors to be about 1000GB () 2024-11-15 13:10:07 +08:00
Bo QIU
9b68a8b7d7
Implement file sync protocol V2 () 
* Add new P2P protocol NewFile

* Publish NewFile message when any file finalized

* handle NewFile message in router

* handle NewFile in sync servic to write in db

* use propagation source to handle NewFile message

* Disable sequential sync and store new file in v2 sync store

* Add shard config in FindFile

* Add AnnounceFile RPC message in network layer

* do not propagate FindFile to whole network

* Mark peer connected if FileAnnouncement RPC message received

* fix unit test failures

* Change P2P protocol version

* Ignore py tests of sequential auto sync

* Add py test for auto sync v2

* fmt code

* remove dummy code in py test

* fix random test failure

* Add comments

* Enable file sync protocol v2 in config file by default
 2024-10-28 14:56:08 +08:00
Bo QIU
8f17a7ad72
Fix metrics config deser () 2024-10-22 14:14:33 +08:00
0g-peterzhb
48868b60db
update ip () 2024-10-11 17:07:43 +08:00
Bo QIU
ae6ecfec96
reduce default sync threads () 2024-09-26 14:55:00 +08:00
Bo QIU
ad80b22a1b
Optimize rpc config () 2024-09-25 16:48:40 +08:00
Bo QIU
9cde84ae15
Refactor network peer db configs () 2024-09-24 11:59:34 +08:00
Bo QIU
a9f5169c15
Allow user to configure network bandwidth for file sync () 2024-09-13 16:58:27 +08:00
Bo QIU
b6972b97af
Adjust default value for testnet configs () 
* Adjust default value for testnet configs

* Supports to disable sequential auto sync

* Add py tests for auto sync

* fix py file name

* rm dummy ;py code

* change default block confirm count
 2024-09-05 10:09:29 +08:00
0g-peterzhb
508e787bd0
update boot nodes () 2024-08-30 10:38:19 +08:00
Bo QIU
2fd9712d59
Enhance P2P network protocol to support batch messages for performance concern () 
* Add p2p protocol version in network identity

* Cache annouce file pubsub messages to publish in batch

* fix file location cache

* opt sync metrics

* opt file location cache default configs

* publish files announcements in batch

* enhance announce file pubsub msg metrics

* opt metrics

* fix ci

* fix clippy

* fix batcher

* minor fix

* opt batcher: publish all if expired
 2024-08-29 09:55:24 +08:00
Bo QIU
37344b9439
opt sync config and update config file () 2024-08-26 15:29:52 +08:00
Bo QIU
82fef674ed
Add more metrics for file sync () 
* add metrics in log sync package

* udpate auto sync metrics

* Add metrics for completed file sync

* add more metrics for serial file sync

* adjust default timeout value for auto sync

* fix metrics rpc for Timer type

* add metrics for channel

* refactor channel metrics

* add timeout metrics for segment sync

* refactor channel receiver
 2024-08-22 10:42:15 +08:00
Bo QIU
03286ebd78
Supports HDD config file () 
* Add debug log config

* Add config file for ssd and hdd

* Set most default value for ssd and hdd config file
 2024-08-12 17:07:06 +08:00