smeb_y/0g-storage-node
1
0
Fork 0
mirror of https://github.com/0glabs/0g-storage-node.git synced 2025-04-04 15:35:18 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
207 Commits 13 Branches 36 Tags 17 MiB
9eea71e97d
Commit Graph

14 Commits

Author SHA1 Message Date
Bo QIU
9b68a8b7d7
Implement file sync protocol V2 () 
* Add new P2P protocol NewFile

* Publish NewFile message when any file finalized

* handle NewFile message in router

* handle NewFile in sync servic to write in db

* use propagation source to handle NewFile message

* Disable sequential sync and store new file in v2 sync store

* Add shard config in FindFile

* Add AnnounceFile RPC message in network layer

* do not propagate FindFile to whole network

* Mark peer connected if FileAnnouncement RPC message received

* fix unit test failures

* Change P2P protocol version

* Ignore py tests of sequential auto sync

* Add py test for auto sync v2

* fmt code

* remove dummy code in py test

* fix random test failure

* Add comments

* Enable file sync protocol v2 in config file by default
 2024-10-28 14:56:08 +08:00
Bo QIU
8f17a7ad72
Fix metrics config deser () 2024-10-22 14:14:33 +08:00
0g-peterzhb
48868b60db
update ip () 2024-10-11 17:07:43 +08:00
Bo QIU
ae6ecfec96
reduce default sync threads () 2024-09-26 14:55:00 +08:00
Bo QIU
ad80b22a1b
Optimize rpc config () 2024-09-25 16:48:40 +08:00
Bo QIU
9cde84ae15
Refactor network peer db configs () 2024-09-24 11:59:34 +08:00
Bo QIU
a9f5169c15
Allow user to configure network bandwidth for file sync () 2024-09-13 16:58:27 +08:00
Bo QIU
b6972b97af
Adjust default value for testnet configs () 
* Adjust default value for testnet configs

* Supports to disable sequential auto sync

* Add py tests for auto sync

* fix py file name

* rm dummy ;py code

* change default block confirm count
 2024-09-05 10:09:29 +08:00
0g-peterzhb
508e787bd0
update boot nodes () 2024-08-30 10:38:19 +08:00
Bo QIU
2fd9712d59
Enhance P2P network protocol to support batch messages for performance concern () 
* Add p2p protocol version in network identity

* Cache annouce file pubsub messages to publish in batch

* fix file location cache

* opt sync metrics

* opt file location cache default configs

* publish files announcements in batch

* enhance announce file pubsub msg metrics

* opt metrics

* fix ci

* fix clippy

* fix batcher

* minor fix

* opt batcher: publish all if expired
 2024-08-29 09:55:24 +08:00
bruno-valante
5757c98d2a
Config query context interval & Add config comments () 2024-08-27 17:36:36 +08:00
Bo QIU
37344b9439
opt sync config and update config file () 2024-08-26 15:29:52 +08:00
Bo QIU
82fef674ed
Add more metrics for file sync () 
* add metrics in log sync package

* udpate auto sync metrics

* Add metrics for completed file sync

* add more metrics for serial file sync

* adjust default timeout value for auto sync

* fix metrics rpc for Timer type

* add metrics for channel

* refactor channel metrics

* add timeout metrics for segment sync

* refactor channel receiver
 2024-08-22 10:42:15 +08:00
Bo QIU
03286ebd78
Supports HDD config file () 
* Add debug log config

* Add config file for ssd and hdd

* Set most default value for ssd and hdd config file
 2024-08-12 17:07:06 +08:00