0g-storage-node

mirror of https://github.com/0glabs/0g-storage-node.git synced 2025-04-04 15:35:18 +00:00

Author	SHA1	Message	Date
Bo QIU	e912522386	Supports to sync historical files without NewFile gossip message (#269 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * Supports to randomly sync historical files * Add name for random file sync batcher * Remove sync store metrics since multiple random batcher created * opt log * ignore pruned or finalized historical file * Add python tests for historical file sync	2024-11-15 10:00:58 +08:00
Bo QIU	9b68a8b7d7	Implement file sync protocol V2 (#249 ) Some checks failed abi-consistent-check / build-and-compare (push) Has been cancelled Details code-coverage / unittest-cov (push) Has been cancelled Details rust / check (push) Has been cancelled Details rust / test (push) Has been cancelled Details rust / lints (push) Has been cancelled Details functional-test / test (push) Has been cancelled Details * Add new P2P protocol NewFile * Publish NewFile message when any file finalized * handle NewFile message in router * handle NewFile in sync servic to write in db * use propagation source to handle NewFile message * Disable sequential sync and store new file in v2 sync store * Add shard config in FindFile * Add AnnounceFile RPC message in network layer * do not propagate FindFile to whole network * Mark peer connected if FileAnnouncement RPC message received * fix unit test failures * Change P2P protocol version * Ignore py tests of sequential auto sync * Add py test for auto sync v2 * fmt code * remove dummy code in py test * fix random test failure * Add comments * Enable file sync protocol v2 in config file by default	2024-10-28 14:56:08 +08:00
Bo QIU	b6972b97af	Adjust default value for testnet configs (#180 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * Adjust default value for testnet configs * Supports to disable sequential auto sync * Add py tests for auto sync * fix py file name * rm dummy ;py code * change default block confirm count	2024-09-05 10:09:29 +08:00
Bo QIU	82fef674ed	Add more metrics for file sync (#164 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * add metrics in log sync package * udpate auto sync metrics * Add metrics for completed file sync * add more metrics for serial file sync * adjust default timeout value for auto sync * fix metrics rpc for Timer type * add metrics for channel * refactor channel metrics * add timeout metrics for segment sync * refactor channel receiver	2024-08-22 10:42:15 +08:00
Bo QIU	f9120b1e4a	Add metrics for router and auto sync (#161 ) * Add metrics configurations * Add metrics in router package * Add catch up info in sync service state * Add metrics for auto sync * update cargo lock	2024-08-19 09:54:52 +08:00
Bo QIU	9189cabbb2	Supports batch randomly auto sync files (#154 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details	2024-08-08 18:36:08 +08:00
Bo QIU	e1df2f0868	Change hardcoded const variables to configs (#153 )	2024-08-08 16:21:50 +08:00
Bo QIU	891e00fa80	Refactor auto sync to return sync status (#150 ) Some checks are pending abi-consistent-check / build-and-compare (push) Waiting to run Details code-coverage / unittest-cov (push) Waiting to run Details rust / check (push) Waiting to run Details rust / test (push) Waiting to run Details rust / lints (push) Waiting to run Details functional-test / test (push) Waiting to run Details * Refactor auto sync to return sync state * Add auto sync manager to wrap multiple objects * use auto sync manager * fix python tests	2024-08-05 17:30:26 +08:00
Bo QIU	b1c52c7ad6	disable auto sync until catched up (#125 )	2024-07-12 17:45:20 +08:00
Bo QIU	84f455d1d4	Fix some issues in sync package (#111 ) * Change default concurrent sync threads * enhance log level in sync store * Add rwlock in sync store to avoid concurrency issue * enhance serial sync state machine log level * wrap Instant for debug purpose * add timestamp for connecting peers state * Select random peer to sync chunks * return sync peers states instead of connected peers only * Use tokio async RwLock for sync store	2024-07-08 11:47:59 +08:00
Bo QIU	816353dfd4	Supports to concurrently sync files in sequence (#108 ) * Supports to concurrently sync files in sequence * add more comments * refactor random auto sync	2024-07-04 14:04:17 +08:00

11 Commits