Commit Graph

33 Commits

Author SHA1 Message Date
peilun-conflux
2ed6bca446
Process padding data in groups to avoid OOM. (#27) 2024-03-14 11:37:34 +08:00
Chenxing Li
ef3044fafc
Revert incorrect submodule update (#30) 2024-03-14 10:10:41 +08:00
0g-peterzhb
c276faf1fd
update url (#26) 2024-03-12 20:33:06 +08:00
0g-peterzhb
2e1d076460
@peter/update submodule (#25)
* update modules
2024-03-12 18:49:51 +08:00
peilun-conflux
39ca3113d8
Cache zero hash results. (#24)
* Cache zero hash results.

* Fix clippy.
2024-03-01 10:08:10 +08:00
peilun-conflux
3e2068d363
Fix a wrong assertion when we insert the last tx again. (#23) 2024-02-28 16:59:30 +08:00
peilun-conflux
310bf1c8dd
Save updated mpt nodes from proof to DB. (#20)
* Save updated mpt nodes from proof to DB.

* Free disk space for Github Actions.

* Use an alternative Rust cache action.

* Fix action usage.

* Do not free large packages.
2024-02-06 18:46:35 +08:00
MiniFrenchBread
01c2dd1135
feat: upload_segments (#21)
* feat: upload_segments

* feat: max request body
2024-02-06 17:51:31 +08:00
Bo QIU
8f328a9eab
enhance py test framework to support more args (#19) 2024-02-04 15:07:42 +08:00
Bo QIU
80cebd4c70
refactor python run all (#18) 2024-02-01 15:54:31 +08:00
Bo QIU
012f5b34ec
hotfix for py test (#17) 2024-01-31 18:13:25 +08:00
Bo QIU
cb8c6ebf81
enhance test framework for extensibility (#16)
* enhance test framework for extensibility

* extract common tests dir
2024-01-31 16:56:13 +08:00
Bo QIU
c2b8b1cab3
Rpc enhancements (#15)
* add admin rpc to terminate file or chunks sync

* Disallow to change file sync goal when failed

* split admin rpc into separate endpoints

* Support to launch public and private rpc at one port

* use one rpc port for python test

* fix lint

* restart to sync file or chunks if sync already completed or failed
2024-01-30 16:50:35 +08:00
Bo QIU
e7011b4657
use common actoin to setup rust with cargo cache enabled (#14)
* use common actoin to setup rust with cargo cache enabled

* hotfix for actions syntax

* hotfix actions syntax

* fix wrong action path

* aaa

* bbb

* ccc

* ddd
2024-01-29 16:25:04 +08:00
peilun-conflux
19d9d31b0c
Fix proof data update in corner cases. (#13)
* Fix proof data update in corner cases.

* Fix fmt.
2024-01-28 16:52:28 +08:00
Bo QIU
a4abe2b2a4
fix build dependency isuse (#12)
* fix build dependency isuse

* cargo fmt

* fix lint failure in CI

* update toolchain
2024-01-26 19:48:40 +08:00
MiniFrenchBread
7667e02019
fix: contract, tests, clippy (#11) 2024-01-26 16:13:18 +08:00
peilun-conflux
0c123500c9
Update the merkle tree with proof data. (#9)
* Add proof data for chunk proof.

* Support file proof.

* Update with segment proof and fix issues.

* Fix more issues.

* Fix the process of file proof.

* Merge branch 'main' into fix_proof

* Enable sync_test.

* Fix wrongly updated submodule.

* Fix bsc node version.
2024-01-26 10:29:09 +08:00
Bo QIU
2c2dba8730
fix ci failure (#10)
* fix ci failure

* fix ci failures

* fix py test issue

* disable --all-features for code coverage CI

* do not fail ci if failed to upload code coverage
2024-01-25 19:00:00 +08:00
Bo QIU
8b225fde43
Fix python test (#8)
* Fix stdouterr issue when shutdown storage node

* Fix random failure for submission test

* add more info for failed rpc

* use single file instead of subprocess pipe to launch CLI

* Opt test_all for windows

* wait for log entry before file sync by admin
2024-01-24 20:42:25 +08:00
MiniFrenchBread
7479f56474
feat: write cached segments to storage on log synced (#7) 2024-01-23 18:47:14 +08:00
peilun-conflux
77bf2e122f
Merge pull request #6 from zero-gravity-labs/test-sync-chunks
add python test for chunks sync by rpc
2024-01-23 00:06:14 +08:00
boqiu
99ead6423b add python test for chunks sync by rpc 2024-01-22 18:19:28 +08:00
Bo QIU
613c1a8eb5
add readme for python tests (#5) 2024-01-19 21:26:33 +08:00
peilun-conflux
877f484dd0
Merge pull request #2 from zero-gravity-labs/filter_address
Filter address in log sync.
2024-01-19 19:45:27 +08:00
Bo QIU
9b4b0436c3
Supports to sync partial chunks (#4)
* refactor p2p signed message

* add new pubsub messages in network layer to find chunks

* handle find chunks pubsub message in router

* Supports to sync partial chunks

* add admin rpc to sync chunks

* limit number of chunks to sync at a time

* refactor code to sync file and chunks

* add more switches to trigger file sync

* fix ut failure

* refactor code
2024-01-19 14:04:59 +08:00
Bo QIU
971d344acd
fmt code (#3) 2024-01-19 10:56:59 +08:00
Peilun Li
a26cef470a Merge branch 'main' into filter_address 2024-01-17 10:57:59 +08:00
Peilun Li
986bfa412c Add to start_recover. 2024-01-17 10:57:07 +08:00
peilun-conflux
5253436226
Merge pull request #1 from zero-gravity-labs/disable_check
Disable write window size check.
2024-01-17 10:55:34 +08:00
Peilun Li
e236c2f70a Filter address in log sync. 2024-01-16 17:54:23 +08:00
Peilun Li
6e15838060 Disable write window size check. 2024-01-10 17:29:11 +08:00
Peilun Li
9058467be1 Initial commit 2024-01-04 18:05:32 +08:00