Vitaliy Filippov
2c0801f6e4
Configure ESLint and add it to CI
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m20s
Dettagli
Test / test_root_node (push) Successful in 10s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m50s
Dettagli
Test / test_switch_primary (push) Successful in 40s
Dettagli
Test / test_write (push) Successful in 41s
Dettagli
Test / test_write_no_same (push) Successful in 18s
Dettagli
Test / test_write_xor (push) Successful in 1m5s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m17s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m25s
Dettagli
Test / test_heal_ec (push) Successful in 4m46s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 5m38s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m16s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m45s
Dettagli
Test / test_osd_tags (push) Successful in 27s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 7m12s
Dettagli
Test / test_enospc (push) Successful in 2m6s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m34s
Dettagli
Test / test_enospc_imm (push) Successful in 1m43s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m23s
Dettagli
Test / test_enospc_xor (push) Successful in 1m57s
Dettagli
Test / test_enospc_imm_xor (push) Successful in 1m0s
Dettagli
Test / test_scrub (push) Successful in 32s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 31s
Dettagli
Test / test_scrub_xor (push) Successful in 33s
Dettagli
Test / test_nfs (push) Successful in 18s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 27s
Dettagli
Test / test_scrub_ec (push) Successful in 28s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 57s
Dettagli
2024-04-16 02:39:31 +03:00
Vitaliy Filippov
fd83fef1d9
Fix pool deletion
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Dettagli
Test / test_root_node (push) Successful in 9s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m53s
Dettagli
Test / test_switch_primary (push) Successful in 39s
Dettagli
Test / test_write (push) Successful in 39s
Dettagli
Test / test_write_no_same (push) Successful in 18s
Dettagli
Test / test_write_xor (push) Successful in 1m9s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 3m53s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m33s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m27s
Dettagli
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Dettagli
Test / test_heal_csum_4k_dj (push) Has been cancelled
Dettagli
Test / test_heal_csum_4k (push) Has been cancelled
Dettagli
Test / test_osd_tags (push) Has been cancelled
Dettagli
Test / test_enospc (push) Has been cancelled
Dettagli
Test / test_enospc_xor (push) Has been cancelled
Dettagli
Test / test_enospc_imm (push) Has been cancelled
Dettagli
Test / test_enospc_imm_xor (push) Has been cancelled
Dettagli
Test / test_scrub (push) Has been cancelled
Dettagli
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Dettagli
Test / test_scrub_xor (push) Has been cancelled
Dettagli
Test / test_scrub_pg_size_3 (push) Has been cancelled
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Dettagli
Test / test_scrub_ec (push) Has been cancelled
Dettagli
Test / test_nfs (push) Has been cancelled
Dettagli
Test / test_heal_csum_32k_dj (push) Has been cancelled
Dettagli
Test / test_heal_ec (push) Has been cancelled
Dettagli
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Dettagli
Test / test_heal_csum_32k (push) Has been cancelled
Dettagli
2024-04-16 02:20:26 +03:00
Vitaliy Filippov
8d1067971b
Fix pg_effsize (and thus "used space") calculation in monitor
2024-04-16 02:20:18 +03:00
Vitaliy Filippov
ae5af04fde
Add noout flag for OSDs
2024-04-16 02:19:55 +03:00
Vitaliy Filippov
266d038b11
Fix 32-bit build warnings and one error again :-)
Test / test_snapshot_chain_ec (push) Successful in 2m52s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m7s
Dettagli
Test / test_root_node (push) Successful in 8s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m36s
Dettagli
Test / test_switch_primary (push) Successful in 40s
Dettagli
Test / test_write (push) Successful in 41s
Dettagli
Test / test_write_no_same (push) Successful in 18s
Dettagli
Test / test_write_xor (push) Successful in 1m6s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m25s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 3m52s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m21s
Dettagli
Test / test_heal_ec (push) Successful in 5m27s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 5m56s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 5m49s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m43s
Dettagli
Test / test_osd_tags (push) Successful in 21s
Dettagli
Test / test_enospc (push) Successful in 2m18s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m43s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m27s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m29s
Dettagli
Test / test_enospc_imm (push) Successful in 1m5s
Dettagli
Test / test_enospc_xor (push) Successful in 1m38s
Dettagli
Test / test_scrub (push) Successful in 37s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Dettagli
Test / test_enospc_imm_xor (push) Successful in 45s
Dettagli
Test / test_scrub_xor (push) Successful in 33s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 34s
Dettagli
Test / test_scrub_ec (push) Successful in 34s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 43s
Dettagli
Test / test_nfs (push) Successful in 13s
Dettagli
2024-04-11 22:49:33 +03:00
Vitaliy Filippov
ff4414d37e
Release 1.6.0
...
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m25s
Dettagli
Test / test_root_node (push) Successful in 8s
Dettagli
Test / test_rebalance_verify (push) Successful in 4m4s
Dettagli
Test / test_switch_primary (push) Successful in 34s
Dettagli
Test / test_write (push) Successful in 54s
Dettagli
Test / test_write_xor (push) Successful in 52s
Dettagli
Test / test_write_no_same (push) Successful in 13s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m13s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m9s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 4m30s
Dettagli
Test / test_heal_ec (push) Successful in 5m16s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 6m21s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 5m40s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m42s
Dettagli
Test / test_osd_tags (push) Successful in 39s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m35s
Dettagli
Test / test_enospc (push) Successful in 1m43s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m27s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m31s
Dettagli
Test / test_enospc_xor (push) Successful in 1m42s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 39s
Dettagli
Test / test_scrub (push) Successful in 41s
Dettagli
Test / test_enospc_imm (push) Successful in 46s
Dettagli
Test / test_enospc_imm_xor (push) Successful in 52s
Dettagli
Test / test_scrub_xor (push) Successful in 32s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 39s
Dettagli
Test / test_scrub_ec (push) Successful in 34s
Dettagli
Test / test_nfs (push) Successful in 16s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 46s
Dettagli
New features:
- Implement "hierarchical failure domains" and other complex distribution rules, for example
EC 4+2 over 3 DC, with 2 chunks per each DC ([documentation](docs/config/pool.en.md#level_placement))
- Make OSDs handle ENOSPC - now cluster stays online even if some OSDs fill up
to 100 %, only writes requiring free space hang
- Implement Stage/Unstage & volume locking for CSI to prevent parallel mounting
and/or modifications of the same volume
- Warn about full and almost full OSDs in vitastor-cli status
- Add an experimental NBD netlink map mode as an option ([documentation](docs/usage/nbd.en.md))
- Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
- Add [administration docs](docs/usage/admin.en.md)
Bug fixes:
- Fix client operation retry timeout - previously the timeout wasn't applied and writes were
retries almost instantly
- Fix monitors crashing on invalid pool configurations
- Fix journaling - make each journal write wait for all previous journal writes
- Fix monitor thinking that OSD weight is 0 after deleting /osd/config/ key online
- Fix a write stall caused by flusher possibly not trimming journal on rollback
- Set 32k csum_block_size for HDD by default in vitastor-disk
2024-04-09 16:57:59 +03:00
Vitaliy Filippov
0fa7ecc03f
Add also a test for OSD tags
2024-04-09 16:57:59 +03:00
Vitaliy Filippov
c29bfe12eb
Oops - fix filter_by_root_node, add a test for it
2024-04-09 15:48:44 +03:00
Vitaliy Filippov
57bf84ddb2
Fix filtering in mon
2024-04-09 14:51:05 +03:00
Vitaliy Filippov
dff4879c8c
Check if NBD_ATTR_BACKEND_IDENTIFIER is defined
2024-04-09 13:16:58 +03:00
Vitaliy Filippov
af9a853db6
Move NBD netlink map&unmap to separate commands, add "netlink-revive" command
Test / test_splitbrain (push) Successful in 21s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m57s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m18s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m40s
Dettagli
Test / test_rebalance_verify (push) Successful in 4m19s
Dettagli
Test / test_switch_primary (push) Successful in 33s
Dettagli
Test / test_write (push) Successful in 53s
Dettagli
Test / test_write_xor (push) Successful in 58s
Dettagli
Test / test_write_no_same (push) Successful in 13s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m29s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 5m12s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m50s
Dettagli
Test / test_heal_ec (push) Successful in 3m46s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 6m12s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m40s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m52s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m51s
Dettagli
Test / test_enospc (push) Successful in 1m42s
Dettagli
Test / test_enospc_xor (push) Successful in 2m23s
Dettagli
Test / test_enospc_imm (push) Successful in 1m42s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m12s
Dettagli
Test / test_heal_csum_4k (push) Successful in 5m40s
Dettagli
Test / test_enospc_imm_xor (push) Successful in 1m26s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Dettagli
Test / test_scrub (push) Successful in 35s
Dettagli
Test / test_scrub_xor (push) Successful in 27s
Dettagli
Test / test_nfs (push) Successful in 23s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Dettagli
Test / test_scrub_ec (push) Successful in 30s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 43s
Dettagli
2024-04-08 16:34:41 +03:00
Vitaliy Filippov
b7a3275af3
Make netlink optional
2024-04-08 01:51:28 +03:00
Vitaliy Filippov
64c5c4ca26
Fix code style
2024-04-08 01:35:03 +03:00
442a9d838d
nbd-proxy: add configuration via netlink to support kinds of timeouts.
...
PR #58 - https://github.com/vitalif/vitastor/pull/58/commits
By MIND Software LLC
By submitting this pull request, I accept Vitastor CLA
2024-04-08 00:50:08 +03:00
Vitaliy Filippov
6366972fe8
Warn about full and almost full OSDs in status
Test / test_splitbrain (push) Successful in 18s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m23s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 2m53s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m21s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m46s
Dettagli
Test / test_switch_primary (push) Successful in 33s
Dettagli
Test / test_write (push) Successful in 54s
Dettagli
Test / test_write_xor (push) Successful in 48s
Dettagli
Test / test_write_no_same (push) Successful in 14s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m22s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m34s
Dettagli
Test / test_heal_ec (push) Successful in 3m38s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 5m44s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m45s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m34s
Dettagli
Test / test_enospc (push) Successful in 1m47s
Dettagli
Test / test_enospc_xor (push) Successful in 2m41s
Dettagli
Test / test_enospc_imm (push) Successful in 1m31s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m15s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Dettagli
Test / test_scrub (push) Successful in 35s
Dettagli
Test / test_scrub_xor (push) Successful in 26s
Dettagli
Test / test_enospc_imm_xor (push) Successful in 1m13s
Dettagli
Test / test_nfs (push) Successful in 24s
Dettagli
Test / test_scrub_ec (push) Successful in 33s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 34s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 42s
Dettagli
2024-04-07 19:39:51 +03:00
Vitaliy Filippov
2b863fb715
Add ENOSPC handling tests
2024-04-07 19:39:33 +03:00
Vitaliy Filippov
3bf4dd5abd
Fix client op retry timeout - do not retry immediately
2024-04-07 19:08:36 +03:00
Vitaliy Filippov
3b84dcaedd
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
Test / test_rm (push) Successful in 14s
Dettagli
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m59s
Dettagli
Test / test_snapshot_down (push) Successful in 28s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 30s
Dettagli
Test / test_splitbrain (push) Successful in 27s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m41s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m12s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m33s
Dettagli
Test / test_rebalance_verify (push) Successful in 4m24s
Dettagli
Test / test_switch_primary (push) Successful in 34s
Dettagli
Test / test_write (push) Successful in 53s
Dettagli
Test / test_write_xor (push) Successful in 51s
Dettagli
Test / test_write_no_same (push) Successful in 11s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 3m11s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 6m3s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 4m57s
Dettagli
Test / test_heal_ec (push) Successful in 4m52s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 4m37s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m55s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m42s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m41s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m45s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 44s
Dettagli
Test / test_scrub (push) Successful in 48s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m6s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 1m30s
Dettagli
Test / test_scrub_ec (push) Successful in 51s
Dettagli
Test / test_nfs (push) Successful in 39s
Dettagli
Test / test_heal_csum_4k (push) Successful in 5m22s
Dettagli
Test / test_scrub_xor (push) Successful in 18s
Dettagli
2024-04-07 18:02:05 +03:00
Vitaliy Filippov
20fbc4a745
Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
Test / test_rm (push) Successful in 16s
Dettagli
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m4s
Dettagli
Test / test_snapshot_down (push) Successful in 26s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 30s
Dettagli
Test / test_splitbrain (push) Successful in 18s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m32s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m11s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m34s
Dettagli
Test / test_rebalance_verify (push) Successful in 4m12s
Dettagli
Test / test_switch_primary (push) Successful in 33s
Dettagli
Test / test_write (push) Successful in 52s
Dettagli
Test / test_write_xor (push) Successful in 54s
Dettagli
Test / test_write_no_same (push) Successful in 13s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m6s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 5m1s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 4m15s
Dettagli
Test / test_heal_ec (push) Successful in 4m11s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 6m4s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 5m59s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m42s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m40s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 55s
Dettagli
Test / test_scrub (push) Successful in 58s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m22s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m24s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 2m11s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 25s
Dettagli
Test / test_scrub_ec (push) Successful in 23s
Dettagli
Test / test_nfs (push) Successful in 13s
Dettagli
Test / test_scrub_xor (push) Successful in 18s
Dettagli
2024-04-07 12:39:46 +03:00
Vitaliy Filippov
02993ee1dd
Implement Stage/Unstage & volume locking for CSI to prevent parallel modifications of the same volume
2024-04-07 11:48:19 +03:00
Vitaliy Filippov
3629dbc54d
Plug the new PG combinator into monitor
Test / test_move_reappear (push) Successful in 22s
Dettagli
Test / test_snapshot_down (push) Successful in 25s
Dettagli
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m46s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 24s
Dettagli
Test / test_splitbrain (push) Successful in 17s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m36s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m17s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m50s
Dettagli
Test / test_switch_primary (push) Successful in 33s
Dettagli
Test / test_write (push) Successful in 50s
Dettagli
Test / test_write_xor (push) Successful in 56s
Dettagli
Test / test_write_no_same (push) Successful in 14s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 3m29s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 5m23s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 4m23s
Dettagli
Test / test_heal_ec (push) Successful in 4m57s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 5m21s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m33s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m55s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m54s
Dettagli
Test / test_scrub (push) Successful in 1m32s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 1m12s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 7m12s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m1s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 1m41s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m22s
Dettagli
Test / test_scrub_ec (push) Successful in 44s
Dettagli
Test / test_nfs (push) Successful in 16s
Dettagli
Test / test_scrub_xor (push) Successful in 18s
Dettagli
2024-04-07 02:44:17 +03:00
Vitaliy Filippov
29284bef40
Implement new DSL/rule-based PG generation algorithm
2024-04-07 00:36:20 +03:00
Vitaliy Filippov
6a924d6066
Extract PG combinator into a separate module
2024-04-07 00:36:20 +03:00
Vitaliy Filippov
9fe779a691
Do not die on invalid pool configurations
Test / test_rm (push) Successful in 16s
Dettagli
Test / test_move_reappear (push) Successful in 24s
Dettagli
Test / test_snapshot_down (push) Successful in 26s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 31s
Dettagli
Test / test_splitbrain (push) Successful in 17s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m34s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m12s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 2m59s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m27s
Dettagli
Test / test_switch_primary (push) Successful in 34s
Dettagli
Test / test_write (push) Successful in 55s
Dettagli
Test / test_write_xor (push) Successful in 54s
Dettagli
Test / test_write_no_same (push) Successful in 15s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m37s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m8s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m48s
Dettagli
Test / test_heal_ec (push) Successful in 3m47s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 6m8s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m18s
Dettagli
Test / test_heal_csum_32k (push) Successful in 7m9s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 7m7s
Dettagli
Test / test_scrub (push) Successful in 1m9s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Dettagli
Test / test_scrub_xor (push) Successful in 1m7s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m20s
Dettagli
Test / test_heal_csum_4k (push) Successful in 5m58s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 2m9s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m4s
Dettagli
Test / test_nfs (push) Successful in 15s
Dettagli
Test / test_scrub_ec (push) Successful in 21s
Dettagli
2024-04-07 00:36:20 +03:00
Vitaliy Filippov
31c2751b9b
Move NBD/VDUSE map/unmap functions to a separate file
2024-04-07 00:36:09 +03:00
Vitaliy Filippov
c5195666cd
Fix journal sequencing: make each journal write wait for all previous journal writes
Test / test_snapshot_ec (push) Successful in 31s
Dettagli
Test / test_rm (push) Successful in 15s
Dettagli
Test / test_snapshot_down (push) Successful in 30s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 32s
Dettagli
Test / test_splitbrain (push) Successful in 25s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m11s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 2m35s
Dettagli
Test / test_rebalance_verify (push) Successful in 3m10s
Dettagli
Test / test_switch_primary (push) Successful in 39s
Dettagli
Test / test_write (push) Successful in 43s
Dettagli
Test / test_write_no_same (push) Successful in 18s
Dettagli
Test / test_write_xor (push) Successful in 1m3s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m22s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 5m11s
Dettagli
Test / test_heal_ec (push) Successful in 4m23s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 4m55s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m31s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m29s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 7m18s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 1m0s
Dettagli
Test / test_scrub (push) Failing after 3m19s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Dettagli
Test / test_scrub_xor (push) Successful in 58s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m13s
Dettagli
Test / test_scrub_ec (push) Successful in 50s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 1m51s
Dettagli
Test / test_heal_csum_4k (push) Successful in 5m13s
Dettagli
Test / test_nfs (push) Successful in 23s
Dettagli
2024-04-06 23:53:12 +03:00
Vitaliy Filippov
f36d7eb76c
Fix monitor thinking that OSD weight is 0 after deleting /osd/config/ key
Test / test_rm (push) Successful in 16s
Dettagli
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m30s
Dettagli
Test / test_snapshot_down (push) Successful in 31s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 32s
Dettagli
Test / test_splitbrain (push) Successful in 23s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m13s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m22s
Dettagli
Test / test_rebalance_verify (push) Successful in 4m5s
Dettagli
Test / test_switch_primary (push) Successful in 34s
Dettagli
Test / test_write (push) Successful in 52s
Dettagli
Test / test_write_xor (push) Successful in 52s
Dettagli
Test / test_write_no_same (push) Successful in 14s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m41s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 3m51s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Dettagli
Test / test_heal_ec (push) Successful in 4m35s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 6m0s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m48s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 7m7s
Dettagli
Test / test_scrub (push) Successful in 1m36s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 1m20s
Dettagli
Test / test_scrub_xor (push) Successful in 56s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m37s
Dettagli
Test / test_nfs (push) Successful in 18s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 47s
Dettagli
Test / test_scrub_ec (push) Successful in 27s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 1m3s
Dettagli
2024-04-05 23:14:46 +03:00
Vitaliy Filippov
dd7f651de1
Add --max-request-bytes=104857600 to etcd params in tests
2024-04-05 23:14:46 +03:00
Vitaliy Filippov
a2994ecd0d
Fix flusher possibly not trimming journal on rollback
2024-04-05 23:14:39 +03:00
Vitaliy Filippov
5d3aaf016b
Add administration docs
2024-03-31 01:54:52 +03:00
Vitaliy Filippov
0b097ca3f2
Set 32k csum_block_size for HDD by default
2024-03-30 16:16:49 +03:00
Vitaliy Filippov
989675a780
s/etcd_ws_keepalive_timeout/etcd_ws_keepalive_interval/ in docs
2024-03-26 01:56:08 +03:00
Vitaliy Filippov
f8c403ec9e
Add newer benchmark results
2024-03-23 18:28:48 +03:00
Vitaliy Filippov
bfbb85e653
Replace -Oanything with -O3, not just -O/-O1/-O2
Test / test_move_reappear (push) Successful in 22s
Dettagli
Test / test_rm (push) Successful in 13s
Dettagli
Test / test_snapshot_down (push) Successful in 31s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 32s
Dettagli
Test / test_splitbrain (push) Successful in 21s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m11s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m14s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 3m29s
Dettagli
Test / test_rebalance_verify (push) Successful in 4m4s
Dettagli
Test / test_switch_primary (push) Successful in 40s
Dettagli
Test / test_write (push) Successful in 42s
Dettagli
Test / test_write_no_same (push) Successful in 17s
Dettagli
Test / test_write_xor (push) Successful in 1m3s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 4m36s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 3m43s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 3m36s
Dettagli
Test / test_heal_ec (push) Successful in 6m7s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 5m39s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 5m33s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m38s
Dettagli
Test / test_scrub (push) Successful in 1m52s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m32s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 6m30s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m25s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 1m32s
Dettagli
Test / test_scrub_xor (push) Successful in 31s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 35s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 43s
Dettagli
Test / test_nfs (push) Successful in 13s
Dettagli
Test / test_scrub_ec (push) Successful in 19s
Dettagli
2024-03-18 02:03:44 +03:00
Vitaliy Filippov
9ad6822353
Release 1.5.0
...
Test / test_rm (push) Successful in 14s
Dettagli
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m36s
Dettagli
Test / test_snapshot_down (push) Successful in 31s
Dettagli
Test / test_snapshot_down_ec (push) Successful in 30s
Dettagli
Test / test_splitbrain (push) Successful in 24s
Dettagli
Test / test_snapshot_chain (push) Successful in 2m20s
Dettagli
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Dettagli
Test / test_rebalance_verify_imm (push) Successful in 5m11s
Dettagli
Test / test_rebalance_verify (push) Successful in 5m55s
Dettagli
Test / test_switch_primary (push) Successful in 33s
Dettagli
Test / test_rebalance_verify_ec_imm (push) Successful in 4m26s
Dettagli
Test / test_write (push) Successful in 54s
Dettagli
Test / test_write_xor (push) Successful in 57s
Dettagli
Test / test_write_no_same (push) Successful in 19s
Dettagli
Test / test_rebalance_verify_ec (push) Successful in 7m21s
Dettagli
Test / test_heal_pg_size_2 (push) Successful in 4m36s
Dettagli
Test / test_heal_csum_32k_dmj (push) Successful in 4m33s
Dettagli
Test / test_heal_ec (push) Successful in 6m15s
Dettagli
Test / test_heal_csum_32k_dj (push) Successful in 6m31s
Dettagli
Test / test_heal_csum_32k (push) Successful in 6m29s
Dettagli
Test / test_heal_csum_4k_dmj (push) Successful in 6m15s
Dettagli
Test / test_scrub_zero_osd_2 (push) Successful in 1m16s
Dettagli
Test / test_scrub (push) Successful in 1m18s
Dettagli
Test / test_scrub_xor (push) Successful in 1m13s
Dettagli
Test / test_heal_csum_4k_dj (push) Successful in 7m10s
Dettagli
Test / test_scrub_ec (push) Successful in 56s
Dettagli
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Dettagli
Test / test_heal_csum_4k (push) Successful in 6m2s
Dettagli
Test / test_scrub_pg_size_3 (push) Successful in 2m11s
Dettagli
Test / test_nfs (push) Successful in 11s
Dettagli
After half a year of hard work, VitastorFS is finally here ! :-)
New features:
- VitastorFS, a full-featured clustered (read-write-many) file system.
Documentation: [VitastorFS](docs/usage/nfs.en.md)
- Embedded key-value database implementation based on Parallel Optimistic B-Tree
algorithm and used for the metadata of VitastorFS
- Pool management commands in vitastor-cli (create-pool, list-pools, rm-pool, modify-pool).
Thanks MIND Software (https://mindsw.io ) for their contribution!
[Documentation](docs/usage/cli.en.md#create-pool)
Bug fixes:
- Fix a very rare "infinite loop" in the client library
- Fix a rare OSD hang on during start when zeroing out bad metadata entries left from the previous run
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
2043b4e374
Fix build errors for gcc 8
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
de840e6fe3
Reduce kv-cli loadjson load parallelism to 16
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
b5e04bf809
Fix build warning
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
8807a1623b
Fix markdown tables
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
f12855c31b
Add vitastor-kv to packages
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
e75dcc9a71
Add documentation for VitastorFS
2024-03-16 15:16:43 +03:00
Vitaliy Filippov
88516ab4bd
Remove extra log
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
6221126b4f
Allow to print simple-offsets just given the device size
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
6783d4a13c
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
dcbe1afac3
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
0bde28c24a
Make nfs_do_rmw a library function
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
bb8ca6184e
Support setattr guard
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
87310ef7bb
Support ctime
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
4f4b2dab80
Log NFS liveness checks
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
f70da82317
Add loadjson command to vitastor-kv
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
idelson