Vitaliy Filippov
9301c857b1
Release 1.6.1
...
Test / test_snapshot_chain_ec (push) Successful in 2m59s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m16s
Details
Test / test_root_node (push) Successful in 10s
Details
Test / test_rebalance_verify (push) Successful in 3m50s
Details
Test / test_switch_primary (push) Successful in 37s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_write_xor (push) Successful in 1m20s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m20s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m54s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m25s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m52s
Details
Test / test_heal_ec (push) Successful in 6m12s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m40s
Details
Test / test_heal_csum_32k (push) Successful in 6m21s
Details
Test / test_osd_tags (push) Successful in 21s
Details
Test / test_enospc (push) Successful in 2m25s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m5s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m3s
Details
Test / test_heal_csum_4k (push) Successful in 6m1s
Details
Test / test_scrub (push) Successful in 43s
Details
Test / test_enospc_imm (push) Successful in 47s
Details
Test / test_enospc_xor (push) Successful in 1m38s
Details
Test / test_enospc_imm_xor (push) Successful in 1m0s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 26s
Details
Test / test_scrub_xor (push) Successful in 36s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 33s
Details
Test / test_scrub_ec (push) Successful in 26s
Details
Test / test_scrub_pg_size_3 (push) Successful in 47s
Details
Test / test_nfs (push) Successful in 16s
Details
A bunch of monitor fixes
- Add noout flag for OSDs (/vitastor/config/osd/xx)
- Fix "effective" size of degraded PGs (and thus "used space") calculation in monitor
- Fix monitor not clearing PGs of deleted pools
- Fix incorrect PG generation with hosts with 0 OSDs
- Fix monitor crashing during primary OSD recheck when pool has no PGs
- Fix monitor crashing when node_placement included non-existing OSDs
- Fix possible data movement after removing OSDs reweighted to 0
- Remove extra empty keys from pool configurations created by vitastor-cli create-pool
- Fix 32-bit build
2024-04-22 02:01:29 +03:00
Vitaliy Filippov
3094358ec2
Fix autovivification leading to extra empty keys in pool-create
Test / test_snapshot_chain_ec (push) Successful in 2m48s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m4s
Details
Test / test_root_node (push) Successful in 10s
Details
Test / test_rebalance_verify (push) Successful in 3m44s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 19s
Details
Test / test_write_xor (push) Successful in 1m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m36s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m21s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m33s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m41s
Details
Test / test_heal_ec (push) Successful in 6m5s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m29s
Details
Test / test_heal_csum_32k (push) Successful in 6m11s
Details
Test / test_osd_tags (push) Successful in 22s
Details
Test / test_enospc (push) Successful in 2m30s
Details
Test / test_heal_csum_4k (push) Successful in 6m9s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m11s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m14s
Details
Test / test_scrub (push) Successful in 42s
Details
Test / test_enospc_imm (push) Successful in 47s
Details
Test / test_enospc_xor (push) Successful in 1m4s
Details
Test / test_enospc_imm_xor (push) Successful in 1m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 27s
Details
Test / test_scrub_xor (push) Successful in 27s
Details
Test / test_nfs (push) Successful in 20s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 49s
Details
Test / test_scrub_ec (push) Successful in 31s
Details
2024-04-20 02:04:09 +03:00
Vitaliy Filippov
87f666d2a2
Filter out OSDs reweighted to 0
2024-04-20 02:03:53 +03:00
Vitaliy Filippov
bd7fe4ef8f
Filter out non-existing OSDs added in node_placement
2024-04-20 02:03:36 +03:00
Vitaliy Filippov
1b3f9a1416
Do not set non-existing OSD weight to 0, we'll remove them instead
2024-04-20 02:03:11 +03:00
Vitaliy Filippov
a7b7354f38
Do not recheck primary distribution when pool has no PGs
2024-04-20 02:02:47 +03:00
Vitaliy Filippov
765befa22f
Remove empty nodes from tree because PG DSL expects that all leaf nodes are OSDs
2024-04-20 02:02:28 +03:00
Vitaliy Filippov
87b3ab94fe
Do not disable require-atomic-updates and no-unused-vars
2024-04-20 02:02:13 +03:00
Vitaliy Filippov
2c0801f6e4
Configure ESLint and add it to CI
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m20s
Details
Test / test_root_node (push) Successful in 10s
Details
Test / test_rebalance_verify (push) Successful in 3m50s
Details
Test / test_switch_primary (push) Successful in 40s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_write_xor (push) Successful in 1m5s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m17s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m25s
Details
Test / test_heal_ec (push) Successful in 4m46s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m38s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m16s
Details
Test / test_heal_csum_32k (push) Successful in 6m45s
Details
Test / test_osd_tags (push) Successful in 27s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m12s
Details
Test / test_enospc (push) Successful in 2m6s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m34s
Details
Test / test_enospc_imm (push) Successful in 1m43s
Details
Test / test_heal_csum_4k (push) Successful in 6m23s
Details
Test / test_enospc_xor (push) Successful in 1m57s
Details
Test / test_enospc_imm_xor (push) Successful in 1m0s
Details
Test / test_scrub (push) Successful in 32s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 31s
Details
Test / test_scrub_xor (push) Successful in 33s
Details
Test / test_nfs (push) Successful in 18s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 27s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
Test / test_scrub_pg_size_3 (push) Successful in 57s
Details
2024-04-16 02:39:31 +03:00
Vitaliy Filippov
fd83fef1d9
Fix pool deletion
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Details
Test / test_root_node (push) Successful in 9s
Details
Test / test_rebalance_verify (push) Successful in 3m53s
Details
Test / test_switch_primary (push) Successful in 39s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_write_xor (push) Successful in 1m9s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m53s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m33s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m27s
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_osd_tags (push) Has been cancelled
Details
Test / test_enospc (push) Has been cancelled
Details
Test / test_enospc_xor (push) Has been cancelled
Details
Test / test_enospc_imm (push) Has been cancelled
Details
Test / test_enospc_imm_xor (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
Test / test_nfs (push) Has been cancelled
Details
Test / test_heal_csum_32k_dj (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_32k (push) Has been cancelled
Details
2024-04-16 02:20:26 +03:00
Vitaliy Filippov
8d1067971b
Fix pg_effsize (and thus "used space") calculation in monitor
2024-04-16 02:20:18 +03:00
Vitaliy Filippov
ae5af04fde
Add noout flag for OSDs
2024-04-16 02:19:55 +03:00
Vitaliy Filippov
266d038b11
Fix 32-bit build warnings and one error again :-)
Test / test_snapshot_chain_ec (push) Successful in 2m52s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m7s
Details
Test / test_root_node (push) Successful in 8s
Details
Test / test_rebalance_verify (push) Successful in 3m36s
Details
Test / test_switch_primary (push) Successful in 40s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_write_xor (push) Successful in 1m6s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m25s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m52s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m21s
Details
Test / test_heal_ec (push) Successful in 5m27s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m56s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m49s
Details
Test / test_heal_csum_32k (push) Successful in 6m43s
Details
Test / test_osd_tags (push) Successful in 21s
Details
Test / test_enospc (push) Successful in 2m18s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m43s
Details
Test / test_heal_csum_4k (push) Successful in 6m27s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m29s
Details
Test / test_enospc_imm (push) Successful in 1m5s
Details
Test / test_enospc_xor (push) Successful in 1m38s
Details
Test / test_scrub (push) Successful in 37s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Details
Test / test_enospc_imm_xor (push) Successful in 45s
Details
Test / test_scrub_xor (push) Successful in 33s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 34s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 43s
Details
Test / test_nfs (push) Successful in 13s
Details
2024-04-11 22:49:33 +03:00
Vitaliy Filippov
ff4414d37e
Release 1.6.0
...
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m25s
Details
Test / test_root_node (push) Successful in 8s
Details
Test / test_rebalance_verify (push) Successful in 4m4s
Details
Test / test_switch_primary (push) Successful in 34s
Details
Test / test_write (push) Successful in 54s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m9s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m30s
Details
Test / test_heal_ec (push) Successful in 5m16s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m21s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m40s
Details
Test / test_heal_csum_32k (push) Successful in 6m42s
Details
Test / test_osd_tags (push) Successful in 39s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m35s
Details
Test / test_enospc (push) Successful in 1m43s
Details
Test / test_heal_csum_4k (push) Successful in 6m27s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m31s
Details
Test / test_enospc_xor (push) Successful in 1m42s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 39s
Details
Test / test_scrub (push) Successful in 41s
Details
Test / test_enospc_imm (push) Successful in 46s
Details
Test / test_enospc_imm_xor (push) Successful in 52s
Details
Test / test_scrub_xor (push) Successful in 32s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 39s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
Test / test_nfs (push) Successful in 16s
Details
Test / test_scrub_pg_size_3 (push) Successful in 46s
Details
New features:
- Implement "hierarchical failure domains" and other complex distribution rules, for example
EC 4+2 over 3 DC, with 2 chunks per each DC ([documentation](docs/config/pool.en.md#level_placement))
- Make OSDs handle ENOSPC - now cluster stays online even if some OSDs fill up
to 100 %, only writes requiring free space hang
- Implement Stage/Unstage & volume locking for CSI to prevent parallel mounting
and/or modifications of the same volume
- Warn about full and almost full OSDs in vitastor-cli status
- Add an experimental NBD netlink map mode as an option ([documentation](docs/usage/nbd.en.md))
- Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
- Add [administration docs](docs/usage/admin.en.md)
Bug fixes:
- Fix client operation retry timeout - previously the timeout wasn't applied and writes were
retries almost instantly
- Fix monitors crashing on invalid pool configurations
- Fix journaling - make each journal write wait for all previous journal writes
- Fix monitor thinking that OSD weight is 0 after deleting /osd/config/ key online
- Fix a write stall caused by flusher possibly not trimming journal on rollback
- Set 32k csum_block_size for HDD by default in vitastor-disk
2024-04-09 16:57:59 +03:00
Vitaliy Filippov
0fa7ecc03f
Add also a test for OSD tags
2024-04-09 16:57:59 +03:00
Vitaliy Filippov
c29bfe12eb
Oops - fix filter_by_root_node, add a test for it
2024-04-09 15:48:44 +03:00
Vitaliy Filippov
57bf84ddb2
Fix filtering in mon
2024-04-09 14:51:05 +03:00
Vitaliy Filippov
dff4879c8c
Check if NBD_ATTR_BACKEND_IDENTIFIER is defined
2024-04-09 13:16:58 +03:00
Vitaliy Filippov
af9a853db6
Move NBD netlink map&unmap to separate commands, add "netlink-revive" command
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m57s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m18s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m40s
Details
Test / test_rebalance_verify (push) Successful in 4m19s
Details
Test / test_switch_primary (push) Successful in 33s
Details
Test / test_write (push) Successful in 53s
Details
Test / test_write_xor (push) Successful in 58s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m29s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m12s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m50s
Details
Test / test_heal_ec (push) Successful in 3m46s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m12s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m40s
Details
Test / test_heal_csum_32k (push) Successful in 6m52s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m51s
Details
Test / test_enospc (push) Successful in 1m42s
Details
Test / test_enospc_xor (push) Successful in 2m23s
Details
Test / test_enospc_imm (push) Successful in 1m42s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m12s
Details
Test / test_heal_csum_4k (push) Successful in 5m40s
Details
Test / test_enospc_imm_xor (push) Successful in 1m26s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Details
Test / test_scrub (push) Successful in 35s
Details
Test / test_scrub_xor (push) Successful in 27s
Details
Test / test_nfs (push) Successful in 23s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Details
Test / test_scrub_ec (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 43s
Details
2024-04-08 16:34:41 +03:00
Vitaliy Filippov
b7a3275af3
Make netlink optional
2024-04-08 01:51:28 +03:00
Vitaliy Filippov
64c5c4ca26
Fix code style
2024-04-08 01:35:03 +03:00
idelson
442a9d838d
nbd-proxy: add configuration via netlink to support kinds of timeouts.
...
PR #58 - https://github.com/vitalif/vitastor/pull/58/commits
By MIND Software LLC
By submitting this pull request, I accept Vitastor CLA
2024-04-08 00:50:08 +03:00
Vitaliy Filippov
6366972fe8
Warn about full and almost full OSDs in status
Test / test_splitbrain (push) Successful in 18s
Details
Test / test_snapshot_chain (push) Successful in 2m23s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m53s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m21s
Details
Test / test_rebalance_verify (push) Successful in 3m46s
Details
Test / test_switch_primary (push) Successful in 33s
Details
Test / test_write (push) Successful in 54s
Details
Test / test_write_xor (push) Successful in 48s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m22s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m34s
Details
Test / test_heal_ec (push) Successful in 3m38s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Details
Test / test_heal_csum_32k (push) Successful in 6m45s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m34s
Details
Test / test_enospc (push) Successful in 1m47s
Details
Test / test_enospc_xor (push) Successful in 2m41s
Details
Test / test_enospc_imm (push) Successful in 1m31s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Details
Test / test_heal_csum_4k (push) Successful in 6m15s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Details
Test / test_scrub (push) Successful in 35s
Details
Test / test_scrub_xor (push) Successful in 26s
Details
Test / test_enospc_imm_xor (push) Successful in 1m13s
Details
Test / test_nfs (push) Successful in 24s
Details
Test / test_scrub_ec (push) Successful in 33s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 42s
Details
2024-04-07 19:39:51 +03:00
Vitaliy Filippov
2b863fb715
Add ENOSPC handling tests
2024-04-07 19:39:33 +03:00
Vitaliy Filippov
3bf4dd5abd
Fix client op retry timeout - do not retry immediately
2024-04-07 19:08:36 +03:00
Vitaliy Filippov
3b84dcaedd
Handle ENOSPC during write - rollback partial EC writes, remember partial replica writes
Test / test_rm (push) Successful in 14s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m59s
Details
Test / test_snapshot_down (push) Successful in 28s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 27s
Details
Test / test_snapshot_chain (push) Successful in 2m41s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m12s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m33s
Details
Test / test_rebalance_verify (push) Successful in 4m24s
Details
Test / test_switch_primary (push) Successful in 34s
Details
Test / test_write (push) Successful in 53s
Details
Test / test_write_xor (push) Successful in 51s
Details
Test / test_write_no_same (push) Successful in 11s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m11s
Details
Test / test_rebalance_verify_ec (push) Successful in 6m3s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m57s
Details
Test / test_heal_ec (push) Successful in 4m52s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m37s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m55s
Details
Test / test_heal_csum_32k (push) Successful in 6m42s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m41s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m45s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 44s
Details
Test / test_scrub (push) Successful in 48s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m6s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m30s
Details
Test / test_scrub_ec (push) Successful in 51s
Details
Test / test_nfs (push) Successful in 39s
Details
Test / test_heal_csum_4k (push) Successful in 5m22s
Details
Test / test_scrub_xor (push) Successful in 18s
Details
2024-04-07 18:02:05 +03:00
Vitaliy Filippov
20fbc4a745
Add --pg parameter to vitastor-cli describe, print objects with 0x in human-readable format too
Test / test_rm (push) Successful in 16s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m4s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 18s
Details
Test / test_snapshot_chain (push) Successful in 2m32s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m11s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m34s
Details
Test / test_rebalance_verify (push) Successful in 4m12s
Details
Test / test_switch_primary (push) Successful in 33s
Details
Test / test_write (push) Successful in 52s
Details
Test / test_write_xor (push) Successful in 54s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m6s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m1s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m15s
Details
Test / test_heal_ec (push) Successful in 4m11s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m4s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m59s
Details
Test / test_heal_csum_32k (push) Successful in 6m42s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m40s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 55s
Details
Test / test_scrub (push) Successful in 58s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m22s
Details
Test / test_heal_csum_4k (push) Successful in 6m24s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m11s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 25s
Details
Test / test_scrub_ec (push) Successful in 23s
Details
Test / test_nfs (push) Successful in 13s
Details
Test / test_scrub_xor (push) Successful in 18s
Details
2024-04-07 12:39:46 +03:00
Vitaliy Filippov
02993ee1dd
Implement Stage/Unstage & volume locking for CSI to prevent parallel modifications of the same volume
2024-04-07 11:48:19 +03:00
Vitaliy Filippov
3629dbc54d
Plug the new PG combinator into monitor
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m46s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_snapshot_chain (push) Successful in 2m36s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m17s
Details
Test / test_rebalance_verify (push) Successful in 3m50s
Details
Test / test_switch_primary (push) Successful in 33s
Details
Test / test_write (push) Successful in 50s
Details
Test / test_write_xor (push) Successful in 56s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m29s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m23s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m23s
Details
Test / test_heal_ec (push) Successful in 4m57s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m21s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m33s
Details
Test / test_heal_csum_32k (push) Successful in 6m55s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m54s
Details
Test / test_scrub (push) Successful in 1m32s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m12s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m12s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m41s
Details
Test / test_heal_csum_4k (push) Successful in 6m22s
Details
Test / test_scrub_ec (push) Successful in 44s
Details
Test / test_nfs (push) Successful in 16s
Details
Test / test_scrub_xor (push) Successful in 18s
Details
2024-04-07 02:44:17 +03:00
Vitaliy Filippov
29284bef40
Implement new DSL/rule-based PG generation algorithm
2024-04-07 00:36:20 +03:00
Vitaliy Filippov
6a924d6066
Extract PG combinator into a separate module
2024-04-07 00:36:20 +03:00
Vitaliy Filippov
9fe779a691
Do not die on invalid pool configurations
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Successful in 24s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_snapshot_chain (push) Successful in 2m34s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m12s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m59s
Details
Test / test_rebalance_verify (push) Successful in 3m27s
Details
Test / test_switch_primary (push) Successful in 34s
Details
Test / test_write (push) Successful in 55s
Details
Test / test_write_xor (push) Successful in 54s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m37s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m8s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m48s
Details
Test / test_heal_ec (push) Successful in 3m47s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m8s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m18s
Details
Test / test_heal_csum_32k (push) Successful in 7m9s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m7s
Details
Test / test_scrub (push) Successful in 1m9s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_xor (push) Successful in 1m7s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m20s
Details
Test / test_heal_csum_4k (push) Successful in 5m58s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m9s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m4s
Details
Test / test_nfs (push) Successful in 15s
Details
Test / test_scrub_ec (push) Successful in 21s
Details
2024-04-07 00:36:20 +03:00
Vitaliy Filippov
31c2751b9b
Move NBD/VDUSE map/unmap functions to a separate file
2024-04-07 00:36:09 +03:00
Vitaliy Filippov
c5195666cd
Fix journal sequencing: make each journal write wait for all previous journal writes
Test / test_snapshot_ec (push) Successful in 31s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m11s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m35s
Details
Test / test_rebalance_verify (push) Successful in 3m10s
Details
Test / test_switch_primary (push) Successful in 39s
Details
Test / test_write (push) Successful in 43s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_write_xor (push) Successful in 1m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m22s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m11s
Details
Test / test_heal_ec (push) Successful in 4m23s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m55s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m31s
Details
Test / test_heal_csum_32k (push) Successful in 6m29s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m18s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m0s
Details
Test / test_scrub (push) Failing after 3m19s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Details
Test / test_scrub_xor (push) Successful in 58s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m13s
Details
Test / test_scrub_ec (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m51s
Details
Test / test_heal_csum_4k (push) Successful in 5m13s
Details
Test / test_nfs (push) Successful in 23s
Details
2024-04-06 23:53:12 +03:00
Vitaliy Filippov
f36d7eb76c
Fix monitor thinking that OSD weight is 0 after deleting /osd/config/ key
Test / test_rm (push) Successful in 16s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m30s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m22s
Details
Test / test_rebalance_verify (push) Successful in 4m5s
Details
Test / test_switch_primary (push) Successful in 34s
Details
Test / test_write (push) Successful in 52s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m41s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m51s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Details
Test / test_heal_ec (push) Successful in 4m35s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m0s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Details
Test / test_heal_csum_32k (push) Successful in 6m48s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m7s
Details
Test / test_scrub (push) Successful in 1m36s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m20s
Details
Test / test_scrub_xor (push) Successful in 56s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Details
Test / test_heal_csum_4k (push) Successful in 6m37s
Details
Test / test_nfs (push) Successful in 18s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 47s
Details
Test / test_scrub_ec (push) Successful in 27s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m3s
Details
2024-04-05 23:14:46 +03:00
Vitaliy Filippov
dd7f651de1
Add --max-request-bytes=104857600 to etcd params in tests
2024-04-05 23:14:46 +03:00
Vitaliy Filippov
a2994ecd0d
Fix flusher possibly not trimming journal on rollback
2024-04-05 23:14:39 +03:00
Vitaliy Filippov
5d3aaf016b
Add administration docs
2024-03-31 01:54:52 +03:00
Vitaliy Filippov
0b097ca3f2
Set 32k csum_block_size for HDD by default
2024-03-30 16:16:49 +03:00
Vitaliy Filippov
989675a780
s/etcd_ws_keepalive_timeout/etcd_ws_keepalive_interval/ in docs
2024-03-26 01:56:08 +03:00
Vitaliy Filippov
f8c403ec9e
Add newer benchmark results
2024-03-23 18:28:48 +03:00
Vitaliy Filippov
bfbb85e653
Replace -Oanything with -O3, not just -O/-O1/-O2
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m11s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m14s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m29s
Details
Test / test_rebalance_verify (push) Successful in 4m4s
Details
Test / test_switch_primary (push) Successful in 40s
Details
Test / test_write (push) Successful in 42s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_write_xor (push) Successful in 1m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m36s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m43s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m36s
Details
Test / test_heal_ec (push) Successful in 6m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m39s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m33s
Details
Test / test_heal_csum_32k (push) Successful in 6m38s
Details
Test / test_scrub (push) Successful in 1m52s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m32s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m30s
Details
Test / test_heal_csum_4k (push) Successful in 6m25s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m32s
Details
Test / test_scrub_xor (push) Successful in 31s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 35s
Details
Test / test_scrub_pg_size_3 (push) Successful in 43s
Details
Test / test_nfs (push) Successful in 13s
Details
Test / test_scrub_ec (push) Successful in 19s
Details
2024-03-18 02:03:44 +03:00
Vitaliy Filippov
9ad6822353
Release 1.5.0
...
Test / test_rm (push) Successful in 14s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m36s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m20s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 5m11s
Details
Test / test_rebalance_verify (push) Successful in 5m55s
Details
Test / test_switch_primary (push) Successful in 33s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m26s
Details
Test / test_write (push) Successful in 54s
Details
Test / test_write_xor (push) Successful in 57s
Details
Test / test_write_no_same (push) Successful in 19s
Details
Test / test_rebalance_verify_ec (push) Successful in 7m21s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m36s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m33s
Details
Test / test_heal_ec (push) Successful in 6m15s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m31s
Details
Test / test_heal_csum_32k (push) Successful in 6m29s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m15s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m16s
Details
Test / test_scrub (push) Successful in 1m18s
Details
Test / test_scrub_xor (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m10s
Details
Test / test_scrub_ec (push) Successful in 56s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Details
Test / test_heal_csum_4k (push) Successful in 6m2s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m11s
Details
Test / test_nfs (push) Successful in 11s
Details
After half a year of hard work, VitastorFS is finally here ! :-)
New features:
- VitastorFS, a full-featured clustered (read-write-many) file system.
Documentation: [VitastorFS](docs/usage/nfs.en.md)
- Embedded key-value database implementation based on Parallel Optimistic B-Tree
algorithm and used for the metadata of VitastorFS
- Pool management commands in vitastor-cli (create-pool, list-pools, rm-pool, modify-pool).
Thanks MIND Software (https://mindsw.io ) for their contribution!
[Documentation](docs/usage/cli.en.md#create-pool)
Bug fixes:
- Fix a very rare "infinite loop" in the client library
- Fix a rare OSD hang on during start when zeroing out bad metadata entries left from the previous run
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
2043b4e374
Fix build errors for gcc 8
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
de840e6fe3
Reduce kv-cli loadjson load parallelism to 16
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
b5e04bf809
Fix build warning
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
8807a1623b
Fix markdown tables
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
f12855c31b
Add vitastor-kv to packages
2024-03-16 15:35:10 +03:00
Vitaliy Filippov
e75dcc9a71
Add documentation for VitastorFS
2024-03-16 15:16:43 +03:00
Vitaliy Filippov
88516ab4bd
Remove extra log
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
6221126b4f
Allow to print simple-offsets just given the device size
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
6783d4a13c
Implement fool protection for FS pools
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
dcbe1afac3
Store pool ID in inode metadata
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
0bde28c24a
Make nfs_do_rmw a library function
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
bb8ca6184e
Support setattr guard
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
87310ef7bb
Support ctime
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
4f4b2dab80
Log NFS liveness checks
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
f70da82317
Add loadjson command to vitastor-kv
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
e42148f347
Allow to specify KV commands on command line
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
c289584469
Add JSON dump format
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
018e89f867
Erase verf key left from creation from ientries on every modification
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
603dc68f11
Implement async mtime change
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
7b12342933
Allow to specify additional NFS mount options
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
44bf0f16ee
Fix malloc/free in nfs_kv_read/write
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
8840c84572
Fix "bad key in etcd" in mon for FS pools
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
5b747c12ec
Check if already mounted before mounting
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
05f5f46162
Fix zero used space, update mtime when moving/changing inode
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
b5604191c8
Ignore ECANCELED in nfs-proxy (happens in io_uring on fork)
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
e871de27de
Support unaligned shared_offsets, align shared file data instead of header
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
f600ce98e2
Implement auto-unmount local NFS server mode for vitastor-nfs
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
57605a5c13
Return error on failed shrink
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
29bd4561bb
Implement rename over an existing file/directory
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
7142460ec8
Support --logfile in nfs-proxy
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
d03f19ebe5
Fix shared file overlap, add FIXMEs
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
88f9d18be3
Create inode, then direntry, not direntry, then inode; retry ID collisions
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
6213fbd8c6
Fix NFS shared/aligned write FIXMEs
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
3aee37eadd
Allow to disable per-inode stats for VitastorFS pools
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
ecfc753e93
Add basic NFS tests, fix bugs
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
a574f9ad71
Return block NFS implementation back as an option too
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
7c235c9103
Move KV FS header into a separate file
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
e5bb986164
Implement packing small files into shared inodes
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
181795d748
Split new NFS proxy implementation into multiple files
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
8cdc38805b
WIP VitastorFS with metadata storage in VitastorKV
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
0cd455d17f
First just recheck version without actually re-reading block in vitastor-kv
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
32ba653ba6
Fix vitastor-kv hang on reopen & unfinished closed listing
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
231d4b15fc
Add loadable dump format to vitastor-kv (dump)
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
9dc4d5fd7b
Fix freeing r/w buffers on errors in kv_db
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
e58538fa47
Fix eviction when random_pos selects the end
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
11ac9e7024
Implement min/max list_count to make listings during performance test reasonable
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
511bc3df1c
Fix and improve parallel allocation
...
- Do not try to allocate more DB blocks in an inode block until it's "confirmed" and "locked" by the first write
- Do not recheck for new zero DB blocks on first write into an inode block - a CAS failure means someone else is already writing into it
- Throw new allocation blocks away regardless of whether the known_version is 0 on a CAS failure
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
a64f0d1f73
Implement key_prefix for K/V stress test
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
ec5f7c6b87
More fixes
...
- do not overwrite a block with older version if known version is newer
(read may start before update and end after update)
- invalidated block versions can't be remembered and trusted
- right boundary for split blocks is right_half when diving down, not key_lt
- restart update also when block is "invalidated", not just on version mismatch
- copy callback in listings to avoid closure destruction bugs too
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
3ebed9a749
Add logging and one more assert
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
eab67a6e8f
Make get_block() wait for updating when unrelated block is found along the path
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
20993d9b7a
Fix a race condition where changed blocks were parsed over existing cached blocks and getting a mix of data
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
5cf9b343c0
Simplify code by removing an unneeded "optimisation"
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
79ae0aadcd
Add kv_log_level, print warnings on level 1, trace ops on level 10
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
605afc3583
Fix duplicate keys in listings on parallel updates -- do not rewind key "iterator position"
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
c0681d8242
Implement key suffix to avoid collisions of multiple test workers
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
763e77b4f4
Do not complain on empty first block
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
19426aa4c5
Add JSON output for stress-tester
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
08f586bcec
Print total stats
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
f1cd87473a
Do not send more than op_count operations (fix segfault on finish)
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
1bd8d2da56
Add some more resiliency to serialize()
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
a7396d2baf
Invalidate blocks being updated too
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
e98a38810d
Change new block allocation method: make each writer choose multiple empty PG blocks and place blocks in them
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
28c4324c36
Remove blocks from cache on unsuccessful updates
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
31ec3fa8f5
Allow to track multiple updates per block (it should never happen though)
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
e4fa26f60a
Do not call stop_updating after failed write_new_block and after clear_block (both delete the item)
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
59ae27f9e5
Track versions of parent blocks and recheck if changed during update
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
2c6a301d9b
Fix resume_split condition (key_lt can also be "")
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
01558349f8
Experiment: transform offsets for better sharding
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
36f4717d0d
More post-stress-test fixes
...
- Prevent _split types of new blocks
- Stop updating new blocks only after the whole update, otherwise pointers
may become invalid
- Use recheck_none for updates initially
- Use UINT64_MAX as initial block version when postponing ops, otherwise the
check fails when the block is initially empty. This for example leads to
writing both leaf items & block pointers (which is incorrect) into the root
block when starting stress-test with --parallelism 32
- Fix -EINTR comparison
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
babaf2a0ce
Print operation statistics
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
5773f1a375
K/V fixes after stress-test :-)
...
- track block versions correctly - per inode block (128kb) instead of tree block (4kb)
- prevent multiple parallel CAS writes of the same inode block
- add logging for EILSEQ which means invalid data in the tree
- fix get_block updated flag which was true for blocks already in cache and was leading to infinite loops on "unrelated block" errors
- apply changes to blocks in cache only after successful writes (using "virtual changes")
- do not replace cached block with an older version from disk
- recheck "unrelated blocks" (read/update collisions) until data stops changing
- track tree path correctly - do not treat split block as parent of its right half
- correctly move blocks when finding new empty place on disk
- restart updates from the beginning when one of blocks is changed by a parallel update
- fix delete using SET opcode and setting key to the empty value instead
- prevent changing the same key more than 1 time in parallel
- fix listing verification
- resume continue_updates in update_find (required because it uses continue_update itself)
- add allow_old_cached parameter to get()
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
57222a9f79
Implement K/V DB stress tester
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
61ef000c6e
Evict blocks based on memory limit & block usage
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
7d5e1cc393
Track blocks per level
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
5e7f27a02d
Track block level
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
fd1d8a8520
Experimental B-Tree Vitastor embedded K/V database implementation!
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
c364e14c40
Stop then retry, not retry then stop
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
3ebbfa0428
Fix another rare OSD hang on zeroing out entries on start
2024-03-16 13:24:36 +03:00
Vitaliy Filippov
aa79d1db1c
Fix incorrect "changing scheme" message in modify-pool
Test / test_rm (push) Successful in 14s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m32s
Details
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_snapshot_down (push) Successful in 29s
Details
Test / test_snapshot_down_ec (push) Successful in 29s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_snapshot_chain (push) Successful in 2m5s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m3s
Details
Test / test_rebalance_verify_imm (push) Successful in 4m0s
Details
Test / test_rebalance_verify (push) Successful in 4m40s
Details
Test / test_switch_primary (push) Successful in 38s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_write_xor (push) Successful in 1m2s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m34s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m34s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m22s
Details
Test / test_heal_ec (push) Successful in 4m58s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m37s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m21s
Details
Test / test_heal_csum_32k (push) Successful in 7m1s
Details
Test / test_scrub (push) Successful in 1m37s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m59s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m26s
Details
Test / test_scrub_xor (push) Successful in 1m3s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m20s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m7s
Details
Test / test_scrub_ec (push) Successful in 36s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m37s
Details
Test / test_heal_csum_4k (push) Successful in 6m23s
Details
2024-03-06 00:41:35 +03:00
Vitaliy Filippov
a1fecb7eff
Move callback away when calling it in cluster_client
2024-03-06 00:41:35 +03:00
Vitaliy Filippov
ff74b19423
Fix rare OSD hang on zeroing out bad entries on start
2024-03-06 00:41:35 +03:00
Vitaliy Filippov
4cf6dceed7
Merge branch 'rel-1.4'
Test / test_minsize_1 (push) Has been cancelled
Details
Test / test_move_reappear (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot_chain (push) Has been cancelled
Details
Test / test_snapshot_chain_ec (push) Has been cancelled
Details
Test / test_snapshot_down (push) Has been cancelled
Details
Test / test_snapshot_down_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_switch_primary (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_32k_dj (push) Has been cancelled
Details
Test / test_heal_csum_32k (push) Has been cancelled
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
2024-02-29 09:59:01 +03:00
Vitaliy Filippov
38b8963330
Release 1.4.8
...
Test / test_rm (push) Successful in 19s
Details
Test / test_move_reappear (push) Successful in 26s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m40s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 34s
Details
Test / test_splitbrain (push) Successful in 27s
Details
Test / test_snapshot_chain (push) Successful in 2m18s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m59s
Details
Test / test_rebalance_verify_imm (push) Successful in 5m32s
Details
Test / test_rebalance_verify (push) Successful in 6m11s
Details
Test / test_switch_primary (push) Successful in 41s
Details
Test / test_write (push) Successful in 45s
Details
Test / test_write_no_same (push) Successful in 23s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m2s
Details
Test / test_write_xor (push) Successful in 55s
Details
Test / test_rebalance_verify_ec (push) Successful in 6m22s
Details
Test / test_heal_pg_size_2 (push) Successful in 5m41s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m59s
Details
Test / test_heal_csum_32k_dj (push) Successful in 7m19s
Details
Test / test_heal_csum_32k (push) Successful in 7m17s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m14s
Details
Test / test_scrub (push) Successful in 1m12s
Details
Test / test_heal_ec (push) Successful in 9m2s
Details
Test / test_scrub_xor (push) Successful in 56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 2m1s
Details
Test / test_heal_csum_4k_dj (push) Successful in 4m45s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m31s
Details
Test / test_heal_csum_4k (push) Successful in 4m54s
Details
Test / test_scrub_ec (push) Successful in 46s
Details
- Do not use \r if output is not a terminal (should fix unexpected job output in proxmox)
- Fix rm/rm-data error return code, add --down-ok option to bypass the error
- Add EIO retry timeout and allow to disable these retries, rename up_wait_retry_interval to client_retry_interval
- Add ubuntu jammy build
- Wait for blockstore initialisation before starting OSD (prevent timeouts when init takes time)
- Fix a rare use-after-free in automatic sync after delete in blockstore
2024-02-29 09:58:34 +03:00
Vitaliy Filippov
77167e2920
Do not use \r if output is not a terminal
2024-02-29 00:21:17 +03:00
Vitaliy Filippov
5af23672d0
Fix rm/rm-data error return code, add --down-ok option to bypass the error
2024-02-29 00:20:10 +03:00
Vitaliy Filippov
6bf1f539a6
Add EIO retry timeout and allow to disable these retries, rename up_wait_retry_interval to client_retry_interval
2024-02-28 13:10:02 +03:00
Vitaliy Filippov
4eab26f968
Add documentation and a very basic test for pool management commands
Test / test_snapshot_ec (push) Successful in 31s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_move_reappear (push) Successful in 24s
Details
Test / test_snapshot_down (push) Successful in 27s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 2m15s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m58s
Details
Test / test_rebalance_verify_imm (push) Successful in 5m3s
Details
Test / test_rebalance_verify (push) Successful in 5m36s
Details
Test / test_switch_primary (push) Successful in 37s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m3s
Details
Test / test_write_no_same (push) Successful in 21s
Details
Test / test_write (push) Successful in 58s
Details
Test / test_write_xor (push) Successful in 1m31s
Details
Test / test_rebalance_verify_ec (push) Successful in 6m20s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m7s
Details
Test / test_heal_ec (push) Successful in 4m33s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m53s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m17s
Details
Test / test_heal_csum_32k (push) Successful in 7m23s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m26s
Details
Test / test_scrub (push) Successful in 1m29s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m1s
Details
Test / test_scrub_xor (push) Successful in 1m1s
Details
Test / test_heal_csum_4k (push) Successful in 6m34s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m19s
Details
Test / test_scrub_ec (push) Successful in 24s
Details
2024-02-28 13:08:04 +03:00
Vitaliy Filippov
86243b7101
Rework & fix pool-create / pool-modify / pool-ls
2024-02-28 13:08:04 +03:00
idelson
dc92851322
vitastor-cli: add commands to control pools: pool-create, pool-ls, pool-modify, pool-rm
...
PR #59 - https://github.com/vitalif/vitastor/pull/58/commits
By MIND Software LLC
By submitting this pull request, I accept Vitastor CLA
2024-02-28 13:08:04 +03:00
Zibort Cloud
02d1f16bbd
Add ubuntu jammy build
...
PR #62 #62
I accept Vitastor CLA agreement: https://git.yourcmc.ru/vitalif/vitastor/src/branch/master/CLA-en.md
2024-02-28 11:43:54 +03:00
Vitaliy Filippov
fc413038d1
Wait for blockstore initialisation before starting OSD
Test / test_cas (push) Has been cancelled
Details
Test / test_change_pg_count (push) Has been cancelled
Details
Test / test_change_pg_count_ec (push) Has been cancelled
Details
Test / test_change_pg_size (push) Has been cancelled
Details
Test / test_create_nomaxid (push) Has been cancelled
Details
Test / test_etcd_fail (push) Has been cancelled
Details
Test / test_interrupted_rebalance (push) Has been cancelled
Details
Test / test_interrupted_rebalance_imm (push) Has been cancelled
Details
Test / test_interrupted_rebalance_ec (push) Has been cancelled
Details
Test / test_interrupted_rebalance_ec_imm (push) Has been cancelled
Details
Test / test_failure_domain (push) Has been cancelled
Details
Test / test_snapshot (push) Has been cancelled
Details
Test / test_snapshot_ec (push) Has been cancelled
Details
Test / test_minsize_1 (push) Has been cancelled
Details
Test / test_move_reappear (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot_chain (push) Has been cancelled
Details
Test / test_snapshot_chain_ec (push) Has been cancelled
Details
Test / test_snapshot_down (push) Has been cancelled
Details
Test / test_snapshot_down_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_switch_primary (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
2024-02-27 02:20:04 +03:00
Vitaliy Filippov
1bc0b5aab3
Fix a rare use-after-free in automatic sync after delete in blockstore
...
Test / test_interrupted_rebalance_ec (push) Successful in 2m49s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m29s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m48s
Details
Test / test_rebalance_verify_imm (push) Successful in 4m9s
Details
Test / test_rebalance_verify (push) Successful in 4m42s
Details
Test / test_switch_primary (push) Successful in 41s
Details
Test / test_write (push) Successful in 43s
Details
Test / test_write_no_same (push) Successful in 21s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m37s
Details
Test / test_write_xor (push) Successful in 1m11s
Details
Test / test_rebalance_verify_ec (push) Successful in 7m14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m3s
Details
Test / test_heal_ec (push) Successful in 4m18s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m5s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m52s
Details
Test / test_heal_csum_32k (push) Successful in 6m23s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m23s
Details
Test / test_scrub (push) Successful in 1m30s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m18s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m9s
Details
Test / test_scrub_xor (push) Successful in 57s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m5s
Details
Test / test_scrub_ec (push) Successful in 1m6s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m3s
Details
Test / test_heal_csum_4k (push) Successful in 4m54s
Details
ASan report: [0] READ of size 16 at operator() /root/vitastor/src/blockstore_write.cpp:100
...[5] blockstore_impl_t::ack_sync(blockstore_op_t*) /root/vitastor/src/blockstore_sync.cpp:232
2024-02-24 00:06:36 +03:00
Vitaliy Filippov
5e934264cf
Release 1.4.7
...
- Fix another old "BUG: Attempt to overwrite used offset" in a very simple
case: bs=4k rw=write iodepth=16 from OSD start; add this case to tests
- Fix a rare crash with "unexpected state during flush: 0x51" possible with
EC since 1.4.2 during rebalance and OSD outages
- Fix a rare write stall with EC & immediate_commit=none caused by sync
operations reserving unneeded space in the journal
- Fix 32-bit build warnings, most in printf/scanf format strings
2024-02-22 12:45:52 +03:00
Vitaliy Filippov
f20564b44b
Fix 32-bit build warnings (99.9% in printf)
2024-02-22 12:22:16 +03:00
Vitaliy Filippov
b3c15db331
32M journal by default in simple-offsets
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_move_reappear (push) Successful in 24s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m17s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m55s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m46s
Details
Test / test_rebalance_verify (push) Successful in 3m9s
Details
Test / test_switch_primary (push) Successful in 39s
Details
Test / test_write (push) Successful in 43s
Details
Test / test_write_no_same (push) Successful in 19s
Details
Test / test_write_xor (push) Successful in 55s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m35s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m37s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m36s
Details
Test / test_heal_ec (push) Successful in 5m47s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m21s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m16s
Details
Test / test_heal_csum_32k (push) Successful in 6m45s
Details
Test / test_scrub (push) Successful in 1m56s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m39s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m42s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m16s
Details
Test / test_scrub_xor (push) Successful in 47s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m26s
Details
Test / test_heal_csum_4k (push) Successful in 6m32s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 48s
Details
Test / test_scrub_ec (push) Successful in 49s
Details
2024-02-21 15:25:02 +03:00
Vitaliy Filippov
685bcd6ef9
Do not reserve extra space for big_writes during sync - sync itself is needed to commit and clear them
2024-02-21 13:00:14 +03:00
Vitaliy Filippov
3eb389b321
Supposed fix for "unexpected state during flush: 0x51" with EC
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m32s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m4s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m51s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m47s
Details
Test / test_rebalance_verify (push) Successful in 3m30s
Details
Test / test_switch_primary (push) Successful in 38s
Details
Test / test_write (push) Successful in 51s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m32s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m7s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 59s
Details
Test / test_scrub (push) Successful in 1m2s
Details
Test / test_scrub_xor (push) Successful in 36s
Details
Test / test_scrub_ec (push) Successful in 38s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 40s
Details
Test / test_scrub_pg_size_3 (push) Successful in 49s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m12s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m8s
Details
Test / test_heal_csum_32k (push) Successful in 4m55s
Details
Test / test_heal_ec (push) Failing after 10m14s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 4m59s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m5s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m54s
Details
Test / test_heal_csum_4k (push) Successful in 3m49s
Details
2024-02-21 01:32:06 +03:00
Vitaliy Filippov
3d16cde23c
Fix assertions, add small sequential write test
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m8s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m48s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m57s
Details
Test / test_rebalance_verify (push) Successful in 3m29s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 54s
Details
Test / test_write_xor (push) Successful in 51s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m40s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m20s
Details
Test / test_scrub (push) Successful in 1m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 46s
Details
Test / test_scrub_xor (push) Successful in 41s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m0s
Details
Test / test_scrub_ec (push) Successful in 58s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m45s
Details
Test / test_heal_pg_size_2 (push) Failing after 4m52s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m36s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m33s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m35s
Details
Test / test_interrupted_rebalance (push) Successful in 2m28s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m30s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m41s
Details
Test / test_heal_ec (push) Failing after 10m20s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 4m21s
Details
Test / test_heal_csum_32k (push) Successful in 5m15s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m48s
Details
Test / test_heal_csum_4k (push) Successful in 5m32s
Details
2024-02-20 19:41:48 +03:00
Vitaliy Filippov
c6406d67fc
Fix journal space_check incorrectly checking for space at the beginning
2024-02-20 19:40:56 +03:00
Vitaliy Filippov
f87964861d
Release 1.4.6
...
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_move_reappear (push) Successful in 26s
Details
Test / test_snapshot_down (push) Successful in 28s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m3s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m46s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m1s
Details
Test / test_rebalance_verify (push) Successful in 3m30s
Details
Test / test_switch_primary (push) Successful in 38s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_write_xor (push) Successful in 38s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m38s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m57s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m14s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m21s
Details
Test / test_heal_csum_32k (push) Successful in 5m45s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m27s
Details
Test / test_scrub (push) Successful in 1m30s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m26s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 38s
Details
Test / test_scrub_xor (push) Successful in 40s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m8s
Details
Test / test_scrub_ec (push) Successful in 1m5s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m49s
Details
Test / test_heal_csum_4k (push) Successful in 5m41s
Details
Test / test_heal_ec (push) Successful in 4m11s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m22s
Details
Unwavering stabilization of 1.4.x, continued :-)
- Include the accidentally lost part of 1.4.5 journal trimming fix
- Fix a possible OSD crash with "BUG: Attempt to overwrite used offset"
which was probably present for long time, but became apparent after
fixing flapping tests in CI
- Fix remaining flapping tests in CI. It was the first time when tests
actually passed without retries :-)
2024-02-20 17:01:26 +03:00
Vitaliy Filippov
62a4f45160
Raise test_scrub waiting timeout
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_rm (push) Successful in 19s
Details
Test / test_move_reappear (push) Successful in 25s
Details
Test / test_snapshot_down (push) Successful in 28s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_snapshot_chain (push) Successful in 2m17s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_rebalance_verify (push) Successful in 3m43s
Details
Test / test_switch_primary (push) Successful in 40s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 42s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m55s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m6s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m51s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m47s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m50s
Details
Test / test_heal_csum_32k (push) Successful in 5m42s
Details
Test / test_heal_ec (push) Failing after 10m30s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m22s
Details
Test / test_scrub (push) Successful in 1m21s
Details
Test / test_scrub_xor (push) Successful in 46s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m21s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m56s
Details
Test / test_scrub_ec (push) Successful in 55s
Details
Test / test_heal_csum_4k (push) Successful in 4m28s
Details
Test / test_heal_csum_4k_dj (push) Failing after 10m15s
Details
2024-02-20 16:26:09 +03:00
Vitaliy Filippov
7048228678
Supposed fix for "BUG: Attempt to overwrite used offset"
2024-02-20 15:56:48 +03:00
Vitaliy Filippov
ea73857450
Add asserts to catch "BUG: Attempt to overwrite used offset"
2024-02-20 15:56:48 +03:00
Vitaliy Filippov
6cfe38ec04
Followup to empty cur.oid as stop condition for forced trim fix
2024-02-20 15:56:38 +03:00
Vitaliy Filippov
7ae5766fdb
Wait to clear has_degraded in test_heal - should fix flaps of test_heal_* in CI
2024-02-20 15:56:27 +03:00
Vitaliy Filippov
f882c7dd87
Release 1.4.5
...
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m23s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 29s
Details
Test / test_snapshot_chain (push) Successful in 2m17s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m14s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m24s
Details
Test / test_rebalance_verify (push) Successful in 3m59s
Details
Test / test_switch_primary (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 32s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m46s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m52s
Details
Test / test_heal_ec (push) Successful in 5m25s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m24s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 4m23s
Details
Test / test_heal_csum_4k_dj (push) Successful in 4m17s
Details
Test / test_scrub (push) Successful in 38s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 29s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 43s
Details
Test / test_scrub_ec (push) Successful in 32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m46s
Details
Test / test_heal_csum_4k (push) Successful in 4m4s
Details
Test / test_write (push) Successful in 1m38s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m5s
Details
Test / test_heal_csum_32k (push) Successful in 4m15s
Details
- Fix a write stall caused by incorrect journal trimming introduced in 1.4.4 :)
- Fix PGs sometimes hanging in "starting" state on mass OSD restarts
- Fix a rare crash with "map::at" during OSD pings
- Use new defaults for non-capacitor (desktop) SSDs - improves T1Q256 random write from ~6k iops to ~45k iops
- Make journal_trim_interval configurable
2024-02-16 10:13:33 +03:00
Vitaliy Filippov
26dd863c8d
Fix sometimes possible crash on clients.at() during pings
2024-02-16 10:13:33 +03:00
Vitaliy Filippov
2ae859fbc6
Use min/max_flusher_count=32/256, 128M journal and autosync_writes=512 for non-capacitor SSDs by default
2024-02-16 10:13:33 +03:00
Vitaliy Filippov
f6cd9f9153
Add a note about pg_minsize
2024-02-15 23:38:52 +03:00
Vitaliy Filippov
8389c0f33b
Fix PGs sometimes hanging in "starting" state on mass OSD restarts
2024-02-15 23:38:52 +03:00
Vitaliy Filippov
9db2196aef
Make journal_trim_interval configurable
2024-02-15 23:38:51 +03:00
Vitaliy Filippov
8d6ae662fe
Use empty cur.oid as stop condition for forced trim, not journal_trim_counter
2024-02-15 23:27:17 +03:00
Vitaliy Filippov
c777a0041a
Release 1.4.4
...
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m23s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m18s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m13s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m8s
Details
Test / test_rebalance_verify (push) Successful in 3m41s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_write_xor (push) Successful in 39s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m56s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m21s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m15s
Details
Test / test_heal_ec (push) Successful in 5m1s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m32s
Details
Test / test_heal_csum_32k (push) Successful in 5m38s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m43s
Details
Test / test_scrub (push) Successful in 1m31s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m17s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m57s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m7s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 41s
Details
Test / test_scrub_ec (push) Successful in 24s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 3m56s
Details
Test / test_heal_csum_4k (push) Successful in 3m16s
Details
A couple of fixes for EC pools
- Fix a segfault possible on partial EC overwrite in 1234 -> 5030 rebalance scenario
- Fix two problems leading to EC pools stalling on rebalance & parallel sudden stops
of OSDs, for example during a sudden poweroff of a host:
- Recovery auto-tuning (1.4.0 feature) could apply too large delays and stall
the EC journal - fixed by limiting delays with a new recovery_tune_sleep_cutoff_us
parameter (10 seconds by default) and applying recovery pauses before write
operations, not after them, to not occupy space in the journal for long time
- Dynamic journal space reservation (1.3.0 feature) wasn't accounting new writes
when checking the limit so OSDs could still fill the journal fully and stall -
fixed by including new writes into the limit
- Print etcd dbSize instead of dbSizeInUse in status
2024-02-11 16:23:08 +03:00
Vitaliy Filippov
2947ea93e8
Raise test_snapshot_chain_ec timeout to 6 minutes
2024-02-11 16:13:52 +03:00
Vitaliy Filippov
978bdc128a
Apply recovery pause before writes, after commits, and do not apply it to syncs to not block EC pools from functioning
2024-02-11 16:13:52 +03:00
Vitaliy Filippov
bb2f395f1e
Add cutoff threshold for recovery auto-tuning
2024-02-11 16:13:52 +03:00
Vitaliy Filippov
b127da40f7
Add a FIXME about incomplete PGs
2024-02-11 13:42:51 +03:00
Vitaliy Filippov
ca34a6047a
Fix dynamic journal space reservation: include the new write itself, too
2024-02-11 13:42:51 +03:00
Vitaliy Filippov
38ba76e893
Fix flusher sometimes being unable to trim journal when the flush queue is empty
2024-02-11 13:42:51 +03:00
Vitaliy Filippov
1e3c4edea0
Print etcd dbSize instead of dbSizeInUse in status
2024-02-11 13:42:51 +03:00
Vitaliy Filippov
e7ac855b07
Fix that EC segfault (1234 -> 5030 partial overwrite)
2024-02-11 13:42:51 +03:00
Vitaliy Filippov
c53357ac45
Add a test for EC segfault with partial overwrite in 1234 -> 5030 rebalance scenario
2024-02-11 13:42:51 +03:00
Vitaliy Filippov
27e9f244ec
Release 1.4.3
...
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 36s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_interrupted_rebalance (push) Successful in 5m3s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 3m1s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m13s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_rebalance_verify (push) Successful in 3m29s
Details
Test / test_switch_primary (push) Successful in 37s
Details
Test / test_write (push) Successful in 44s
Details
Test / test_write_xor (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m13s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m31s
Details
Test / test_heal_ec (push) Successful in 4m54s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m25s
Details
Test / test_heal_csum_32k (push) Successful in 6m8s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m17s
Details
Test / test_scrub (push) Successful in 1m8s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 55s
Details
Test / test_scrub_xor (push) Successful in 45s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m22s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m11s
Details
Test / test_scrub_ec (push) Successful in 46s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m39s
Details
Test / test_heal_csum_4k (push) Successful in 6m8s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m15s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m41s
Details
Hotfix for hotfix O:-)
- "Write stall fix" was incomplete and EC write stalls could
continue even on 1.4.2. Now they're finally fixed O:-)
- Make monitor ignore statistics of stopped OSDs. Previously if you stopped all
OSDs the last total I/O numbers would remain the same indefinitely
2024-02-09 00:29:31 +03:00
Vitaliy Filippov
8e25a28a08
Ignore down OSDs in monitor statistics aggregation
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m50s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 18s
Details
Test / test_snapshot_chain (push) Successful in 2m10s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m8s
Details
Test / test_rebalance_verify (push) Successful in 3m6s
Details
Test / test_interrupted_rebalance (push) Failing after 10m52s
Details
Test / test_rebalance_verify_imm (push) Successful in 5m28s
Details
Test / test_switch_primary (push) Successful in 37s
Details
Test / test_write (push) Successful in 42s
Details
Test / test_write_xor (push) Successful in 38s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_rebalance_verify_ec (push) Successful in 6m7s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 6m3s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m12s
Details
Test / test_heal_ec (push) Successful in 5m20s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m53s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m23s
Details
Test / test_heal_csum_32k (push) Successful in 5m59s
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
2024-02-09 00:22:36 +03:00
Vitaliy Filippov
5d3317e4f2
Followup to 1.4.2 write stall fix - sadly, the previous version was not working correctly :)
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_snapshot_chain (push) Successful in 1m21s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m50s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 16s
Details
Test / test_etcd_fail (push) Successful in 6m42s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m19s
Details
Test / test_rebalance_verify (push) Successful in 4m7s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m6s
Details
Test / test_write_no_same (push) Successful in 22s
Details
Test / test_write_xor (push) Successful in 1m34s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 6m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m7s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m59s
Details
Test / test_heal_csum_32k (push) Successful in 5m4s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m59s
Details
Test / test_scrub (push) Successful in 1m9s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 37s
Details
Test / test_scrub_xor (push) Successful in 52s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m5s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m12s
Details
Test / test_heal_csum_4k (push) Successful in 5m1s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m48s
Details
Test / test_scrub_ec (push) Successful in 19s
Details
Test / test_interrupted_rebalance (push) Successful in 1m38s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m20s
Details
Test / test_heal_ec (push) Successful in 3m3s
Details
2024-02-08 19:34:29 +03:00
Vitaliy Filippov
016115c0d4
Release 1.4.2
...
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_down_ec (push) Successful in 39s
Details
Test / test_interrupted_rebalance (push) Successful in 4m52s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 3m11s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m16s
Details
Test / test_rebalance_verify (push) Successful in 3m45s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_xor (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m8s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m57s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m22s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m20s
Details
Test / test_heal_ec (push) Successful in 5m54s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m24s
Details
Test / test_heal_csum_32k (push) Successful in 6m3s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m54s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 53s
Details
Test / test_scrub (push) Successful in 55s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m14s
Details
Test / test_scrub_xor (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m50s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 57s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_heal_csum_4k (push) Successful in 5m47s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m24s
Details
- Log to systemd by default
- Fix excessive autosyncs after every operation with disabled immediate_commit (introduced in 1.1.0)
- Fix a possible write stall with EC due to the lack of OSD wakeup after stabilizing previous writes
- Change sync operation semantics as a final fix to possible write stalls with EC and disabled immediate_commit
- Sync after deleting data in CLI rm / rm-data if immediate_commit is disabled
- Fix OSDs ignoring syncs & autosyncs for delete operations
- Fix OSD space reporting sometimes adding garbage zeros for deleted inodes (causing extra pool/stats etcd keys for deleted pools)
- Speed up monitor failover - change default etcd_mon_ttl from 30 to 5 seconds
- Speed up operation retries - change default up_wait_retry_interval to 50 ms
- Add patch for libvirt 9.10
2024-02-04 02:23:49 +03:00
Vitaliy Filippov
e026de95d5
Log to systemd by default
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_etcd_fail (push) Successful in 5m19s
Details
Test / test_snapshot_chain (push) Successful in 1m26s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 28s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m8s
Details
Test / test_interrupted_rebalance (push) Successful in 7m44s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Details
Test / test_switch_primary (push) Successful in 34s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m41s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m18s
Details
Test / test_write_no_same (push) Successful in 22s
Details
Test / test_write_xor (push) Successful in 1m41s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m54s
Details
Test / test_rebalance_verify (push) Successful in 9m38s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m4s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m23s
Details
Test / test_heal_csum_32k (push) Successful in 5m24s
Details
Test / test_heal_ec (push) Failing after 10m18s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m31s
Details
Test / test_scrub (push) Successful in 1m18s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m0s
Details
Test / test_scrub_xor (push) Successful in 51s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m10s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 48s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m59s
Details
Test / test_scrub_ec (push) Successful in 48s
Details
Test / test_heal_csum_4k (push) Successful in 4m39s
Details
2024-02-04 01:21:31 +03:00
Vitaliy Filippov
77c10fd1f8
In fact, do not autosync blockstore when autosync_writes=0
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_snapshot_chain (push) Successful in 1m57s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m41s
Details
Test / test_rebalance_verify (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m26s
Details
Test / test_switch_primary (push) Successful in 45s
Details
Test / test_write (push) Successful in 33s
Details
Test / test_write_xor (push) Successful in 33s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m42s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m57s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m24s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m29s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m10s
Details
Test / test_heal_csum_32k (push) Successful in 5m13s
Details
Test / test_scrub (push) Successful in 1m5s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m1s
Details
Test / test_scrub_xor (push) Successful in 1m2s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 57s
Details
Test / test_scrub_ec (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m1s
Details
Test / test_heal_csum_4k (push) Successful in 4m40s
Details
Test / test_interrupted_rebalance (push) Successful in 1m38s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m2s
Details
Test / test_heal_ec (push) Successful in 5m17s
Details
2024-02-03 20:37:36 +03:00
Vitaliy Filippov
581d02e581
Mark secondary OSDs with deletions as dirty to not forget to sync & autosync them
Test / test_change_pg_count (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot_chain (push) Has been cancelled
Details
Test / test_snapshot_chain_ec (push) Has been cancelled
Details
Test / test_snapshot_down (push) Has been cancelled
Details
Test / test_snapshot_down_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_switch_primary (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Details
Test / test_cas (push) Has been cancelled
Details
Test / test_heal_csum_32k_dj (push) Has been cancelled
Details
Test / test_heal_csum_32k (push) Has been cancelled
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
2024-02-03 20:31:08 +03:00
Vitaliy Filippov
f03a9db4d9
Fix OSD space reporting sometimes adding garbage zeros for deleted inodes (causing extra pool/stats etcd keys for deleted pools)
2024-02-03 20:31:08 +03:00
Vitaliy Filippov
cb9c30bc31
Sync after sending all deletes to each PG in cli rm-data
2024-02-03 20:31:08 +03:00
Vitaliy Filippov
a86a380d20
Fix invalid parsing of autosync_writes in blockstore leading to autosyncs after every operation with disabled immediate_commit :D
2024-02-03 20:31:08 +03:00
Vitaliy Filippov
d2b43cb118
Change default etcd_mon_ttl
Test / test_move_reappear (push) Successful in 35s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 3m29s
Details
Test / test_interrupted_rebalance (push) Successful in 4m47s
Details
Test / test_snapshot_down (push) Successful in 29s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m46s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m10s
Details
Test / test_rebalance_verify_imm (push) Successful in 4m24s
Details
Test / test_rebalance_verify (push) Successful in 4m54s
Details
Test / test_switch_primary (push) Successful in 35s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m38s
Details
Test / test_write (push) Successful in 46s
Details
Test / test_write_xor (push) Successful in 49s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_rebalance_verify_ec (push) Successful in 7m14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m10s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m10s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m52s
Details
Test / test_heal_csum_32k (push) Successful in 5m20s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m8s
Details
Test / test_heal_ec (push) Failing after 10m21s
Details
Test / test_scrub (push) Successful in 1m2s
Details
Test / test_scrub_xor (push) Successful in 54s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m4s
Details
Test / test_heal_csum_4k_dj (push) Successful in 4m48s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m26s
Details
Test / test_scrub_ec (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Failing after 2m5s
Details
Test / test_heal_csum_4k (push) Successful in 4m33s
Details
2024-01-29 23:45:19 +03:00
Vitaliy Filippov
cc76e6876b
Fix flapping "scrub" test
Test / test_rm (push) Successful in 16s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m53s
Details
Test / test_snapshot_down (push) Successful in 29s
Details
Test / test_snapshot_down_ec (push) Successful in 38s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_interrupted_rebalance (push) Successful in 5m46s
Details
Test / test_snapshot_chain (push) Successful in 2m59s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m36s
Details
Test / test_rebalance_verify (push) Successful in 3m22s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m46s
Details
Test / test_write_xor (push) Successful in 40s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m46s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m23s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m40s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m45s
Details
Test / test_scrub (push) Successful in 1m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 43s
Details
Test / test_scrub_xor (push) Successful in 35s
Details
Test / test_heal_csum_4k (push) Successful in 4m14s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m19s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 35s
Details
Test / test_scrub_ec (push) Successful in 21s
Details
Test / test_heal_csum_32k (push) Successful in 4m48s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 4m48s
Details
Test / test_heal_csum_4k_dj (push) Successful in 4m27s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m29s
Details
Test / test_heal_ec (push) Successful in 3m7s
Details
2024-01-28 14:59:33 +03:00
Vitaliy Filippov
1cec62d25d
Sync only completed writes
...
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_down_ec (push) Successful in 35s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_interrupted_rebalance (push) Successful in 5m14s
Details
Test / test_snapshot_chain (push) Successful in 2m50s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m47s
Details
Test / test_rebalance_verify (push) Successful in 3m42s
Details
Test / test_switch_primary (push) Successful in 33s
Details
Test / test_write (push) Successful in 42s
Details
Test / test_write_xor (push) Successful in 44s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m52s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m19s
Details
Test / test_heal_ec (push) Successful in 6m20s
Details
Test / test_heal_csum_32k (push) Successful in 3m29s
Details
Test / test_scrub (push) Successful in 1m24s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 4m23s
Details
Test / test_scrub_xor (push) Successful in 1m9s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m29s
Details
Test / test_heal_csum_4k (push) Successful in 5m36s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m53s
Details
Test / test_scrub_ec (push) Successful in 29s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m9s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m13s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m17s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m25s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 24s
Details
Should be a final remaining fix to EC + non-capacitor (non-immediate-commit) write hangs :).
First it was breaking non-EC ("instantly stable") writes because they sometimes
complete out of order which was leading to the following error:
terminate called after throwing an instance of 'std::runtime_error'
what(): BUG: Unexpected dirty_entry 1000000000001:29480000 v65540 unstable state during flush: 0x151
But it is easily fixed by scanning previous and next dirty_entries in mark_stable.
2024-01-27 15:17:22 +03:00
Vitaliy Filippov
1c322b33ed
Change default up_wait_retry_interval to 50 ms
Test / test_rm (push) Successful in 14s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 3m59s
Details
Test / test_snapshot_chain (push) Successful in 1m34s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_down_ec (push) Successful in 29s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m35s
Details
Test / test_interrupted_rebalance (push) Successful in 8m15s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m54s
Details
Test / test_switch_primary (push) Successful in 36s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m48s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m51s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Failing after 3m9s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Details
Test / test_heal_ec (push) Successful in 3m50s
Details
Test / test_rebalance_verify (push) Failing after 9m30s
Details
Test / test_heal_csum_32k_dmj (push) Failing after 5m40s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m12s
Details
Test / test_heal_csum_32k (push) Successful in 6m25s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m56s
Details
Test / test_scrub (push) Successful in 1m4s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 55s
Details
Test / test_scrub_xor (push) Successful in 56s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m19s
Details
Test / test_scrub_pg_size_3 (push) Failing after 2m14s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m53s
Details
Test / test_scrub_ec (push) Successful in 1m1s
Details
Test / test_heal_csum_4k (push) Successful in 5m17s
Details
2024-01-26 01:51:08 +03:00
Vitaliy Filippov
d27524f441
Add patch for libvirt 9.10
2024-01-25 01:09:12 +03:00
Vitaliy Filippov
ba55f91409
Release 1.4.1
...
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 1m27s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 4m41s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m0s
Details
Test / test_splitbrain (push) Successful in 18s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_rebalance_verify_ec (push) Failing after 2m21s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m30s
Details
Test / test_switch_primary (push) Successful in 39s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_interrupted_rebalance (push) Failing after 10m8s
Details
Test / test_write_xor (push) Successful in 36s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m4s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Details
Test / test_rebalance_verify (push) Successful in 8m31s
Details
Test / test_heal_ec (push) Successful in 5m9s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m27s
Details
Test / test_heal_csum_32k (push) Successful in 5m42s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m1s
Details
Test / test_scrub (push) Successful in 59s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 38s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m5s
Details
Test / test_scrub_xor (push) Successful in 58s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m25s
Details
Test / test_scrub_ec (push) Failing after 42s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
Test / test_heal_csum_4k (push) Successful in 5m38s
Details
- Fix a monitor crash on primary OSD switching introduced in 1.4.0
- Fix "partly outside array bounds" warnings for GCC 12 in cpp-btree
- Fix a realloc memory leak in theory possible with too large listings (OSD_OP_LIST)
2024-01-18 02:31:42 +03:00
Vitaliy Filippov
80aac39513
Add detailed formula for theoretical EC N+K random write performance
2024-01-18 00:36:32 +03:00
Vitaliy Filippov
2aa5aa7ab6
Add a test for simple master switching without PG reconfiguration
...
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 1m27s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m56s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 6m40s
Details
Test / test_interrupted_rebalance (push) Successful in 8m12s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m12s
Details
Test / test_switch_primary (push) Successful in 34s
Details
Test / test_write (push) Successful in 46s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m18s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m42s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 6m36s
Details
Test / test_heal_ec (push) Successful in 5m2s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m33s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m58s
Details
Test / test_heal_csum_32k (push) Successful in 6m6s
Details
Test / test_scrub (push) Successful in 47s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m17s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 43s
Details
Test / test_scrub_xor (push) Successful in 47s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m44s
Details
Test / test_scrub_ec (push) Successful in 41s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m18s
Details
Test / test_scrub_pg_size_3 (push) Successful in 2m11s
Details
Test / test_heal_csum_4k (push) Successful in 6m12s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m16s
Details
Test / test_write_xor (push) Successful in 34s
Details
Also use osd_out_time:1 only in select tests and restart mon in tests only on connection errors
2024-01-17 00:19:01 +03:00
Vitaliy Filippov
3ca3b8a8d8
Fix recheck_pgs bug introduced in 1.4.0
Test / test_rm (push) Successful in 14s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 3m27s
Details
Test / test_snapshot_chain (push) Successful in 1m24s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m54s
Details
Test / test_snapshot_down_ec (push) Successful in 20s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m42s
Details
Test / test_etcd_fail (push) Failing after 10m8s
Details
Test / test_interrupted_rebalance (push) Failing after 10m9s
Details
Test / test_write (push) Successful in 1m22s
Details
Test / test_rebalance_verify_ec (push) Failing after 1m51s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m27s
Details
Test / test_write_xor (push) Failing after 3m13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m22s
Details
Test / test_rebalance_verify (push) Failing after 10m9s
Details
Test / test_heal_ec (push) Successful in 4m41s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m42s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m58s
Details
Test / test_heal_csum_32k (push) Successful in 6m34s
Details
Test / test_scrub (push) Successful in 54s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 49s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m1s
Details
Test / test_scrub_ec (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
2024-01-16 23:49:21 +03:00
Vitaliy Filippov
2cf649eba6
Fix "partly outside array bounds" warnings for GCC 12 in cpp-btree
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_interrupted_rebalance (push) Successful in 7m36s
Details
Test / test_rebalance_verify (push) Successful in 3m35s
Details
Test / test_write (push) Successful in 1m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 4m4s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m35s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m32s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m29s
Details
Test / test_heal_ec (push) Successful in 5m47s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m47s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m4s
Details
Test / test_heal_csum_32k (push) Successful in 6m19s
Details
Test / test_scrub (push) Successful in 56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 43s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m14s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 57s
Details
Test / test_scrub_ec (push) Successful in 47s
Details
Test / test_heal_csum_4k (push) Successful in 5m56s
Details
Test / test_minsize_1 (push) Successful in 14s
Details
Test / test_scrub_pg_size_3 (push) Successful in 46s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m40s
Details
Test / test_write_xor (push) Failing after 3m6s
Details
2024-01-15 03:04:33 +03:00
Vitaliy Filippov
5935640a4a
Add CLA PR form
2024-01-14 16:48:24 +03:00
Vitaliy Filippov
d00d4dbac0
Initialize mod_revision field in etcd_state_client
Test / test_interrupted_rebalance_ec (push) Successful in 2m28s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_move_reappear (push) Successful in 29s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 26s
Details
Test / test_splitbrain (push) Successful in 16s
Details
Test / test_snapshot_chain (push) Successful in 2m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m28s
Details
Test / test_rebalance_verify (push) Successful in 3m0s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m14s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m7s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m33s
Details
Test / test_heal_ec (push) Successful in 4m40s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m40s
Details
Test / test_heal_csum_32k (push) Successful in 6m8s
Details
Test / test_scrub (push) Successful in 1m4s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 47s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m33s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m28s
Details
Test / test_scrub_xor (push) Successful in 44s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m2s
Details
Test / test_scrub_ec (push) Successful in 42s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
Test / test_heal_csum_4k (push) Successful in 5m56s
Details
Test / test_interrupted_rebalance (push) Successful in 1m53s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m17s
Details
Test / test_write (push) Failing after 3m15s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m6s
Details
Test / test_write_xor (push) Failing after 3m11s
Details
2024-01-13 01:30:28 +03:00
Vitaliy Filippov
5d9d6f32a0
Fix common realloc memory leak mistakes found by cppcheck
2024-01-13 01:30:28 +03:00
Vitaliy Filippov
5280d1d561
Release 1.4.0
...
Test / test_snapshot (push) Successful in 26s
Details
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Successful in 24s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_snapshot_chain (push) Successful in 2m41s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m48s
Details
Test / test_rebalance_verify (push) Successful in 3m28s
Details
Test / test_write (push) Successful in 47s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m5s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m41s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m45s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m52s
Details
Test / test_heal_ec (push) Successful in 5m11s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m42s
Details
Test / test_heal_csum_32k (push) Successful in 5m56s
Details
Test / test_scrub (push) Successful in 1m25s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m18s
Details
Test / test_scrub_xor (push) Successful in 42s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m49s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m32s
Details
Test / test_heal_csum_4k (push) Successful in 5m31s
Details
Test / test_scrub_ec (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m5s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m21s
Details
Test / test_write_xor (push) Successful in 36s
Details
New features:
- Intelligent recovery/rebalance speed auto-tuning to reduce its impact on clients (see README -> Features)
- Auto-restoration of dead VDUSE daemons in CSI plugin
- Add vitastor-disk update-sb command
- Update QEMU for Debian Bookworm to 8.1 and use it for CSI plugin
Bug fixes:
- Fix pools SOMETIMES staying inactive after stopping a node due to OSDs not reacting
to PG state changes caused by incorrect full reload of state from etcd on reconnection
- Make monitors retry pool configuration changes quickier which fixes them being unable
to apply changes when an ongoing rebalance is quickly making a lot of PGs clean
- Fix CSI plugin not accepting array of strings as etcd address in /etc/vitastor/vitastor.conf
- Allow multiple interfaces with the same IP address, for "simple routed" full mesh network
- Do not ignore loopback addresses for OSD network (to make ECMP setups with frr possible)
- Fix a rare client crash during OSD reconnections
- Only treat data partitions as existing OSDs in vitastor-disk prepare
- Remove etcd parameter from default command examples
- Fix reported free space sometimes changing non-immediately after deletion of data from OSDs
- Fix a possible OSD crash on print_slow when bs_op is NULL
- Use the same etcd_ws_keepalive_interval in mon as in OSD
- Fix mon not using values from config when /config/global is not present
- Remove pve-storage-portal-dns-list format for vitastor_etcd_address
- Parse log_level in cluster_client
- Fix vitastor-nbd image existence check not working because of non-zeroed inode_watch fields
- Do not warn on EPIPE in client unless log_level is raised explicitly
- Fix incorrect error in CSI when searching for the device in /sys
- Remove 2 last prints to stdout in etcd_state_client
- Fix a possible OSD crash when checking corrupted journal entries
2024-01-12 01:28:33 +03:00
Vitaliy Filippov
317b0feb0a
Add a note about VDUSE daemon auto-restart
2024-01-12 01:27:36 +03:00
Vitaliy Filippov
247f0552db
Fix debug log "killing..." in CSI
2024-01-10 01:19:34 +03:00
Vitaliy Filippov
2f228fa96a
Only treat data partitions as existing OSDs in vitastor-disk prepare
Test / test_interrupted_rebalance_ec (push) Successful in 2m40s
Details
Test / test_rm (push) Successful in 31s
Details
Test / test_move_reappear (push) Successful in 39s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_interrupted_rebalance (push) Successful in 4m42s
Details
Test / test_snapshot_down_ec (push) Successful in 26s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Failing after 3m17s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m13s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s
Details
Test / test_write (push) Successful in 37s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m37s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m20s
Details
Test / test_write_xor (push) Failing after 3m8s
Details
Test / test_rebalance_verify (push) Successful in 8m20s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m17s
Details
Test / test_heal_ec (push) Successful in 4m59s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m15s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m35s
Details
Test / test_heal_csum_32k (push) Successful in 6m47s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m49s
Details
Test / test_scrub (push) Successful in 1m2s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 45s
Details
Test / test_scrub_xor (push) Successful in 40s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m16s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m9s
Details
Test / test_scrub_ec (push) Successful in 45s
Details
Test / test_heal_csum_4k (push) Successful in 5m26s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
2023-12-31 11:46:47 +03:00
Vitaliy Filippov
2f6b9c0306
Remove etcd parameter from default command examples
2023-12-31 02:50:41 +03:00
Vitaliy Filippov
48b5f871e0
Add Contributor License Aggrement in Russian and English
2023-12-31 01:23:52 +03:00
Vitaliy Filippov
c17f76a3e4
Add documentation for recovery auto-tuning
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_snapshot_down_ec (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 1m50s
Details
Test / test_splitbrain (push) Successful in 52s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m31s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m28s
Details
Test / test_rebalance_verify (push) Successful in 3m25s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m31s
Details
Test / test_write (push) Successful in 1m17s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m36s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m12s
Details
Test / test_heal_ec (push) Successful in 5m20s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m36s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m11s
Details
Test / test_heal_csum_32k (push) Successful in 6m13s
Details
Test / test_scrub (push) Successful in 56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m6s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m31s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m58s
Details
Test / test_scrub_xor (push) Successful in 43s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m10s
Details
Test / test_scrub_ec (push) Successful in 49s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m40s
Details
Test / test_heal_csum_4k (push) Successful in 5m59s
Details
Test / test_write_xor (push) Successful in 34s
Details
Test / test_interrupted_rebalance (push) Successful in 1m19s
Details
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
a6ab54b1ba
Do not allow negative util_low/high
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
99ee8596ea
Rename min/max_util to util_low/high
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
c4928e6ecd
Protect from try_send completing the operation immediately
...
Fixes a possible use-after-free in case of continue_ops() calling try_send(),
then connect_peer() -> set_timer() -> trigger_nearest() -> handle_op_part() -> continue_ops() again
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
ec7dcd1be5
Do not apply very large recovery pauses during tests
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
e600bbc151
Fix flapping move_reappear test by adding an fsync before stopping PG
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
8b8c1179a7
Use a separate used_blocks counter for free space stats to hide possibly delayed on-flush deallocation
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
d5a6fa6dd7
Fix possible crash on print_slow when bs_op is NULL
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
f757a35a8d
Retry PG changes without re-running lpsolve when pool configuration and OSD tree don't change
...
OSDs often change their /pg/history keys during rebalance, so monitor receives additional
transaction failures from etcd if it re-runs lpsolve which sometimes may even lead to monitor
being unable to apply PG changes at all until rebalance completes
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
1edf86ed26
Aggregate recovery delay using simple mean over last 10 observations (EWMA is shit)
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
5ca7cde612
Experiment/WIP: Try to track "secondary" recovery ops separately
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
751935ddd8
WIP Auto-tune recovery speed
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
d84dee7098
Track recovery op latencies + refactor into a structure
2023-12-31 01:23:17 +03:00
Vitaliy Filippov
dcc76eee15
Add a parity chunk count change test script
2023-12-26 23:48:41 +03:00
Vitaliy Filippov
2f38adeb3d
Restart dead VDUSE daemons at regular intervals
2023-12-24 12:58:50 +03:00
Vitaliy Filippov
f72f14e6a7
Clear old PG states, history, and OSD states on etcd state reload
...
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m24s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m24s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m21s
Details
Test / test_write (push) Successful in 36s
Details
Test / test_rebalance_verify (push) Successful in 4m12s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m29s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m25s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m10s
Details
Test / test_heal_ec (push) Successful in 4m46s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m31s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m41s
Details
Test / test_heal_csum_32k (push) Successful in 6m41s
Details
Test / test_scrub (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m53s
Details
Test / test_scrub_xor (push) Successful in 54s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 58s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m27s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m15s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m27s
Details
Test / test_heal_csum_4k (push) Successful in 6m20s
Details
Test / test_scrub_ec (push) Successful in 29s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Also add protection from etcd watcher messages being split into multiple websocket
messages - I'm not sure if etcd actually does that, but it's better to have extra
protection anyway.
Also check that all etcd watchers are started in the keepalive routine, otherwise
it sometimes tries to revive etcd watchers starting with revision=1 which obviously
always fails because this revision is nearly always compacted.
All these changes should fix an old rarely reproduced bug where SOMETIMES OSDs
didn't react to PG config changes which was leading to offline pools on node reboot.
It happened on the full reload of state from etcd.
2023-12-24 02:02:13 +03:00
Vitaliy Filippov
1299373988
Use the same etcd_ws_keepalive_interval in OSD and mon
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m58s
Details
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m36s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m8s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m58s
Details
Test / test_rebalance_verify (push) Successful in 3m55s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m18s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m8s
Details
Test / test_write_xor (push) Failing after 3m11s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m47s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m58s
Details
Test / test_heal_ec (push) Successful in 6m21s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m11s
Details
Test / test_heal_csum_32k (push) Successful in 6m22s
Details
Test / test_scrub (push) Successful in 1m17s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m17s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m35s
Details
Test / test_scrub_xor (push) Successful in 57s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m27s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m3s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m33s
Details
Test / test_scrub_ec (push) Successful in 44s
Details
Test / test_heal_csum_4k (push) Successful in 6m9s
Details
2023-12-23 20:07:29 +03:00
Vitaliy Filippov
178bb0e701
Prevent re-entry into timerfd set_nearest
Test / test_interrupted_rebalance_ec (push) Successful in 2m0s
Details
Test / test_rm (push) Successful in 19s
Details
Test / test_move_reappear (push) Successful in 23s
Details
Test / test_snapshot_ec (push) Successful in 40s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 2m32s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m10s
Details
Test / test_rebalance_verify (push) Successful in 4m2s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m25s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m19s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m8s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m26s
Details
Test / test_heal_csum_32k (push) Successful in 6m12s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m41s
Details
Test / test_scrub (push) Successful in 1m17s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 57s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m36s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m36s
Details
Test / test_scrub_ec (push) Successful in 31s
Details
Test / test_heal_csum_4k (push) Successful in 5m23s
Details
Test / test_write_xor (push) Successful in 1m4s
Details
Test / test_heal_ec (push) Successful in 3m29s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m20s
Details
2023-12-22 02:32:40 +03:00
Vitaliy Filippov
4ece4dfdd0
Fix mon not using values from config when /config/global is not present
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m24s
Details
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m57s
Details
Test / test_rebalance_verify (push) Successful in 3m47s
Details
Test / test_write (push) Successful in 44s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 56s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m29s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m42s
Details
Test / test_heal_ec (push) Successful in 5m1s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m10s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m57s
Details
Test / test_heal_csum_32k (push) Successful in 6m21s
Details
Test / test_scrub (push) Successful in 1m16s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_xor (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 8m15s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m1s
Details
Test / test_heal_csum_4k (push) Successful in 5m47s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m14s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m24s
Details
Test / test_scrub_ec (push) Successful in 27s
Details
2023-12-22 02:25:09 +03:00
Vitaliy Filippov
95631773b6
Remove pve-storage-portal-dns-list format for vitastor_etcd_address
2023-12-20 02:22:06 +03:00
Vitaliy Filippov
7239cfb91a
Parse log_level in cluster_client
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m52s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 20s
Details
Test / test_snapshot_down (push) Successful in 27s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_snapshot_chain (push) Successful in 2m18s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_rebalance_verify (push) Successful in 3m43s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m17s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m9s
Details
Test / test_write_xor (push) Failing after 3m16s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m49s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m6s
Details
Test / test_heal_ec (push) Successful in 6m46s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m25s
Details
Test / test_heal_csum_32k (push) Successful in 6m41s
Details
Test / test_scrub (push) Successful in 1m15s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m25s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m33s
Details
Test / test_scrub_xor (push) Successful in 1m7s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m16s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m56s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m7s
Details
Test / test_heal_csum_4k (push) Successful in 6m14s
Details
2023-12-20 02:21:23 +03:00
Vitaliy Filippov
7cea642f4a
Fix vitastor-nbd image existence check not working because of non-zeroed inode_watch fields
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m14s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m53s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m49s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 3m34s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 53s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m48s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m16s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m3s
Details
Test / test_heal_ec (push) Successful in 4m37s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m49s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m0s
Details
Test / test_heal_csum_32k (push) Successful in 6m59s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m6s
Details
Test / test_scrub (push) Successful in 1m13s
Details
Test / test_scrub_xor (push) Successful in 51s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m44s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m44s
Details
Test / test_scrub_ec (push) Successful in 45s
Details
Test / test_heal_csum_4k (push) Successful in 6m56s
Details
2023-12-19 01:11:37 +03:00
Vitaliy Filippov
dc615403d9
Do not warn on EPIPE in client unless log_level is raised explicitly
Test / test_snapshot_ec (push) Successful in 36s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m58s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 49s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m26s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 4m6s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 41s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m10s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m0s
Details
Test / test_heal_ec (push) Successful in 4m32s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m50s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m50s
Details
Test / test_heal_csum_32k (push) Successful in 7m6s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m2s
Details
Test / test_scrub (push) Successful in 1m6s
Details
Test / test_scrub_xor (push) Successful in 58s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m57s
Details
Test / test_heal_csum_4k (push) Successful in 6m42s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m42s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 53s
Details
Test / test_scrub_ec (push) Successful in 22s
Details
2023-12-17 13:42:26 +03:00
Vitaliy Filippov
1a704e06ab
Allow multiple interfaces with the same IP address, for "simple routed" full mesh network
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m59s
Details
Test / test_rm (push) Successful in 20s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 51s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m29s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m7s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_rebalance_verify (push) Successful in 3m59s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 41s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m20s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m17s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m52s
Details
Test / test_heal_ec (push) Successful in 5m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m38s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m7s
Details
Test / test_heal_csum_32k (push) Successful in 6m56s
Details
Test / test_scrub (push) Successful in 1m10s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_xor (push) Successful in 49s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m32s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m19s
Details
Test / test_heal_csum_4k (push) Successful in 6m3s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m45s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
2023-12-17 13:25:56 +03:00
Vitaliy Filippov
575475de71
Do not ignore loopback addresses for OSD network (to make ECMP setups with frr possible)
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m21s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m55s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m42s
Details
Test / test_write (push) Successful in 43s
Details
Test / test_rebalance_verify (push) Successful in 3m42s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 39s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m9s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m54s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m20s
Details
Test / test_heal_ec (push) Successful in 4m53s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m14s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m9s
Details
Test / test_heal_csum_32k (push) Successful in 6m49s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m56s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m10s
Details
Test / test_scrub_xor (push) Successful in 55s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m31s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m19s
Details
Test / test_heal_csum_4k (push) Successful in 6m16s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m44s
Details
Test / test_scrub_ec (push) Successful in 21s
Details
2023-12-17 11:55:13 +03:00
Vitaliy Filippov
aca2bef15f
Add vitastor-disk update-sb command
Test / test_snapshot_ec (push) Successful in 31s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 2m8s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m52s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m56s
Details
Test / test_write (push) Successful in 36s
Details
Test / test_rebalance_verify (push) Successful in 3m38s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m0s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m14s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m22s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m9s
Details
Test / test_heal_ec (push) Successful in 6m49s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m14s
Details
Test / test_heal_csum_32k (push) Successful in 6m12s
Details
Test / test_scrub (push) Successful in 1m21s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m21s
Details
Test / test_scrub_xor (push) Successful in 1m13s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m9s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m3s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m48s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_heal_csum_4k (push) Successful in 6m2s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_write_xor (push) Failing after 3m5s
Details
2023-12-14 01:11:42 +03:00
Vitaliy Filippov
4dd6e89263
Change qemu to qemu-system-x86 in docs
2023-12-14 01:01:00 +03:00
Vitaliy Filippov
9bac99ffb6
Fix incorrect error in CSI when searching for the device in /sys
2023-12-14 01:00:32 +03:00
Vitaliy Filippov
62ed130960
Support building qemu 8.1 from bookworm-backports
2023-12-10 00:34:13 +03:00
Vitaliy Filippov
9c7755b6e8
Use qemu-storage-daemon from QEMU 8.1.2 for CSI
2023-12-08 00:10:12 +03:00
Vitaliy Filippov
691ebd991a
Move 2 last log printfs to stderr from stdout in etcd_state_client
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m46s
Details
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m12s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m57s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 22s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m45s
Details
Test / test_write (push) Successful in 31s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m32s
Details
Test / test_write_xor (push) Successful in 1m15s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 6m34s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m43s
Details
Test / test_heal_ec (push) Successful in 5m33s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m45s
Details
Test / test_heal_csum_32k (push) Successful in 6m37s
Details
Test / test_scrub (push) Successful in 1m3s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m39s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m37s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 54s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m29s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 48s
Details
Test / test_scrub_ec (push) Successful in 46s
Details
Test / test_heal_csum_4k (push) Successful in 5m31s
Details
2023-12-08 00:01:52 +03:00
Vitaliy Filippov
6d5df908a3
Fix possible out of bounds when checking invalid journal entries
2023-12-08 00:01:07 +03:00
Vitaliy Filippov
fa87769ed8
Correct config options in vduse docs
2023-12-06 02:09:04 +03:00
Vitaliy Filippov
2ce8292803
Also log when killing process
2023-12-06 01:06:53 +03:00
Vitaliy Filippov
7f8f7ded52
Check for empty output of vitastor-nbd map (just in case)
2023-12-06 01:01:14 +03:00
Vitaliy Filippov
68553eabbb
Log executed CLI commands
2023-12-06 00:48:12 +03:00
Vitaliy Filippov
3147c5c8d5
Remove internal error wrapping
2023-12-06 00:39:42 +03:00
Vitaliy Filippov
576e2ae608
Fix etcd_address check in CSI
2023-12-06 00:28:21 +03:00
Vitaliy Filippov
a1c7cc3d8d
Release 1.3.1
...
Test / test_interrupted_rebalance_ec (push) Successful in 1m46s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m22s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m59s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m3s
Details
Test / test_rebalance_verify (push) Successful in 3m47s
Details
Test / test_write (push) Successful in 44s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m36s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m20s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m45s
Details
Test / test_heal_ec (push) Successful in 6m22s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Details
Test / test_heal_csum_32k (push) Successful in 6m2s
Details
Test / test_scrub (push) Successful in 1m14s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m19s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m54s
Details
Test / test_scrub_xor (push) Successful in 1m1s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m59s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m54s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m2s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
Test / test_heal_csum_4k (push) Successful in 6m0s
Details
Test / test_write_xor (push) Successful in 32s
Details
Hotfix to 1.3.0 - new "journal space reservation" had a bug which
caused OSDs to crash with EC and without immediate_commit.
2023-12-04 18:35:09 +03:00
Vitaliy Filippov
a5e3dfbc5a
Oops, 1.3.0 needs a hotfix
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m53s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 27s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m56s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s
Details
Test / test_rebalance_verify (push) Successful in 3m38s
Details
Test / test_write (push) Successful in 45s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m5s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m22s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m51s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m39s
Details
Test / test_heal_ec (push) Successful in 6m39s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m55s
Details
Test / test_heal_csum_32k (push) Successful in 6m5s
Details
Test / test_scrub (push) Successful in 1m18s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m19s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m25s
Details
Test / test_scrub_xor (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m46s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m17s
Details
Test / test_heal_csum_4k (push) Successful in 5m51s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m0s
Details
Test / test_scrub_ec (push) Successful in 21s
Details
Test / test_write_xor (push) Successful in 33s
Details
2023-12-04 13:45:54 +03:00
Vitaliy Filippov
7972502eaf
Release 1.3.0
...
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m1s
Details
Test / test_snapshot_down (push) Successful in 19s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_snapshot_down_ec (push) Failing after 3m10s
Details
Test / test_rebalance_verify (push) Successful in 2m45s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m17s
Details
Test / test_write (push) Successful in 1m11s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m41s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_write_xor (push) Failing after 3m6s
Details
Test / test_rebalance_verify_ec (push) Failing after 5m27s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m36s
Details
Test / test_heal_csum_32k_dj (push) Failing after 4m53s
Details
Test / test_heal_csum_32k (push) Failing after 5m27s
Details
Test / test_heal_ec (push) Failing after 10m15s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m14s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m15s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 56s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m4s
Details
Test / test_heal_csum_4k (push) Failing after 5m31s
Details
Test / test_scrub_xor (push) Failing after 3m17s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 3m6s
Details
Test / test_change_pg_count_ec (push) Failing after 3m5s
Details
Test / test_snapshot_ec (push) Failing after 3m5s
Details
Test / test_scrub_ec (push) Failing after 3m5s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m5s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m5s
Details
New features:
- RDMA without ODP - much faster and all cards are now supported, not just Mellanox
- VDUSE in CSI - faster, more stable and can even recover after CSI pod restart!
- Reserve journal space for stabilize requests dynamically to prevent stalls under load with EC
- Raise default NBD timeout from 30 to 300 seconds and allow to take it from /etc/vitastor/vitastor.conf
- Remove explicit etcdUrl/etcdPrefix K8S storage class parameter support to prevent
etcd migration issues for volumes created with these parameters
- Support QEMU 8.1 and pve-qemu 8.1
Bug fixes:
- Fix RDMA connection (and thus memory) leak
- Fix rare crashes under load due to incorrect io_uring queue size tracking
- Fix monitor statistics aggregation in case of empty /osd/stats keys
- Fix crash on unknown long argument to vitastor-disk
- Allow trailing comma in JSONs again
- Fix crash on attempts to dump a long listing of objects "to stabilize" or "to rollback" in a slow op
2023-12-04 02:36:43 +03:00
Vitaliy Filippov
e57b7203b8
Use cmake3 on RHEL 7
2023-12-04 02:36:29 +03:00
Vitaliy Filippov
c8a179dcda
Note that Proxmox 8.1 is supported
2023-12-04 02:20:33 +03:00
Vitaliy Filippov
845454742d
Fix warning with QEMU 8.1
2023-12-04 01:59:07 +03:00
Vitaliy Filippov
d65512bd80
Add patches for QEMU 8.1
2023-12-04 01:56:17 +03:00
Vitaliy Filippov
53de2bbd0f
Support VDUSE in CSI
...
VDUSE has multiple advantages:
- Better performance
- Lack of timeout problems
- And even the ability to recover after restart of the vitastor-csi pod!
2023-12-04 00:41:24 +03:00
Vitaliy Filippov
628aa59574
Raise default NBD timeout from 30 to 300 seconds and allow to take it from /etc/vitastor/vitastor.conf
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m0s
Details
Test / test_snapshot_down (push) Successful in 20s
Details
Test / test_snapshot_ec (push) Failing after 3m6s
Details
Test / test_splitbrain (push) Successful in 13s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m7s
Details
Test / test_snapshot_down_ec (push) Failing after 3m7s
Details
Test / test_rebalance_verify (push) Successful in 2m42s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m14s
Details
Test / test_write (push) Successful in 45s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m19s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m40s
Details
Test / test_write_xor (push) Failing after 3m5s
Details
Test / test_rebalance_verify_ec (push) Failing after 5m22s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m48s
Details
Test / test_heal_csum_32k_dj (push) Successful in 4m27s
Details
Test / test_heal_ec (push) Failing after 10m6s
Details
Test / test_heal_csum_32k_dmj (push) Failing after 10m14s
Details
Test / test_heal_csum_32k (push) Failing after 10m14s
Details
Test / test_scrub (push) Successful in 22s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 19s
Details
Test / test_heal_csum_4k_dmj (push) Failing after 10m10s
Details
Test / test_scrub_pg_size_3 (push) Successful in 30s
Details
Test / test_scrub_xor (push) Failing after 3m6s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 3m5s
Details
Test / test_heal_csum_4k_dj (push) Failing after 10m13s
Details
Test / test_scrub_ec (push) Failing after 3m5s
Details
Test / test_heal_csum_4k (push) Failing after 10m8s
Details
2023-12-02 14:11:14 +03:00
Vitaliy Filippov
037cf64a47
Remove explicit etcdUrl/etcdPrefix from volume parameters
2023-12-02 13:26:00 +03:00
Vitaliy Filippov
19e2d9d6fa
Fix crash on unknown long argument to vitastor-disk
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 59s
Details
Test / test_snapshot_down (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Failing after 3m5s
Details
Test / test_splitbrain (push) Successful in 11s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Failing after 22s
Details
Test / test_rebalance_verify_ec (push) Failing after 44s
Details
Test / test_snapshot_down_ec (push) Failing after 3m5s
Details
Test / test_rebalance_verify (push) Successful in 2m53s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m14s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_write (push) Failing after 3m19s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m7s
Details
Test / test_write_xor (push) Failing after 3m8s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m9s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m45s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m1s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 4m12s
Details
Test / test_heal_ec (push) Failing after 10m13s
Details
Test / test_heal_csum_4k_dj (push) Failing after 4m13s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 48s
Details
Test / test_scrub (push) Successful in 51s
Details
Test / test_scrub_pg_size_3 (push) Successful in 55s
Details
Test / test_heal_csum_32k (push) Failing after 10m12s
Details
Test / test_heal_csum_4k (push) Failing after 3m55s
Details
Test / test_scrub_xor (push) Failing after 3m7s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 3m14s
Details
Test / test_scrub_ec (push) Failing after 3m11s
Details
2023-12-01 00:55:51 +03:00
Vitaliy Filippov
bfc7e61909
Add more notes + performance comparison about VDUSE
2023-11-25 02:25:56 +03:00
Vitaliy Filippov
7da4868b37
Fix monitor statistics aggregation in case of empty /osd/stats keys
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_chain (push) Successful in 1m1s
Details
Test / test_snapshot_down (push) Successful in 20s
Details
Test / test_snapshot_ec (push) Failing after 3m6s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_snapshot_down_ec (push) Failing after 3m7s
Details
Test / test_rebalance_verify_ec (push) Failing after 48s
Details
Test / test_rebalance_verify (push) Successful in 3m30s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m3s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m36s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m7s
Details
Test / test_write (push) Failing after 3m7s
Details
Test / test_write_xor (push) Failing after 3m6s
Details
Test / test_heal_csum_32k_dmj (push) Failing after 4m5s
Details
Test / test_heal_csum_32k (push) Failing after 3m16s
Details
Test / test_heal_pg_size_2 (push) Failing after 10m7s
Details
Test / test_heal_ec (push) Failing after 10m10s
Details
Test / test_heal_csum_32k_dj (push) Failing after 10m14s
Details
Test / test_scrub (push) Successful in 59s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 54s
Details
Test / test_heal_csum_4k_dj (push) Successful in 4m27s
Details
Test / test_scrub_pg_size_3 (push) Successful in 41s
Details
Test / test_heal_csum_4k (push) Failing after 4m56s
Details
Test / test_scrub_xor (push) Failing after 3m11s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 3m5s
Details
Test / test_scrub_ec (push) Failing after 3m5s
Details
Test / test_heal_csum_4k_dmj (push) Failing after 10m8s
Details
2023-11-24 01:05:21 +03:00
Vitaliy Filippov
b5c020ce0b
Use io_uring SQ size for ringloop capacity - otherwise get_sqe could return NULL when space_left() was > 0 under load
...
Test / test_rm (push) Successful in 11s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_snapshot_chain (push) Successful in 1m0s
Details
Test / test_snapshot_down (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Failing after 3m5s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m5s
Details
Test / test_snapshot_down_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_ec (push) Failing after 42s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m47s
Details
Test / test_rebalance_verify (push) Successful in 3m14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m38s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m5s
Details
Test / test_write_no_same (push) Successful in 11s
Details
Test / test_write (push) Failing after 3m6s
Details
Test / test_write_xor (push) Failing after 3m5s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m45s
Details
Test / test_heal_csum_32k_dj (push) Failing after 4m41s
Details
Test / test_heal_csum_32k (push) Successful in 4m28s
Details
Test / test_heal_ec (push) Failing after 10m12s
Details
Test / test_heal_csum_4k_dmj (push) Failing after 4m27s
Details
Test / test_scrub (push) Successful in 53s
Details
Test / test_heal_csum_32k_dmj (push) Failing after 10m16s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 59s
Details
Test / test_heal_csum_4k_dj (push) Failing after 4m24s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m7s
Details
Test / test_scrub_xor (push) Failing after 3m14s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 3m6s
Details
Test / test_scrub_ec (push) Failing after 3m7s
Details
Test / test_heal_csum_4k (push) Failing after 10m9s
Details
Raise default io_uring size to 1024 for the same effective capacity as previously
2023-11-20 03:04:06 +03:00
Vitaliy Filippov
6b33ae973d
%d -> %lu
2023-11-20 03:02:26 +03:00
Vitaliy Filippov
cf36445359
Reserve journal space for stabilize requests dynamically to prevent stalls
2023-11-20 03:01:57 +03:00
Vitaliy Filippov
3fd873d263
Add -fno-omit-frame-pointer by default
2023-11-20 02:59:54 +03:00
Vitaliy Filippov
a00e8ae9ed
Fix mismatch journal pos format in vitastor-disk
Test / test_interrupted_rebalance_ec (push) Successful in 1m47s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m12s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m42s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 4m23s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m45s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m49s
Details
Test / test_write_xor (push) Failing after 3m9s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m20s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m41s
Details
Test / test_heal_ec (push) Successful in 6m24s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m53s
Details
Test / test_heal_csum_32k (push) Successful in 6m10s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m21s
Details
Test / test_scrub (push) Failing after 3m13s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 56s
Details
Test / test_scrub_xor (push) Successful in 44s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m48s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m0s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_heal_csum_4k (push) Successful in 5m43s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m8s
Details
2023-11-19 15:19:54 +03:00
Vitaliy Filippov
75674545dc
Limit the number of printed object versions in slow op dump (otherwise it may overflow the fixed buffer)
Test / test_interrupted_rebalance_ec (push) Successful in 1m55s
Details
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_move_reappear (push) Failing after 49s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m17s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m58s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m12s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 3m52s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 57s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m18s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m21s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m0s
Details
Test / test_heal_ec (push) Successful in 4m48s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m8s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m29s
Details
Test / test_heal_csum_32k (push) Successful in 6m21s
Details
Test / test_scrub (push) Successful in 1m15s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m42s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m1s
Details
Test / test_scrub_xor (push) Successful in 49s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m22s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m6s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m37s
Details
Test / test_scrub_ec (push) Successful in 35s
Details
Test / test_heal_csum_4k (push) Successful in 6m16s
Details
2023-11-13 01:10:28 +03:00
Vitaliy Filippov
225eb2fe3d
Support RDMA without ODP by stupidly copying memory. Disable ODP by default
...
ODP is slower than regular RDMA even with memory copy overhead
Example numbers:
- 3950000 random read iops without ODP vs 240000 iops with ODP
- 1447000 random write iops without ODP vs 101000 iops with ODP
Reference: https://tkygtr6.github.io/pub/ISPASS21_slides.pdf
2023-11-12 15:03:47 +03:00
Vitaliy Filippov
7e82573ed0
Fix RDMA connection leak which was preventing stable functioning of RDMA :)
Test / test_minsize_1 (push) Successful in 14s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m19s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m45s
Details
Test / test_rebalance_verify (push) Successful in 3m36s
Details
Test / test_write (push) Successful in 37s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write_xor (push) Successful in 53s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m54s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m8s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m5s
Details
Test / test_heal_ec (push) Successful in 4m48s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m25s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m29s
Details
Test / test_heal_csum_32k (push) Successful in 6m22s
Details
Test / test_scrub (push) Successful in 1m7s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m39s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m9s
Details
Test / test_scrub_xor (push) Successful in 47s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m3s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m12s
Details
Test / test_heal_csum_4k (push) Successful in 6m11s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m29s
Details
Test / test_scrub_ec (push) Successful in 33s
Details
2023-11-11 23:40:47 +03:00
Vitaliy Filippov
12a6bed2d5
Return the new accidentally rolled back json11 commit ("allow trailing comma")
Test / test_snapshot_ec (push) Successful in 28s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m51s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m22s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m4s
Details
Test / test_rebalance_verify (push) Successful in 3m48s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m14s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m2s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m44s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m43s
Details
Test / test_heal_ec (push) Successful in 6m47s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m57s
Details
Test / test_heal_csum_32k (push) Successful in 6m11s
Details
Test / test_scrub (push) Successful in 1m10s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m17s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m19s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m10s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m47s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m3s
Details
Test / test_heal_csum_4k (push) Successful in 6m3s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
Test / test_scrub_xor (push) Successful in 23s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m25s
Details
Test / test_write_xor (push) Failing after 3m6s
Details
2023-11-07 15:49:23 +03:00
Vitaliy Filippov
5524dbdab7
Release 1.2.0
...
Test / test_snapshot_ec (push) Successful in 25s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m18s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 18s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m57s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s
Details
Test / test_write (push) Successful in 38s
Details
Test / test_rebalance_verify (push) Successful in 3m39s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m56s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m6s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m35s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k (push) Successful in 5m50s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m44s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 57s
Details
Test / test_scrub (push) Successful in 1m0s
Details
Test / test_scrub_xor (push) Successful in 1m5s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m9s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 54s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
Test / test_heal_csum_4k (push) Successful in 5m8s
Details
Test / test_heal_ec (push) Successful in 3m17s
Details
Test / test_write_xor (push) Successful in 35s
Details
Test / test_move_reappear (push) Failing after 48s
Details
New features:
- Implement CSI volume expansion
- Implement CSI volume snapshots
- CSI driver now requires Kubernetes >= 1.20
Bug fixes:
- Important bug fix for EC: fix EC n+k, k>=2 read recovery in ISA-L version returning
incorrect data when reading at least the second chunk out of multiple missing chunks
without reading the first one. All users of EC n+k, k>=2 should upgrade as soon as
possible, and upgrade should be conducted with downtime: first stop all clients
(VMs/containers), then all OSDs, then upgrade and restart everything.
- Fix unstable statistics aggregation in monitor (affecting vitastor-cli status and df)
- Make udev not wait for OSDs to start during boot
- Do not report negative numbers of offline PGs in vitastor-cli status when changing PG count
- Report both old and new PG counts in vitastor-cli df when changing it
- Fix OSDs sometimes not starting with "The code only supports journal versions 1 and 2,
but it is 2 on disk" error after upgrading from pre-1.0 versions and letting OSDs run
for some time
- Fix monitors sometimes returning old PG count back after OSD configuration changes
- Make monitor PG changes more stable and timeout errors less probable
2023-11-05 01:48:57 +03:00
Vitaliy Filippov
cd3dec06ac
Remove spaces from old->new PG count in df
Test / test_interrupted_rebalance_ec (push) Successful in 1m50s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_snapshot_down (push) Successful in 29s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m34s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m9s
Details
Test / test_rebalance_verify (push) Successful in 4m9s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m15s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m29s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m21s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m38s
Details
Test / test_heal_ec (push) Successful in 6m14s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m22s
Details
Test / test_heal_csum_32k (push) Successful in 6m40s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m12s
Details
Test / test_scrub_xor (push) Successful in 1m16s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m4s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m34s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m4s
Details
Test / test_heal_csum_4k (push) Successful in 5m37s
Details
Test / test_scrub_ec (push) Successful in 43s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m14s
Details
Test / test_write_xor (push) Successful in 1m11s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m43s
Details
2023-11-05 01:45:45 +03:00
Vitaliy Filippov
371d79e059
Document vitastor-csi features
2023-11-05 01:05:26 +03:00
Vitaliy Filippov
0e888e6c60
Prevent spamming etcd with last_clean_pgs update requests
Test / test_snapshot_ec (push) Successful in 34s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m23s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m4s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m54s
Details
Test / test_rebalance_verify (push) Successful in 3m48s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 55s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m15s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m3s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m59s
Details
Test / test_heal_ec (push) Successful in 4m56s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m48s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k (push) Successful in 6m35s
Details
Test / test_scrub (push) Successful in 1m14s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m54s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m2s
Details
Test / test_scrub_xor (push) Successful in 49s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m9s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m54s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m17s
Details
Test / test_heal_csum_4k (push) Successful in 6m18s
Details
Test / test_scrub_ec (push) Successful in 37s
Details
2023-11-05 00:12:00 +03:00
Vitaliy Filippov
408c21d8f0
Scale last_clean_pgs PG count even if current PGs already contain the new number of PGs
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_snapshot_ec (push) Successful in 31s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 2m15s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m56s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m59s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_rebalance_verify (push) Successful in 3m44s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m5s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m1s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m1s
Details
Test / test_heal_ec (push) Successful in 5m3s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m13s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m37s
Details
Test / test_heal_csum_32k (push) Successful in 6m19s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m13s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m5s
Details
Test / test_scrub_xor (push) Successful in 48s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m11s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m10s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m29s
Details
Test / test_heal_csum_4k (push) Successful in 6m9s
Details
Test / test_scrub_ec (push) Successful in 35s
Details
2023-11-04 23:45:59 +03:00
Vitaliy Filippov
43cb9ae212
Prevent multiple parallel recheck_pgs in case of timeouts
Test / test_snapshot_ec (push) Successful in 37s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m25s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m7s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_rebalance_verify (push) Successful in 3m54s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m6s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m10s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m1s
Details
Test / test_heal_ec (push) Successful in 4m21s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m10s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m51s
Details
Test / test_heal_csum_32k (push) Successful in 6m54s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m38s
Details
Test / test_scrub (push) Successful in 1m9s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m2s
Details
Test / test_scrub_xor (push) Successful in 43s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m24s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m16s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
Test / test_scrub_ec (push) Successful in 37s
Details
Test / test_heal_csum_4k (push) Successful in 6m2s
Details
2023-11-04 20:59:56 +03:00
Vitaliy Filippov
e15b6e7805
Fix "cannot be narrowed" in clang
Test / test_snapshot_ec (push) Successful in 44s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m10s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Failing after 51s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m32s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m2s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_write (push) Successful in 33s
Details
Test / test_rebalance_verify (push) Successful in 3m53s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m23s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m11s
Details
Test / test_write_xor (push) Failing after 3m12s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m47s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m17s
Details
Test / test_heal_ec (push) Successful in 5m34s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m43s
Details
Test / test_heal_csum_32k (push) Successful in 6m30s
Details
Test / test_scrub (push) Successful in 1m18s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m24s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m23s
Details
Test / test_scrub_xor (push) Successful in 54s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m1s
Details
Test / test_scrub_ec (push) Successful in 54s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m25s
Details
Test / test_heal_csum_4k (push) Successful in 6m10s
Details
2023-11-04 18:14:44 +03:00
Vitaliy Filippov
31017d8412
Allow to start with V2 journal with header size from V1, as incorrectly updated by previous versions
2023-11-04 18:13:42 +03:00
Vitaliy Filippov
4819854064
Fix OSDs incorrectly updating journal superblock after upgrade to 1.x from pre-1.x and refusing to start after it
Test / test_interrupted_rebalance_imm (push) Successful in 3m38s
Details
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_move_reappear (push) Failing after 47s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m31s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m7s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m54s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_rebalance_verify (push) Successful in 3m46s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_write_xor (push) Successful in 37s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m56s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m0s
Details
Test / test_heal_pg_size_2 (push) Failing after 4m18s
Details
Test / test_heal_ec (push) Successful in 5m3s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m19s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k (push) Successful in 6m37s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m46s
Details
Test / test_scrub (push) Successful in 1m5s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 48s
Details
Test / test_scrub_xor (push) Successful in 45s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m37s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m17s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m40s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
Test / test_heal_csum_4k (push) Successful in 7m13s
Details
2023-11-04 15:02:24 +03:00
Vitaliy Filippov
1f509cca77
Fix unused capture warnings and void* arithmetic (clang)
Test / test_minsize_1 (push) Successful in 14s
Details
Test / test_snapshot_ec (push) Successful in 40s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 33s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m31s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m7s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m6s
Details
Test / test_write (push) Successful in 39s
Details
Test / test_rebalance_verify (push) Successful in 4m7s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m23s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m20s
Details
Test / test_write_xor (push) Failing after 3m9s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m44s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m8s
Details
Test / test_heal_csum_32k (push) Successful in 5m58s
Details
Test / test_heal_ec (push) Failing after 10m16s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 5m57s
Details
Test / test_scrub (push) Successful in 1m8s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 59s
Details
Test / test_scrub_xor (push) Successful in 47s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m30s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m7s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m34s
Details
Test / test_heal_csum_4k (push) Successful in 5m21s
Details
Test / test_scrub_ec (push) Successful in 43s
Details
2023-11-04 14:55:12 +03:00
Vitaliy Filippov
aa8e8e8271
Add version info to --help output
Test / test_minsize_1 (push) Successful in 16s
Details
Test / test_snapshot_ec (push) Successful in 39s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m31s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m47s
Details
Test / test_rebalance_verify (push) Successful in 3m38s
Details
Test / test_write (push) Successful in 38s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m19s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m6s
Details
Test / test_write_xor (push) Failing after 3m10s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m54s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m6s
Details
Test / test_heal_ec (push) Successful in 5m48s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m22s
Details
Test / test_heal_csum_32k (push) Successful in 6m30s
Details
Test / test_scrub (push) Successful in 1m18s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m12s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m38s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m14s
Details
Test / test_scrub_xor (push) Successful in 1m0s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 56s
Details
Test / test_scrub_ec (push) Successful in 51s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m20s
Details
Test / test_heal_csum_4k (push) Successful in 5m58s
Details
2023-11-04 13:32:12 +03:00
Vitaliy Filippov
4d79e531c5
Do not print "-X offline" in status when changing pool PG count, print it in df instead
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m20s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_ec (push) Successful in 36s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_move_reappear (push) Failing after 48s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m21s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m6s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 3m46s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m7s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m23s
Details
Test / test_write_xor (push) Failing after 3m8s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m15s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m39s
Details
Test / test_heal_ec (push) Successful in 6m35s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m5s
Details
Test / test_heal_csum_32k (push) Successful in 6m45s
Details
Test / test_scrub (push) Successful in 1m8s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m24s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m6s
Details
Test / test_scrub_xor (push) Successful in 41s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m18s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m29s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m34s
Details
Test / test_heal_csum_4k (push) Successful in 6m7s
Details
Test / test_scrub_ec (push) Successful in 30s
Details
2023-11-04 13:12:13 +03:00
Vitaliy Filippov
30dff8893f
Fix ISA-L version EC recovery with first missing data chunk not being read
...
Test / test_snapshot (push) Successful in 44s
Details
Test / test_snapshot_ec (push) Successful in 28s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m20s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m49s
Details
Test / test_rebalance_verify (push) Successful in 3m37s
Details
Test / test_write (push) Successful in 42s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 54s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m55s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m13s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m4s
Details
Test / test_heal_ec (push) Successful in 5m2s
Details
Test / test_heal_csum_32k_dmj (push) Failing after 5m54s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m6s
Details
Test / test_heal_csum_32k (push) Successful in 6m59s
Details
Test / test_scrub (push) Successful in 1m16s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m56s
Details
Test / test_scrub_xor (push) Successful in 51s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m25s
Details
Test / test_heal_csum_4k (push) Successful in 6m9s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m33s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m37s
Details
Test / test_scrub_ec (push) Successful in 26s
Details
(Yes, all EC n + k with k >= 2 users should upgrade as soon as possible)
2023-11-04 01:34:18 +03:00
Vitaliy Filippov
becf14a705
Add a test for EC with multiple missing data chunks, but without recovery of first of them
2023-11-04 01:34:18 +03:00
Vitaliy Filippov
64388788c1
Implement CSI volume expansion
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_minsize_1 (push) Successful in 16s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_snapshot_chain (push) Successful in 2m24s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m15s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_rebalance_verify (push) Successful in 4m13s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_write_xor (push) Successful in 50s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m28s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m30s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m5s
Details
Test / test_heal_ec (push) Successful in 4m57s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 6m13s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m10s
Details
Test / test_heal_csum_32k (push) Successful in 6m40s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m24s
Details
Test / test_scrub (push) Successful in 1m7s
Details
Test / test_scrub_xor (push) Successful in 47s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m25s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m59s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m10s
Details
Test / test_heal_csum_4k (push) Successful in 6m2s
Details
Test / test_scrub_ec (push) Successful in 40s
Details
2023-11-01 12:46:20 +03:00
Vitaliy Filippov
37653abe4b
Implement CSI volume snapshots
2023-11-01 12:46:20 +03:00
Vitaliy Filippov
7c054c6f10
Add "id" to df --json output
2023-11-01 12:46:16 +03:00
Vitaliy Filippov
bb7709e824
Support listening on non-127.0.0.1 in tests
2023-11-01 12:45:27 +03:00
Vitaliy Filippov
ebeace5a2d
Add cmake and pkg-config to debian build depends
2023-11-01 12:45:27 +03:00
Vitaliy Filippov
a378789f10
Rollback erroneous go.mod changes in 1.1.0 O:-)
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m52s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m23s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m2s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m1s
Details
Test / test_rebalance_verify (push) Successful in 3m49s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_write_xor (push) Successful in 43s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m15s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m9s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m13s
Details
Test / test_heal_ec (push) Successful in 4m31s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m59s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m14s
Details
Test / test_heal_csum_32k (push) Successful in 6m47s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m47s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m0s
Details
Test / test_scrub_xor (push) Successful in 52s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m19s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m52s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m2s
Details
Test / test_heal_csum_4k (push) Successful in 5m46s
Details
Test / test_scrub_ec (push) Successful in 25s
Details
2023-10-30 18:47:48 +03:00
Vitaliy Filippov
1fe678e57b
Add --no-block to udev rule
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m0s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 30s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m29s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m4s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 18s
Details
Test / test_write (push) Successful in 29s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m53s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 3m46s
Details
Test / test_write_xor (push) Failing after 3m6s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m1s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m50s
Details
Test / test_heal_ec (push) Successful in 4m34s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m5s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m57s
Details
Test / test_heal_csum_32k (push) Successful in 6m56s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m28s
Details
Test / test_scrub (push) Successful in 1m10s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 57s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m34s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m8s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m37s
Details
Test / test_scrub_ec (push) Successful in 41s
Details
Test / test_heal_csum_4k (push) Successful in 6m6s
Details
2023-10-30 12:18:29 +03:00
Vitaliy Filippov
2e592a2f22
Fix undefined variable "timeout"
Test / test_snapshot_ec (push) Successful in 44s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m9s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_move_reappear (push) Failing after 51s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m26s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m2s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_rebalance_verify (push) Successful in 3m56s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_write_xor (push) Successful in 38s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m2s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m13s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m17s
Details
Test / test_heal_ec (push) Successful in 5m2s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m43s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m36s
Details
Test / test_heal_csum_32k (push) Successful in 7m4s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m47s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 59s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m26s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m32s
Details
Test / test_heal_csum_4k (push) Successful in 6m31s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 27s
Details
Test / test_scrub_ec (push) Successful in 25s
Details
Test / test_scrub_xor (push) Failing after 3m7s
Details
2023-10-29 01:30:55 +03:00
Vitaliy Filippov
b92f644e3a
Fix statistics aggregation, calculate inode stats by first deriving per-OSD stats, too
2023-10-29 01:30:55 +03:00
Vitaliy Filippov
890ea3dbc0
Forgot to add new parameter page to README
2023-10-28 13:39:53 +03:00
Vitaliy Filippov
06630369bf
Plans++
2023-10-28 13:38:04 +03:00
Vitaliy Filippov
b4740acf62
Fix operations paused for 0.5-1 second when it happens that io_uring submit is not triggered
Test / test_snapshot (push) Successful in 24s
Details
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_move_reappear (push) Failing after 48s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m30s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m4s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m41s
Details
Test / test_write (push) Successful in 48s
Details
Test / test_rebalance_verify (push) Successful in 3m42s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m17s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m11s
Details
Test / test_write_xor (push) Failing after 3m8s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m40s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m9s
Details
Test / test_heal_ec (push) Successful in 6m31s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m30s
Details
Test / test_heal_csum_32k (push) Successful in 6m22s
Details
Test / test_scrub (push) Successful in 1m14s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m20s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m23s
Details
Test / test_scrub_xor (push) Successful in 1m4s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Details
Test / test_scrub_ec (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m35s
Details
Test / test_heal_csum_4k (push) Successful in 6m1s
Details
2023-10-28 13:18:21 +03:00
Vitaliy Filippov
eae81bbda6
Fix typo
2023-10-28 01:09:20 +03:00
Vitaliy Filippov
8222e3c77d
Release 1.1.0
...
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_move_reappear (push) Failing after 49s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m25s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m5s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m51s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_rebalance_verify (push) Successful in 3m38s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_write_xor (push) Successful in 50s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m0s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m2s
Details
Test / test_heal_ec (push) Successful in 4m49s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m27s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m44s
Details
Test / test_heal_csum_32k (push) Successful in 6m57s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m50s
Details
Test / test_scrub (push) Successful in 1m12s
Details
Test / test_scrub_xor (push) Successful in 48s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 54s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m14s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m38s
Details
Test / test_heal_csum_4k (push) Successful in 6m20s
Details
Test / test_scrub_ec (push) Successful in 27s
Details
New features:
- Implement [client writeback cache](docs/config/client.en.md#client_enable_writeback)
- Add the third I/O mode: [O_DIRECT|O_SYNC](docs/config/osd.en.md#data_io) (good for Optane)
- Reduce load on etcd by splitting OSD lease and statistics reporting intervals:
[etcd_stats_interval](docs/config/osd.en.md#etcd_stats_interval) (default 30 sec)
- Make MON automatically filter OSDs by layout (block_size/immediate_commit/bitmap_granularity)
to prevent "refusing to start PGs of this pool" errors on misconfiguration
- Support running fio benchmarks on systems without io_uring
- Make QEMU driver compatible with QEMU 8.1
- Document usage of [vhost-user-blk](docs/usage/qemu.en.md#vhost-user-blk)
Bug fixes:
- Fix resizing disks in QEMU driver (for example, in Proxmox)
- Fix "unexpected result" in Proxmox driver by making CLI flush output on exit
- Remove unneeded block_size mismatch warnings on pools without matching PGs
- Fix possible segfault in vitastor-cli ls -l (usually with deleted pools)
- Fix QEMU driver compatibility with systems without io_uring
- Fix monitor eating 100% CPU when etcd is down (caused by infinite retries)
- Fix potential incorrect write processing with snapshots (not caught in tests
but could probably lead to client hangs)
- Fix buffer insertion in cluster_client (not caught in tests but could
probably lead to incorrect writes in rare cases)
- Fix rare OSD crash during sync operation processing
- Fix a reenterability issue in cluster_client not reproducible in QEMU/fio,
but reproducible with the currently developed K/V database implementation
- Fix deletion of the first modified object - OSDs could crash if you modified
the same object a lot of times, then deleted it, and then modified it again
- Fix the fio_sec_osd test tool
2023-10-28 00:33:06 +03:00
Vitaliy Filippov
29cbe70e74
Bump qemu version to vitastor4
2023-10-28 00:33:06 +03:00
Vitaliy Filippov
a883e79507
Make docs to add etcd_stats_interval
2023-10-27 14:09:26 +03:00
Vitaliy Filippov
be7e76f849
Split etcd_stats_interval out of etcd_report_interval
Test / test_interrupted_rebalance_ec (push) Successful in 1m46s
Details
Test / test_snapshot_ec (push) Successful in 36s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Successful in 29s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 2m15s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m57s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m29s
Details
Test / test_rebalance_verify (push) Successful in 3m40s
Details
Test / test_write (push) Successful in 1m0s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_write_xor (push) Successful in 50s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m58s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m21s
Details
Test / test_heal_ec (push) Successful in 4m5s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m36s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m28s
Details
Test / test_heal_csum_32k (push) Successful in 6m38s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m46s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 59s
Details
Test / test_scrub (push) Successful in 1m16s
Details
Test / test_scrub_xor (push) Successful in 53s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m57s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m18s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m7s
Details
Test / test_heal_csum_4k (push) Successful in 5m43s
Details
Test / test_scrub_ec (push) Successful in 32s
Details
2023-10-27 01:26:26 +03:00
Vitaliy Filippov
6fd2cf5df6
Add documentation for the write-back cache
2023-10-27 01:26:26 +03:00
Vitaliy Filippov
294a754c9e
Allow write-back by default in NBD & NFS
2023-10-27 01:26:26 +03:00
Vitaliy Filippov
8bfea6e7de
Support vitastor_c_create_epoll() in fio driver
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_rm (push) Successful in 21s
Details
Test / test_snapshot_down (push) Successful in 27s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m29s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_snapshot_chain (push) Successful in 2m35s
Details
Test / test_rebalance_verify (push) Successful in 3m22s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m22s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m56s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m51s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m21s
Details
Test / test_heal_ec (push) Successful in 5m45s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m43s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m10s
Details
Test / test_heal_csum_32k (push) Successful in 6m29s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m22s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m51s
Details
Test / test_scrub (push) Successful in 36s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 34s
Details
Test / test_heal_csum_4k (push) Successful in 5m35s
Details
Test / test_scrub_xor (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 1m31s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 31s
Details
Test / test_scrub_pg_size_3 (push) Successful in 42s
Details
Test / test_scrub_ec (push) Successful in 20s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m23s
Details
2023-10-26 22:57:36 +03:00
Vitaliy Filippov
bac9e34836
Allow to create vitastor_c with plain epoll without uring :-)
2023-10-26 22:57:36 +03:00
Vitaliy Filippov
8aa4d492c1
Allow to use epoll_manager without ringloop
2023-10-26 22:57:36 +03:00
Vitaliy Filippov
9336ee5476
Correctly free manual "small vector" in cluster_client %-)
2023-10-26 22:57:36 +03:00
Vitaliy Filippov
ad30b11519
Add the missing ringloop creation check to vitastor_c_create_uring_json()
Test / test_minsize_1 (push) Failing after 1s
Details
Test / test_move_reappear (push) Failing after 1s
Details
Test / test_rm (push) Failing after 0s
Details
Test / test_snapshot_chain (push) Failing after 0s
Details
Test / test_snapshot_chain_ec (push) Failing after 1s
Details
Test / test_snapshot_down (push) Failing after 1s
Details
Test / test_snapshot_down_ec (push) Failing after 0s
Details
Test / test_splitbrain (push) Failing after 1s
Details
Test / test_rebalance_verify (push) Failing after 1s
Details
Test / test_rebalance_verify_imm (push) Failing after 1s
Details
Test / test_rebalance_verify_ec (push) Failing after 1s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 1s
Details
Test / test_write (push) Failing after 1s
Details
Test / test_write_xor (push) Failing after 1s
Details
Test / test_write_no_same (push) Failing after 1s
Details
Test / test_heal_pg_size_2 (push) Failing after 1s
Details
Test / test_heal_ec (push) Failing after 1s
Details
Test / test_heal_csum_32k_dmj (push) Failing after 1s
Details
Test / test_heal_csum_32k_dj (push) Failing after 1s
Details
Test / test_heal_csum_32k (push) Failing after 1s
Details
Test / test_heal_csum_4k_dmj (push) Failing after 1s
Details
Test / test_heal_csum_4k_dj (push) Failing after 1s
Details
Test / test_heal_csum_4k (push) Failing after 1s
Details
Test / test_scrub (push) Failing after 1s
Details
Test / test_scrub_zero_osd_2 (push) Failing after 1s
Details
Test / test_scrub_xor (push) Failing after 1s
Details
Test / test_scrub_pg_size_3 (push) Failing after 1s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Failing after 0s
Details
Test / test_scrub_ec (push) Failing after 1s
Details
Test / build (push) Successful in 2m35s
Details
2023-10-26 18:07:23 +03:00
Vitaliy Filippov
a061246997
Do not attempt to initialize QEMU driver via vitastor_c_create_qemu_uring()
...
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_minsize_1 (push) Successful in 18s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot_down (push) Failing after 26s
Details
Test / test_move_reappear (push) Failing after 52s
Details
Test / test_snapshot_down_ec (push) Failing after 27s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m28s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m6s
Details
Test / test_rebalance_verify (push) Successful in 3m30s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m29s
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_32k_dj (push) Has been cancelled
Details
Test / test_heal_csum_32k (push) Has been cancelled
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
It doesn't add any compatibility because vitastor_c_uring_register_eventfd()
is added in the same VITASTOR_C_API_VERSION 2.
2023-10-26 17:46:19 +03:00
Vitaliy Filippov
5066e35a49
Fix write-over-delete failing for the very first entry in dirty_db
Test / test_minsize_1 (push) Successful in 17s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot_down (push) Failing after 27s
Details
Test / test_move_reappear (push) Failing after 53s
Details
Test / test_snapshot_down_ec (push) Failing after 27s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_snapshot_chain (push) Successful in 2m28s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m59s
Details
Test / test_rebalance_verify (push) Successful in 3m22s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m21s
Details
Test / test_write (push) Successful in 42s
Details
Test / test_write_xor (push) Successful in 48s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m41s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m8s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m17s
Details
Test / test_heal_ec (push) Successful in 4m33s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m23s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m18s
Details
Test / test_heal_csum_32k (push) Successful in 6m44s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m53s
Details
Test / test_scrub (push) Successful in 1m11s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m5s
Details
Test / test_scrub_xor (push) Successful in 1m1s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m58s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m41s
Details
Test / test_scrub_ec (push) Successful in 37s
Details
Test / test_heal_csum_4k (push) Successful in 6m4s
Details
2023-10-21 17:00:14 +03:00
Vitaliy Filippov
93dc31f3fc
Fix possible segfault in vitastor-cli ls -l
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m21s
Details
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot_down (push) Failing after 26s
Details
Test / test_move_reappear (push) Failing after 52s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Failing after 26s
Details
Test / test_snapshot_chain (push) Successful in 2m22s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m44s
Details
Test / test_rebalance_verify (push) Successful in 3m20s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m20s
Details
Test / test_write (push) Successful in 36s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m59s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m49s
Details
Test / test_write_xor (push) Failing after 3m11s
Details
Test / test_heal_pg_size_2 (push) Failing after 4m40s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m13s
Details
Test / test_heal_ec (push) Successful in 5m32s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m1s
Details
Test / test_heal_csum_32k (push) Successful in 6m54s
Details
Test / test_scrub (push) Successful in 1m28s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m7s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m25s
Details
Test / test_scrub_xor (push) Successful in 59s
Details
Test / test_heal_csum_4k (push) Successful in 6m39s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m6s
Details
Test / test_scrub_ec (push) Successful in 35s
Details
2023-10-18 11:11:41 +03:00
Vitaliy Filippov
f245b56176
Fix another possible reenterability issue in cluster_client
...
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m9s
Details
Test / test_snapshot_ec (push) Successful in 42s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_down (push) Failing after 27s
Details
Test / test_move_reappear (push) Failing after 50s
Details
Test / test_snapshot_down_ec (push) Failing after 26s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_chain (push) Successful in 2m26s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m58s
Details
Test / test_rebalance_verify (push) Successful in 3m26s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m27s
Details
Test / test_write (push) Successful in 42s
Details
Test / test_write_xor (push) Successful in 51s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m56s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m11s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m18s
Details
Test / test_heal_ec (push) Successful in 5m5s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m7s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m14s
Details
Test / test_heal_csum_32k (push) Successful in 6m54s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m55s
Details
Test / test_scrub (push) Successful in 1m23s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub_xor (push) Successful in 1m0s
Details
Test / test_heal_csum_4k_dj (push) Successful in 7m15s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m7s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m40s
Details
Test / test_scrub_ec (push) Successful in 42s
Details
Test / test_heal_csum_4k (push) Successful in 6m17s
Details
Non-reproducible in QEMU/FIO, only caught during K/V DB debugging
2023-10-08 11:02:53 +03:00
Vitaliy Filippov
befca06f18
Support any OSD count in test_heal
2023-10-08 11:02:53 +03:00
Vitaliy Filippov
fbf0263625
Add qemu-storage-daemon to documentation
2023-09-16 18:40:52 +03:00
Vitaliy Filippov
3bcf276d4d
Run tests with writeback
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m56s
Details
Test / test_rm (push) Successful in 21s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_snapshot_chain (push) Successful in 2m24s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m54s
Details
Test / test_rebalance_verify (push) Successful in 3m32s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m31s
Details
Test / test_write (push) Successful in 46s
Details
Test / test_write_xor (push) Successful in 52s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m52s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m3s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m52s
Details
Test / test_heal_ec (push) Successful in 5m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m29s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m7s
Details
Test / test_heal_csum_32k (push) Successful in 6m44s
Details
Test / test_scrub (push) Successful in 1m20s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m57s
Details
Test / test_scrub_xor (push) Successful in 55s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m11s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m42s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m12s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m33s
Details
Test / test_scrub_ec (push) Successful in 42s
Details
Test / test_heal_csum_4k (push) Successful in 6m14s
Details
Test / test_move_reappear (push) Successful in 18s
Details
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
38db53f5ee
Implement client writeback cache
...
- Disabled by default, enable with client_enable_writeback=true
- Even then only enabled in FIO when -direct is disabled and in QEMU when
block device cache is enabled in settings
- Can also be enabled in other clients like vitastor-cli using parameter
client_writeback_allowed=true, but not recommended
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
cd543a90bc
Prevent stack overflows in cli_merge with CAS and writeback cache
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
f600cc07b0
Autosync in blockstore every autosync_writes, too
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
6a8e530e6b
Add FIXME to timerfd_manager
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
5cadb170b9
Fix possible OSD crash during sync due to missing min_flushed_journal_sector reset
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
e72d4ed1d4
Remove unused bs_sync fields
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
ff479a102d
Make MON filter OSDs by block layout to prevent "refusing to start PGs of this pool" errors on misconfiguration
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
27d0d5b06a
Reads do not have to wait for buffer flushes anymore
2023-09-16 17:52:17 +03:00
Vitaliy Filippov
33950c1ec8
Fix fio_sec_osd attr_len
Test / test_failure_domain (push) Has been cancelled
Details
Test / test_snapshot (push) Has been cancelled
Details
Test / test_snapshot_ec (push) Has been cancelled
Details
Test / test_minsize_1 (push) Has been cancelled
Details
Test / test_move_reappear (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot_chain (push) Has been cancelled
Details
Test / test_snapshot_chain_ec (push) Has been cancelled
Details
Test / test_snapshot_down (push) Has been cancelled
Details
Test / test_snapshot_down_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_32k_dj (push) Has been cancelled
Details
Test / test_heal_csum_32k (push) Has been cancelled
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / build (push) Has been cancelled
Details
2023-09-16 17:49:10 +03:00
Vitaliy Filippov
eea7ef1f19
Remove debug osd_trace from test_write
Test / test_snapshot_ec (push) Successful in 41s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_snapshot_down (push) Successful in 32s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_snapshot_chain (push) Successful in 2m18s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_rebalance_verify (push) Successful in 3m24s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m26s
Details
Test / test_write (push) Successful in 45s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_write_xor (push) Successful in 49s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m59s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m56s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m39s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m9s
Details
Test / test_heal_csum_32k (push) Successful in 6m8s
Details
Test / test_scrub (push) Successful in 1m26s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m53s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m15s
Details
Test / test_scrub_xor (push) Successful in 57s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m18s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 59s
Details
Test / test_scrub_ec (push) Successful in 57s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m37s
Details
Test / test_heal_csum_4k (push) Successful in 5m21s
Details
Test / test_heal_ec (push) Successful in 7m21s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m59s
Details
2023-09-12 01:35:36 +03:00
Vitaliy Filippov
cc0fdc6253
Remove erroneous block_size mismatch warnings on pools without matching PGs
Test / test_snapshot_ec (push) Successful in 36s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_move_reappear (push) Failing after 52s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m23s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m58s
Details
Test / test_rebalance_verify (push) Successful in 3m32s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m29s
Details
Test / test_write (push) Successful in 52s
Details
Test / test_write_xor (push) Successful in 56s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m0s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m30s
Details
Test / test_heal_ec (push) Successful in 4m6s
Details
Test / test_heal_pg_size_2 (push) Failing after 4m19s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m2s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m12s
Details
Test / test_heal_csum_32k (push) Successful in 6m24s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m19s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m8s
Details
Test / test_scrub (push) Successful in 1m15s
Details
Test / test_scrub_xor (push) Successful in 1m8s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m45s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m58s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m9s
Details
Test / test_scrub_ec (push) Successful in 42s
Details
Test / test_heal_csum_4k (push) Successful in 5m26s
Details
2023-09-08 23:19:04 +03:00
Vitaliy Filippov
79ecd59b10
Flush STDOUT and STDERR before exiting from cli to fix Proxmox "Unexpected result"
Test / test_interrupted_rebalance_ec (push) Successful in 1m51s
Details
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot_down (push) Successful in 29s
Details
Test / test_snapshot_down_ec (push) Successful in 30s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_snapshot_chain (push) Successful in 2m18s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m55s
Details
Test / test_rebalance_verify (push) Successful in 3m15s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m10s
Details
Test / test_write (push) Successful in 47s
Details
Test / test_write_xor (push) Successful in 57s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m3s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m24s
Details
Test / test_heal_pg_size_2 (push) Failing after 3m44s
Details
Test / test_heal_ec (push) Successful in 4m55s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m48s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m11s
Details
Test / test_heal_csum_32k (push) Successful in 6m14s
Details
Test / test_scrub (push) Successful in 1m32s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m33s
Details
Test / test_scrub_xor (push) Successful in 59s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m7s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m25s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m21s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m46s
Details
Test / test_scrub_ec (push) Successful in 53s
Details
Test / test_heal_csum_4k (push) Successful in 5m20s
Details
2023-09-07 17:30:26 +03:00
Vitaliy Filippov
51081c9b45
Put etcd into tmpfs for tests
Test / test_minsize_1 (push) Successful in 16s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_snapshot_ec (push) Successful in 25s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 31s
Details
Test / test_splitbrain (push) Successful in 26s
Details
Test / test_snapshot_chain (push) Successful in 2m17s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m58s
Details
Test / test_rebalance_verify (push) Successful in 3m18s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m0s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m16s
Details
Test / test_heal_ec (push) Successful in 4m44s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m38s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m36s
Details
Test / test_heal_csum_32k (push) Successful in 6m35s
Details
Test / test_scrub (push) Successful in 1m38s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m39s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m17s
Details
Test / test_scrub_xor (push) Successful in 57s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m4s
Details
Test / test_heal_csum_4k (push) Successful in 6m8s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 48s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m9s
Details
Test / test_scrub_ec (push) Successful in 29s
Details
Test / test_write_xor (push) Successful in 1m13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m24s
Details
2023-09-07 02:35:09 +03:00
Vitaliy Filippov
b7d398be5b
Fix sscanf validation usage (field count instead of null_byte == 0)
Test / test_minsize_1 (push) Has been cancelled
Details
Test / test_move_reappear (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot_chain (push) Has been cancelled
Details
Test / test_snapshot_chain_ec (push) Has been cancelled
Details
Test / test_snapshot_down (push) Has been cancelled
Details
Test / test_snapshot_down_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / build (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
Test / test_heal_csum_32k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_32k_dj (push) Has been cancelled
Details
Test / test_heal_csum_32k (push) Has been cancelled
Details
Test / test_heal_csum_4k_dmj (push) Has been cancelled
Details
Test / test_heal_csum_4k_dj (push) Has been cancelled
Details
Test / test_heal_csum_4k (push) Has been cancelled
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
2023-09-07 02:34:35 +03:00
Vitaliy Filippov
85e9f67d9d
Add supported_truncate_flags
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m19s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_snapshot_chain (push) Successful in 2m13s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m54s
Details
Test / test_rebalance_verify (push) Successful in 3m25s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m22s
Details
Test / test_write (push) Successful in 52s
Details
Test / test_write_xor (push) Successful in 55s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m50s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 6m8s
Details
Test / test_heal_ec (push) Successful in 5m1s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m32s
Details
Test / test_heal_csum_32k (push) Successful in 6m14s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m23s
Details
Test / test_scrub (push) Successful in 1m27s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m24s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m15s
Details
Test / test_scrub_xor (push) Successful in 58s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 55s
Details
Test / test_scrub_ec (push) Successful in 53s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m24s
Details
Test / test_heal_csum_4k (push) Successful in 4m44s
Details
Test / test_move_reappear (push) Successful in 20s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m1s
Details
2023-09-06 17:37:52 +03:00
Vitaliy Filippov
79c6d6f323
Make QEMU driver compatible with QEMU 8.1
Test / test_snapshot_ec (push) Successful in 31s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 2m2s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m44s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 3m10s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m10s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m39s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 7m1s
Details
Test / test_write (push) Successful in 36s
Details
Test / test_write_xor (push) Successful in 1m11s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m1s
Details
Test / test_heal_ec (push) Successful in 6m7s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m19s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m7s
Details
Test / test_heal_csum_32k (push) Successful in 6m21s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m22s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m40s
Details
Test / test_heal_csum_4k (push) Successful in 5m34s
Details
Test / test_scrub (push) Successful in 1m2s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 46s
Details
Test / test_scrub_xor (push) Successful in 38s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m7s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 50s
Details
Test / test_scrub_ec (push) Successful in 48s
Details
2023-08-24 02:23:55 +03:00
Vitaliy Filippov
ae760dbc1d
Fix co_truncate size division by BDRV_SECTOR_SIZE
2023-08-24 01:55:35 +03:00
Vitaliy Filippov
65487da4b1
Do not include msgr_rdma.h into messenger.h
2023-08-24 01:55:35 +03:00
Vitaliy Filippov
7862282938
Extract validation to check_rw(), remove duplicate code with OP_SYNC
Test / test_snapshot_ec (push) Successful in 19s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 59s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m41s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_rebalance_verify (push) Successful in 3m23s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m19s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m33s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m28s
Details
Test / test_write (push) Successful in 51s
Details
Test / test_write_xor (push) Successful in 1m6s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m26s
Details
Test / test_heal_ec (push) Successful in 5m21s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m56s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m2s
Details
Test / test_heal_csum_32k (push) Successful in 6m41s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m53s
Details
Test / test_heal_csum_4k_dj (push) Successful in 3m58s
Details
Test / test_heal_csum_4k (push) Successful in 4m55s
Details
Test / test_scrub (push) Successful in 48s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 54s
Details
Test / test_scrub_xor (push) Successful in 50s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m4s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 46s
Details
Test / test_scrub_ec (push) Successful in 47s
Details
2023-08-13 23:49:52 +03:00
Vitaliy Filippov
30ce2bd951
Fix buffer insert in cluster_client
2023-08-12 11:08:50 +03:00
Vitaliy Filippov
b1a0afd10a
Aggregate buffer flushes
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_chain (push) Successful in 2m21s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m56s
Details
Test / test_snapshot_down (push) Successful in 25s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_rebalance_verify (push) Successful in 3m39s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m35s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m6s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 6m8s
Details
Test / test_write (push) Successful in 50s
Details
Test / test_write_xor (push) Successful in 55s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m14s
Details
Test / test_heal_ec (push) Successful in 5m2s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 5m1s
Details
Test / test_heal_csum_32k_dj (push) Successful in 6m12s
Details
Test / test_heal_csum_32k (push) Successful in 6m35s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 7m18s
Details
Test / test_heal_csum_4k_dj (push) Successful in 6m24s
Details
Test / test_heal_csum_4k (push) Successful in 5m12s
Details
Test / test_scrub (push) Successful in 1m39s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 49s
Details
Test / test_scrub_xor (push) Successful in 45s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m19s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 57s
Details
Test / test_scrub_ec (push) Successful in 59s
Details
2023-08-11 11:26:13 +03:00
Vitaliy Filippov
85b6134910
Return dirty buffers on read in client
...
Test / test_snapshot_ec (push) Successful in 22s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_chain (push) Successful in 1m57s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m39s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m4s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m7s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m26s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 7m35s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 38s
Details
Test / test_write_no_same (push) Successful in 21s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m58s
Details
Test / test_heal_ec (push) Successful in 3m15s
Details
Test / test_heal_csum_32k_dmj (push) Successful in 4m52s
Details
Test / test_heal_csum_32k_dj (push) Successful in 5m3s
Details
Test / test_heal_csum_32k (push) Successful in 5m26s
Details
Test / test_heal_csum_4k_dmj (push) Successful in 6m12s
Details
Test / test_heal_csum_4k_dj (push) Successful in 5m9s
Details
Test / test_heal_csum_4k (push) Successful in 5m13s
Details
Test / test_scrub (push) Successful in 1m24s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 1m15s
Details
Test / test_scrub_xor (push) Successful in 1m5s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m45s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m11s
Details
Test / test_scrub_ec (push) Successful in 56s
Details
Required at least to return buffers when they need to be replayed, but until
they are actually replayed
2023-08-09 00:57:08 +03:00
Vitaliy Filippov
b1b07a393d
Fix incorrect marking op parts as done with snapshots (could probably lead to client hangs)
2023-08-09 00:57:08 +03:00
Vitaliy Filippov
7333022adf
Add a third I/O mode: O_DIRECT|O_SYNC, change parameters to data_io/meta_io/journal_io
2023-08-09 00:57:08 +03:00
Vitaliy Filippov
ab8627c9fa
Fix monitor retrying failed etcd connection in an infinite loop without pauses
2023-08-09 00:57:08 +03:00
Vitaliy Filippov
6acf562e01
Release 1.0.0
...
New features:
- Data and metadata checksums!
- Metadata checksums are always used with new disk format
- Data checksums can be turned on with --data_csum_type crc32c for new OSDs
- Checksum block size can be configured
- inmemory_metadata now also affects keeping checksums in memory
- Linux page cache I/O caching support which can be enabled separately for
data, metadata (including checksums) and journal (O_SYNC instead of O_DIRECT)
- Details [here](https://git.yourcmc.ru/vitalif/vitastor/src/branch/master/docs/config/layout-osd.en.md#data_csum_type )
- Backwards compatibility is preserved, you can use new OSDs with old disks
Release also includes bug fixes from [0.9.6](https://git.yourcmc.ru/vitalif/vitastor/releases/tag/v0.9.6 ).
0.9.6 is moved to "-oldstable" repositories and will be available for some additional time.
2023-07-29 18:57:19 +03:00
Vitaliy Filippov
6f797f429e
Add a note about -oldstable
2023-07-29 18:11:13 +03:00
Vitaliy Filippov
b8a1734465
Reword checksum docs one more time
2023-07-29 14:42:56 +03:00
Vitaliy Filippov
c752b68167
Remove "without checksums" from docs :)
2023-07-29 12:19:03 +03:00
Vitaliy Filippov
564df2eb5d
Support using buffered I/O with O_SYNC instead of direct I/O
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
9a427dd70a
Allow to override OSD devices in tests
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
1a4ceb420d
Track used blocks, not object versions
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
21b5124a4b
Document data_csum_type and csum_block_size parameters
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
4181add1f4
Remove creepy "metadata copying" during overwrite
...
Instead of it, just do not verify checksums of currently mutated objects.
When clean data modification during flush runs in parallel to a read request,
that request may read a mix of old and new data. It may even read a mix of
multiple flushed versions if it lasts too long... And attempts to verify it
using temporary copies of metadata make the algorithm too complex and creepy.
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
a8464c19af
Support keeping checksums on disk (not in memory)
...
Definitely beneficial for SSD+HDD setups
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
819cb70cdd
Check for "Checksum mismatch" and "BUG" messages during test_heal
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
3c8e4c6b72
Use clean_dyn_size for space check
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
8ef4cf89dc
Log more details about checksum mismatch in big_writes
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
7bfb1639ea
Use find_holes() in flusher for unification
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
628e481c32
Fill journal header to know checksum type & size when dumping journal with --all
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
af6f2046fc
Fix journal read checksum verification with inmemory_journal=false
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
9357e5293e
Call fill_partial_checksum_blocks() correctly in regard to COPY_BUF_CSUM_FILL
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
12851dc07d
Wait for journal reads before checking them in clear_incomplete_csum_block_bits
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
a5753e35a3
Check for checksum mismatch absence in test_heal
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
d6ee1ca17c
Use zero checksum size for zero-length writes
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
71674d00cf
Fix journal data checksum mangling on corrupted block overwrite
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
ddb078d5a7
Check journal entry size when checking block checksums
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
d22d56f90a
Fix journal data checksum verification on start
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
eb1331a079
Add more details to "journal entry data is corrupt" messages
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
c5274f655b
...and partially remove the perversion with bitmap inlining
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
45e07d6294
Sadly we have to refcount dyn_data...
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
a8ee391e05
Fix clean block checksum read
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
de48fa3fd2
Allow to forcibly set meta_format
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
874a766b62
Rename meta_version to meta_format
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
384bd8e28f
Support old metadata format in vitastor-disk dump-meta
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
430994f48a
Fix journal big_write simple reads after checksum changes
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
3d7f838c59
Verify checksums in test_heal in different combinations
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
b909d81f41
Fix bitmap-granular checksums
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
e42975ffd1
Fix wait_journal_count not being zeroed
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
93778324e5
Rewrite and fix find_holes into a more obvious version
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
eeb6727170
Fix missing checksum read offset
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
7fe82c692e
Add a test for checksums
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
92c6e16eba
Fix checksum verification in big_write journal reads
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
213a9ccb4d
Verify checksums during journal reads
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
a166147110
Add backwards compatibility with non-checksum metadata and journal formats
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
7d532880c3
Implement large csum_block_size support (more than 4k) + refactor blockstore_flush
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
0b0405d115
Implement bitmap-granular (4k) metadata & data checksums
2023-07-29 12:17:18 +03:00
Vitaliy Filippov
e651c93a90
Release 0.9.6
...
Test / test_interrupted_rebalance (push) Successful in 1m59s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 3m41s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m53s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m29s
Details
Test / test_failure_domain (push) Successful in 50s
Details
Test / test_snapshot (push) Successful in 45s
Details
Test / test_snapshot_ec (push) Successful in 23s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot_chain (push) Successful in 2m23s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m1s
Details
Test / test_snapshot_down (push) Successful in 31s
Details
Test / test_snapshot_down_ec (push) Successful in 32s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_rebalance_verify (push) Successful in 3m34s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m31s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m14s
Details
Test / test_write (push) Successful in 44s
Details
Test / test_write_xor (push) Successful in 54s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m38s
Details
Test / test_heal_ec (push) Successful in 3m56s
Details
Test / test_scrub (push) Successful in 36s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 35s
Details
Test / test_scrub_xor (push) Successful in 31s
Details
Test / test_scrub_pg_size_3 (push) Successful in 46s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 25s
Details
Test / test_scrub_ec (push) Successful in 24s
Details
- Fix vitastor-disk partition zeroing (sometimes it was writing garbage instead of zeroes)
- Fix incorrect EC space statistics in `vitastor-cli status`
- Several bug fixes for NFS:
- Add . and .. in NFS directory listings
- Return FILE_SYNC from NFS writes if immediate_commit is enabled
- Return the same "verifier" in NFS COMMIT as in NFS WRITE
- Make parallel NFS extending writes work correctly, without conflicts
- Handle parallel NFS extending writes without imposing extra load on etcd
- Support UTF-8 in vitastor-cli table output
- Also allow "0" and "no" as false for inmemory_metadata and inmemory_journal
- Use HDD defaults for HDD-only in automatic `vitastor-disk prepare` mode
2023-07-29 10:54:00 +03:00
Vitaliy Filippov
988e90be69
Fix vitastor-disk partition zeroing (it was writing random garbage instead of zeroes :D)
Test / test_interrupted_rebalance (push) Successful in 1m59s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m38s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m12s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m18s
Details
Test / test_failure_domain (push) Successful in 8s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 20s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m3s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m25s
Details
Test / test_snapshot_down (push) Successful in 20s
Details
Test / test_snapshot_down_ec (push) Successful in 20s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 3m16s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m40s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m17s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m20s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_xor (push) Successful in 33s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m54s
Details
Test / test_heal_ec (push) Successful in 4m7s
Details
Test / test_scrub (push) Successful in 58s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 53s
Details
Test / test_scrub_xor (push) Successful in 40s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m6s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 37s
Details
Test / test_scrub_ec (push) Successful in 39s
Details
2023-07-28 12:29:07 +03:00
Vitaliy Filippov
272a45ad63
Fix modprobe command in docs
2023-07-27 23:57:02 +03:00
Vitaliy Filippov
25a15d24cf
Fix incorrect EC space statistics in `vitastor-cli status`
Test / test_etcd_fail (push) Successful in 1m21s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m9s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m52s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m25s
Details
Test / test_failure_domain (push) Successful in 10s
Details
Test / test_snapshot (push) Successful in 28s
Details
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 2m1s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m41s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_rebalance_verify (push) Successful in 3m9s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m23s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m38s
Details
Test / test_write (push) Successful in 33s
Details
Test / test_write_xor (push) Successful in 43s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m16s
Details
Test / test_heal_ec (push) Successful in 5m0s
Details
Test / test_scrub (push) Successful in 56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 41s
Details
Test / test_scrub_xor (push) Successful in 32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 45s
Details
Test / test_scrub_ec (push) Successful in 40s
Details
2023-07-27 02:26:17 +00:00
Vitaliy Filippov
700e0e9bff
Handle parallel NFS extending writes without imposing extra load on etcd
2023-07-27 02:26:17 +00:00
Vitaliy Filippov
ab0ca7c00f
Return FILE_SYNC from NFS writes if immediate_commit is enabled
2023-07-26 02:09:47 +03:00
Vitaliy Filippov
f153bc950b
Return the same "verifier" in NFS COMMIT as in NFS WRITE
...
This fixes buffered (not O_DIRECT) NFS writes in Linux - previously they were
hanging in an infinite loop because COMMIT didn't return the same verifier as
previous WRITEs, and NFS kernel client was infinitely retrying the same writes.
Also this probably allows for correct NFS failover, at least for the same
buffered writes, because NFS clients repeat all write requests until a COMMIT
confirms them.
2023-07-26 02:09:47 +03:00
Vitaliy Filippov
425ff8818d
Add . and .. in NFS directory listings
...
MC, for example, hangs with infinite listing retries without them
2023-07-26 02:09:47 +03:00
Vitaliy Filippov
9e287a7778
Handle extending writes correctly in NFS proxy
...
Previously, multiple parallel writes extending file size through NFS were
racing with each other and triggering deletions of part of the written data
I.e. if you mounted vitastor-nfs and just copied a file into it in MC then
you could end up with only a part of the file actually written
2023-07-26 02:09:43 +03:00
Vitaliy Filippov
f52f58b9e9
Support UTF-8 in vitastor-cli table output
2023-07-25 01:48:57 +00:00
Vitaliy Filippov
1fe6b0c0e2
Also allow "0" and "no" as false for inmemory_metadata and inmemory_journal
2023-07-25 01:48:57 +00:00
Vitaliy Filippov
e4237e9ed8
Enable HDD defaults for HDD-only in automatic `vitastor-disk prepare` mode
Test / test_interrupted_rebalance (push) Successful in 2m20s
Details
Test / test_interrupted_rebalance_imm (push) Failing after 10m5s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m4s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m19s
Details
Test / test_failure_domain (push) Successful in 39s
Details
Test / test_snapshot (push) Successful in 34s
Details
Test / test_snapshot_ec (push) Successful in 23s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m59s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m40s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m10s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m11s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m29s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m54s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_xor (push) Successful in 35s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m59s
Details
Test / test_heal_ec (push) Successful in 5m12s
Details
Test / test_scrub (push) Successful in 59s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 47s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 38s
Details
Test / test_scrub_ec (push) Successful in 22s
Details
2023-07-23 02:33:22 +03:00
Vitaliy Filippov
10a5fd6abb
Release 0.9.5
...
Test / test_etcd_fail (push) Successful in 50s
Details
Test / test_interrupted_rebalance (push) Successful in 2m27s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m39s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m29s
Details
Test / test_failure_domain (push) Successful in 19s
Details
Test / test_snapshot (push) Successful in 31s
Details
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot_chain (push) Successful in 1m49s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m51s
Details
Test / test_snapshot_down (push) Successful in 26s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 18s
Details
Test / test_rebalance_verify (push) Successful in 3m8s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m13s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m36s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m59s
Details
Test / test_write (push) Successful in 48s
Details
Test / test_write_xor (push) Successful in 37s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_ec (push) Successful in 4m6s
Details
Test / test_scrub (push) Successful in 35s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 34s
Details
Test / test_scrub_xor (push) Successful in 42s
Details
Test / test_scrub_pg_size_3 (push) Successful in 52s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 33s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
A hotfix to 0.9.4 containing only one bugfix: 100% CPU usage in the new QEMU
driver caused by the lack of eventfd reset on io_uring event handling :)
2023-07-21 00:04:41 +03:00
Vitaliy Filippov
1c316ef350
Reset eventfd on every ringloop::loop()
2023-07-21 00:04:41 +03:00
Vitaliy Filippov
0b2d12eef1
Remove has_work, it was unnecessary
2023-07-21 00:04:37 +03:00
Vitaliy Filippov
1c10430ae1
Release 0.9.4
...
Test / test_interrupted_rebalance (push) Successful in 1m54s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m4s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m40s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m25s
Details
Test / test_failure_domain (push) Successful in 15s
Details
Test / test_snapshot (push) Successful in 25s
Details
Test / test_snapshot_ec (push) Successful in 20s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_chain (push) Successful in 1m56s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m33s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 3m3s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m2s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m13s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 8m35s
Details
Test / test_write (push) Successful in 33s
Details
Test / test_write_xor (push) Successful in 40s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m25s
Details
Test / test_heal_ec (push) Successful in 3m9s
Details
Test / test_scrub (push) Successful in 1m0s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 46s
Details
Test / test_scrub_xor (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m55s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m25s
Details
Test / test_scrub_ec (push) Successful in 52s
Details
- Improve QEMU driver performance by integrating io_uring in it (up to 1.5x total iops improvement)
- Fix QEMU driver deadlocks which started to reproduce in qemu-img after iothread fixes
- Fix `vitastor-cli status` reporting more etcds than actually exists (fix etcd address duplication in config on reload)
- Fix `vitastor-cli ls` crashing on inodes in non-existing pools
- Delete old garbage /pool/stats/ keys for non-existing (deleted) pools
- Reduce memory usage of etcds initialized by make-etcd script
- Fix OSDs almost always crashing on etcd restart due to "revisions were compacted" (support reloading state from etcd)
- Fix a crash and a stall possible mostly in HDD setups with small journal and big (512k, 900k) random writes
- Add notes about HDDs to documentation. You are officially allowed to use HDD-only Vitastor with HGST/Toshiba/EXOS :)
2023-07-19 02:50:30 +03:00
Vitaliy Filippov
dfce91d168
Change git url in docs, correct block/vitastor.c path
2023-07-19 01:02:12 +03:00
Vitaliy Filippov
332a13ba30
Build patched QEMU against local packages
2023-07-19 00:05:02 +03:00
Vitaliy Filippov
d0e257ee81
Fix non-existing pool handling in `vitastor-cli ls`
Test / test_interrupted_rebalance (push) Successful in 2m6s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 3m11s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m6s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 2m20s
Details
Test / test_failure_domain (push) Successful in 22s
Details
Test / test_snapshot (push) Successful in 50s
Details
Test / test_snapshot_ec (push) Successful in 33s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 1m23s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_chain (push) Successful in 2m22s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m6s
Details
Test / test_snapshot_down (push) Successful in 24s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 19s
Details
Test / test_rebalance_verify (push) Successful in 3m28s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m27s
Details
Test / test_rebalance_verify_ec (push) Successful in 9m10s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 9m29s
Details
Test / test_write (push) Successful in 1m36s
Details
Test / test_write_xor (push) Successful in 2m17s
Details
Test / test_write_no_same (push) Successful in 36s
Details
Test / test_heal_pg_size_2 (push) Successful in 6m27s
Details
Test / test_heal_ec (push) Successful in 5m53s
Details
Test / test_scrub (push) Successful in 44s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 35s
Details
Test / test_scrub_xor (push) Successful in 36s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 46s
Details
Test / test_scrub_ec (push) Successful in 36s
Details
2023-07-18 23:52:02 +03:00
Vitaliy Filippov
004912aac0
Add RPM spec patches for 6.2-el8 and 7.2-el9
Test / test_interrupted_rebalance (push) Successful in 1m57s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 3m16s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m52s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m25s
Details
Test / test_failure_domain (push) Failing after 47s
Details
Test / test_snapshot (push) Successful in 40s
Details
Test / test_snapshot_ec (push) Successful in 24s
Details
Test / test_minsize_1 (push) Successful in 16s
Details
Test / test_move_reappear (push) Failing after 52s
Details
Test / test_rm (push) Successful in 19s
Details
Test / test_snapshot_chain (push) Successful in 2m27s
Details
Test / test_snapshot_chain_ec (push) Failing after 3m9s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 21s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_rebalance_verify (push) Successful in 3m34s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m32s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m14s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m18s
Details
Test / test_write (push) Successful in 49s
Details
Test / test_write_xor (push) Successful in 58s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Details
Test / test_heal_ec (push) Failing after 10m39s
Details
Test / test_scrub (push) Successful in 33s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 29s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m1s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 44s
Details
Test / test_scrub_ec (push) Successful in 25s
Details
2023-07-18 23:38:14 +03:00
Vitaliy Filippov
c18e92273e
Copy qemu 5.1 -> 5.2 patch for convenience
2023-07-18 23:37:53 +03:00
Vitaliy Filippov
9815d70ffc
It is impossible to use io_uring with older vitastor-client because it does not have vitastor_c_uring_has_work()
2023-07-18 23:37:53 +03:00
Vitaliy Filippov
4a4627dcab
Do not use bool in C library
2023-07-18 23:37:53 +03:00
Vitaliy Filippov
b963f2fd93
Add QEMU 2.12 patch (basically the same as 3.1)
2023-07-18 23:37:06 +03:00
Vitaliy Filippov
ba7427020e
Fix deadlocks possible in qemu-img after fixing iothread
...
Deadlock was caused by switching QEMU coroutines directly inside
vitastor_co_read_bitmap_cb() callback. The correct way is to schedule a BH
/BH is a QEMU term for setImmediate() :)/, same as in read and write callbacks.
2023-07-18 23:32:16 +03:00
Vitaliy Filippov
a0aac7eb2a
Update drives
Test / test_interrupted_rebalance (push) Failing after 1m42s
Details
Test / test_interrupted_rebalance_imm (push) Failing after 1m37s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m48s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m25s
Details
Test / test_failure_domain (push) Successful in 19s
Details
Test / test_snapshot (push) Successful in 25s
Details
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_move_reappear (push) Failing after 49s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot_chain (push) Successful in 2m24s
Details
Test / test_snapshot_chain_ec (push) Successful in 3m0s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_rebalance_verify (push) Successful in 3m39s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m38s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m29s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m32s
Details
Test / test_write (push) Successful in 54s
Details
Test / test_write_xor (push) Successful in 1m5s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m51s
Details
Test / test_heal_ec (push) Successful in 4m16s
Details
Test / test_scrub (push) Successful in 35s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Details
Test / test_scrub_xor (push) Successful in 32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 55s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 48s
Details
Test / test_scrub_ec (push) Successful in 27s
Details
2023-07-13 01:49:45 +03:00
Vitaliy Filippov
ac7b834af3
Disable journal_no_same_sector_overwrites by default for HDD-only
Test / test_interrupted_rebalance (push) Successful in 1m17s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m29s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m53s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m31s
Details
Test / test_failure_domain (push) Successful in 9s
Details
Test / test_snapshot (push) Successful in 20s
Details
Test / test_snapshot_ec (push) Successful in 21s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 39s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m10s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m9s
Details
Test / test_snapshot_down (push) Successful in 21s
Details
Test / test_snapshot_down_ec (push) Successful in 22s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_rebalance_verify (push) Successful in 2m56s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m53s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m39s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m44s
Details
Test / test_write (push) Successful in 49s
Details
Test / test_write_xor (push) Successful in 59s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m41s
Details
Test / test_heal_ec (push) Successful in 3m49s
Details
Test / test_scrub (push) Successful in 33s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 30s
Details
Test / test_scrub_xor (push) Successful in 25s
Details
Test / test_scrub_pg_size_3 (push) Successful in 40s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 35s
Details
Test / test_scrub_ec (push) Successful in 33s
Details
2023-07-10 00:34:35 +03:00
Vitaliy Filippov
ee0c78fd74
Fix default HDD block size in docs (actual size is 1 MB)
2023-07-09 13:12:30 +03:00
Vitaliy Filippov
e6646a5b2f
Bump QEMU version to vitastor3
2023-07-09 13:01:04 +03:00
Vitaliy Filippov
ae69662b17
Add "Recommended drives"
2023-07-09 12:59:18 +03:00
Vitaliy Filippov
57ad4c3636
Add a note about HDD, enable throttling only for hybrid OSDs
Test / test_interrupted_rebalance (push) Successful in 2m4s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m30s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m45s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m23s
Details
Test / test_failure_domain (push) Successful in 9s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 19s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Failing after 1m32s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m8s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m2s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 21s
Details
Test / test_splitbrain (push) Successful in 13s
Details
Test / test_rebalance_verify (push) Successful in 2m52s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m46s
Details
Test / test_rebalance_verify_ec (push) Successful in 5m9s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m5s
Details
Test / test_write (push) Successful in 40s
Details
Test / test_write_xor (push) Successful in 49s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m43s
Details
Test / test_heal_ec (push) Successful in 4m35s
Details
Test / test_scrub (push) Successful in 37s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 40s
Details
Test / test_scrub_xor (push) Successful in 31s
Details
Test / test_scrub_pg_size_3 (push) Successful in 40s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 26s
Details
Test / test_scrub_ec (push) Successful in 22s
Details
2023-07-09 12:45:11 +03:00
Vitaliy Filippov
b7e4d0c9bf
Fix journal dirty_start position tracking and some debug prints
...
Fixes two bugs found during HDD testing :-)
1) OSD crashed with "BUG: Attempt to overwrite used offset of the journal" during
`fio -bs=900k -iodepth=128` test with 16 MB journal
2) OSD stalled during `fio -bs=512k -iodepth=128` test with 64 MB journal
2023-07-09 01:17:55 +03:00
Vitaliy Filippov
161a23c966
Support reloading state when etcd says "revisions were compacted"
...
Test / test_interrupted_rebalance (push) Successful in 3m9s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m38s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m54s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m36s
Details
Test / test_failure_domain (push) Successful in 9s
Details
Test / test_snapshot (push) Successful in 23s
Details
Test / test_snapshot_ec (push) Successful in 22s
Details
Test / test_minsize_1 (push) Successful in 14s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 2m2s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m38s
Details
Test / test_snapshot_down (push) Successful in 21s
Details
Test / test_snapshot_down_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m10s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m10s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m27s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 6m2s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 45s
Details
Test / test_write_no_same (push) Successful in 22s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m0s
Details
Test / test_heal_ec (push) Successful in 3m52s
Details
Test / test_scrub (push) Successful in 1m1s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 42s
Details
Test / test_scrub_xor (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 45s
Details
Test / test_scrub_ec (push) Successful in 26s
Details
Before this change, OSDs almost always died when one of the etcds was restarted,
even though the rest of them was still in quorum and the lease was still active
2023-07-07 01:33:48 +03:00
Vitaliy Filippov
2f999d8607
Reduce etcd memory usage
...
Test / test_etcd_fail (push) Successful in 1m34s
Details
Test / test_interrupted_rebalance (push) Successful in 1m52s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m4s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m13s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 20s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 19s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m56s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m36s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 23s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m27s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m30s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m48s
Details
Test / test_heal_ec (push) Successful in 4m15s
Details
Test / test_scrub (push) Successful in 33s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 31s
Details
Test / test_scrub_xor (push) Successful in 28s
Details
Test / test_scrub_pg_size_3 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 35s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
With default --snapshot-count 100000 and GOGC=100 it easily reaches 6.6 GB
even when we only store 1-2 MB of data in it
2023-07-06 00:46:26 +03:00
Vitaliy Filippov
d007a374f2
Delete extra /pool/stats/ keys for non-existing pools
Test / test_interrupted_rebalance (push) Failing after 10m5s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m29s
Details
Test / test_interrupted_rebalance_ec (push) Failing after 10m7s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m32s
Details
Test / test_failure_domain (push) Successful in 8s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 19s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m1s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m25s
Details
Test / test_snapshot_down (push) Successful in 20s
Details
Test / test_snapshot_down_ec (push) Successful in 19s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 3m1s
Details
Test / test_rebalance_verify_imm (push) Successful in 4m11s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m19s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m51s
Details
Test / test_write (push) Successful in 31s
Details
Test / test_write_xor (push) Successful in 41s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m10s
Details
Test / test_heal_ec (push) Failing after 10m11s
Details
Test / test_scrub (push) Successful in 43s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 36s
Details
Test / test_scrub_xor (push) Successful in 37s
Details
Test / test_scrub_pg_size_3 (push) Successful in 48s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 23s
Details
Test / test_scrub_ec (push) Successful in 22s
Details
2023-07-06 00:40:13 +03:00
Vitaliy Filippov
45c0694853
Clear etcd_local addresses on reload and also skip duplicates
2023-07-06 00:39:39 +03:00
Vitaliy Filippov
57bcba2406
Add notes about VDUSE
2023-07-04 16:51:46 +03:00
Vitaliy Filippov
30ac899074
Make QEMU driver compatible with older vitastor_client and with systems without io_uring
Test / test_interrupted_rebalance (push) Successful in 1m45s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m25s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m23s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m37s
Details
Test / test_failure_domain (push) Successful in 8s
Details
Test / test_snapshot (push) Successful in 20s
Details
Test / test_snapshot_ec (push) Successful in 18s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m26s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m8s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 21s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 2m48s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m48s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m10s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m13s
Details
Test / test_write (push) Successful in 1m16s
Details
Test / test_write_xor (push) Successful in 38s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m10s
Details
Test / test_heal_ec (push) Successful in 3m28s
Details
Test / test_scrub (push) Successful in 43s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 41s
Details
Test / test_scrub_xor (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 44s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 38s
Details
Test / test_scrub_ec (push) Successful in 36s
Details
2023-07-04 15:51:43 +03:00
Vitaliy Filippov
2348d39cf4
Avoid repeated qemu_uring_handlers, add 2.0-2.7 compatibility
2023-07-04 00:28:23 +03:00
Vitaliy Filippov
3de7929fe5
Integrate v2 - direct epoll
2023-07-04 00:28:23 +03:00
Vitaliy Filippov
07b2196bc2
Integrate QEMU driver with io_uring
2023-07-04 00:28:23 +03:00
Vitaliy Filippov
b8e30608d6
Bump QEMU version to vitastor2
Test / test_etcd_fail (push) Successful in 1m40s
Details
Test / test_interrupted_rebalance (push) Successful in 2m45s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 7m42s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m59s
Details
Test / test_failure_domain (push) Successful in 17s
Details
Test / test_snapshot (push) Successful in 56s
Details
Test / test_snapshot_ec (push) Successful in 51s
Details
Test / test_minsize_1 (push) Successful in 11s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m14s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m50s
Details
Test / test_snapshot_down (push) Successful in 23s
Details
Test / test_snapshot_down_ec (push) Successful in 20s
Details
Test / test_splitbrain (push) Successful in 13s
Details
Test / test_rebalance_verify (push) Successful in 3m18s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m15s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m38s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m45s
Details
Test / test_write (push) Successful in 50s
Details
Test / test_write_xor (push) Successful in 46s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m36s
Details
Test / test_heal_ec (push) Successful in 4m37s
Details
Test / test_scrub (push) Successful in 37s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 35s
Details
Test / test_scrub_xor (push) Successful in 29s
Details
Test / test_scrub_pg_size_3 (push) Successful in 33s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 31s
Details
Test / test_scrub_ec (push) Successful in 27s
Details
2023-07-01 00:55:32 +03:00
Vitaliy Filippov
a612cdca47
Release 0.9.3
...
- Add patch for libvirt 9.0
- Add support for Proxmox VE 8.0
- Fix compatibility of the QEMU driver with iothread (QEMU rebuilds are coming)
- Fix vitastor-cli rm-data/rm/merge hanging when some OSDs are down.
Allow deletions in unclean cluster at the cost of some data possibly
"reappearing" when those OSDs start back. In that case you can just repeat
the deletion request using rm-data.
- A bunch of bug fixes for snapshots:
- Fix snapshot reads often not working at all with snapshot chain size > 2
- Fix optimized snapshot data merge (children to parent)
- Fix updating of image name index key during optimized merge
- Fix auto-selection preventing the use of optimized merge with only 1 snapshot
- Fix incorrect CAS retries during snapshot merge
- Fix snapshot merge progress reporting
- Fix primary_read bitmap buffers use-after-free which could lead to
incorrect allocation map reads
- Remove /usr/local/bin path from make-etcd
- Some documentation fixes
2023-07-01 00:25:58 +03:00
Vitaliy Filippov
c8d61568b5
Fix primary_read bitmap buffers being freed too early (use-after-free)
Test / test_etcd_fail (push) Successful in 1m43s
Details
Test / test_interrupted_rebalance (push) Successful in 1m23s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m33s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m39s
Details
Test / test_failure_domain (push) Successful in 10s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 17s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m7s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m1s
Details
Test / test_snapshot_down (push) Successful in 22s
Details
Test / test_snapshot_down_ec (push) Successful in 20s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 2m51s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m49s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m6s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m3s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_xor (push) Successful in 34s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m11s
Details
Test / test_heal_ec (push) Successful in 3m54s
Details
Test / test_scrub (push) Successful in 44s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 30s
Details
Test / test_scrub_xor (push) Successful in 31s
Details
Test / test_scrub_pg_size_3 (push) Successful in 37s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Details
Test / test_scrub_ec (push) Successful in 1m31s
Details
2023-06-30 12:47:45 +03:00
Vitaliy Filippov
84ed3c6395
Fix CAS retries during snapshot merge
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Failing after 10m10s
Details
Test / test_interrupted_rebalance (push) Successful in 2m46s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m35s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m45s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m53s
Details
Test / test_failure_domain (push) Successful in 7s
Details
Test / test_snapshot (push) Successful in 24s
Details
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Failing after 49s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m35s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m9s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_rebalance_verify (push) Successful in 3m0s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m5s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m20s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m24s
Details
Test / test_write (push) Successful in 34s
Details
Test / test_write_xor (push) Successful in 38s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m0s
Details
Test / test_heal_ec (push) Successful in 3m58s
Details
Test / test_scrub (push) Successful in 58s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 38s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 35s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 30s
Details
Test / test_scrub_ec (push) Successful in 23s
Details
2023-06-30 02:30:23 +03:00
Vitaliy Filippov
a7b57386c0
Do not print last subcommand result twice during "inverse" snapshot merge
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Successful in 1m28s
Details
Test / test_interrupted_rebalance (push) Successful in 1m45s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m46s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m44s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m30s
Details
Test / test_failure_domain (push) Successful in 8s
Details
Test / test_snapshot (push) Successful in 30s
Details
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_minsize_1 (push) Failing after 19s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot_chain (push) Successful in 1m57s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m42s
Details
Test / test_splitbrain (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 3m23s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m17s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m5s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m50s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_xor (push) Failing after 3m17s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m12s
Details
Test / test_heal_ec (push) Successful in 4m13s
Details
Test / test_scrub (push) Successful in 38s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 36s
Details
Test / test_scrub_xor (push) Successful in 33s
Details
Test / test_scrub_pg_size_3 (push) Successful in 46s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 35s
Details
Test / test_scrub_ec (push) Successful in 33s
Details
2023-06-30 02:07:10 +03:00
Vitaliy Filippov
9d4ea5f764
Fix inverse parent selection which prevented the use of optimized merge in case of only 1 snapshot
2023-06-30 01:39:11 +03:00
Vitaliy Filippov
000e4944ec
Remove "inverse parent" image name index key from etcd during snapshot merge
2023-06-30 01:23:30 +03:00
Vitaliy Filippov
8426616d89
Warn about unfinished deletions in rm-data
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Successful in 1m46s
Details
Test / test_interrupted_rebalance (push) Successful in 2m34s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m50s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m35s
Details
Test / test_interrupted_rebalance_ec_imm (push) Failing after 10m6s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_snapshot (push) Successful in 21s
Details
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Failing after 48s
Details
Test / test_rm (push) Successful in 13s
Details
Test / test_snapshot_chain (push) Successful in 1m35s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m11s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_rebalance_verify (push) Successful in 3m4s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m0s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m25s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m58s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 34s
Details
Test / test_write_no_same (push) Successful in 12s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m3s
Details
Test / test_heal_ec (push) Successful in 3m53s
Details
Test / test_scrub (push) Successful in 26s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 35s
Details
Test / test_scrub_xor (push) Successful in 35s
Details
Test / test_scrub_pg_size_3 (push) Successful in 45s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Details
Test / test_scrub_ec (push) Successful in 25s
Details
2023-06-30 01:18:25 +03:00
Vitaliy Filippov
1a841344ec
Print progress of all operations during snapshot merge
2023-06-30 01:13:47 +03:00
Vitaliy Filippov
8603b5cb1d
Do not hang on inactive OSDs during delete, report and skip them instead
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_etcd_fail (push) Successful in 46s
Details
Test / test_interrupted_rebalance (push) Successful in 3m13s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m30s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m18s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m34s
Details
Test / test_failure_domain (push) Successful in 7s
Details
Test / test_snapshot (push) Successful in 29s
Details
Test / test_snapshot_ec (push) Successful in 32s
Details
Test / test_minsize_1 (push) Successful in 12s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot_chain (push) Successful in 1m37s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m21s
Details
Test / test_splitbrain (push) Successful in 13s
Details
Test / test_rebalance_verify (push) Successful in 3m14s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m8s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m18s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m20s
Details
Test / test_write (push) Successful in 32s
Details
Test / test_write_xor (push) Successful in 43s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m55s
Details
Test / test_heal_ec (push) Successful in 4m2s
Details
Test / test_scrub (push) Successful in 56s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 51s
Details
Test / test_scrub_xor (push) Successful in 29s
Details
Test / test_scrub_pg_size_3 (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 37s
Details
Test / test_scrub_ec (push) Successful in 32s
Details
2023-06-30 00:15:16 +03:00
Vitaliy Filippov
f12b8e45a9
Remove /usr/local/bin path from make-etcd
Test / test_create_nomaxid (push) Successful in 6s
Details
Test / test_etcd_fail (push) Successful in 51s
Details
Test / test_interrupted_rebalance (push) Successful in 7m28s
Details
Test / test_interrupted_rebalance_imm (push) Failing after 10m10s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 7m21s
Details
Test / test_interrupted_rebalance_ec_imm (push) Failing after 10m7s
Details
Test / test_failure_domain (push) Successful in 7s
Details
Test / test_snapshot (push) Successful in 17s
Details
Test / test_snapshot_ec (push) Successful in 18s
Details
Test / test_minsize_1 (push) Successful in 11s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rm (push) Successful in 10s
Details
Test / test_snapshot_chain (push) Successful in 1m19s
Details
Test / test_snapshot_chain_ec (push) Successful in 1m43s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_rebalance_verify (push) Successful in 3m9s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m31s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m33s
Details
Test / test_write (push) Successful in 49s
Details
Test / test_write_xor (push) Successful in 58s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m47s
Details
Test / test_heal_ec (push) Successful in 3m59s
Details
Test / test_scrub (push) Successful in 58s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 42s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 39s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 31s
Details
Test / test_scrub_ec (push) Successful in 31s
Details
2023-06-29 23:49:31 +03:00
Vitaliy Filippov
878ccbb6ea
Fix snapshot chain "down-merge" ("up-merge" worked well...)
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_interrupted_rebalance (push) Successful in 7m46s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m31s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m42s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m22s
Details
Test / test_failure_domain (push) Successful in 7s
Details
Test / test_snapshot (push) Successful in 18s
Details
Test / test_snapshot_ec (push) Successful in 20s
Details
Test / test_minsize_1 (push) Successful in 11s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot_chain (push) Successful in 1m11s
Details
Test / test_snapshot_chain_ec (push) Successful in 2m13s
Details
Test / test_splitbrain (push) Successful in 13s
Details
Test / test_rebalance_verify (push) Successful in 3m26s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m27s
Details
Test / test_rebalance_verify_ec (push) Successful in 4m23s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m32s
Details
Test / test_write (push) Successful in 31s
Details
Test / test_write_xor (push) Successful in 33s
Details
Test / test_write_no_same (push) Successful in 13s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m37s
Details
Test / test_heal_ec (push) Successful in 4m43s
Details
Test / test_scrub (push) Successful in 45s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 37s
Details
Test / test_scrub_xor (push) Successful in 39s
Details
Test / test_scrub_pg_size_3 (push) Successful in 55s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 33s
Details
Test / test_scrub_ec (push) Successful in 32s
Details
2023-06-29 00:47:21 +03:00
Vitaliy Filippov
b14220b4d0
Add a test for snapshot chain
2023-06-29 00:47:21 +03:00
Vitaliy Filippov
181d6ba407
Move npm install to CI build and remove it from tests
2023-06-28 23:41:46 +03:00
Vitaliy Filippov
63c2b9832c
Fix chained (snapshot) reads often not working at all with chain size > 2
Test / test_change_pg_count (push) Successful in 42s
Details
Test / test_change_pg_count_ec (push) Successful in 36s
Details
Test / test_change_pg_size (push) Successful in 9s
Details
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_etcd_fail (push) Successful in 1m6s
Details
Test / test_failure_domain (push) Successful in 10s
Details
Test / test_interrupted_rebalance (push) Successful in 1m52s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m49s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m2s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m19s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_rebalance_verify (push) Successful in 3m10s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m56s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m6s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m9s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot (push) Successful in 24s
Details
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_splitbrain (push) Successful in 25s
Details
Test / test_write (push) Successful in 1m30s
Details
Test / test_write_xor (push) Successful in 2m14s
Details
Test / test_write_no_same (push) Successful in 20s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m5s
Details
Test / test_heal_ec (push) Successful in 4m11s
Details
Test / test_scrub (push) Successful in 48s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 32s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 37s
Details
Test / test_scrub_ec (push) Successful in 41s
Details
2023-06-28 18:54:03 +03:00
Vitaliy Filippov
10e2e6a7c8
Add a patch for pve-qemu 8.0
2023-06-24 01:33:52 +03:00
Vitaliy Filippov
a598428992
Add a note about PVE 8.0
2023-06-24 01:29:28 +03:00
Vitaliy Filippov
08a677b684
Notes about rebuilding pve-qemu
2023-06-24 01:00:21 +03:00
Vitaliy Filippov
7c8fbdad16
Fix typo
2023-06-22 02:07:33 +03:00
Vitaliy Filippov
2f9353df60
Markdown preprocessor to compile multiple .md files into one
2023-06-22 01:27:38 +03:00
Vitaliy Filippov
57c744f288
Fix some cross-references in docs
2023-06-22 01:16:03 +03:00
Vitaliy Filippov
a11ca56fb1
Fix compatibility of the QEMU driver with iothread
Test / test_change_pg_count_ec (push) Successful in 55s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Successful in 57s
Details
Test / test_failure_domain (push) Successful in 10s
Details
Test / test_interrupted_rebalance (push) Successful in 1m53s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m31s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m39s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m46s
Details
Test / test_minsize_1 (push) Successful in 55s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 3m13s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m52s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m10s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m25s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot (push) Successful in 36s
Details
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_splitbrain (push) Successful in 13s
Details
Test / test_write (push) Successful in 38s
Details
Test / test_write_xor (push) Successful in 1m50s
Details
Test / test_write_no_same (push) Successful in 14s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m17s
Details
Test / test_heal_ec (push) Successful in 4m18s
Details
Test / test_scrub (push) Successful in 50s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 51s
Details
Test / test_scrub_xor (push) Successful in 39s
Details
Test / test_scrub_pg_size_3 (push) Successful in 53s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 42s
Details
Test / test_scrub_ec (push) Successful in 28s
Details
2023-06-21 02:11:28 +03:00
Vitaliy Filippov
b84927b340
Fix \n in nbd_proxy
Test / test_change_pg_count (push) Successful in 41s
Details
Test / test_change_pg_count_ec (push) Successful in 37s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 9s
Details
Test / test_etcd_fail (push) Successful in 1m9s
Details
Test / test_failure_domain (push) Successful in 9s
Details
Test / test_interrupted_rebalance (push) Successful in 1m54s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m47s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m17s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m26s
Details
Test / test_minsize_1 (push) Successful in 19s
Details
Test / test_move_reappear (push) Successful in 50s
Details
Test / test_rebalance_verify (push) Successful in 3m6s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m3s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m10s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m55s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot (push) Successful in 24s
Details
Test / test_snapshot_ec (push) Successful in 24s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_write (push) Successful in 1m38s
Details
Test / test_write_xor (push) Successful in 2m13s
Details
Test / test_write_no_same (push) Successful in 23s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m5s
Details
Test / test_scrub (push) Successful in 42s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 33s
Details
Test / test_scrub_xor (push) Successful in 31s
Details
Test / test_scrub_pg_size_3 (push) Successful in 40s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 34s
Details
Test / test_scrub_ec (push) Successful in 30s
Details
2023-06-19 01:48:58 +03:00
Vitaliy Filippov
83cacba226
Fix patched-qemu build
2023-06-19 01:47:55 +03:00
Vitaliy Filippov
2c8f0bc6d5
Add a note about Debian 12
2023-06-19 01:08:41 +03:00
Vitaliy Filippov
7ae5b0e368
Add patch for libvirt 9.0
2023-06-19 01:07:08 +03:00
Vitaliy Filippov
926be372fd
Release 0.9.2
...
Test / test_change_pg_count (push) Successful in 35s
Details
Test / test_change_pg_count_ec (push) Successful in 34s
Details
Test / test_change_pg_size (push) Successful in 9s
Details
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Successful in 1m1s
Details
Test / test_failure_domain (push) Successful in 9s
Details
Test / test_interrupted_rebalance (push) Successful in 1m26s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m15s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m31s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m32s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_rebalance_verify (push) Successful in 2m49s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m45s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m3s
Details
Test / test_rm (push) Successful in 12s
Details
Test / test_snapshot (push) Successful in 24s
Details
Test / test_snapshot_ec (push) Successful in 35s
Details
Test / test_splitbrain (push) Successful in 21s
Details
Test / test_write (push) Successful in 1m10s
Details
Test / test_write_xor (push) Successful in 2m23s
Details
Test / test_write_no_same (push) Successful in 19s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m58s
Details
Test / test_heal_ec (push) Successful in 4m8s
Details
Test / test_scrub (push) Successful in 1m3s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 36s
Details
Test / test_scrub_xor (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 51s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 32s
Details
Test / test_scrub_ec (push) Successful in 43s
Details
- Measure and report scrub I/O statistics in vitastor-cli status
- Make aggregated statistics in vitastor-cli status much smoother
(first derive, then sum instead of first summing and then deriving)
- Fix an old rare bug leading to journal corruption
(try to use scrub if you think you're affected...)
- Do not start EC PGs without at least <data chunks> OSDs in each old set
(prevents spurious read errors with EC during reconnections/restarts)
- Fix failed assert(!scrub_list_op) on OSD restart with pending scrubs
- Fix future planned scrubs not starting because of incorrect time comparison
- Build packages for Debian 12 (Bookworm)
2023-06-18 19:44:33 +03:00
Vitaliy Filippov
6222779b52
Support debian bookworm (12) build
2023-06-18 19:44:33 +03:00
Vitaliy Filippov
a4186e20aa
First derive, then sum per-OSD statistics instead of first summing and then deriving
...
Test / test_change_pg_count (push) Successful in 43s
Details
Test / test_change_pg_count_ec (push) Successful in 37s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_failure_domain (push) Successful in 16s
Details
Test / test_interrupted_rebalance (push) Successful in 1m49s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m38s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m23s
Details
Test / test_minsize_1 (push) Successful in 13s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 3m2s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m53s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 5m27s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot (push) Successful in 34s
Details
Test / test_snapshot_ec (push) Successful in 29s
Details
Test / test_splitbrain (push) Successful in 22s
Details
Test / test_write (push) Successful in 37s
Details
Test / test_write_xor (push) Successful in 44s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m31s
Details
Test / test_heal_ec (push) Successful in 4m20s
Details
Test / test_scrub (push) Successful in 38s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 30s
Details
Test / test_scrub_xor (push) Successful in 32s
Details
Test / test_scrub_pg_size_3 (push) Successful in 42s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 37s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
This makes statistics reported by vitastor-cli status much smoother
2023-06-18 01:32:24 +03:00
Vitaliy Filippov
c74a424930
Report scrub I/O in vitastor-cli status
2023-06-17 21:11:21 +03:00
Vitaliy Filippov
32f2c4dd27
Measure scrub statistics
2023-06-17 20:56:26 +03:00
Vitaliy Filippov
3ad16b9a1a
Fix auto_scrubs not starting because of < vs <= =))
Test / test_change_pg_count (push) Successful in 41s
Details
Test / test_change_pg_count_ec (push) Successful in 36s
Details
Test / test_change_pg_size (push) Successful in 9s
Details
Test / test_create_nomaxid (push) Successful in 9s
Details
Test / test_etcd_fail (push) Successful in 1m20s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_interrupted_rebalance (push) Successful in 2m1s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m55s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m48s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m32s
Details
Test / test_move_reappear (push) Successful in 51s
Details
Test / test_rebalance_verify (push) Successful in 3m19s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m21s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m4s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot (push) Successful in 23s
Details
Test / test_snapshot_ec (push) Successful in 26s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_write (push) Successful in 1m35s
Details
Test / test_write_xor (push) Successful in 2m29s
Details
Test / test_write_no_same (push) Successful in 29s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m11s
Details
Test / test_heal_ec (push) Successful in 5m4s
Details
Test / test_scrub (push) Successful in 55s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 41s
Details
Test / test_scrub_xor (push) Successful in 37s
Details
Test / test_scrub_pg_size_3 (push) Successful in 57s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 46s
Details
Test / test_scrub_ec (push) Successful in 31s
Details
2023-06-17 17:32:21 +03:00
Vitaliy Filippov
1c2df841c2
Fix failed assert(!scrub_list_op) on OSD restart with pending scrubs
Test / test_change_pg_count (push) Successful in 38s
Details
Test / test_change_pg_count_ec (push) Successful in 38s
Details
Test / test_change_pg_size (push) Successful in 9s
Details
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_etcd_fail (push) Successful in 53s
Details
Test / test_failure_domain (push) Successful in 15s
Details
Test / test_interrupted_rebalance (push) Successful in 2m3s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 2m55s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 2m43s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m31s
Details
Test / test_minsize_1 (push) Successful in 14s
Details
Test / test_move_reappear (push) Successful in 17s
Details
Test / test_rebalance_verify (push) Successful in 3m9s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m10s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m15s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 4m45s
Details
Test / test_rm (push) Successful in 18s
Details
Test / test_snapshot (push) Successful in 35s
Details
Test / test_snapshot_ec (push) Successful in 18s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_write (push) Successful in 35s
Details
Test / test_write_xor (push) Successful in 1m12s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m41s
Details
Test / test_scrub (push) Successful in 33s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 29s
Details
Test / test_scrub_xor (push) Successful in 30s
Details
Test / test_scrub_pg_size_3 (push) Successful in 51s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 31s
Details
Test / test_scrub_ec (push) Successful in 26s
Details
2023-06-17 17:02:54 +03:00
Vitaliy Filippov
aa5dacc7a9
Do not start EC PGs without at least pg_data_size connections to old OSDs from each set
Test / test_change_pg_count (push) Successful in 36s
Details
Test / test_change_pg_count_ec (push) Successful in 38s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 9s
Details
Test / test_etcd_fail (push) Successful in 1m13s
Details
Test / test_failure_domain (push) Successful in 11s
Details
Test / test_interrupted_rebalance (push) Successful in 1m51s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m43s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m47s
Details
Test / test_minsize_1 (push) Successful in 43s
Details
Test / test_move_reappear (push) Successful in 43s
Details
Test / test_rebalance_verify (push) Successful in 3m16s
Details
Test / test_rebalance_verify_imm (push) Successful in 3m9s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m8s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 3m10s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot (push) Successful in 22s
Details
Test / test_snapshot_ec (push) Successful in 25s
Details
Test / test_splitbrain (push) Successful in 15s
Details
Test / test_write (push) Successful in 1m44s
Details
Test / test_write_xor (push) Successful in 2m29s
Details
Test / test_write_no_same (push) Successful in 22s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m37s
Details
Test / test_heal_ec (push) Successful in 4m4s
Details
Test / test_scrub (push) Successful in 48s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 41s
Details
Test / test_scrub_xor (push) Successful in 39s
Details
Test / test_scrub_pg_size_3 (push) Successful in 47s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 41s
Details
Test / test_scrub_ec (push) Successful in 34s
Details
2023-06-17 02:16:30 +03:00
Vitaliy Filippov
affe8fc270
Raise timeout also for add_osd and rebalance_verify
2023-06-17 00:29:03 +03:00
Vitaliy Filippov
4fdc49bdc7
Add another assert-type check (it does not fire, just as a safety measure for the future)
2023-06-17 00:07:22 +03:00
Vitaliy Filippov
86b4682975
Put get_trim_pos into the "critical section". Fixes rare journal corruption issue
...
The consequence of this issue was that in some very rare cases (only reproduced
under load in CI when running 4+ tests in parallel) small write data written to
journal could overwrite journal entries.
Also add an assert-type safety check to be able to catch this issue in the
future again in case of a regression.
2023-06-17 00:06:42 +03:00
Vitaliy Filippov
bdd48e4cf1
Release 0.9.1
...
Test / test_change_pg_count (push) Successful in 35s
Details
Test / test_change_pg_count_ec (push) Successful in 32s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 6s
Details
Test / test_etcd_fail (push) Successful in 49s
Details
Test / test_failure_domain (push) Successful in 9s
Details
Test / test_interrupted_rebalance (push) Successful in 1m4s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 57s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m2s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 53s
Details
Test / test_minsize_1 (push) Successful in 14s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 1m45s
Details
Test / test_rebalance_verify_imm (push) Successful in 1m41s
Details
Test / test_rebalance_verify_ec (push) Successful in 1m53s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 1m48s
Details
Test / test_rm (push) Successful in 10s
Details
Test / test_snapshot (push) Successful in 14s
Details
Test / test_snapshot_ec (push) Successful in 16s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_write (push) Successful in 49s
Details
Test / test_write_xor (push) Successful in 1m1s
Details
Test / test_write_no_same (push) Successful in 11s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m12s
Details
Test / test_scrub (push) Successful in 28s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 22s
Details
Test / test_scrub_xor (push) Successful in 34s
Details
Test / test_scrub_pg_size_3 (push) Successful in 25s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 26s
Details
Test / test_scrub_ec (push) Successful in 24s
Details
- Fix "Client XX command out of sync" messages sometimes happening on OSD reconnections
- Fix a bug where EC reads parallel with writes to the same object failed with -ERANGE error
- Slightly reduce the amount of metadata writes during journal flushing
- Correctly unmap NBD volumes when Proxmox forces map_volume use (with SWTPM and maybe some other cases)
2023-06-10 11:42:49 +03:00
Vitaliy Filippov
af8c3411cd
Correctly unmap NBD when Proxmox forces map_volume use (with SWTPM and maybe something else)
2023-06-08 01:31:49 +03:00
Vitaliy Filippov
9c405009f3
Use randrw in test_heal
Test / test_change_pg_count (push) Successful in 33s
Details
Test / test_change_pg_count_ec (push) Successful in 32s
Details
Test / test_change_pg_size (push) Successful in 8s
Details
Test / test_create_nomaxid (push) Successful in 9s
Details
Test / test_etcd_fail (push) Successful in 51s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_interrupted_rebalance (push) Successful in 1m4s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m20s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 55s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 22s
Details
Test / test_rebalance_verify (push) Successful in 1m47s
Details
Test / test_rebalance_verify_imm (push) Successful in 1m45s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m3s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 1m52s
Details
Test / test_rm (push) Successful in 11s
Details
Test / test_snapshot (push) Successful in 15s
Details
Test / test_snapshot_ec (push) Successful in 16s
Details
Test / test_splitbrain (push) Successful in 12s
Details
Test / test_write (push) Successful in 31s
Details
Test / test_write_xor (push) Successful in 47s
Details
Test / test_write_no_same (push) Successful in 11s
Details
Test / test_heal_pg_size_2 (push) Successful in 3m12s
Details
Test / test_scrub (push) Successful in 24s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 26s
Details
Test / test_scrub_xor (push) Successful in 26s
Details
Test / test_scrub_pg_size_3 (push) Successful in 25s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 42s
Details
Test / test_scrub_ec (push) Successful in 33s
Details
2023-06-03 00:49:53 +03:00
Vitaliy Filippov
f9fbea25a4
Remove double write when old and new locations are in the same metadata block
...
Also add another metadata entry fool-safety check which, ideally, will never fire %)
2023-06-03 00:47:10 +03:00
Vitaliy Filippov
2c9a10d081
Fix an idiotic bug leading to failed reads with -ERANGE with EC :D
2023-06-03 00:44:52 +03:00
Vitaliy Filippov
150968070f
Slightly improve some debug prints
Test / test_change_pg_count (push) Successful in 30s
Details
Test / test_change_pg_count_ec (push) Successful in 31s
Details
Test / test_change_pg_size (push) Successful in 7s
Details
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_etcd_fail (push) Successful in 45s
Details
Test / test_failure_domain (push) Successful in 8s
Details
Test / test_interrupted_rebalance (push) Successful in 1m3s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 55s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m30s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 57s
Details
Test / test_minsize_1 (push) Successful in 20s
Details
Test / test_move_reappear (push) Successful in 16s
Details
Test / test_rebalance_verify (push) Successful in 1m49s
Details
Test / test_rebalance_verify_imm (push) Successful in 1m40s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 1m51s
Details
Test / test_rm (push) Successful in 14s
Details
Test / test_snapshot (push) Successful in 16s
Details
Test / test_snapshot_ec (push) Successful in 17s
Details
Test / test_splitbrain (push) Successful in 14s
Details
Test / test_write (push) Successful in 41s
Details
Test / test_write_xor (push) Successful in 49s
Details
Test / test_write_no_same (push) Successful in 10s
Details
Test / test_heal_pg_size_2 (push) Successful in 2m58s
Details
Test / test_scrub (push) Successful in 23s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 19s
Details
Test / test_scrub_xor (push) Successful in 17s
Details
Test / test_scrub_pg_size_3 (push) Successful in 24s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 28s
Details
Test / test_scrub_ec (push) Successful in 25s
Details
2023-05-29 01:04:16 +03:00
Vitaliy Filippov
cdfc74665b
Close client FDs only when destroying the client, after handling all async reads/writes
...
Test / test_change_pg_count (push) Successful in 50s
Details
Test / test_change_pg_count_ec (push) Successful in 58s
Details
Test / test_change_pg_size (push) Successful in 17s
Details
Test / test_create_nomaxid (push) Successful in 19s
Details
Test / test_etcd_fail (push) Successful in 58s
Details
Test / test_failure_domain (push) Successful in 14s
Details
Test / test_interrupted_rebalance (push) Successful in 1m31s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m23s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m16s
Details
Test / test_minsize_1 (push) Successful in 38s
Details
Test / test_move_reappear (push) Successful in 54s
Details
Test / test_rebalance_verify (push) Successful in 2m26s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m7s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m51s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m15s
Details
Test / test_rm (push) Successful in 22s
Details
Test / test_snapshot (push) Successful in 40s
Details
Test / test_snapshot_ec (push) Successful in 34s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_write (push) Successful in 1m7s
Details
Test / test_write_xor (push) Successful in 2m13s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_heal_pg_size_2 (push) Successful in 5m14s
Details
Test / test_scrub (push) Successful in 36s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 40s
Details
Test / test_scrub_xor (push) Successful in 54s
Details
Test / test_scrub_pg_size_3 (push) Successful in 54s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 1m12s
Details
Test / test_scrub_ec (push) Successful in 1m10s
Details
Fixes "Client XX command out of sync" sometimes happening on reconnections
2023-05-25 00:52:43 +03:00
Vitaliy Filippov
3f60fecd7c
Fix typo
2023-05-21 18:37:01 +03:00
Vitaliy Filippov
3b4cf29e65
Release 0.9.0
...
New features:
- Scrubbing! Check documentation: [auto_scrub](src/branch/master/docs/config/osd.en.md#auto_scrub)
- Document online-updatable configuration parameters
Bug fixes:
- Fix NaN during PG optimisation if there are nonexisting OSDs in node_placement
- Fix monitor crash on pool deletion
- Clear journal_device and meta_device before initialising the next OSD in automatic mode
- Sync unsynced deletes before overwriting them with a lower version
(reproducted mostly/only after scrubbing)
2023-05-21 15:07:14 +03:00
Vitaliy Filippov
eeaba11ebd
Use fio 3.27-8 for alma9
2023-05-21 14:48:26 +03:00
Vitaliy Filippov
aea567cfbd
Slightly improve scrub docs
Test / test_cas (push) Successful in 9s
Details
Test / test_change_pg_count (push) Successful in 52s
Details
Test / test_change_pg_count_ec (push) Successful in 1m0s
Details
Test / test_change_pg_size (push) Successful in 16s
Details
Test / test_create_nomaxid (push) Successful in 16s
Details
Test / test_etcd_fail (push) Successful in 56s
Details
Test / test_failure_domain (push) Successful in 13s
Details
Test / test_interrupted_rebalance (push) Successful in 1m24s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m10s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m9s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m6s
Details
Test / test_minsize_1 (push) Failing after 19s
Details
Test / test_move_reappear (push) Successful in 28s
Details
Test / test_rebalance_verify (push) Successful in 2m25s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m19s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m3s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m20s
Details
Test / test_rm (push) Successful in 16s
Details
Test / test_snapshot (push) Successful in 21s
Details
Test / test_snapshot_ec (push) Successful in 28s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_write_xor (push) Has started running
Details
Test / test_heal_pg_size_2 (push) Has started running
Details
Test / test_write (push) Has started running
Details
Test / test_scrub (push) Has been cancelled
Details
Test / test_scrub_zero_osd_2 (push) Has been cancelled
Details
Test / test_scrub_xor (push) Has been cancelled
Details
Test / test_scrub_pg_size_3 (push) Has been cancelled
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Has been cancelled
Details
Test / test_scrub_ec (push) Has been cancelled
Details
2023-05-21 12:52:30 +03:00
Vitaliy Filippov
ce02f47de6
Allow to disable scrub_find_best
2023-05-21 12:33:38 +03:00
Vitaliy Filippov
5fd3208616
Add version archive link to docs
2023-05-21 11:47:33 +03:00
Vitaliy Filippov
5997b76535
Remove -runtime=10 from fio params in test_scrub, it was breaking the test in CI :D
Test / test_change_pg_count (push) Successful in 49s
Details
Test / test_change_pg_count_ec (push) Successful in 2m53s
Details
Test / test_change_pg_size (push) Successful in 17s
Details
Test / test_create_nomaxid (push) Successful in 13s
Details
Test / test_etcd_fail (push) Successful in 1m0s
Details
Test / test_failure_domain (push) Successful in 13s
Details
Test / test_interrupted_rebalance (push) Successful in 1m18s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m3s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m40s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 52s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 23s
Details
Test / test_rebalance_verify (push) Successful in 2m32s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m29s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m55s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m30s
Details
Test / test_rm (push) Successful in 22s
Details
Test / test_snapshot (push) Successful in 26s
Details
Test / test_snapshot_ec (push) Successful in 38s
Details
Test / test_splitbrain (push) Successful in 28s
Details
Test / test_write (push) Successful in 1m5s
Details
Test / test_write_xor (push) Successful in 2m13s
Details
Test / test_write_no_same (push) Successful in 18s
Details
Test / test_heal_ec (push) Successful in 5m27s
Details
Test / test_scrub (push) Successful in 36s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 39s
Details
Test / test_scrub_xor (push) Successful in 1m2s
Details
Test / test_scrub_pg_size_3 (push) Successful in 50s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 29s
Details
Test / test_scrub_ec (push) Successful in 1m25s
Details
2023-05-21 11:03:59 +03:00
Vitaliy Filippov
f1961157f0
Fix brute-force error locator for EC n+k with k > 2
Test / test_change_pg_count_ec (push) Successful in 2m23s
Details
Test / test_change_pg_size (push) Successful in 20s
Details
Test / test_create_nomaxid (push) Successful in 16s
Details
Test / test_etcd_fail (push) Successful in 55s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_interrupted_rebalance (push) Successful in 1m18s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m9s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m23s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m8s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 28s
Details
Test / test_rebalance_verify (push) Successful in 2m17s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m19s
Details
Test / test_rebalance_verify_ec (push) Successful in 3m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m22s
Details
Test / test_rm (push) Successful in 23s
Details
Test / test_snapshot (push) Successful in 20s
Details
Test / test_snapshot_ec (push) Successful in 34s
Details
Test / test_splitbrain (push) Successful in 33s
Details
Test / test_write (push) Successful in 1m15s
Details
Test / test_write_xor (push) Successful in 2m6s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_heal_pg_size_2 (push) Successful in 5m22s
Details
Test / test_heal_ec (push) Successful in 5m31s
Details
Test / test_scrub (push) Successful in 29s
Details
Test / test_scrub_zero_osd_2 (push) Successful in 27s
Details
Test / test_scrub_xor (push) Successful in 22s
Details
Test / test_scrub_pg_size_3 (push) Failing after 37s
Details
Test / test_scrub_pg_size_6_pg_minsize_4_osd_count_6_ec (push) Successful in 29s
Details
Test / test_scrub_ec (push) Failing after 33s
Details
2023-05-21 00:57:14 +03:00
Vitaliy Filippov
88c1ba0790
Fix compile errors with gcc 10
Test / build (push) Has started running
Details
Test / buildenv (push) Successful in 11s
Details
Test / make_test (push) Has been cancelled
Details
Test / test_add_osd (push) Has been cancelled
Details
Test / test_cas (push) Has been cancelled
Details
Test / test_change_pg_count (push) Has been cancelled
Details
Test / test_change_pg_count_ec (push) Has been cancelled
Details
Test / test_change_pg_size (push) Has been cancelled
Details
Test / test_create_nomaxid (push) Has been cancelled
Details
Test / test_etcd_fail (push) Has been cancelled
Details
Test / test_failure_domain (push) Has been cancelled
Details
Test / test_interrupted_rebalance (push) Has been cancelled
Details
Test / test_interrupted_rebalance_imm (push) Has been cancelled
Details
Test / test_interrupted_rebalance_ec (push) Has been cancelled
Details
Test / test_interrupted_rebalance_ec_imm (push) Has been cancelled
Details
Test / test_minsize_1 (push) Has been cancelled
Details
Test / test_move_reappear (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot (push) Has been cancelled
Details
Test / test_snapshot_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
2023-05-20 23:20:09 +03:00
Vitaliy Filippov
b5bd611683
Add scrub tests to CI
2023-05-20 23:20:09 +03:00
Vitaliy Filippov
fa90b5a4e7
Schedule automatic scrubs correctly (not just after previous scrub)
2023-05-20 23:20:09 +03:00
Vitaliy Filippov
8d40ad99a6
Add scrub documentation
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
3475772b07
Add configuration online update documentation
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
25fcedf6e7
Enable vitastor-cli fix in test
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
6ca20aa194
Allow scrub to fix corrupted object states
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
4bfd994341
Sync unsynced deletes before overwriting them with a lower version
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
59e959dcbb
Do not die when "different versions are returned from subops"
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
a9581f0739
Handle dirty deletes during read correctly O_o
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
105a405b0a
Implement vitastor-cli fix
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
d55d7d5326
Add scrub test
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
0e5d0e02a9
Add "vitastor-cli describe" command
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
0439981a66
Implement "describe object(s)" operation
...
Required to implement fixing inconsistent objects in vitastor-cli
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
6648f6bb6e
Implement ambiguity detection during scrub
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
281be547eb
Implement brute-force error locator for EC
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
0c78dd7178
Add no_scrub flag
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
3c924397e7
Store next scrub timestamp instead of last scrub timestamp
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
c3bd26193d
Implement PG scrub runner
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
43b77d7619
Implement scrubbing "data path" - OSD_OP_SCRUB
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
a6d846863b
Add min/max stripe and limit to OP_LIST
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
8dc427b43c
Retry failed reads (including chained and RMW) from other replicas
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
bf2112653b
Refcount object_states
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
0538a484b3
Add corrupted object state
2023-05-20 23:19:39 +03:00
Vitaliy Filippov
97720fa6b4
Remove unused capture
Test / buildenv (push) Successful in 12s
Details
Test / build (push) Has started running
Details
Test / make_test (push) Has been cancelled
Details
Test / test_add_osd (push) Has been cancelled
Details
Test / test_cas (push) Has been cancelled
Details
Test / test_change_pg_count (push) Has been cancelled
Details
Test / test_change_pg_count_ec (push) Has been cancelled
Details
Test / test_change_pg_size (push) Has been cancelled
Details
Test / test_create_nomaxid (push) Has been cancelled
Details
Test / test_etcd_fail (push) Has been cancelled
Details
Test / test_failure_domain (push) Has been cancelled
Details
Test / test_interrupted_rebalance (push) Has been cancelled
Details
Test / test_interrupted_rebalance_imm (push) Has been cancelled
Details
Test / test_interrupted_rebalance_ec (push) Has been cancelled
Details
Test / test_interrupted_rebalance_ec_imm (push) Has been cancelled
Details
Test / test_minsize_1 (push) Has been cancelled
Details
Test / test_move_reappear (push) Has been cancelled
Details
Test / test_rebalance_verify (push) Has been cancelled
Details
Test / test_rebalance_verify_imm (push) Has been cancelled
Details
Test / test_rebalance_verify_ec (push) Has been cancelled
Details
Test / test_rebalance_verify_ec_imm (push) Has been cancelled
Details
Test / test_rm (push) Has been cancelled
Details
Test / test_snapshot (push) Has been cancelled
Details
Test / test_snapshot_ec (push) Has been cancelled
Details
Test / test_splitbrain (push) Has been cancelled
Details
Test / test_write (push) Has been cancelled
Details
Test / test_write_xor (push) Has been cancelled
Details
Test / test_write_no_same (push) Has been cancelled
Details
Test / test_heal_pg_size_2 (push) Has been cancelled
Details
Test / test_heal_ec (push) Has been cancelled
Details
2023-05-20 22:58:51 +03:00
Vitaliy Filippov
e60e352df6
Improve vitastor-nbd documentation
2023-05-20 22:58:51 +03:00
Vitaliy Filippov
98077a1712
Remove unused dependencies from CSI
2023-05-18 11:54:47 +03:00
Vitaliy Filippov
1c7d53996d
Reweight only 2 OSDs to zero in test_rebalance_verify, otherwise the test does not pass with EC 3+2
Test / buildenv (push) Successful in 9s
Details
Test / build (push) Successful in 2m20s
Details
Test / test_cas (push) Successful in 11s
Details
Test / make_test (push) Successful in 35s
Details
Test / test_change_pg_size (push) Successful in 22s
Details
Test / test_change_pg_count (push) Successful in 52s
Details
Test / test_create_nomaxid (push) Successful in 19s
Details
Test / test_change_pg_count_ec (push) Successful in 1m3s
Details
Test / test_failure_domain (push) Successful in 13s
Details
Test / test_etcd_fail (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m3s
Details
Test / test_interrupted_rebalance (push) Successful in 1m14s
Details
Test / test_minsize_1 (push) Successful in 22s
Details
Test / test_move_reappear (push) Successful in 18s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m1s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m38s
Details
Test / test_rebalance_verify (push) Successful in 2m20s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m1s
Details
Test / test_rm (push) Successful in 26s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m30s
Details
Test / test_snapshot (push) Successful in 22s
Details
Test / test_snapshot_ec (push) Successful in 28s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_write (push) Successful in 48s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m11s
Details
Test / test_write_xor (push) Successful in 1m28s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m48s
Details
Test / test_heal_ec (push) Successful in 5m12s
Details
Test / test_add_osd (push) Successful in 1m20s
Details
2023-05-18 00:42:40 +03:00
Vitaliy Filippov
2ca07b1ea7
Raise timeout in test_rebalance_verify
Test / buildenv (push) Successful in 10s
Details
Test / build (push) Successful in 2m27s
Details
Test / test_cas (push) Successful in 11s
Details
Test / make_test (push) Successful in 34s
Details
Test / test_change_pg_size (push) Successful in 22s
Details
Test / test_change_pg_count (push) Successful in 52s
Details
Test / test_create_nomaxid (push) Successful in 8s
Details
Test / test_failure_domain (push) Successful in 12s
Details
Test / test_etcd_fail (push) Successful in 1m0s
Details
Test / test_interrupted_rebalance (push) Successful in 1m15s
Details
Test / test_add_osd (push) Successful in 2m33s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m4s
Details
Test / test_change_pg_count_ec (push) Successful in 2m52s
Details
Test / test_minsize_1 (push) Successful in 19s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 53s
Details
Test / test_move_reappear (push) Successful in 21s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m36s
Details
Test / test_rebalance_verify (push) Successful in 2m22s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m22s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_snapshot (push) Successful in 19s
Details
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_rebalance_verify_ec (push) Failing after 3m6s
Details
Test / test_splitbrain (push) Successful in 17s
Details
Test / test_write_no_same (push) Successful in 20s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 3m9s
Details
Test / test_write (push) Successful in 49s
Details
Test / test_write_xor (push) Successful in 1m17s
Details
Test / test_heal_ec (push) Successful in 4m53s
Details
Test / test_heal_pg_size_2 (push) Failing after 10m10s
Details
2023-05-17 01:58:01 +03:00
Vitaliy Filippov
022176aa98
Fix NaN during PG optimisation if there are nonexisting OSDs in node_placement
Test / buildenv (push) Successful in 11s
Details
Test / build (push) Successful in 2m28s
Details
Test / test_cas (push) Successful in 12s
Details
Test / make_test (push) Successful in 40s
Details
Test / test_change_pg_size (push) Successful in 23s
Details
Test / test_change_pg_count (push) Successful in 1m1s
Details
Test / test_create_nomaxid (push) Successful in 7s
Details
Test / test_failure_domain (push) Successful in 11s
Details
Test / test_change_pg_count_ec (push) Successful in 1m35s
Details
Test / test_etcd_fail (push) Successful in 51s
Details
Test / test_add_osd (push) Successful in 2m27s
Details
Test / test_interrupted_rebalance (push) Successful in 1m14s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m3s
Details
Test / test_minsize_1 (push) Successful in 28s
Details
Test / test_move_reappear (push) Successful in 41s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m13s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m49s
Details
Test / test_rebalance_verify (push) Successful in 2m21s
Details
Test / test_rm (push) Successful in 15s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m12s
Details
Test / test_snapshot (push) Successful in 20s
Details
Test / test_snapshot_ec (push) Successful in 28s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_write_no_same (push) Successful in 17s
Details
Test / test_write (push) Successful in 1m6s
Details
Test / test_write_xor (push) Successful in 1m42s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m57s
Details
Test / test_heal_ec (push) Successful in 4m42s
Details
Test / test_rebalance_verify_ec_imm (push) Failing after 2m19s
Details
Test / test_rebalance_verify_ec (push) Failing after 2m25s
Details
2023-05-17 01:20:30 +03:00
Vitaliy Filippov
120e3fa7bc
Fix pool deletion
Test / buildenv (push) Successful in 10s
Details
Test / build (push) Successful in 2m32s
Details
Test / test_cas (push) Successful in 13s
Details
Test / make_test (push) Successful in 35s
Details
Test / test_change_pg_size (push) Successful in 21s
Details
Test / test_change_pg_count (push) Successful in 53s
Details
Test / test_create_nomaxid (push) Successful in 17s
Details
Test / test_change_pg_count_ec (push) Successful in 1m3s
Details
Test / test_failure_domain (push) Successful in 16s
Details
Test / test_etcd_fail (push) Successful in 1m3s
Details
Test / test_add_osd (push) Successful in 2m36s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m10s
Details
Test / test_interrupted_rebalance (push) Successful in 1m24s
Details
Test / test_minsize_1 (push) Failing after 28s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m8s
Details
Test / test_move_reappear (push) Failing after 1m2s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m8s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m12s
Details
Test / test_rebalance_verify (push) Successful in 2m22s
Details
Test / test_rm (push) Successful in 21s
Details
Test / test_snapshot (push) Successful in 24s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m19s
Details
Test / test_snapshot_ec (push) Successful in 27s
Details
Test / test_splitbrain (push) Successful in 20s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m33s
Details
Test / test_write_no_same (push) Successful in 15s
Details
Test / test_write (push) Successful in 1m14s
Details
Test / test_write_xor (push) Successful in 2m9s
Details
Test / test_heal_ec (push) Successful in 4m25s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m59s
Details
2023-05-17 00:45:59 +03:00
Vitaliy Filippov
629999f789
Clear journal_device and meta_device before initialising the next OSD in automatic mode
2023-05-15 23:58:55 +03:00
Vitaliy Filippov
93eca11ba2
Fix rhel 9 installation docs
2023-05-15 13:09:18 +03:00
Vitaliy Filippov
5a9e1ede52
Release 0.8.9
...
Test / buildenv (push) Successful in 9s
Details
Test / build (push) Successful in 2m31s
Details
Test / test_cas (push) Successful in 12s
Details
Test / make_test (push) Successful in 33s
Details
Test / test_change_pg_size (push) Successful in 19s
Details
Test / test_change_pg_count (push) Successful in 55s
Details
Test / test_create_nomaxid (push) Successful in 21s
Details
Test / test_change_pg_count_ec (push) Successful in 58s
Details
Test / test_failure_domain (push) Successful in 13s
Details
Test / test_etcd_fail (push) Successful in 1m4s
Details
Test / test_interrupted_rebalance (push) Successful in 1m13s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m7s
Details
Test / test_add_osd (push) Successful in 2m59s
Details
Test / test_move_reappear (push) Successful in 24s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m22s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m1s
Details
Test / test_rebalance_verify (push) Successful in 2m12s
Details
Test / test_minsize_1 (push) Successful in 15s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m4s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m9s
Details
Test / test_rm (push) Successful in 17s
Details
Test / test_snapshot (push) Successful in 23s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m31s
Details
Test / test_splitbrain (push) Successful in 23s
Details
Test / test_snapshot_ec (push) Successful in 30s
Details
Test / test_write_no_same (push) Successful in 16s
Details
Test / test_write (push) Successful in 53s
Details
Test / test_write_xor (push) Successful in 1m19s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m30s
Details
Test / test_heal_ec (push) Successful in 4m32s
Details
- The tests are now stable and run in a CI system based on Gitea CI
- The release includes final bug fixes for EC:
- Implement missing EC recovery of allocation bitmap when built with ISA-L
- Fix broken snapshot export with EC (allocation bitmap reads were giving incorrect results previously)
- Also fixed bugs manifesting under heavy load:
- Fix monitor possibly applying incorrect PG history on retries
- Fix monitor incorrectly changing PG count when last_clean_pgs contains less PGs than the new number
- Allow writes to wait for free space again, but now correctly (previously dropped in 0.8.2)
- Fix a rare segfault in client (handle client stop during incoming stream handling in 1 more place)
- Make monitor correctly handle etcd connection errors - it could die instead of connecting to another etcd
- Fix OSD rarely being unable to report PG states after a PG was taken over by another OSD
- Fixed return code for incomplete EC objects (now EIO) and made cluster client retry this error
- Made other small changes for tests: timeouts, nice/ionice for etcd, waiting conditions, NBD device checks and so on
2023-05-14 01:25:09 +03:00
Vitaliy Filippov
1c9a188600
Add tests to CI
Test / buildenv (push) Successful in 10s
Details
Test / build (push) Successful in 10s
Details
Test / test_cas (push) Successful in 12s
Details
Test / make_test (push) Successful in 34s
Details
Test / test_change_pg_size (push) Successful in 17s
Details
Test / test_create_nomaxid (push) Successful in 9s
Details
Test / test_change_pg_count (push) Successful in 1m29s
Details
Test / test_failure_domain (push) Successful in 11s
Details
Test / test_change_pg_count_ec (push) Successful in 1m35s
Details
Test / test_etcd_fail (push) Successful in 52s
Details
Test / test_add_osd (push) Successful in 2m13s
Details
Test / test_interrupted_rebalance_imm (push) Successful in 1m4s
Details
Test / test_interrupted_rebalance (push) Successful in 1m28s
Details
Test / test_minsize_1 (push) Successful in 21s
Details
Test / test_interrupted_rebalance_ec_imm (push) Successful in 1m4s
Details
Test / test_move_reappear (push) Successful in 30s
Details
Test / test_interrupted_rebalance_ec (push) Successful in 1m53s
Details
Test / test_rebalance_verify_imm (push) Successful in 2m14s
Details
Test / test_rebalance_verify (push) Successful in 2m16s
Details
Test / test_rebalance_verify_ec_imm (push) Successful in 2m4s
Details
Test / test_rm (push) Successful in 22s
Details
Test / test_snapshot (push) Successful in 28s
Details
Test / test_rebalance_verify_ec (push) Successful in 2m27s
Details
Test / test_splitbrain (push) Successful in 24s
Details
Test / test_snapshot_ec (push) Successful in 34s
Details
Test / test_write_no_same (push) Successful in 19s
Details
Test / test_write (push) Successful in 1m19s
Details
Test / test_write_xor (push) Successful in 1m36s
Details
Test / test_heal_pg_size_2 (push) Successful in 4m34s
Details
Test / test_heal_ec (push) Successful in 4m21s
Details
2023-05-14 00:06:09 +03:00
Vitaliy Filippov
de3e609166
Add a FIXME about QEMU driver thread safety
2023-05-14 00:06:09 +03:00
Vitaliy Filippov
11481170f5
Add a FIXME about ENOSPC
2023-05-13 23:59:44 +03:00
Vitaliy Filippov
e69d459d43
Allow rebalance to start in test_interrupted_rebalance, raise etcd start timeout
2023-05-13 15:16:28 +03:00
Vitaliy Filippov
da82754baa
Wait for conditions in test_move_reappear instead of waiting a fixed amount of time
2023-05-12 23:18:07 +03:00
Vitaliy Filippov
d356aca030
Add missing $NO_SAME OSD argument to test_splitbrain
2023-05-12 23:18:07 +03:00
Vitaliy Filippov
04a273d213
Raise NBD timeout in tests
2023-05-12 23:18:07 +03:00
Vitaliy Filippov
6442010f93
Skip offline PGs during state reporting when the state is already deleted or taken over by another OSD
...
This fixes OSDs being unable to report PG states in rare conditions
2023-05-12 23:17:45 +03:00
Vitaliy Filippov
6f4dc16c59
Handle etcd connection errors correctly in mon (unhandled error events)
2023-05-11 11:02:44 +03:00
Vitaliy Filippov
ce4a8067b5
Handle client stop during incoming stream handling in 1 more place
2023-05-11 01:53:41 +03:00
Vitaliy Filippov
e431ecb715
Make tests more stable in CI
2023-05-11 01:53:41 +03:00
Vitaliy Filippov
8cac795445
Return EIO instead of EINVAL for incomplete EC objects
2023-05-11 01:15:23 +03:00
Vitaliy Filippov
a409598b16
Wait for free space again, but count on big_write flushes instead of just flusher activity
2023-05-10 01:51:02 +03:00
Vitaliy Filippov
f4c6765522
Ignore ENOENT in epoll_ctl
2023-05-08 20:39:20 +03:00
Vitaliy Filippov
ad2916068a
Fix test_add_osd rebalance timeout check
2023-05-08 20:39:20 +03:00
Vitaliy Filippov
321cb435a6
Fix monitor incorrectly changing PG count when last_clean_pgs contains less PGs than the new number
2023-05-08 20:39:20 +03:00
Vitaliy Filippov
cfcf4f4355
Support checking /dev/nbdX nodes in Docker
2023-05-08 20:39:20 +03:00
Vitaliy Filippov
e0fb17bfee
Make etcd more stable in tests (add ionice and raise timeout)
2023-05-08 20:36:00 +03:00
Vitaliy Filippov
5b9031fecc
Fix monitor possibly applying incorrect PG history under heavy load
...
Monitor could deceive itself by immediately saving PG configuration changes
which weren't applied to etcd yet in memory, and apply incorrect PG history
changes next time if the first update fails.
This usually only happened under heavy load and was caught in CI. :-)
2023-05-07 23:23:00 +03:00
Vitaliy Filippov
5da1d8e1b5
Fix EC just-bitmap reads (len=0) (fixes SCHEME=ec test_snapshot.sh)
2023-05-07 14:00:08 +03:00
Vitaliy Filippov
44f86f1999
Add a basic EC 2+2 recovery test (not really required, but let it be there)
2023-05-07 11:26:27 +03:00
Vitaliy Filippov
2d9a80c6f6
Implement missing bitmap recovery with ISA-L \(°□°)/
2023-05-07 11:25:51 +03:00
Vitaliy Filippov
5e295e346e
Do not make vitastor-mon part of vitastor.target
2023-04-29 00:17:47 +03:00
Vitaliy Filippov
d9c0898b7c
Notes about config and vitastor-disk cache status
2023-04-29 00:08:24 +03:00
Vitaliy Filippov
04cfb48361
Add a note about PVE 7.4
2023-04-28 11:37:11 +03:00
Vitaliy Filippov
ab615849d6
Release 0.8.8
...
- Fix vitastor-cli rm/rm-data broken in 0.8.6 (missing messenger initialization)
- Prepare OSD read handler for upcoming version with scrub - allow "secondary reads" to return errors
- Fix OSDs re-peering PGs infinitely with a big number of PGs (reproduced in test_add_osd)
- Fix another variant of flusher sync-waiting stall (reproduced in test_write)
- Fix other tests in tests/ (will add them to Gitea CI soon)
- Add patches for QEMU 6.2-8.0
- Fix QEMU driver compatibility with QEMU 8.0
- Build packages for RHEL 9 clones (based on AlmaLinux 9)
2023-04-28 11:22:00 +03:00
Vitaliy Filippov
38be9a49c0
Add AlmaLinux 9 build to documentation
2023-04-28 02:00:52 +03:00
Vitaliy Filippov
7d6bf84a3e
Add scripts/meson-buildoptions.sh to QEMU patches
2023-04-28 01:43:22 +03:00
Vitaliy Filippov
41a40a4123
Add QEMU spec patch for Alma/Rocky/RH 9
2023-04-28 01:32:06 +03:00
Vitaliy Filippov
b94587ef0e
Fix some build warnings
2023-04-28 00:44:27 +03:00
Vitaliy Filippov
2a2f4f6738
Add Almalinux 9 build
2023-04-28 00:40:50 +03:00
Vitaliy Filippov
c768a9015f
Fix QEMU driver compatibility with QEMU 8.0
2023-04-25 11:20:21 +03:00
Vitaliy Filippov
0d9e10cf96
Add patches for QEMU 6.2-8.0
2023-04-25 11:20:21 +03:00
Vitaliy Filippov
b74ccb613c
Fix another variant of flusher sync-waiting stall
2023-04-24 00:44:41 +03:00
Vitaliy Filippov
5052174918
Fix test_write_no_same (too large image)
2023-04-24 00:44:41 +03:00
Vitaliy Filippov
eec9cf5575
Fix test_snapshot.sh - qemu-img requires explicit backing_fmt
2023-04-24 00:44:41 +03:00
Vitaliy Filippov
a04dab0840
Initialize messenger in cluster_client listings
2023-04-24 00:44:41 +03:00
Vitaliy Filippov
160863f707
Print op pointer values in slow log
2023-04-23 17:54:00 +03:00
Vitaliy Filippov
2f16c32eb4
Fix test_minsize_1 (left_on_dead)
2023-04-23 17:54:00 +03:00
Vitaliy Filippov
2877cd0adb
Allow OP_SEC_READ to return errors (do not hang the connection)
2023-04-23 17:54:00 +03:00
Vitaliy Filippov
480509f5b9
Fix pg_data_size > 1 for replicas (harmless bug)
2023-04-23 01:50:42 +03:00
Vitaliy Filippov
46462da45e
Preload own PG history updates to fix PG state loop possibly applying the old metadata version
2023-04-23 01:50:30 +03:00
Vitaliy Filippov
024c8658f6
Fix missing } in quick start documentation
2023-04-12 18:26:38 +03:00
Vitaliy Filippov
7e958afeda
Release 0.8.7
...
This release includes a bunch of important bugfixes for erasure-coded setups
with disabled immediate_commit. After these fixes, "test_heal" OSD killing test
now passes fine with EC:
- Fix cluster write stalls with "Error while doing flush on OSD xx: -16 (Device or resource busy)"
in OSD logs possible in EC setups with disabled immediate_commit by selectively
syncing nonsynced objects on STABILIZE/ROLLBACK (https://github.com/vitalif/vitastor/issues/51 )
- Fix other EC + disabled immediate_commit problems:
- Fix "opcode=5 retval=-2" errors happening on SYNC retries
- Fix non-working "pagination" during PG dirty object flushing
- Fix write operations not continued correctly after dirty object flushing
- Fix incorrect parity read-modify-write calculation when writing into a lost chunk
- Fix OSDs losing left_on_dead PG state of non-clean PGs and thus not removing junk data in the cluster
- Fix a small memory leak caused by bad indexing of EC recovery matrices
- Fix a rare use-after-free in cluster_client caused by a reenterability issue
- Fix vitastor-cli create command syntax in the CSI driver
- Allow to start OSDs without local store for tests
- Fix memory allocation error in disk_tool_meta for non-standard metadata block sizes
- Fix delete operations received before loading pool metadata crashing OSDs with "null pointer exception"
- Improve "theoretical performance" Russian documentation
New features:
- Implement online configuration update for some parameters. Documentation is coming soon :)
2023-04-11 02:11:57 +03:00
Vitaliy Filippov
2f5e769a29
Fix a small memory leak caused by bad indexing of EC recovery matrices
2023-04-11 00:30:36 +03:00
Vitaliy Filippov
28d5e53c6c
Add test_heal to run_tests
2023-04-09 02:10:42 +03:00
Vitaliy Filippov
d9f55f11d8
More logs (log_level 10), append to log instead of overwriting on restart in tests
2023-04-09 02:06:10 +03:00
Vitaliy Filippov
3237014608
Fix incorrect parity read-modify-write calculation when writing into a lost chunk
2023-04-09 02:06:10 +03:00
Vitaliy Filippov
baaf8f6f44
Fix write operations not continued correctly after flush
2023-04-09 02:06:10 +03:00
Vitaliy Filippov
1d83fdcd17
Add debug logs to osd_flush
2023-04-09 02:06:10 +03:00
Vitaliy Filippov
0ddd787c38
Fix non-working "pagination" during PG dirty object flushing
2023-04-08 02:44:02 +03:00
Vitaliy Filippov
6eff3a60a5
Do not lose left_on_dead PG state of non-clean PGs
2023-04-08 02:44:02 +03:00
Vitaliy Filippov
888a6975ab
Fix a rare use-after-free in cluster_client caused by a reenterability issue
2023-04-08 02:44:02 +03:00
Vitaliy Filippov
cd1e890bd4
Fix "opcode=5 retval=-2" errors sometimes possible with EC
2023-04-08 02:44:02 +03:00
Vitaliy Filippov
0fbf4c6a08
Selectively sync nonsynced objects on STABILIZE/ROLLBACK (fix for github issue #51 )
2023-04-08 02:44:02 +03:00
Vitaliy Filippov
d06ed2b0e7
Implement online config update
2023-03-26 19:21:50 +03:00
Vitaliy Filippov
3bbc46543d
Fix vitastor-cli create syntax
2023-03-17 11:12:58 +03:00
Vitaliy Filippov
2fb0c85618
Allow to start OSDs without local store (only for tests)
2023-03-15 01:13:59 +03:00
Vitaliy Filippov
d81a6c04fc
Update cmake min version so it does not complain about deprecation
2023-03-15 01:08:23 +03:00
Vitaliy Filippov
7b35801647
Fix possible bad realloc in disk_tool_meta for non-standard metadata block sizes
2023-03-15 01:08:23 +03:00
Vitaliy Filippov
f3228d5c07
Fix typo (did not affect execution though)
2023-03-15 01:08:23 +03:00
Vitaliy Filippov
18366f5055
Fix read/write return type in rw_blocking
2023-03-15 01:08:14 +03:00
Vitaliy Filippov
851507c147
Add missing close() in test stubs
2023-03-15 00:23:56 +03:00
Vitaliy Filippov
9aaad28488
Fix "null pointer exception" for unhandled OSD_OP_DELETEs (when pool is not loaded yet)
2023-03-02 11:16:39 +03:00
Vitaliy Filippov
dd57d086fe
Add a missing part of the "theoretical performance" to the Russian version
2023-03-01 00:24:54 +03:00
Vitaliy Filippov
8810eae8fb
Release 0.8.6
...
Important fixes:
- Fix possibly incorrect EC parity chunk updates with EC n+k, k > 1 and when
the first parity chunk is missing
Minor fixes and improvements:
- Fix incorrect EC free space statistics in vitastor-cli df output
- Speedup vitastor-cli startup in clusters with RDMA
- Remove unused PG "peered" state (previously used to update PG epoch)
- Use sfdisk with just --json in vitastor-disk (--dump --json isn't needed)
- Allow trailing comma in sfdisk output (fixes sfdisk 2.36 compatibility)
- Slightly improve RDMA send/receive code
- Reduce RDMA memory consumption by default (rdma_max_recv/send = 16/8)
- Use vitastor-cli instead of direct etcd interaction in the CSI driver
2023-02-28 11:18:48 +03:00
Vitaliy Filippov
c1365f46c9
Use vitastor-cli instead of direct etcd interaction in the CSI driver
2023-02-28 11:02:50 +03:00
Vitaliy Filippov
14d6acbcba
Set default rdma_max_recv/send to 16/8, fix documentation
2023-02-28 11:00:56 +03:00
Vitaliy Filippov
1e307069bc
Fix missing parity chunk calculation for EC n+k, k > 1 and first parity chunk missing
2023-02-28 02:40:19 +03:00
Vitaliy Filippov
c3e80abad7
Allow to send more than 1 operation at a time
2023-02-26 02:01:04 +03:00
Vitaliy Filippov
138ffe4032
Reuse incoming RDMA buffers
2023-02-26 00:55:01 +03:00
Vitaliy Filippov
8139a34e97
Fix json11: allow trailing comma
2023-02-23 01:16:01 +03:00
Vitaliy Filippov
4ab630b44d
Use just sfdisk --json, --dump is not needed
2023-02-23 00:55:47 +03:00
Vitaliy Filippov
2c8241b7db
Remove PG "peered" state
2023-02-21 01:30:42 +03:00
Vitaliy Filippov
36a7dd3671
Move tests to "make test"
2023-02-21 01:30:42 +03:00
Vitaliy Filippov
936122bbcf
Initialize msgr lazily in client to speedup vitastor-cli with RDMA enabled
2023-02-19 18:59:07 +03:00
Vitaliy Filippov
1a1ba0d1e7
Add set_immediate to ringloop and use it for bs/osd ops to prevent reenterability issues
2023-02-09 17:37:26 +03:00
Vitaliy Filippov
3d09c9cec7
Remove unused wait_sqe() from ringloop
2023-02-09 17:37:26 +03:00
Vitaliy Filippov
3d08a1ad6c
Fix cluster_client test after last reenterability fixes
2023-02-05 01:47:32 +03:00
Vitaliy Filippov
499881d81c
Fix typo
2023-01-27 01:52:02 +03:00
Vitaliy Filippov
aba93b951b
Fix incorrect EC free space statistics in vitastor-cli df output
2023-01-26 02:04:29 +03:00
Vitaliy Filippov
d125fb1f30
Release 0.8.5
...
- Fix a possible "double free" bug in the client library happening on OSD restart
- Fix a possible write hang on PG history update when only epoch is changed
- Fix incorrect systemd target "local.target" in mon/make-etcd
- Allow "content" option in PVE storage plugin to allow to enable containers
- Build client library without tcmalloc which fixes "attempt to free invalid pointer"
errors when, for example, trying to run QEMU with both Vitastor and Ceph RBD disks
2023-01-25 01:43:49 +03:00
Vitaliy Filippov
9d3fd72298
Require liburing < 2 in rpm specs
2023-01-25 01:43:49 +03:00
Vitaliy Filippov
8b552a01f9
Do not retry successful operation parts in client (could lead to "double free" bugs)
2023-01-25 01:30:36 +03:00
Vitaliy Filippov
0385b2f9e8
Fix write hangs on PG epoch update - always set pg.history_changed to true
2023-01-25 01:30:15 +03:00
Vitaliy Filippov
749c837045
Replace non-existing local.target with multi-user.target
2023-01-25 01:29:31 +03:00
Vitaliy Filippov
98001d845b
Remove version from vitastor-release.rpm links
2023-01-23 14:03:33 +03:00
Vitaliy Filippov
c96bcae74b
Allow "content" option in PVE storage plugin to allow to enable containers
2023-01-16 18:14:45 +03:00
Vitaliy Filippov
9f4e34a8cc
Build client library without tcmalloc
...
Fixes "[src/tcmalloc.cc:332] Attempt to free invalid pointer ..." when trying
to run QEMU with both Vitastor and Ceph RBD disks and other possible allocator
collisions.
2023-01-15 00:01:11 +03:00
Vitaliy Filippov
81fc8bb94c
Release 0.8.4
...
New features:
- Implement QCOW2 image/snapshot export via qemu-img (bdrv_co_block_status in the driver)
- Remove OSDs from PG history during `vitastor-cli rm-osd` to prevent `left_on_dead` PG states after deletion
- Add a new recovery_pg_switch setting to mix all PGs during recovery, to almost
fully reduce the probability of ENOSPC during rebalance
- Introduce partial ENOSPC ("OSD is full") handling - now ENOSPC doesn't turn
into cascades of crashes
- Add migration support to Proxmox VE Vitastor driver
- Track last_clean_pgs on a per-pool basis thus reducing data movement in a cluster
with pools remaining unclean/degraded for a long time
Bug fixes:
- Fix a bug where monitor could generate degraded PGs if one of the hosts had no OSDs
- Fix a bug where monitor could skip PG redistribution with a lot of OSDs in cluster
- Report PG history synchronously on the first write, which improves PG consistency
and availability at the same time, because history now gets reported correctly
and doesn't get reported without the need for it
- Fix possible write and recovery stalls which could happen in a cluster with both EC and replicated pools
- Make OSD and monitors sanitize & deduplicate PG history items in etcd
- Fix non-working OSD peer config safety check
- Fix a rare journal flush stall where flushing wasn't activated with full journal, but with empty flush queue
- Fix builds without ISA-L (jerasure-only) crashing with EC N+K, K>=2 due to the lack of 16-byte buffer alignment
- Fix a possible crash for EC N+K, K>=2 when calculating a parity chunk with previous parity chunk missing
- Fix a bug where vitastor-disk purge with suppressed warnings didn't work
2023-01-13 23:59:54 +03:00
Vitaliy Filippov
bc465c16de
Fix arithmetic on void* for clang
2023-01-13 23:58:42 +03:00
Vitaliy Filippov
8763e9211c
Fix qemu driver compilation warning/error
2023-01-13 23:44:39 +03:00
Vitaliy Filippov
9e1a80bd17
Replace apt-key with trusted.gpg.d
2023-01-13 19:51:47 +03:00
Vitaliy Filippov
3e280f2f08
Mark vitastor as shared storage in PVE driver
2023-01-13 01:36:30 +03:00
Vitaliy Filippov
fe87b4076b
Fix backwards compatibility in cluster_client
2023-01-12 02:37:31 +03:00
Vitaliy Filippov
a38957c1a7
Skip empty hosts in lp-optimizer
2023-01-09 16:26:16 +03:00
Vitaliy Filippov
137309cf29
Implement bdrv_co_block_status for snapshot export support
2023-01-07 17:06:58 +03:00
Vitaliy Filippov
373f9d0387
Try to re-peer PGs on history change
2023-01-06 12:46:44 +03:00
Vitaliy Filippov
c4516ea971
Also remove deleted OSD from PG configuration and last_clean_pgs
2023-01-06 12:46:44 +03:00
Vitaliy Filippov
91065c80fc
Try to prevent left_on_dead when deleting OSDs by removing them from PG history
2023-01-06 12:46:43 +03:00
Vitaliy Filippov
0f6b946add
Time changes with every stat change, do not schedule checks based on it
2023-01-05 13:54:16 +03:00
Vitaliy Filippov
465cbf0b2f
Do not re-schedule recheck indefinitely, run it after mon_change_timeout in any case
2023-01-05 13:48:06 +03:00
Vitaliy Filippov
41add50e4e
Track last_clean_pgs on a per-pool basis
2023-01-03 02:20:50 +03:00
Vitaliy Filippov
02e7be7dc9
Prevent reenterability side effects during PG history operation resume
2023-01-03 02:20:50 +03:00
Vitaliy Filippov
73940adf07
Prioritize EC (non-instantly-stable) operations under journal pressure
...
This reduces the probability of hitting OSD stalls with EC due to "deadlocks"
where two parallel write operations wait for each other to complete
2023-01-03 00:05:45 +03:00
Vitaliy Filippov
e950c024d3
Do not sync peer OSDs before listing
...
Sync before listing was added to wait for all PG writes possibly left in queue
from the previous master to finish before listing it
But in fact it may block the cluster when EC is used and some unstable writes
are left in the queue - they block journal flushing, rollback/stabilize is
required to unblock them, but rollback/stabilize may only happen after PG is
peered. But peering needs listings, listings are requested only after sync, and
sync itself waits for currently blocked writes waiting in the queue
2023-01-03 00:05:45 +03:00
Vitaliy Filippov
71d6d9f868
Fix possible crash on ENOSPC during operation cancel in blockstore
2023-01-03 00:05:45 +03:00
Vitaliy Filippov
a4dfa519af
Report PG history synchronously during write
...
This has 2 effects:
1) OSD sets aren't added into PG history until actual write attempts anymore
which removes unneeded extra osd_sets in PG history
2) New OSD sets are reported synchronously and can't be lost on PG restarts
happening at the same time with reconfiguration
2023-01-01 23:41:05 +03:00
Vitaliy Filippov
37a6aff2fa
Write OSD numbers always as numbers in mon
2023-01-01 23:17:42 +03:00
Vitaliy Filippov
67019f5b02
Make OSD sort & sanitize PG history items
2023-01-01 23:17:42 +03:00
Vitaliy Filippov
0593e5c21c
Fix OSD peer config safety check
2022-12-31 02:24:42 +03:00
Vitaliy Filippov
998e24adf8
Add a new recovery_pg_switch setting to mix all PGs during recovery
2022-12-30 02:03:33 +03:00
Vitaliy Filippov
d7bd36dc32
Fix another rare journal flush stall
2022-12-30 02:03:33 +03:00
Vitaliy Filippov
cf5c562800
Log all object locations when peering PGs
2022-12-30 02:03:33 +03:00
Vitaliy Filippov
629200b0cc
Return ENOSPC as the primary OSD
2022-12-30 02:03:33 +03:00
Vitaliy Filippov
3589ccec22
Do not disconnect peer on ENOSPC during write
2022-12-30 01:54:25 +03:00
Vitaliy Filippov
8d55a1e780
Build osd_rmw_test both with and without ISA-L
2022-12-29 19:13:57 +03:00
Vitaliy Filippov
65f6b3a4eb
Fix jerasure crashing on bitmap calculation/restoration due to the lack of 16-byte alignment
2022-12-29 19:13:57 +03:00
Vitaliy Filippov
fd216eac77
Add a test for missing parity chunk calculation
2022-12-29 19:13:57 +03:00
Vitaliy Filippov
61fca7c426
Fix crash when calculating a parity chunk with previous parity chunk missing (test coming shortly)
2022-12-29 19:13:57 +03:00
Vitaliy Filippov
1c29ed80b9
Fix quote in docs :)
2022-12-28 18:08:53 +03:00
Vitaliy Filippov
68f3fb795e
Suppress warnings in vitastor-disk purge correctly
2022-12-27 11:09:19 +03:00
Vitaliy Filippov
fa90f287da
Release 0.8.3
...
- Implement a new "vitastor-disk purge" command to remove OSDs with safety checks
- Implement a new "vitastor-cli rm-osd" command to only remove OSD metadata from etcd
- Fix a bug where the monitor could ignore OSD removal and other /osd/stats key changes
- Fix a bug where garbage could be returned when reading objects being written at the same time
- Fix a rare write stall where journal space could be not reclaimed where there
were no new operations in the flush queue
- Fix a rare peering stall caused by a previous long listing operations queues limiting attempt
- Fix total object count statistic in OSD on object creation
- Add missing offset&len into vitastor-disk dump-journal for big_writes, fix JSON format
- Make vitastor-cli print help on missing command
- Make vitastor-cli translate all '-' to '_' in CLI options
2022-12-27 02:40:55 +03:00
Vitaliy Filippov
795020674d
Loop journal flusher when the queue is empty but there is a trim request
2022-12-27 02:28:20 +03:00
Vitaliy Filippov
8e12285629
Fix vitastor-disk purge (now it works)
2022-12-27 02:28:20 +03:00
Vitaliy Filippov
b9b50ab4cc
Implement vitastor-disk purge command
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
0d8625f92d
Make vitastor-cli print help on missing command
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
2f3c2c5140
Implement safety check for OSD removal, translate all '-' to '_' in cli options
...
'-' to '_' translation fixes a bug with create --image_meta
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
4ebdd02b0f
Remove LIST op limiter
...
It doesn't prevent OSD slow ops but may itself lead to stalls :)
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
bf6fdc4141
Check add/rm osd with 2048 PGs
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
c2244331e6
Add vitastor-cli rm-osd command
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
3de57e87b1
Recheck OSD tree in monitor on /osd/stats changes
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
2d4cc688b2
Add a remove-osd test
2022-12-26 02:48:48 +03:00
Vitaliy Filippov
31bd1ec145
Fix object creation check for statistics
2022-12-21 02:51:11 +03:00
Vitaliy Filippov
c08d1f2dfe
Add missing offset&len into big_writes journal dump, fix commas again
2022-12-21 02:51:11 +03:00
Vitaliy Filippov
1d80bcc8d0
Fix blockstore returning garbage for unstable reads if there is an in-flight version
...
"In-flight" versions are added into dirty_db when writes are enqueued. And they
weren't ignored by subsequent reads even though they didn't have data location yet.
This bug was leading to test_heal.sh not passing sometimes with replicated setups.
2022-12-21 02:48:24 +03:00
Vitaliy Filippov
5ef8bed75f
Release 0.8.2
...
- Fix QEMU driver compatibility with QEMU 7.0 and < 2.9
- Add patches for pve-qemu-kvm 7.1 (PVE 7.3) and pve-qemu-kvm 6.2 (PVE 7.2)
- Fix Proxmox driver location in the pve-storage-vitastor package
- Disable HDD autodetection in non-hybrid mode
- Explicitly warn about a buggy kernels on -EAGAIN in io_uring
- Final fix for the lack of zeroing out of old metadata entries
(do not crash with "big_write journal_entry was allocated over another object"
in some cases after an unclean OSD shutdown)
- Wait for data writes before fsyncing data if data fsync is enabled
- Never try to wait for free space inside blockstore thus stalling OSDs
- Fix a rare crash in osd_peering due to callback ordering
- Fix a rare duplication of ping & op message IDs
- Fix a rare use-after-free during pings
- Add --force to vitastor-disk read-sb
- Make vitastor-disk dump metadata object IDs in hex, add forgotten commas
- Fix vitastor-disk SCSI disk cache check
2022-12-17 17:54:13 +03:00
Vitaliy Filippov
8669998e5e
Fix discard_list_subop() for local ops
2022-12-17 17:54:13 +03:00
Vitaliy Filippov
b457327e77
Oops. Fix metadata read after fixes :-)
2022-12-17 17:31:57 +03:00
Vitaliy Filippov
f7fa9d5e34
Fix SCSI device cache type check
2022-12-17 17:31:57 +03:00
Vitaliy Filippov
49b88b01f9
Fix clang build
2022-12-17 16:25:26 +03:00
Vitaliy Filippov
71688bcb59
Disable HDD autodetection in non-hybrid mode
2022-12-17 16:12:15 +03:00
Vitaliy Filippov
552e207d2b
Explicitly print errors about -EAGAIN in io_uring
2022-12-17 15:49:49 +03:00
Vitaliy Filippov
5464821fa5
Final fix for the lack of zeroing out of old metadata entries
...
If a crash occurs during flushing a redirect-write it may happen so that
the disk contains both old and new metadata entries. This is OK, but prior
to 0.8.0 after this situation OSDs started without problem, but then they
crashed after some more overwrites with a "tried to overwrite non-zero
metadata entry" error. 0.8.0 introduced a change that was intended to fix
this situation, but rather than fixing it it prevented OSDs from starting,
now because of a "big_write journal_entry was allocated over another object"
error... :-)
This change finally fixes the original issue.
Followup to 54ef2c389f
2022-12-17 14:50:31 +03:00
Vitaliy Filippov
6917a32ca8
Add --force to vitastor-disk read-sb
2022-12-17 02:47:15 +03:00
Vitaliy Filippov
f8722a8bd5
Dump meta in hex
2022-12-17 01:50:38 +03:00
Vitaliy Filippov
9c2f69c9fa
Add forgotten commas to vitastor-disk dump-journal
2022-12-17 01:22:58 +03:00
Vitaliy Filippov
1a93e3f33a
Wait for data writes before fsyncing data if data fsync is enabled
2022-12-16 20:46:55 +03:00
Vitaliy Filippov
3f35744052
Fix compatibility with QEMU aio_set_fd_handler signatures in 7.0 and < 2.9
2022-12-15 19:17:17 +03:00
Vitaliy Filippov
66f14ac019
Update notes about Proxmox 7.1-7.3
2022-12-15 18:57:28 +03:00
Vitaliy Filippov
1364009931
Add patches for pve-qemu-kvm 7.1 (PVE 7.3) and pve-qemu-kvm 6.2 (PVE 7.2)
2022-12-14 19:01:36 +03:00
Vitaliy Filippov
d7e30b8353
Fix pve-storage-vitastor filename
2022-12-14 16:41:35 +03:00
Vitaliy Filippov
cb437913d3
Never try to wait for free space inside blockstore
2022-12-12 00:27:05 +03:00
Vitaliy Filippov
472bce58ab
Fix rare crash in osd_peering due to callback ordering
2022-12-12 00:27:05 +03:00
Vitaliy Filippov
7a71e7ef01
Fix possible duplication of ping & op message IDs
2022-12-04 00:16:47 +03:00
Vitaliy Filippov
c71e5e7bbd
Fix possible use-after-free during pings
2022-12-04 00:16:47 +03:00
Vitaliy Filippov
8fdf30b21f
Release 0.8.1
...
- Remove an additional data copy operation when flushing journal (should
slightly increase write performance)
- Fix a bug where new writes in the inmemory_journal=false mode could overwrite
the data currently read by a parallel read operation
- Fix degraded parity writes for EC N+K when K>1 where the bug could also lead
to an "assertion failed" error
- Fix missing journal space check for "big" writes which could lead to
"prefill_single_journal_entry(): assertion failed..." error in OSD
- Fix possible "assertion failed: next->prev_wait >= 0" in client in rare cases
- Fix missing "len" field in vitastor-disk write-journal big_writes
- Fix possible crash of a full OSD (ENOSPC)
- Fix CSI build scripts to include newest packages every time
- Fix CSI endpoint in the liveness probe manifest
2022-11-20 11:44:09 +03:00
Vitaliy Filippov
238037ae31
Make journal trimmer wait until reads are completed when inmemory_journal is false
...
Without this new writes may in theory overwrite journal data being read at that time
2022-11-20 01:49:21 +03:00
Vitaliy Filippov
09a8864686
Fix degraded parity writes for EC N+K when K>1
...
Fixes possible `calc_rmw_parity_ec(): Assertion `bufs[i][curbuf[i]].buf' failed` error
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
6e6f6ecbb0
Add missing journal space check for big_writes
...
Fixes possible `prefill_single_journal_entry(): Assertion `!journal.sector_info[journal.cur_sector].flush_count' failed` error
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
9491f81419
Add missing documentation for OSD tags
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
44c2b30167
Take newest packages every time when rebuilding CSI
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
bf8a0581cd
Fix possible "assertion failed: next->prev_wait >= 0" in client
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
5953942042
Add crc32c test utility
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
a276a1f737
Do not copy journal data additional time when flushing
2022-11-20 00:50:13 +03:00
Vitaliy Filippov
cc24e5796e
Add a FIXME
2022-11-20 00:50:09 +03:00
Vitaliy Filippov
6e26732e6a
Fix skipped "len" field in vitastor-disk write-journal big_writes
2022-11-12 12:01:40 +03:00
Vitaliy Filippov
b4edc79449
Fix possible segfault on ENOSPC
2022-11-12 11:59:43 +03:00
Vitaliy Filippov
5f26887d32
Fix csi endpoint in liveness probe
2022-11-10 18:37:37 +03:00
Vitaliy Filippov
11ec9ad874
Release 0.8.0
...
- Implement automatic OSD activation via udev and simple on-disk superblock storage
- Add a new `vitastor-disk` tool and merge all disk-related functionality there.
Now it can prepare new OSD disks, upgrade plain old systemd units to the new scheme,
resize OSD data area, manage OSD services by disk paths, manage superblocks,
automatically check and disable disk cache, dump and write back journal and metadata.
- Add a documentation section about `vitastor-disk` (read it if you want details!)
- Install systemd services during package installation instead of the older method
of manually creating them via separate shell scripts
- Add a new `make-etcd` script that reuses /etc/vitastor/vitastor.conf to configure etcd
- Allow to configure block_size, bitmap_granularity and immediate_commit per-pool
- Fix "fatal error: tried to overwrite non-zero metadata entry" which was possible
in some cases after unclean OSD shutdown (caused by old metadata entries not being zeroed)
2022-09-05 13:51:20 +03:00
Vitaliy Filippov
83bb6598dc
Fix fsync autodetection for the single-device mode
2022-09-05 13:51:20 +03:00
Vitaliy Filippov
150f369346
Hotfixes for vitastor-disk prepare: max_other, get device size, older sfdisk
2022-09-05 12:48:27 +03:00
Vitaliy Filippov
8d9a5fde15
Fix docs (block_size vs object_size)
2022-09-04 14:47:04 +03:00
Vitaliy Filippov
9ccc607ab9
Fix parse_size
2022-09-04 14:20:56 +03:00
Vitaliy Filippov
8972878c77
Fix make-etcd for ip:port
2022-09-04 14:11:59 +03:00
Vitaliy Filippov
2a1da88253
Create /etc/vitastor during package installation
2022-09-03 23:31:55 +03:00
Vitaliy Filippov
2f13f347b0
Fix space stats in mon
2022-09-03 11:16:33 +03:00
Vitaliy Filippov
9453db0e99
Add a newer make-etcd.js
2022-09-03 02:04:21 +03:00
Vitaliy Filippov
a828a1233d
Remove old make-osd scripts
2022-09-03 02:04:21 +03:00
Vitaliy Filippov
9481456dfe
Automatically check whether to disable cache during prepare
2022-09-03 02:04:21 +03:00
Vitaliy Filippov
bd11db5d0a
Add vitastor-mon.service, vitastor.target, create user and log directory during package installation
2022-09-03 00:09:22 +03:00
Vitaliy Filippov
68ebe5993a
Fix partition reuse
2022-09-02 23:32:25 +03:00
Vitaliy Filippov
eecbfb66ce
Remove the old make-osd.sh script from packages
2022-09-02 20:35:15 +03:00
Vitaliy Filippov
a537db8909
Add documentation for the new "vitastor-disk" tool
2022-08-22 00:31:30 +03:00
Vitaliy Filippov
54ef2c389f
Followup to the "tried to overwrite" fix: also handle it in case of inmemory_meta == false
2022-08-21 01:28:29 +03:00
Vitaliy Filippov
153c73574a
Refactor blockstore_init_meta into slightly more obvious code
2022-08-21 01:21:13 +03:00
Vitaliy Filippov
d83580bd68
Fix "tried to overwrite non-zero metadata entry" when during a previous metadata
...
flush writing new entry is completed, but zeroing out an old one isn't
2022-08-21 00:31:18 +03:00
Vitaliy Filippov
29b40aba93
Add write-meta command (for debug)
2022-08-20 23:56:57 +03:00
Vitaliy Filippov
a52f2b0e8f
Add write-journal command (for debug)
2022-08-20 14:05:53 +03:00
Vitaliy Filippov
1407db9c08
Fix vitastor-disk prepare bugs
2022-08-19 02:22:54 +03:00
Vitaliy Filippov
c0d5e83fb8
Run partprobe when partitions do not appear
2022-08-18 02:05:16 +03:00
Vitaliy Filippov
40d8d65188
Rewrite upgrade-simple to C++
2022-08-18 01:31:31 +03:00
Vitaliy Filippov
a16263e88c
Fix bugs in the upgrade script and in the udev startup script
2022-08-17 10:28:34 +03:00
Vitaliy Filippov
e62bab1b39
Add systemd unit for udev deployments
2022-08-15 00:23:26 +03:00
Vitaliy Filippov
cb4e3a118d
Fix warning
2022-08-15 00:18:21 +03:00
Vitaliy Filippov
b1e39b5dea
Split disk_tool.cpp into separate files
2022-08-14 02:37:01 +03:00
Vitaliy Filippov
1170319431
Finish vitastor-disk prepare in theory
2022-08-14 02:13:24 +03:00
Vitaliy Filippov
2e0a2221eb
vitastor-disk prepare: WIP second form command of the command
2022-08-12 01:58:28 +03:00
Vitaliy Filippov
5a10d135f3
Allow to configure block_size, bitmap_granularity and immediate_commit per-pool
2022-08-11 01:56:33 +03:00
Vitaliy Filippov
4c9aaa8a86
vitastor-disk prepare: implement first form of the command
2022-08-09 01:29:29 +03:00
Vitaliy Filippov
ae99ee6266
Rename base64.{cpp.h} to str_util
2022-07-31 01:12:37 +03:00
Vitaliy Filippov
5af75f7d78
Implement vitastor-cli and vitastor-disk --help <command>
2022-07-31 01:10:05 +03:00
Vitaliy Filippov
7dc6f10ea1
Add read-sb command
2022-07-28 00:14:23 +03:00
Vitaliy Filippov
6fde9950d6
Implement upgrade tool from "simple" units to superblock+udev deployments
2022-07-27 02:33:43 +03:00
Vitaliy Filippov
76dd0fdcea
Implement pre-exec command with on-start OSD checks
2022-07-24 15:09:45 +03:00
Vitaliy Filippov
5acc19bbd5
Implement systemctl start/stop and other commands
2022-07-23 02:18:40 +03:00
Vitaliy Filippov
d5ca4e1f90
Add exec-osd command
2022-07-22 02:17:24 +03:00
Vitaliy Filippov
67e04f789f
Add write-sb (superblock) command
2022-07-19 01:14:31 +03:00
Vitaliy Filippov
837407a84c
Add udev import command
2022-07-19 01:14:31 +03:00
Vitaliy Filippov
1fe5908899
WIP OSD activation from superblock
2022-07-17 02:14:50 +03:00
Vitaliy Filippov
dcc6d546be
Move simple-offsets into vitastor-disk, too
2022-07-15 02:19:35 +03:00
Vitaliy Filippov
85fa389557
Add a test for disk-tool resize
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
dfa433c63b
Add JSON format to dump-journal
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
cf487c95aa
Fix resizer
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
b10656ca09
Parse new disk params in disk_tool resizer
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
ea632367e9
Do not alter dsk.meta_offset/len to skip superblock
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
4d777c6729
Set journal/meta devices to data device explicitly instead of ""
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
0c404c5074
Use blockstore_disk in disk_tool
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
dfd80626bd
Extract disk opening functions to separate module
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
30907852c2
Use simple std::map for the config
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
078ed5b116
WIP Data area resize tool
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
73a363bf92
Rename some variables and constants
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
b0e86ca643
Merge dump-journal and dump-meta into the new "vitastor-disk" tool
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
8800afb649
Fix void* arithmetic again
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
c10c90f620
Swap cli.en.md and cli.ru.md contents O_o
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
e20cdd13b6
Fix simple-offsets return value
2022-07-15 01:38:30 +03:00
Vitaliy Filippov
d29b5d2d04
Add Russian translation of VNPL-1.1
2022-06-24 01:34:25 +03:00
Vitaliy Filippov
65b0e8e940
Fix typo in VNPL-1.1
2022-06-24 01:34:25 +03:00
Vitaliy Filippov
bce357e2a5
Do not read all metadata into memory when dumping
2022-06-13 01:26:30 +03:00
Vitaliy Filippov
0876ca09cd
Fix dumper includes and print format
2022-06-11 00:30:44 +03:00
Vitaliy Filippov
dac12d8a4c
Implement metadata dump tool
2022-06-10 18:50:09 +03:00
Vitaliy Filippov
1eec4407ab
Fix inode creation when /index/maxid is out of sync
2022-06-06 16:35:51 +03:00
huy
3b7c6dcac2
Fix volume creation from snapshots in Cinder driver
2022-06-06 15:46:13 +03:00
Vitaliy Filippov
342517d126
Fix typo
2022-06-05 00:45:02 +03:00
Vitaliy Filippov
675bc12a13
Add extern "C" for systems like Gentoo which miss it in jerasure includes
2022-06-05 00:33:38 +03:00
Vitaliy Filippov
101592bbff
Release 0.7.1
...
- Add ISA-L erasure code implementation, now used automatically instead of jerasure when available
- Fix listings sending too many parallel requests to OSDs
- Fix rm-data crashing with --wait-list
- Remove empty inodes from statistics and `ls` output, after <inode_vanish_time> seconds after deletion
- Make monitor delete pool statistics when the pool is deleted and thus remove them from `df` output
- Log multiple etcd addresses in OSD logs correctly
- Fix true/false parsing in json configs like no_recovery/no_rebalance
- Show no_recovery, no_rebalance, readonly flags in status
2022-06-05 00:07:24 +03:00
Vitaliy Filippov
be4087d9d2
Add a FIXME to test_interrupted_rebalance
2022-06-05 00:06:56 +03:00
Vitaliy Filippov
404e43dd2d
Note that ISA-L does not need to be enabled separately
2022-06-04 22:58:02 +03:00
Vitaliy Filippov
87613ed590
Add ISA-L into RPM specs
2022-06-04 13:27:06 +03:00
Vitaliy Filippov
2a2e914ef9
Show no_recovery, no_rebalance and readonly flags in status
2022-06-04 13:27:06 +03:00
Vitaliy Filippov
0cdc9292c8
Fix true/false parsing in json configs like no_recovery/no_rebalance
2022-06-04 13:27:06 +03:00
Vitaliy Filippov
3e1b03bb5c
Show all etcd addresses in the "reporting to..." message
2022-06-04 13:27:06 +03:00
Vitaliy Filippov
36e851505a
Make monitor delete pool statistics when the pool is deleted
2022-06-04 13:27:06 +03:00
Vitaliy Filippov
1efbbb0c36
Make deleted inodes vanish from statistics after 60 seconds
2022-06-04 13:27:06 +03:00
Vitaliy Filippov
088dd15449
Exclude empty inodes from stats
2022-06-04 00:18:17 +03:00
Vitaliy Filippov
4a531d7b8b
Fix listings sending too many parallel requests to OSDs, fix rm-data crashing with --wait-list
2022-06-03 23:36:37 +03:00
Vitaliy Filippov
a0cae4c180
Rename "jerasure" to "ec" in pool configuration, function names, fix documentation and Debian build scripts
...
Old pool configurations with "jerasure" also remain supported as an alias for "ec"
2022-06-03 15:40:00 +03:00
Vitaliy Filippov
c4eb46600d
Merge run_3osds and run_7osds scripts
2022-06-03 01:56:36 +03:00
Vitaliy Filippov
21b306e25f
Add ISA-L support
2022-06-02 01:47:33 +03:00