1781 Commits (master)

All Branches

Search

Author	SHA1	Message	Date
Vitaliy Filippov	2f999d8607	Reduce etcd memory usage ... With default --snapshot-count 100000 and GOGC=100 it easily reaches 6.6 GB even when we only store 1-2 MB of data in it	2023-07-06 00:46:26 +03:00
Vitaliy Filippov	d007a374f2	Delete extra /pool/stats/ keys for non-existing pools	2023-07-06 00:40:13 +03:00
Vitaliy Filippov	45c0694853	Clear etcd_local addresses on reload and also skip duplicates	2023-07-06 00:39:39 +03:00
Vitaliy Filippov	57bcba2406	Add notes about VDUSE	2023-07-04 16:51:46 +03:00
Vitaliy Filippov	30ac899074	Make QEMU driver compatible with older vitastor_client and with systems without io_uring	2023-07-04 15:51:43 +03:00
Vitaliy Filippov	2348d39cf4	Avoid repeated qemu_uring_handlers, add 2.0-2.7 compatibility	2023-07-04 00:28:23 +03:00
Vitaliy Filippov	3de7929fe5	Integrate v2 - direct epoll	2023-07-04 00:28:23 +03:00
Vitaliy Filippov	07b2196bc2	Integrate QEMU driver with io_uring	2023-07-04 00:28:23 +03:00
Vitaliy Filippov	b8e30608d6	Bump QEMU version to vitastor2	2023-07-01 00:55:32 +03:00
Vitaliy Filippov	a612cdca47	Release 0.9.3 ... - Add patch for libvirt 9.0 - Add support for Proxmox VE 8.0 - Fix compatibility of the QEMU driver with iothread (QEMU rebuilds are coming) - Fix vitastor-cli rm-data/rm/merge hanging when some OSDs are down. Allow deletions in unclean cluster at the cost of some data possibly "reappearing" when those OSDs start back. In that case you can just repeat the deletion request using rm-data. - A bunch of bug fixes for snapshots: - Fix snapshot reads often not working at all with snapshot chain size > 2 - Fix optimized snapshot data merge (children to parent) - Fix updating of image name index key during optimized merge - Fix auto-selection preventing the use of optimized merge with only 1 snapshot - Fix incorrect CAS retries during snapshot merge - Fix snapshot merge progress reporting - Fix primary_read bitmap buffers use-after-free which could lead to incorrect allocation map reads - Remove /usr/local/bin path from make-etcd - Some documentation fixes	2023-07-01 00:25:58 +03:00
Vitaliy Filippov	c8d61568b5	Fix primary_read bitmap buffers being freed too early (use-after-free)	2023-06-30 12:47:45 +03:00
Vitaliy Filippov	84ed3c6395	Fix CAS retries during snapshot merge	2023-06-30 02:30:23 +03:00
Vitaliy Filippov	a7b57386c0	Do not print last subcommand result twice during "inverse" snapshot merge	2023-06-30 02:07:10 +03:00
Vitaliy Filippov	9d4ea5f764	Fix inverse parent selection which prevented the use of optimized merge in case of only 1 snapshot	2023-06-30 01:39:11 +03:00
Vitaliy Filippov	000e4944ec	Remove "inverse parent" image name index key from etcd during snapshot merge	2023-06-30 01:23:30 +03:00
Vitaliy Filippov	8426616d89	Warn about unfinished deletions in rm-data	2023-06-30 01:18:25 +03:00
Vitaliy Filippov	1a841344ec	Print progress of all operations during snapshot merge	2023-06-30 01:13:47 +03:00
Vitaliy Filippov	8603b5cb1d	Do not hang on inactive OSDs during delete, report and skip them instead	2023-06-30 00:15:16 +03:00
Vitaliy Filippov	f12b8e45a9	Remove /usr/local/bin path from make-etcd	2023-06-29 23:49:31 +03:00
Vitaliy Filippov	878ccbb6ea	Fix snapshot chain "down-merge" ("up-merge" worked well...)	2023-06-29 00:47:21 +03:00
Vitaliy Filippov	b14220b4d0	Add a test for snapshot chain	2023-06-29 00:47:21 +03:00
Vitaliy Filippov	181d6ba407	Move npm install to CI build and remove it from tests	2023-06-28 23:41:46 +03:00
Vitaliy Filippov	63c2b9832c	Fix chained (snapshot) reads often not working at all with chain size > 2	2023-06-28 18:54:03 +03:00
Vitaliy Filippov	10e2e6a7c8	Add a patch for pve-qemu 8.0	2023-06-24 01:33:52 +03:00
Vitaliy Filippov	a598428992	Add a note about PVE 8.0	2023-06-24 01:29:28 +03:00
Vitaliy Filippov	08a677b684	Notes about rebuilding pve-qemu	2023-06-24 01:00:21 +03:00
Vitaliy Filippov	7c8fbdad16	Fix typo	2023-06-22 02:07:33 +03:00
Vitaliy Filippov	2f9353df60	Markdown preprocessor to compile multiple .md files into one	2023-06-22 01:27:38 +03:00
Vitaliy Filippov	57c744f288	Fix some cross-references in docs	2023-06-22 01:16:03 +03:00
Vitaliy Filippov	a11ca56fb1	Fix compatibility of the QEMU driver with iothread	2023-06-21 02:11:28 +03:00
Vitaliy Filippov	b84927b340	Fix \n in nbd_proxy	2023-06-19 01:48:58 +03:00
Vitaliy Filippov	83cacba226	Fix patched-qemu build	2023-06-19 01:47:55 +03:00
Vitaliy Filippov	2c8f0bc6d5	Add a note about Debian 12	2023-06-19 01:08:41 +03:00
Vitaliy Filippov	7ae5b0e368	Add patch for libvirt 9.0	2023-06-19 01:07:08 +03:00
Vitaliy Filippov	926be372fd	Release 0.9.2 ... - Measure and report scrub I/O statistics in vitastor-cli status - Make aggregated statistics in vitastor-cli status much smoother (first derive, then sum instead of first summing and then deriving) - Fix an old rare bug leading to journal corruption (try to use scrub if you think you're affected...) - Do not start EC PGs without at least <data chunks> OSDs in each old set (prevents spurious read errors with EC during reconnections/restarts) - Fix failed assert(!scrub_list_op) on OSD restart with pending scrubs - Fix future planned scrubs not starting because of incorrect time comparison - Build packages for Debian 12 (Bookworm)	2023-06-18 19:44:33 +03:00
Vitaliy Filippov	6222779b52	Support debian bookworm (12) build	2023-06-18 19:44:33 +03:00
Vitaliy Filippov	a4186e20aa	First derive, then sum per-OSD statistics instead of first summing and then deriving ... This makes statistics reported by vitastor-cli status much smoother	2023-06-18 01:32:24 +03:00
Vitaliy Filippov	c74a424930	Report scrub I/O in vitastor-cli status	2023-06-17 21:11:21 +03:00
Vitaliy Filippov	32f2c4dd27	Measure scrub statistics	2023-06-17 20:56:26 +03:00
Vitaliy Filippov	3ad16b9a1a	Fix auto_scrubs not starting because of < vs <= =))	2023-06-17 17:32:21 +03:00
Vitaliy Filippov	1c2df841c2	Fix failed assert(!scrub_list_op) on OSD restart with pending scrubs	2023-06-17 17:02:54 +03:00
Vitaliy Filippov	aa5dacc7a9	Do not start EC PGs without at least pg_data_size connections to old OSDs from each set	2023-06-17 02:16:30 +03:00
Vitaliy Filippov	affe8fc270	Raise timeout also for add_osd and rebalance_verify	2023-06-17 00:29:03 +03:00
Vitaliy Filippov	4fdc49bdc7	Add another assert-type check (it does not fire, just as a safety measure for the future)	2023-06-17 00:07:22 +03:00
Vitaliy Filippov	86b4682975	Put get_trim_pos into the "critical section". Fixes rare journal corruption issue ... The consequence of this issue was that in some very rare cases (only reproduced under load in CI when running 4+ tests in parallel) small write data written to journal could overwrite journal entries. Also add an assert-type safety check to be able to catch this issue in the future again in case of a regression.	2023-06-17 00:06:42 +03:00
Vitaliy Filippov	bdd48e4cf1	Release 0.9.1 ... - Fix "Client XX command out of sync" messages sometimes happening on OSD reconnections - Fix a bug where EC reads parallel with writes to the same object failed with -ERANGE error - Slightly reduce the amount of metadata writes during journal flushing - Correctly unmap NBD volumes when Proxmox forces map_volume use (with SWTPM and maybe some other cases)	2023-06-10 11:42:49 +03:00
Vitaliy Filippov	af8c3411cd	Correctly unmap NBD when Proxmox forces map_volume use (with SWTPM and maybe something else)	2023-06-08 01:31:49 +03:00
Vitaliy Filippov	9c405009f3	Use randrw in test_heal	2023-06-03 00:49:53 +03:00
Vitaliy Filippov	f9fbea25a4	Remove double write when old and new locations are in the same metadata block ... Also add another metadata entry fool-safety check which, ideally, will never fire %)	2023-06-03 00:47:10 +03:00
Vitaliy Filippov	2c9a10d081	Fix an idiotic bug leading to failed reads with -ERANGE with EC :D	2023-06-03 00:44:52 +03:00