1781 Commits (master)

All Branches

Search

Author	SHA1	Message	Date
Vitaliy Filippov	45e07d6294	Sadly we have to refcount dyn_data...	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	a8ee391e05	Fix clean block checksum read	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	de48fa3fd2	Allow to forcibly set meta_format	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	874a766b62	Rename meta_version to meta_format	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	384bd8e28f	Support old metadata format in vitastor-disk dump-meta	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	430994f48a	Fix journal big_write simple reads after checksum changes	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	3d7f838c59	Verify checksums in test_heal in different combinations	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	b909d81f41	Fix bitmap-granular checksums	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	e42975ffd1	Fix wait_journal_count not being zeroed	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	93778324e5	Rewrite and fix find_holes into a more obvious version	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	eeb6727170	Fix missing checksum read offset	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	7fe82c692e	Add a test for checksums	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	92c6e16eba	Fix checksum verification in big_write journal reads	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	213a9ccb4d	Verify checksums during journal reads	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	a166147110	Add backwards compatibility with non-checksum metadata and journal formats	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	7d532880c3	Implement large csum_block_size support (more than 4k) + refactor blockstore_flush	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	0b0405d115	Implement bitmap-granular (4k) metadata & data checksums	2023-07-29 12:17:18 +03:00
Vitaliy Filippov	e651c93a90	Release 0.9.6 ... - Fix vitastor-disk partition zeroing (sometimes it was writing garbage instead of zeroes) - Fix incorrect EC space statistics in `vitastor-cli status` - Several bug fixes for NFS: - Add . and .. in NFS directory listings - Return FILE_SYNC from NFS writes if immediate_commit is enabled - Return the same "verifier" in NFS COMMIT as in NFS WRITE - Make parallel NFS extending writes work correctly, without conflicts - Handle parallel NFS extending writes without imposing extra load on etcd - Support UTF-8 in vitastor-cli table output - Also allow "0" and "no" as false for inmemory_metadata and inmemory_journal - Use HDD defaults for HDD-only in automatic `vitastor-disk prepare` mode	2023-07-29 10:54:00 +03:00
Vitaliy Filippov	988e90be69	Fix vitastor-disk partition zeroing (it was writing random garbage instead of zeroes :D)	2023-07-28 12:29:07 +03:00
Vitaliy Filippov	272a45ad63	Fix modprobe command in docs	2023-07-27 23:57:02 +03:00
Vitaliy Filippov	25a15d24cf	Fix incorrect EC space statistics in `vitastor-cli status`	2023-07-27 02:26:17 +00:00
Vitaliy Filippov	700e0e9bff	Handle parallel NFS extending writes without imposing extra load on etcd	2023-07-27 02:26:17 +00:00
Vitaliy Filippov	ab0ca7c00f	Return FILE_SYNC from NFS writes if immediate_commit is enabled	2023-07-26 02:09:47 +03:00
Vitaliy Filippov	f153bc950b	Return the same "verifier" in NFS COMMIT as in NFS WRITE ... This fixes buffered (not O_DIRECT) NFS writes in Linux - previously they were hanging in an infinite loop because COMMIT didn't return the same verifier as previous WRITEs, and NFS kernel client was infinitely retrying the same writes. Also this probably allows for correct NFS failover, at least for the same buffered writes, because NFS clients repeat all write requests until a COMMIT confirms them.	2023-07-26 02:09:47 +03:00
Vitaliy Filippov	425ff8818d	Add . and .. in NFS directory listings ... MC, for example, hangs with infinite listing retries without them	2023-07-26 02:09:47 +03:00
Vitaliy Filippov	9e287a7778	Handle extending writes correctly in NFS proxy ... Previously, multiple parallel writes extending file size through NFS were racing with each other and triggering deletions of part of the written data I.e. if you mounted vitastor-nfs and just copied a file into it in MC then you could end up with only a part of the file actually written	2023-07-26 02:09:43 +03:00
Vitaliy Filippov	f52f58b9e9	Support UTF-8 in vitastor-cli table output	2023-07-25 01:48:57 +00:00
Vitaliy Filippov	1fe6b0c0e2	Also allow "0" and "no" as false for inmemory_metadata and inmemory_journal	2023-07-25 01:48:57 +00:00
Vitaliy Filippov	e4237e9ed8	Enable HDD defaults for HDD-only in automatic `vitastor-disk prepare` mode	2023-07-23 02:33:22 +03:00
Vitaliy Filippov	10a5fd6abb	Release 0.9.5 ... A hotfix to 0.9.4 containing only one bugfix: 100% CPU usage in the new QEMU driver caused by the lack of eventfd reset on io_uring event handling :)	2023-07-21 00:04:41 +03:00
Vitaliy Filippov	1c316ef350	Reset eventfd on every ringloop::loop()	2023-07-21 00:04:41 +03:00
Vitaliy Filippov	0b2d12eef1	Remove has_work, it was unnecessary	2023-07-21 00:04:37 +03:00
Vitaliy Filippov	1c10430ae1	Release 0.9.4 ... - Improve QEMU driver performance by integrating io_uring in it (up to 1.5x total iops improvement) - Fix QEMU driver deadlocks which started to reproduce in qemu-img after iothread fixes - Fix `vitastor-cli status` reporting more etcds than actually exists (fix etcd address duplication in config on reload) - Fix `vitastor-cli ls` crashing on inodes in non-existing pools - Delete old garbage /pool/stats/ keys for non-existing (deleted) pools - Reduce memory usage of etcds initialized by make-etcd script - Fix OSDs almost always crashing on etcd restart due to "revisions were compacted" (support reloading state from etcd) - Fix a crash and a stall possible mostly in HDD setups with small journal and big (512k, 900k) random writes - Add notes about HDDs to documentation. You are officially allowed to use HDD-only Vitastor with HGST/Toshiba/EXOS :)	2023-07-19 02:50:30 +03:00
Vitaliy Filippov	dfce91d168	Change git url in docs, correct block/vitastor.c path	2023-07-19 01:02:12 +03:00
Vitaliy Filippov	332a13ba30	Build patched QEMU against local packages	2023-07-19 00:05:02 +03:00
Vitaliy Filippov	d0e257ee81	Fix non-existing pool handling in `vitastor-cli ls`	2023-07-18 23:52:02 +03:00
Vitaliy Filippov	004912aac0	Add RPM spec patches for 6.2-el8 and 7.2-el9	2023-07-18 23:38:14 +03:00
Vitaliy Filippov	c18e92273e	Copy qemu 5.1 -> 5.2 patch for convenience	2023-07-18 23:37:53 +03:00
Vitaliy Filippov	9815d70ffc	It is impossible to use io_uring with older vitastor-client because it does not have vitastor_c_uring_has_work()	2023-07-18 23:37:53 +03:00
Vitaliy Filippov	4a4627dcab	Do not use bool in C library	2023-07-18 23:37:53 +03:00
Vitaliy Filippov	b963f2fd93	Add QEMU 2.12 patch (basically the same as 3.1)	2023-07-18 23:37:06 +03:00
Vitaliy Filippov	ba7427020e	Fix deadlocks possible in qemu-img after fixing iothread ... Deadlock was caused by switching QEMU coroutines directly inside vitastor_co_read_bitmap_cb() callback. The correct way is to schedule a BH /BH is a QEMU term for setImmediate() :)/, same as in read and write callbacks.	2023-07-18 23:32:16 +03:00
Vitaliy Filippov	a0aac7eb2a	Update drives	2023-07-13 01:49:45 +03:00
Vitaliy Filippov	ac7b834af3	Disable journal_no_same_sector_overwrites by default for HDD-only	2023-07-10 00:34:35 +03:00
Vitaliy Filippov	ee0c78fd74	Fix default HDD block size in docs (actual size is 1 MB)	2023-07-09 13:12:30 +03:00
Vitaliy Filippov	e6646a5b2f	Bump QEMU version to vitastor3	2023-07-09 13:01:04 +03:00
Vitaliy Filippov	ae69662b17	Add "Recommended drives"	2023-07-09 12:59:18 +03:00
Vitaliy Filippov	57ad4c3636	Add a note about HDD, enable throttling only for hybrid OSDs	2023-07-09 12:45:11 +03:00
Vitaliy Filippov	b7e4d0c9bf	Fix journal dirty_start position tracking and some debug prints ... Fixes two bugs found during HDD testing :-) 1) OSD crashed with "BUG: Attempt to overwrite used offset of the journal" during `fio -bs=900k -iodepth=128` test with 16 MB journal 2) OSD stalled during `fio -bs=512k -iodepth=128` test with 64 MB journal	2023-07-09 01:17:55 +03:00
Vitaliy Filippov	161a23c966	Support reloading state when etcd says "revisions were compacted" ... Before this change, OSDs almost always died when one of the etcds was restarted, even though the rest of them was still in quorum and the lease was still active	2023-07-07 01:33:48 +03:00