libmdbx

mirror of https://github.com/isar/libmdbx.git synced 2025-01-09 04:24:12 +08:00

Author	SHA1	Message	Date
Leonid Yuriev	6034985686	mdbx: add `MDBX_ASAN_(UN)POISON_MEMORY_REGION()` macros.	2021-07-16 16:03:49 +03:00
Leonid Yuriev	7da64b725d	mdbx: perform madvise only for the first process opens a DB.	2021-07-16 16:03:49 +03:00
Leonid Yuriev	8aaf5d071b	mdbx: fix `pagecheck()`. Added a check that the data of the BIGDATA node (containing the target page number) is located within the boundaries of the page being checked. The third case of https://github.com/erthink/libmdbx/issues/217.	2021-07-16 15:55:18 +03:00
Leonid Yuriev	b6233ae2e5	mdbx-tools: minor fix/unify error counters.	2021-07-14 10:29:54 +03:00
Leonid Yuriev	fe5f008d39	mdbx-tools: skip iteration & checking records if corresponding tree is corrupted. Hope final for https://github.com/erthink/libmdbx/issues/217	2021-07-14 03:59:56 +03:00
Leonid Yuriev	c8743cb9c4	mdbx: fix null-deref while override invalid meta-pages. Related to https://github.com/erthink/libmdbx/issues/217	2021-07-14 03:59:52 +03:00
Leonid Yuriev	4de2dcebb5	mdbx: increase the `MDBX_READERS_LIMIT` to `32767`. Fixes https://github.com/erthink/libmdbx/issues/219.	2021-07-11 02:44:19 +03:00
Leonid Yuriev	678a80dd19	mdbx: fix hang/shutdown on big-endian platforms without `__cxa_thread_atexit()`. Change-Id: I1bf706abaaf42d5b40751d85ed7c7a83d02acaf5	2021-07-11 02:25:39 +03:00
Leonid Yuriev	c18bf4f898	mdbx: minor clarify `mdbx_mapresize()`.	2021-07-11 02:25:39 +03:00
Leonid Yuriev	728e7f92b2	mdbx: minor fix `mdbx_mresize()` to preserve result code for read-only cases.	2021-07-11 02:25:39 +03:00
Leonid Yuriev	1740043678	mdbx: minimize the size of poisoned/unpoisoned regions to avoid ASAN hangs. More for second case of https://github.com/erthink/libmdbx/issues/217	2021-07-11 02:25:26 +03:00
Leonid Yuriev	891d68838a	mdbx: return `MDBX_TOO_LARGE` under Valgrind/ASAN if being opened DB is 100 larger than RAM. More for second case of https://github.com/erthink/libmdbx/issues/217	2021-07-11 02:25:07 +03:00
Leonid Yuriev	108398c213	mdbx: refine rollback while opening weak/invalid DB. More for https://github.com/erthink/libmdbx/issues/217	2021-07-11 02:24:51 +03:00
Leonid Yuriev	8bdee27248	mdbx: create/refactoring `override_meta()`.	2021-07-11 02:24:51 +03:00
Leonid Yuriev	00c6dc9788	mdbx: re-verify `head` and `steady` meta-pages while opening db by the first process. Basic fix for https://github.com/erthink/libmdbx/issues/217	2021-07-11 02:24:06 +03:00
Leonid Yuriev	fb67682a79	mdbx: refine `mdbx_validate_meta()`.	2021-07-10 17:24:26 +03:00
Leonid Yuriev	5ed50a4739	mdbx: remove `filesize` arg from header/meta read functions (refactoring).	2021-07-10 16:10:30 +03:00
Leonid Yuriev	c30c3def8b	mdbx: the `filesize` field of `mdbx_mmap_t` now is not specific for Windows.	2021-07-10 16:10:30 +03:00
Леонид Юрьев (Leonid Yuriev)	2f74f405ae	mdbx: avoid returning `MDBX_TXN_FULL` error when possible.	2021-07-09 18:29:31 +03:00
Leonid Yuriev	39c5e66ed1	mdbx: fix `safe64_reset()` for platforms without atomic 64-bit compare-and-swap.	2021-07-09 17:44:27 +03:00
Leonid Yuriev	bd2bb51f0f	mdbx++: rework `buffer::silo` to avoid use `std::string`.	2021-07-06 13:45:26 +03:00
Leonid Yuriev	cf5f31c577	mdbx: make `__cold` attribute first (cosmetic).	2021-07-03 01:51:04 +03:00
Leonid Yuriev	fa49e5a57b	mdbx++: rename `slice::from/to_FOO_bytes()` to `slice::envisage_from/to_FOO_length()'.	2021-07-02 21:20:04 +03:00
Leonid Yuriev	5d4281fbbe	mdbx: minor fix spelling.	2021-06-26 18:54:00 +03:00
Leonid Yuriev	a5e10b4ea1	mdbx: minor refine `mdbx_cursor_eof()`.	2021-06-18 01:17:48 +03:00
Leonid Yuriev	b8e621cb2f	mdbx: mdbx: avoid log a warning about empty header during DB creation. Resolve https://github.com/erthink/libmdbx/issues/205.	2021-06-18 01:09:26 +03:00
Leonid Yuriev	5db855d728	mdbx: fix false-negative `mdbx_cursor_eof()` result. Fixes https://github.com/erthink/libmdbx/issues/207.	2021-06-17 21:44:24 +03:00
Leonid Yuriev	d7c06b1337	mdbx: partial fix for recursive SRW-lock with `MDBX_NOTLS` on Windows. Here are some changes to avoid recursive acquisition of SRW-lock, which is still in use: - Read transactions don't acquire the shared SRW-lock with `MDBX_NOTLS. - Memory-mapping of DB is always kept while DB opened, therefore following limitations are: - DB file can't be shrinked while it used, including auto-shrink due to auto-compactification with corresponding geometry settings. - The upper limit of DB size can't be changed while DB is used. - The DB can grow within the upper size limit defined while opening by a first process, but this does not work under Wine since there is no `NtExtendSection()` function. Partially fix https://github.com/erthink/libmdbx/issues/203	2021-06-10 13:42:30 +03:00
Leonid Yuriev	0cd1eac6a8	mdbx: don't check other meta pages if one is specified for verification/recovery. Fixes https://github.com/erthink/libmdbx/issues/202	2021-06-08 20:27:18 +03:00
Leonid Yuriev	f951f246b8	mdbx: allow to predefine/override `MDBX_BUILD_TIMESTAMP` for builds reproducibility. Resolve https://github.com/erthink/libmdbx/issues/201	2021-06-02 14:50:22 +03:00
Leonid Yuriev	ea1fcc2246	mdbx: fix insignificantly Coverity warnings.	2021-05-28 00:54:11 +03:00
Leonid Yuriev	8915db5f83	mdbx-tools: cleanup `MDBX_NOSUBDIR` (needless).	2021-05-28 00:36:24 +03:00
Leonid Yuriev	a7167ce715	mdbx: allow open DB on 9P/WSL2 filesystem in exclusive mode. Related to https://github.com/erthink/libmdbx/issues/97	2021-05-26 21:08:37 +03:00
Leonid Yuriev	3e0c7758ef	mdbx: fallback to non-OFD locks after `EINVAL`. Related to https://github.com/erthink/libmdbx/issues/97	2021-05-26 20:33:55 +03:00
Leonid Yuriev	b0830db25a	mdbx: add `9P` (WSL2 DrvFs) to blacklist of remote filesystems. Related to https://github.com/erthink/libmdbx/issues/97	2021-05-26 20:33:08 +03:00
Leonid Yuriev	bcc546bdfa	mdbx-windows: refix WSL1/WSL2 detection. Refix https://github.com/erthink/libmdbx/issues/97	2021-05-25 15:18:15 +03:00
Leonid Yuriev	6bedb02ac0	mdbx: fix lru-counter overflow by module 2^31. 2 of 2 fixes for https://github.com/erthink/libmdbx/issues/195	2021-05-20 17:42:22 +03:00
Leonid Yuriev	bc6a690733	mdbx: simplify & fix `mdbx_txn_keep()` and `mdbx_cursor_keep()`. 1 of 2 fixes for https://github.com/erthink/libmdbx/issues/195	2021-05-20 15:10:38 +03:00
Leonid Yuriev	84b699a47c	mdbx: fix `elsif` typo.	2021-05-18 22:44:31 +03:00
Leonid Yuriev	841fc15dd3	mdbx: little more likely/unlikely.	2021-05-12 19:24:19 +03:00
Leonid Yuriev	0875d16656	mdbx: fix/refine `mdbx_env_info_ex()` to distinguish a not-available and overflow cases for returned timestamps.	2021-05-12 17:51:31 +03:00
Leonid Yuriev	9c7c709b3e	mdbx: avoid underflow during monotime/16dot16 conversion.	2021-05-12 17:44:18 +03:00
Leonid Yuriev	c5268f1da7	mdbx-tools: add support of page operations stat to `mdbx_stat`.	2021-05-12 14:41:09 +03:00
Leonid Yuriev	16d686bc42	mdbx: account msync/fsync write in page operations.	2021-05-12 14:40:58 +03:00
Leonid Yuriev	137f80e177	mdbx: refile rollback-writes inside `mdbx_setup_dxb()`.	2021-05-12 14:40:58 +03:00
Leonid Yuriev	7d8099fc77	mdbx: refine `mdbx_wipe_steady()`.	2021-05-12 14:40:58 +03:00
Leonid Yuriev	5731ad11c8	mdbx: don't use bool flags for `mdbx_msync()`.	2021-05-12 14:40:58 +03:00
Leonid Yuriev	76b9cb5dcc	mdbx-tools: minor refine built-in usage/help.	2021-05-12 11:33:25 +03:00
Leonid Yuriev	9746dd20df	mdbx-tools: refine/fix `quiet` mode.	2021-05-12 11:33:25 +03:00
Leonid Yuriev	ebab75642e	mdbx: add public `MDBX_MAYBE_UNUSED`. This also should fix C++ mdbx API build by MSVC 2015.	2021-05-11 21:07:40 +03:00
Leonid Yuriev	ed58ff9f81	mdbx++: add `[[maybe_unused]]` to internal functions which depends on platform and compiler features.	2021-05-11 16:53:47 +03:00
Leonid Yuriev	2071958f35	mdbx: remove extra notice/debug logging.	2021-05-11 00:24:01 +03:00
Leonid Yuriev	4fee14d1cf	mdbx: logging all reasons of `MDBX_PROBLEM`. Related to https://github.com/erthink/libmdbx/issues/195	2021-05-10 16:15:58 +03:00
Leonid Yuriev	244fab6c04	mdbx: fix extra conversion of an error during nested dupsort-DB update to `MDBX_PROBLEM`. Hope this fixes https://github.com/erthink/libmdbx/issues/195	2021-05-10 16:15:03 +03:00
Leonid Yuriev	74ea79ac1b	mdbx: minor reorder/shrink transaction fields.	2021-05-10 16:05:19 +03:00
Leonid Yuriev	0d100a898f	mdbx: minor more `const`.	2021-05-10 15:53:07 +03:00
Леонид Юрьев (Leonid Yuriev)	aa1f6fbd5f	mdbx: release v0.10.0 Acknowledgements: ----------------- - [Mahlon E. Smith](https://github.com/mahlonsmith) for [Ruby bindings](https://rubygems.org/gems/mdbx/). - [Alex Sharov](https://github.com/AskAlexSharov) for [mdbx-go](https://github.com/torquem-ch/mdbx-go), bug reporting and testing. - [Artem Vorotnikov](https://github.com/vorot93) for bug reporting and PR. - [Paolo Rebuffo](https://www.linkedin.com/in/paolo-rebuffo-8255766/), [Alexey Akhunov](https://github.com/AlexeyAkhunov) and Mark Grosberg for donations. - [Noel Kuntze](https://github.com/Thermi) for preliminary [Python bindings](https://github.com/Thermi/libmdbx/tree/python-bindings) New features: ------------- - Added `mdbx_env_set_option()` and `mdbx_env_get_option()` for controls various runtime options for an environment (announce of this feature was missed in a previous news). - Added `MDBX_DISABLE_PAGECHECKS` build option to disable some checks to reduce an overhead and detection probability of database corruption to a values closer to the LMDB. The `MDBX_DISABLE_PAGECHECKS=1` provides a performance boost of about 10% in CRUD scenarios, and conjointly with the `MDBX_ENV_CHECKPID=0` and `MDBX_TXN_CHECKOWNER=0` options can yield up to 30% more performance compared to LMDB. - Using float point (exponential quantized) representation for internal 16-bit values of grow step and shrink threshold when huge ones (https://github.com/erthink/libmdbx/issues/166). To minimize the impact on compatibility, only the odd values inside the upper half of the range (i.e. 32769..65533) are used for the new representation. - Added the `mdbx_drop` similar to LMDB command-line tool to purge or delete (sub)database(s). - [Ruby bindings](https://rubygems.org/gems/mdbx/) is available now by [Mahlon E. Smith](https://github.com/mahlonsmith). - Added `MDBX_ENABLE_MADVISE` build option which controls the use of POSIX `madvise()` hints and friends. - The internal node sizes were refined, resulting in a reduction in large/overflow pages in some use cases and a slight increase in limits for a keys size to ≈½ of page size. - Added to `mdbx_chk` output number of keys/items on pages. - Added explicit `install-strip` and `install-no-strip` targets to the `Makefile` (https://github.com/erthink/libmdbx/pull/180). - Major rework page splitting (af9b7b560505684249b76730997f9e00614b8113) for - An "auto-appending" feature upon insertion for both ascending and descending key sequences. As a result, the optimality of page filling increases significantly (more densely, less slackness) while inserting ordered sequences of keys, - A "splitting at middle" to make page tree more balanced on average. - Added `mdbx_get_sysraminfo()` to the API. - Added guessing a reasonable maximum DB size for the default upper limit of geometry (https://github.com/erthink/libmdbx/issues/183). - Major rework internal labeling of a dirty pages (958fd5b9479f52f2124ab7e83c6b18b04b0e7dda) for a "transparent spilling" feature with the gist to make a dirty pages be ready to spilling (writing to a disk) without further altering ones. Thus in the `MDBX_WRITEMAP` mode the OS kernel able to oust dirty pages to DB file without further penalty during transaction commit. As a result, page swapping and I/O could be significantly reduced during extra large transactions and/or lack of memory. - Minimized reading leaf-pages during dropping subDB(s) and nested trees. - Major rework a spilling of dirty pages to support [LRU](https://en.wikipedia.org/wiki/Cache_replacement_policies#Least_recently_used_(LRU)) policy and prioritization for a large/overflow pages. - Statistics of page operations (split, merge, copy, spill, etc) now available through `mdbx_env_info_ex()`. - Auto-setup limit for length of dirty pages list (`MDBX_opt_txn_dp_limit` option). - Support `make options` to list available build options. - Support `make help` to list available make targets. - Silently `make`'s build by default. - Preliminary [Python bindings](https://github.com/Thermi/libmdbx/tree/python-bindings) is available now by [Noel Kuntze](https://github.com/Thermi) (https://github.com/erthink/libmdbx/issues/147). Backward compatibility break: ----------------------------- - The `MDBX_AVOID_CRT` build option was renamed to `MDBX_WITHOUT_MSVC_CRT`. This option is only relevant when building for Windows. - The `mdbx_env_stat()` always, and `mdbx_env_stat_ex()` when called with the zeroed transaction parameter, now internally start temporary read transaction and thus may returns `MDBX_BAD_RSLOT` error. So, just never use deprecated `mdbx_env_stat()' and call `mdbx_env_stat_ex()` with transaction parameter. - The build option `MDBX_CONFIG_MANUAL_TLS_CALLBACK` was removed and now just a non-zero value of the `MDBX_MANUAL_MODULE_HANDLER` macro indicates the requirement to manually call `mdbx_module_handler()` when loading libraries and applications uses statically linked libmdbx on an obsolete Windows versions. Fixes: ------ - Fixed performance regression due non-optimal C11 atomics usage (https://github.com/erthink/libmdbx/issues/160). - Fixed "reincarnation" of subDB after it deletion (https://github.com/erthink/libmdbx/issues/168). - Fixed (disallowing) implicit subDB deletion via operations on `@MAIN`'s DBI-handle. - Fixed a crash of `mdbx_env_info_ex()` in case of a call for a non-open environment (https://github.com/erthink/libmdbx/issues/171). - Fixed the selecting/adjustment values inside `mdbx_env_set_geometry()` for implicit out-of-range cases (https://github.com/erthink/libmdbx/issues/170). - Fixed `mdbx_env_set_option()` for set initial and limit size of dirty page list ((https://github.com/erthink/libmdbx/issues/179). - Fixed an unreasonably huge default upper limit for DB geometry (https://github.com/erthink/libmdbx/issues/183). - Fixed `constexpr` specifier for the `slice::invalid()`. - Fixed (no)readahead auto-handling (https://github.com/erthink/libmdbx/issues/164). - Fixed non-alloy build for Windows. - Switched to using Heap-functions instead of LocalAlloc/LocalFree on Windows. - Fixed `mdbx_env_stat_ex()` to returning statistics of the whole environment instead of MainDB only (https://github.com/erthink/libmdbx/issues/190). - Fixed building by GCC 4.8.5 (added workaround for a preprocessor's bug). - Fixed building C++ part for iOS <= 13.0 (unavailability of `std::filesystem::path`). - Fixed building for Windows target versions prior to Windows Vista (`WIN32_WINNT < 0x0600`). - Fixed building by MinGW for Windows (https://github.com/erthink/libmdbx/issues/155). TODO for a next releases: ------------------------- - [Get rid of dirty-pages list in MDBX_WRITEMAP mode](https://github.com/erthink/libmdbx/issues/193). - [Large/Overflow pages accounting for dirty-room](https://github.com/erthink/libmdbx/issues/192). - [C++ Buffer issue](https://github.com/erthink/libmdbx/issues/191). - Finalize C++ API (few typos and trivia bugs are still likely for now). - [Support for RAW devices](https://github.com/erthink/libmdbx/issues/124). - [Test framework issue](https://github.com/erthink/libmdbx/issues/127). - [Support MessagePack for Keys & Values](https://github.com/erthink/libmdbx/issues/115). - [Engage new terminology](https://github.com/erthink/libmdbx/issues/137). - Packages for [Astra Linux](https://astralinux.ru/), [ALT Linux](https://www.altlinux.org/), [ROSA Linux](https://www.rosalinux.ru/), Fedora/RHEL, Debian/Ubuntu.	2021-05-09 03:01:59 +03:00
Leonid Yuriev	43f1823cdc	mdbx: minor alignment fix for lck-less stub to avoid false-positive alarm from UndefinedBehaviorSanitize. Change-Id: I8d9bc00ccfc7228cb42f9419cf77e8eadb92f918	2021-05-08 22:43:16 +03:00
Leonid Yuriev	e75033b1f4	mdbx: drop some unused stuff. Change-Id: I136dcf891757d5c1a35a8082ee90e8cf07c016c6	2021-05-08 18:40:14 +03:00
Leonid Yuriev	ecd3c06932	mdbx-windows: remove `MDBX_CONFIG_MANUAL_TLS_CALLBACK` build option and add `MDBX_MANUAL_MODULE_HANDLER` macro. Briefly: - Now constructor/destructor of "Thread Local Storage" handled automatically when possible. - Otherwise the MDBX_CONFIG_MANUAL_TLS_CALLBACK macro defined to 1 to indicate that mdbx_module_handle() should be called manually. - Corresponding build option MDBX_CONFIG_MANUAL_TLS_CALLBACK was removed. Related to https://github.com/erthink/libmdbx/issues/155 Change-Id: Ic4e6a34b44f874676f0ab212ff473460e3d80559	2021-05-08 18:39:18 +03:00
Leonid Yuriev	11a521f10a	mdbx-windows: minor fix `mdbx_free()` for `MDBX_WITHOUT_MSVC_CRT=ON`. Related to https://github.com/erthink/libmdbx/issues/155 Change-Id: I378d9c47b51c55e1e61bc7f6269cbc8182265870	2021-05-08 18:38:53 +03:00
Leonid Yuriev	5ae120af80	mdbx-windows: more crutches for MinGW. More for https://github.com/erthink/libmdbx/issues/155 Change-Id: I7de6122ff160372b2dcfd2a0a26e332cb52d0560	2021-05-08 18:38:44 +03:00
Leonid Yuriev	33e8b19ea4	mdbx-windows: check `_WIN32_WINNT` definition. Related to https://github.com/erthink/libmdbx/issues/155 Change-Id: I49c294bd0fa055026b742a12a6f6ea9cd805cf02	2021-05-08 18:38:36 +03:00
Leonid Yuriev	ab1fc94a5b	mdbx-windows: fix build for Windows XP/2000 (`_WIN32_WINNT` < 0x0600). Related to https://github.com/erthink/libmdbx/issues/155 Change-Id: Ibd795817e05b6da39ef270ce7b55b31d963d07b0	2021-05-08 18:38:26 +03:00
Leonid Yuriev	c15ad25073	mdbx: add minor workaround for E2K LCC's bug. Related to https://bugs.mcst.ru/bugzilla/show_bug.cgi?id=6011 Change-Id: I562dbcedb3c172e0646dcb03ef6d5cd3f14e02b9	2021-05-07 19:05:10 +03:00
Leonid Yuriev	a14d6bcb11	mdbx: fix mis-defined `MDBX_FORCE_ASSERTIONS`. Change-Id: I6f7ad4fdd6aca99a4f908d634af0015a6e95c0d1	2021-05-06 17:03:57 +03:00
Leonid Yuriev	1275bdb623	mdbx: add `MDBX_opt_merge_threshold_16dot16_percent` option. Change-Id: I416f85096e4b6fd21f2db622f07f31103cb9074a	2021-05-06 02:05:33 +03:00
Leonid Yuriev	7d54518d60	mdbx: add workaround for GCC 4.8 preprocessor bug. Change-Id: I965cfbcd43596ef896a6b849dd043804bdb3f41f	2021-05-03 15:00:53 +03:00
Leonid Yuriev	d6e67e3982	mdbx: minor retine `options.h` Change-Id: Ic340e6cea25df3e5dddf920ba851e39e714033e0	2021-05-03 15:00:53 +03:00
Leonid Yuriev	c914d417d2	mdbx: refine Doxygen's API description. Change-Id: Ifd326eded287c68c6a95b6c9be22847d6efa5678	2021-05-03 15:00:53 +03:00
Leonid Yuriev	df387ad943	mdbx: fix minor MSVC warnings. Change-Id: I9a2c774f6020bbe5c77e423a1f54110b12bdcb41	2021-05-02 17:11:50 +03:00
Leonid Yuriev	732d3cd2d4	mdbx: fix/rework `mdbx_env_stat_ex()` to return stat of the whole env. Resolves https://github.com/erthink/libmdbx/issues/190 Included fix for the first version of this change. Change-Id: I8357de24fda2ab4c93510574055b52d6e16b0c15	2021-05-02 17:10:37 +03:00
Leonid Yuriev	a56c72d190	mdbx: minor refine internal audit. Change-Id: I0e177e9c9ecf1da97084c175f80b3e987391194c	2021-05-02 15:14:30 +03:00
Leonid Yuriev	9ba8d5892a	mdbx-tools: avoid use `mdbx_env_stat_ex()`. Change-Id: I484ead640967b3a6caa3c2536983a34956ae1827	2021-05-01 21:20:18 +03:00
Leonid Yuriev	fe04c98327	mdbx-tools: cosmetic refine `mdbx_chk`. Change-Id: I815baf437d9e0af3c78f9df717b0fb669863993c	2021-05-01 20:40:52 +03:00
Leonid Yuriev	0054f5388a	mdbx-windows: use Heap-functions instead of LocalAlloc/LocalFree. Change-Id: I85f8a4c888bf98f4792f2a5e522d24ee671f060c	2021-04-30 02:24:36 +03:00
Leonid Yuriev	161b00a4b6	mdbx: refine/rearrange build options. Change-Id: Ic27bf2b1f22e7ed9e6a1db9a1ed2496b1bb1239b	2021-04-30 02:01:22 +03:00
Leonid Yuriev	6b6165cdeb	mdbx: rename internal defines/macros to distinguish it from build options. Change-Id: I42fe240e6ddd5d34c8fec38633849ebdcce0e116	2021-04-30 01:59:48 +03:00
Leonid Yuriev	d27e48ae1b	mdbx-windows: rename `MDBX_AVOID_CRT` build option to `MDBX_DISABLE_MSVC_CRT`. Change-Id: I124c9d86d4a596718bd9671a7c1b538b84c2dd0f	2021-04-30 01:59:48 +03:00
Leonid Yuriev	c3b2c1fdef	mdbx: handling the case when all dirty pages are unspillable. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Iff7a123c1c171371624d8b7ae497941ec4622385	2021-04-28 23:38:41 +03:00
Leonid Yuriev	aa5a39160a	mdbx: internal build option for debuging dirtyroom reservation and spilling. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Ia315ae2cae5f5b5b82891843de22487db0139df3	2021-04-28 23:38:38 +03:00
Leonid Yuriev	39230c9a22	mdbx: more debug/loggin for LRU spilling. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Ifcfabf8864830adf3c50fe8d01d24cccb950dcbb	2021-04-28 23:38:34 +03:00
Leonid Yuriev	9fed78c92d	mdbx: fix LRU spilling internal prio celling. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Ia4be12e063d1754a38889dc311eb1314b3676c21	2021-04-28 23:38:32 +03:00
Leonid Yuriev	329a2a50e6	mdbx: account loose-pages during spilling and do purge ones if a lack of dirtyroom. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: I50c11195ad31615181f8359e123c1ffe2ebcfc30	2021-04-28 23:38:29 +03:00
Leonid Yuriev	17116b9b46	mdbx: raise `MDBX_TXN_FULL` if spilled less that half of needed. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: I3c1a0e1bea6b6ad9bf41347a569e5833e82d8edc	2021-04-28 23:38:26 +03:00
Leonid Yuriev	e57e42d0f8	mdbx: use single pointer to lck-less stub. Change-Id: I80542423386bd54cac574d1678af2620f147c769	2021-04-28 23:38:26 +03:00
Leonid Yuriev	7d249c97ad	mdbx: double dirtyroom reserve for page stack. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: I211fc9c849c9a45254e699d713475898fd20a58e	2021-04-28 23:38:24 +03:00
Leonid Yuriev	4111d7238c	mdbx: spill pages during prepare backlog for `update_gc()`. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: I88463a860da0a53420904daf1b1f39e5ca4c97e5	2021-04-28 23:38:21 +03:00
Leonid Yuriev	760cf515a7	mdbx: minor refactoring `cursor_put()`. Change-Id: Iacdc02f70278382bf0e7fb496bb57f4010403dd0	2021-04-28 23:38:21 +03:00
Leonid Yuriev	7cbd500534	mdbx: minor simplify dirtyroom accounting. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Ia0afcffe5a245aaa9500edc70b2cbca1735070ac	2021-04-28 23:38:19 +03:00
Leonid Yuriev	89558657ea	mdbx: auto-setup `MDBX_opt_txn_dp_limit`. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: I8f8c4f1a2600462bc25b4fad3010a4e6ac70b386	2021-04-28 23:38:16 +03:00
Leonid Yuriev	6134220b8a	mdbx: drop `P_KEEP` flag and use LRU-label insted of. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Ifd3bd2533b40525dd5b0aa05df421c87462c2439	2021-04-28 23:37:48 +03:00
Leonid Yuriev	975413b48d	mdbx: more for page operation statistics. Change-Id: I19fc26dfc9f9627eecc8d505e95d33bad76f2b2f	2021-04-27 18:19:13 +03:00
Leonid Yuriev	f95a277ac5	mdbx: statistics of page operations. Related to https://github.com/erthink/libmdbx/issues/186 Change-Id: Ia00e6e0df9a65f880517ca33e7f444a0526b96e1	2021-04-27 18:02:11 +03:00
Leonid Yuriev	3bbf5d03e2	mdbx: lowering the logging level for page unspill. Change-Id: I03f9bdaa644534d1c1e257e0394549c90a56d612	2021-04-27 16:58:35 +03:00
Leonid Yuriev	13a784eeed	mdbx: rearrange `MDBX_env` ro/rw fields. Change-Id: I055aa6ad592930be2d5d676977fbaa84149472ce	2021-04-27 16:58:31 +03:00
Leonid Yuriev	8b95be91db	mdbx: fix minor Coverity warnings. Change-Id: Id6ab528b597e62b05b5fc4ab87bbe93cbce6573c	2021-04-27 00:12:09 +03:00
Leonid Yuriev	427b480f68	mdbx: add `MDBX_FAKE_SPILL_WRITEMAP` build option. Change-Id: I2c7f9267b0e725674b8bc73547bedd8478231948	2021-04-26 18:18:51 +03:00
Leonid Yuriev	4fa5e95241	mdbx: LRU spilling feature (squashed). Resolves https://github.com/erthink/libmdbx/issues/186 Change-Id: Ie3318964e4e2adbeb77738b8301c45075080850b	2021-04-26 17:51:11 +03:00
Leonid Yuriev	3e272d339a	mdbx: drop `mdbx_dpl_find()` and always promote child LRU-serial to the parent txn. More for https://github.com/erthink/libmdbx/issues/186 Change-Id: Ifeac634e9fa1dee6e2b3375c868cc0fa16422099	2021-04-26 14:08:30 +03:00
Leonid Yuriev	31cfce4ca5	mdbx: fix minor MSVC warnings. Change-Id: I99ab0855334c01796c57f13142127d184ab1291e	2021-04-26 10:56:18 +03:00
Leonid Yuriev	66e5078e28	mdbx: refine `page_touch()` and `dirtyroom` checking. More for https://github.com/erthink/libmdbx/issues/186 Change-Id: I81a6d94e64a60ccb642d0297a9afb2abddf51c49	2021-04-26 02:47:25 +03:00
Leonid Yuriev	f29283a620	mdbx: merge branch `master` into `devel`. Change-Id: I0568e92101e8e3ddf3572c6973542752cd1c235d	2021-04-26 02:08:03 +03:00
Leonid Yuriev	4583f4bc8c	mdbx-windows: minor fix assertion inside `mdbx_suspend_threads_before_remap()`. Change-Id: I2026f8400aea3d7c0763556be3925206d8485684	2021-04-26 02:06:28 +03:00
Leonid Yuriev	55f41f40a1	mdbx: rename `log2n_powerof2()`. Change-Id: I22290630186c5041b6ae242d0db1f5c5f36da4ec	2021-04-26 02:06:28 +03:00
Leonid Yuriev	d1fea74d0e	mdbx: preparation for LRU-spilling. Initial for https://github.com/erthink/libmdbx/issues/186 Change-Id: I9a6d60cc142ff7490e2a23defe9654d7e3337edc	2021-04-26 02:06:01 +03:00
Leonid Yuriev	934ca25ab2	mdbx: fix `MDBX_EACCESS` from `mdbx_env_set_option()` if env not yet opened. Change-Id: I0da15b71919a1787e5cc54441b5e41941afabf66	2021-04-26 00:52:47 +03:00
Leonid Yuriev	b21ad733ea	mdbx: refine `cursor_copy()`, add `cursor_restore()`. Change-Id: I3ac5883c95aaa0e13970a8176f0af5e374d811a1	2021-04-23 16:06:23 +03:00
Leonid Yuriev	9b80da87f0	mdbx-docs: update bits.md Change-Id: Id6cfd9579f31b862f3dc0069862019d08f363f9e	2021-04-23 16:06:23 +03:00
Leonid Yuriev	0b9272209a	mdbx: minor refine spilling. Change-Id: I243ebff592ac7ad544bbd382c93d2e5d4444b081	2021-04-23 16:04:35 +03:00
Leonid Yuriev	416a802789	mdbx: add missing err-log for `MDBX_TXN_FULL` during page allocation. Minor for https://github.com/erthink/libmdbx/issues/186 Change-Id: Iadb868c64fba4e9d5a4ee7df093f0cfb9288bf93	2021-04-21 13:24:54 +03:00
Leonid Yuriev	aaf465b942	mdbx: add missing err-log for `MDBX_TXN_FULL` during page allocation. Change-Id: Iadb868c64fba4e9d5a4ee7df093f0cfb9288bf93	2021-04-21 12:20:32 +03:00
Leonid Yuriev	c2d8c35daa	mdbx: the radix-sort threshold reduced to 333. Change-Id: Ic69b6c3740f71997cd014a82fb32a8202ddb65e0	2021-04-21 00:13:57 +03:00
Leonid Yuriev	eabb29d9c4	mdbx: add `MDBX_xPL_PREALLOC_FOR_RADIXSORT` build options. Change-Id: Icf15558830f86f98c5e970a7eec69cc045045467	2021-04-21 00:13:51 +03:00
Leonid Yuriev	3b5e2680e9	mdbx: fix non-alloy build for windows. Change-Id: Id93eb069543f081c3b1c9734ed65f4afd80a444d	2021-04-20 22:09:48 +03:00
Leonid Yuriev	7a0d6c6196	mdbx: use `POSIX_MADV_DONTNEED`. Change-Id: I2020eb8ec225a49331cf4dc6c5a24d6559916284	2021-04-20 22:09:48 +03:00
Leonid Yuriev	b3b6a48797	mdbx: fix minor warning on Solaris/SunOs.	2021-04-20 22:09:48 +03:00
Leonid Yuriev	b7110eb4d4	mdbx: fix non-alloy build for windows. Change-Id: Id93eb069543f081c3b1c9734ed65f4afd80a444d	2021-04-20 15:17:51 +03:00
Leonid Yuriev	c0704db03a	mdbx: use `POSIX_MADV_DONTNEED`. Change-Id: I2020eb8ec225a49331cf4dc6c5a24d6559916284	2021-04-20 15:17:51 +03:00
Leonid Yuriev	e82359bca0	mdbx: fix minor warning on Solaris/SunOs.	2021-04-20 15:17:51 +03:00
Leonid Yuriev	dc4ab96d4d	mdbx-tools: fix `mdbx_drop` help/usage message. Change-Id: I100daa14641eaa351930034ba8806a7e82085289	2021-04-20 15:17:51 +03:00
Leonid Yuriev	bedd13d411	mdbx-tools: minor fix error messages. Change-Id: Id2efb3db70b5df49e84bc9a8bb47645afe0eb187	2021-04-20 15:17:51 +03:00
Leonid Yuriev	17d8ed4bad	mdbx-tools: fix `mdbx_drop` help/usage message. Change-Id: I100daa14641eaa351930034ba8806a7e82085289	2021-04-18 19:28:22 +03:00
Leonid Yuriev	aa58498d23	mdbx-tools: minor fix error messages. Change-Id: Id2efb3db70b5df49e84bc9a8bb47645afe0eb187	2021-04-18 19:26:15 +03:00
Leonid Yuriev	4cf8496422	mdbx: avoid read leaf-pages during dropping trees. Change-Id: Ib8034a76a150c213fddcca0f7df971f63253b7a5	2021-04-18 19:20:16 +03:00
Leonid Yuriev	d1561dc357	mdbx: refactoring `page_alloc()` result type. Change-Id: I4afc73603d610e4e28b952a38dfa9f30d56809bf	2021-04-18 10:24:22 +03:00
Leonid Yuriev	3f6758e18d	mdbx: minor refactoring `mdbx_cursor_set()`. Change-Id: If3c984fb5ac2f77762501ac720080e2caaacac3c	2021-04-18 10:24:22 +03:00
Leonid Yuriev	b59836e6d9	mdbx: minor refactoring: use cursor_set_result. Change-Id: Ice724c541bc4127aae0e9ea85b4fc1d7c1b68471	2021-04-18 10:24:22 +03:00
Leonid Yuriev	3eb48340ad	mdbx: minor refactoring: use node_result. Change-Id: I489b15c174644b2f414925f5bacbe83c091a0692	2021-04-18 10:24:22 +03:00
Leonid Yuriev	b3aba4691b	mdbx: minor refactoring: use page_result. Change-Id: I7749d9463832ce9b270d06f04f43e413d5ba26b7	2021-04-18 10:24:22 +03:00
Leonid Yuriev	e4db019f47	mdbx: minor refine `cursor_set_ex()`. Change-Id: I0951a917c1e4c9e372f29c64fda0e1b267f48cdd	2021-04-18 10:24:22 +03:00
Leonid Yuriev	dc7098b3fb	mdbx: minor refine `page_new()`. Change-Id: Iafdea1c592c346c7841a39cdfc96436460b27bcb	2021-04-18 10:24:22 +03:00
Leonid Yuriev	6d3ff10165	mdbx: simplify `page_unspill()`. Change-Id: Iaa182d1feaf2abb59015725f000a3d9e0c57de8d	2021-04-18 10:24:22 +03:00
Leonid Yuriev	3622433cf4	mdbx: fix `page_copy()` for unspilling a large/overflow page. Change-Id: I46c6b6bf94c877c1c0142116c404692960dc5ab7	2021-04-18 10:24:22 +03:00
Leonid Yuriev	9c9cdfdb6d	mdbx: minor fix `mdbx_is_dirty()`. Change-Id: Ia539165ddd62a40e13fdfec48de754961681d40f	2021-04-18 10:24:22 +03:00
Leonid Yuriev	a0a4bbaa7c	mdbx: drop goto/label in prev commit. More for https://github.com/erthink/libmdbx/issues/164 Change-Id: Ic708c3ba51dd22d08e96d0bef4632a0beb19999b	2021-04-18 10:24:11 +03:00
Leonid Yuriev	3e0fad1cf6	mdbx: rework (NO)READAHEAD handling. Resolves https://github.com/erthink/libmdbx/issues/164 --- NOTE: Seems there is a bug in the Mach/Darwin/OSX kernel, because MADV_WILLNEED with offset != 0 may cause SIGBUS on following access to the hinted region. 19.6.0 Darwin Kernel Version 19.6.0: Tue Jan 12 22:13:05 PST 2021; root:xnu-6153.141.16~1/RELEASE_X86_64 x86_64 Change-Id: I11ebbf2bd35e3dba9d078be16cb5678aecf8329c	2021-04-17 01:12:16 +03:00
Leonid Yuriev	958fd5b947	mdbx: use `mp_txnid` instead of `P_DIRTY` (squashed). Change-Id: I7e3174611b8819d8050b84d835fe976b87c77c0c	2021-04-14 19:27:13 +03:00
Leonid Yuriev	f587a74597	mdbx: drop `mx_dbistate`. Change-Id: I61616ee1436ed99db93a1036c9bb7d4db7157c8f	2021-04-14 00:26:14 +03:00
Leonid Yuriev	5e334fa830	mdbx: extract `mdbx_touch_dbi()`. Change-Id: I3b077cefe44f4c2db099b2050e1fd72a1aaa2687	2021-04-14 00:25:15 +03:00
Leonid Yuriev	f9977975ae	mdbx: remove extra `TXN_DBI_CHANGED()` check. Change-Id: If2014f7bfbfab98f3c0c357f2475da57efc50693	2021-04-14 00:23:36 +03:00
Leonid Yuriev	e35c92eabb	mdbx: refine `mdbx_page_new()`. Change-Id: Ief0cb313c39f7b11fb1cd611d9b0497c011a7a7a	2021-04-14 00:19:34 +03:00
Leonid Yuriev	49296cad14	mdbx: refactor `mdbx_drop_tree()` & drop `mdbx_retire pgno()`. Change-Id: I37f33d7a11e958ccc1c48a6af31599deb677038d	2021-04-10 22:20:31 +03:00
Leonid Yuriev	dfed1dbc17	mdbx: refactoring: merge `page_retire()` and `page_loose()`. Change-Id: I4b47c11eedad6ef1b83dbf3d34977cdd8fa79505	2021-04-10 22:20:24 +03:00
Leonid Yuriev	20299f87cb	mdbx: minor refine `get_reasonable_db_maxsize()`. Change-Id: I5d654940a325c0c3966a59a37615820587c52c78	2021-04-10 17:48:31 +03:00
Leonid Yuriev	7f5cbf7dd8	mdbx: avoid float-point ops in prev commit. Change-Id: I7fadc5096f49502c01a60436840bb1a87dfe27bd	2021-04-07 14:29:14 +03:00
Leonid Yuriev	c14e4235ee	mdbx: guess a reasonable maximum DB size for the default upper limit of geometry. Fixes https://github.com/erthink/libmdbx/issues/183 Change-Id: Ic7b616e229d3008fda49e5a04121e22997ac53ea	2021-04-07 05:23:06 +03:00
Leonid Yuriev	8ff44026c3	mdbx: fix minor MSVC warning. Change-Id: Ia7ec726b8a516d2115b727960cf7fbc874882cd4	2021-04-07 04:52:38 +03:00
Leonid Yuriev	024ccf6826	mdbx: extract `mdbx_get_sysraminfo()`. Change-Id: I8821009572d275a3b5d2d8729f605b115a80e50a	2021-04-07 04:45:53 +03:00
Leonid Yuriev	6ee62650af	mdbx: add comment for `unsure_equal()`. Change-Id: I0629b5cd4812415c3a240047ec4202f33dddd189	2021-03-30 01:41:34 +03:00
Leonid Yuriev	66df21ba78	mdbx: add a TODO/FIXME note (first r/w opening while r/o present). Change-Id: I5351628aa22313fffd6c2501a2aa16f2c5f573d5	2021-03-30 01:38:24 +03:00
Leonid Yuriev	4f62b059ef	mdbx: minor clarify TODO (configurable threshold to keep reserve space for large/overflow pages). Change-Id: I73a3847852466eb3e34927c5648435c8cf283c0e	2021-03-30 01:34:46 +03:00
Leonid Yuriev	af9b7b5605	mdbx: MAJOR rework page splitting (squashed). Basically, this (squashed) commit introduces: - An "auto-appending" feature upon insertion for both ascending and descending key sequences. As a result, the optimality of page filling increases significantly (more densely, less slackness) while inserting ordered sequences of keys, - A "splitting at middle" for more balanced page tree on average. --- 1. Using left/middle/right tactics for finding the split point of a page: - If a key is inserted close to an edge of page, then the page splits at that edge; - Otherwise a page splits at the middle, which leads to a more balanced tree on average; - So I expect a better behavior on average, but actually effects should be studied further practically. 2. New code for calculating the midpoint of a page split. 3. APPEND-flags no longer affect choosing the page split point. 4. Added left-side splitting by inserting a pure page with a new entry. Change-Id: Id7441acfc8c90636e3be6bc00a0df15714690f3c	2021-03-29 00:49:34 +03:00
Leonid Yuriev	e0795227e4	mdbx: merge branch `master` into `devel`. Change-Id: Ic78177f8bc5ab3dc1826e4e00599f1a7d3087dda	2021-03-29 00:00:43 +03:00
Leonid Yuriev	3ed99f8c20	mdbx: minor refine/fix `cursor_check()` internals. Change-Id: I89ea9a5336b88e7d0201a7f59d66a8bc53849172	2021-03-28 23:34:41 +03:00
Leonid Yuriev	636c212235	mdbx: minor refine `page_check()`. Change-Id: I91cae256c47064422d26663078c8c5a6f619a197	2021-03-28 23:34:41 +03:00
Leonid Yuriev	83cd4f7d58	mdbx: separete `DKBUF` and `DKBUF_DEBUG`. Change-Id: I8d90909ce9c5faec176a12e68f7bab6c2ea1d317	2021-03-28 23:34:41 +03:00
Leonid Yuriev	bfc9921305	mdbx: change branch-node size to ~1/2 of the page size. Change-Id: I0f455ec04170d792ecc933aa501b4ec1ca9b08c0	2021-03-28 23:34:41 +03:00
Leonid Yuriev	72f3a2fc3f	mdbx: check zero-size of the first key on a branch-page. Change-Id: I2be86ea79f04ea8baea92a6e56ef6b22691eeda0	2021-03-28 22:25:40 +03:00
Leonid Yuriev	3c389d17e8	mdbx: minor refine `page_rebalance()`. Change-Id: I066e7a22d62c45f9e80fb4735f55f02ca34d3ee3	2021-03-28 22:25:30 +03:00
Leonid Yuriev	2524a0e749	mdbx: output page type from `bad_page()`. Change-Id: I11e4931de26015204c26c116e91e4a0e02f909b4	2021-03-28 22:25:24 +03:00
Leonid Yuriev	8d3b878965	mdbx: fix minor spelling. Change-Id: Ibab66dc18c92b0ac4fa705e10befb34e268ee1f7	2021-03-28 22:25:17 +03:00
Leonid Yuriev	9e5fe2c61d	mdbx-tools: add to `mdbx_chk` output the number of keys/entries from a pages. Change-Id: I7c2d779fa89848287f8b5a0fa1ff2fc89c5a9b8c	2021-03-28 22:24:56 +03:00
Leonid Yuriev	c77494e2aa	mdbx: fix `mdbx_env_set_option()` for dp_initial & dp_limit. Fixes https://github.com/erthink/libmdbx/issues/179 Change-Id: I925104a45148112e0ce94a069a7468e2b4fc8209	2021-03-24 19:27:31 +03:00
Leonid Yuriev	422d030820	mdbx: fix minor casting warning. Change-Id: I9615b3928bb1b88743b42be9d82a986255d1f074	2021-03-19 03:16:47 +03:00
Leonid Yuriev	b3798a9116	mdbx: `mdbx_node_search()` micro-optimization. Change-Id: I48064ca284aa89b16e418afdc20d09c5dd6e5cba	2021-03-19 00:17:14 +03:00
Leonid Yuriev	cb0ee2373d	mdbx: add `mdbx_cursor_set_ex()` with non-optional `exactp` argument. Resolves https://github.com/erthink/libmdbx/pull/178 Change-Id: I24dc7d44116b5e2e02b5b75375be24c647a762f5	2021-03-18 23:15:55 +03:00
Leonid Yuriev	d0b3c45f04	mdbx: refine `check_dbi()`. Change-Id: I6d51c27c3acdea1b93861f67a32cd3c1ee13dc0d	2021-03-18 23:12:56 +03:00
Leonid Yuriev	6c9e8817b7	mdbx-posix: use `MAP_NORESERVE`. Change-Id: I6a46a5bfa5ed3fa5c3f26775fcba346f71106ad1	2021-03-17 01:27:23 +03:00
Leonid Yuriev	0be7616521	mdbx-posix: minor around `MAP_FIXED_NOREPLACE`. Change-Id: I0991a5ed1e1706442675d9514932fad30de372f8	2021-03-17 01:27:23 +03:00
Leonid Yuriev	0fd90de97e	mdbx-posix: add check for `_POSIX_MAPPED_FILES`. Change-Id: Ie7ee8464346cd57d8cd96b6c5df23da8ed37cbbb	2021-03-17 01:27:19 +03:00
Leonid Yuriev	7dfd3f18f8	mdbx: rework nodes/keys limitations. Change-Id: Id0515346d762d4554102775f26a0fc33f3c0f29e	2021-03-17 01:18:28 +03:00
Leonid Yuriev	b164baa1f5	mdbx: add `MDBX_ENABLE_MADVISE` build option/macro. Change-Id: I6174ec62e4811e891663b8ae0f7918aa09baf5ab	2021-03-17 01:18:18 +03:00
Leonid Yuriev	bd2c3d1c9c	mdbx-tools: minor refine/cleanup. Change-Id: I94974246c1212cf98bf3d31419e8a0fc24c5decc	2021-03-15 01:31:38 +03:00
Leonid Yuriev	3eb343020d	mdbx: simplify `check_txn_rw()`. Change-Id: Id6a24068ffcdd29fe15a888985bd4a17f1de8ab4	2021-03-14 16:33:06 +03:00
Leonid Yuriev	4b8b7d5a77	mdbx: refine `mdbx_env_set_geometry()` internals and 16-bit representation of grow/shrink values. More for https://github.com/erthink/libmdbx/issues/166. Change-Id: I7390f954819309ee4a01faf587aee6b5152e44bc	2021-03-14 03:42:52 +03:00
Leonid Yuriev	55620c1d13	mdbx: fix selecting/adjustment values inside `mdbx_env_set_geometry()` for implicit out-of-range cases. Fixes https://github.com/erthink/libmdbx/issues/170. Change-Id: Ibc8754811aa3d9077447220f9fec7a5543e40cc4	2021-03-13 19:55:19 +03:00
Leonid Yuriev	439cccf65f	mdbx: minor fix assertion in the prev commit. One more for https://github.com/erthink/libmdbx/issues/171. Change-Id: I49be3df948f3dbcc838f3dc307155ac404cfb331	2021-03-13 19:40:18 +03:00
Leonid Yuriev	f7cd08ea48	mdbx: add an explicit/strict check that the environment is open. More for https://github.com/erthink/libmdbx/issues/171. Change-Id: Ifbf7f8ba143d19162bd3ed1cf29c21c31b45f0d5	2021-03-13 18:31:45 +03:00
Leonid Yuriev	e43cf081f1	mdbx: fix `mdbx_env_info_ex()` for a non-open environment case. Fix the https://github.com/erthink/libmdbx/issues/171. Change-Id: Iad3d0186ef40dfd40fad1c3ae0dd97f9c1161c16	2021-03-13 17:15:17 +03:00
Leonid Yuriev	a96b6f79c6	mdbx: fix/disallowing implicit subDB deletion via operations on MAIN_DBI. Change-Id: I3cd786e877f42cef2c0d5556033b2633f8a8ce62	2021-03-13 17:11:35 +03:00
Leonid Yuriev	93f0f21a4c	mdbx-tools: minor speedup `mdbx_load` by adding `__hot/__inline` for internal functions. Change-Id: Iee7d2562dbe184475f01ab9a7f9aae11549d7294	2021-03-13 15:48:31 +03:00
Leonid Yuriev	8b5197b108	mdbx-tools: minor rearrange internal fields inside `mdbx_load` to avoid padding. Change-Id: Ieca06e0c031938b083fd12959812afa1bbc9e2de	2021-03-13 15:47:59 +03:00
Leonid Yuriev	0603dd8305	mdbx-tools: more for `quiet` mode inside `mdbx_load`. Change-Id: I31839d530b94516c9819e6600fd808a3c97c609a	2021-03-13 15:47:19 +03:00
Leonid Yuriev	f01e0efc2d	mdbx-tools: add `mdbx_drop` tool. Change-Id: Ib7b32668c13fcef5951ff7250df57b3263e14d69	2021-03-13 15:45:15 +03:00
Leonid Yuriev	fd021d793a	mdbx: fix MSVC warning. More for https://github.com/erthink/libmdbx/issues/166 Change-Id: I47a2ec72831c06695e7ef4c52a77039e52a718e2	2021-03-09 12:59:54 +03:00
Leonid Yuriev	cd90f831af	mdbx: refine db growth step default. Change-Id: Ief80441cb578ae37d5d7cee4766e57eaacb4bbde	2021-03-09 12:59:27 +03:00
Leonid Yuriev	8e51a10908	mdbx: packing the 16-bit representations of `grow step` and `shrink threshold` values. Using float point (exponential quantized) representation for internal 16-bit values of grow step and shrink threshold when huge ones . To minimize the impact on compatibility, only the odd values inside the upper half of the range (i.e. 32769..65533) are used for the new representation. Resolve https://github.com/erthink/libmdbx/issues/166 Change-Id: I273127c1842deef0d7d8885b55a805b1463556eb	2021-03-09 12:54:48 +03:00
Leonid Yuriev	ec95a50bb6	mdbx: fix not setting the dirty flag for @MAIN when dropping DBI. This fixes https://github.com/erthink/libmdbx/issues/168 Change-Id: Ida9f11fbcea092af17946b95bfe4ac58b822a80c	2021-03-06 20:40:15 +03:00
Leonid Yuriev	b0d449565d	mdbx: shrink dbi table immediately in the `mdbx_dbi_close_locked()`. Change-Id: Idaa5ec9791b5ffa4305e7f9f7a625fba5f956dd9	2021-03-05 03:20:21 +03:00
Leonid Yuriev	de13d6c823	mdbx: merge branch 'master' into devel. Change-Id: Icec2e7548923ef7b3e33bf50fc20842938d5eec5	2021-03-04 19:23:09 +03:00
Erk	b2a0279253	Fix compilation on build targets listed below MIPS	2021-03-04 10:33:12 +01:00
Leonid Yuriev	dec11e639a	mdbx: fix `mdbx_dpl_alloc()`. Change-Id: Ia7d4b1866ca3623668edffd56ab83e845f16b2a5	2021-03-03 16:24:32 +03:00
Leonid Yuriev	0cebc50291	mdbx: refine page-rebalance. Change-Id: Ia94379fa51eb5da1e1ec1a52cc1dd8b67ceb150a	2021-03-03 16:05:52 +03:00
Leonid Yuriev	46dcd6e7ca	mdbx: (re)alloc dpl-list at txn start. Change-Id: Ie35221666f09a189f5513e77d3ecb4056968334f	2021-03-02 03:58:27 +03:00
Leonid Yuriev	8cabd99d24	mdbx: merge branch 'devel'. Change-Id: I2593f0229694d0bdd310975887e31651ead6dcc0	2021-03-02 02:12:10 +03:00
Leonid Yuriev	c4b24b6a4d	mdbx-tools: minor fix a condition for details output about leaf pages. Thanks to Alexander Gavrilov (https://github.com/dartraiden) for the hint. Change-Id: I2a674b7d23310f8c776eef551353f79dfca7a3d8	2021-03-01 23:09:18 +03:00
Leonid Yuriev	c8dccc9bc4	mdbx: limits the initial size of dpl-list to the current db-size. Change-Id: I5f575fc6168f50786b6f8a82ae020d323530a12e	2021-02-28 01:02:16 +03:00
Leonid Yuriev	72d978ee48	mdbx: weakens checks during set the `MDBX_opt_txn_dp_limit` to avoid `MDBX_EINVAL`. Change-Id: I4852261d0c45b726c60792463ab698538fa447e5	2021-02-28 01:02:16 +03:00
Leonid Yuriev	7fcf11013e	mdbx: minor fix likely/unlikely inside `mdbx_cursor_del()`. Change-Id: I86cfc755eef7371ea96c0feb39bffd3ec5298b71	2021-02-28 01:02:16 +03:00
Leonid Yuriev	3fd739ea2c	mdbx: add `MDBX_DISABLE_PAGECHECKS` build option. Change-Id: Ia5e2727b74961e7f829f273225c5c1a6cc764b8e	2021-02-07 02:53:54 +03:00
Leonid Yuriev	c89f30e485	mdbx: fix/rework C11 atomics usage to avoid performance regression. Resolve https://github.com/erthink/libmdbx/issues/160 Change-Id: Ic14ef8c9f1e4fb844952f51e81b58268d7939cfe	2021-02-06 21:16:56 +03:00
Leonid Yuriev	7e7d526ed5	mdbx: minor fix `txn_spill()`. Change-Id: Ic624681d3a9e262b77f761796aabf0231019db72	2021-02-06 19:34:26 +03:00
Leonid Yuriev	0e8c913c57	mdbx: minor refine `node_search()`. Change-Id: Ib9aaca3e7853b9986b6d70bc43a88e90d0a46c0c	2021-02-06 19:33:07 +03:00
Leonid Yuriev	892402a5d8	mdbx: add missing `unlikely()` hints. Change-Id: I0baae944b9d2a994ad65fbb57591c2cc8d35f0d3	2021-02-06 19:31:04 +03:00
Leonid Yuriev	0cc695e22e	mdbx: minor simplify `page_get()`. Change-Id: I2a548ea008fad29da8382946dff3c7d9bffa1e85	2021-02-06 19:30:05 +03:00
Leonid Yuriev	be220dc905	mdbx: release v0.9.3 Acknowledgements: ----------------- - [Mahlon E. Smith](http://www.martini.nu/) for [FreeBSD port of libmdbx](https://svnweb.freebsd.org/ports/head/databases/mdbx/). - [장세연](http://www.castis.com) for bug fixing and PR. - [Clément Renault](https://github.com/Kerollmops/heed) for [Heed](https://github.com/Kerollmops/heed) fully typed Rust wrapper. - [Alex Sharov](https://github.com/AskAlexSharov) for bug reporting. - [Noel Kuntze](https://github.com/Thermi) for bug reporting. Removed options and features: ----------------------------- - Drop `MDBX_HUGE_TRANSACTIONS` build-option (now no longer required). New features: ------------- - Package for FreeBSD is available now by Mahlon E. Smith. - New API functions to get/set various options (https://github.com/erthink/libmdbx/issues/128): - the maximum number of named databases for the environment; - the maximum number of threads/reader slots; - threshold (since the last unsteady commit) to force flush the data buffers to disk; - relative period (since the last unsteady commit) to force flush the data buffers to disk; - limit to grow a list of reclaimed/recycled page's numbers for finding a sequence of contiguous pages for large data items; - limit to grow a cache of dirty pages for reuse in the current transaction; - limit of a pre-allocated memory items for dirty pages; - limit of dirty pages for a write transaction; - initial allocation size for dirty pages list of a write transaction; - maximal part of the dirty pages may be spilled when necessary; - minimal part of the dirty pages should be spilled when necessary; - how much of the parent transaction dirty pages will be spilled while start each child transaction; - Unlimited/Dynamic size of retired and dirty page lists (https://github.com/erthink/libmdbx/issues/123). - Added `-p` option (purge subDB before loading) to `mdbx_load` tool. - Reworked spilling of large transaction and committing of nested transactions: - page spilling code reworked to avoid the flaws and bugs inherited from LMDB; - limit for number of dirty pages now is controllable at runtime; - a spilled pages, including overflow/large pages, now can be reused and refunded/compactified in nested transactions; - more effective refunding/compactification especially for the loosed page cache. - Added `MDBX_ENABLE_REFUND` and `MDBX_PNL_ASCENDING` internal/advanced build options. - Added `mdbx_default_pagesize()` function. - Better support architectures with a weak/relaxed memory consistency model (ARM, AARCH64, PPC, MIPS, RISC-V, etc) by means [C11 atomics](https://en.cppreference.com/w/c/atomic). - Speed up page number lists and dirty page lists (https://github.com/erthink/libmdbx/issues/132). - Added `LIBMDBX_NO_EXPORTS_LEGACY_API` build option. Fixes: ------ - Fixed missing cleanup (null assigned) in the C++ commit/abort (https://github.com/erthink/libmdbx/pull/143). - Fixed `mdbx_realloc()` for case of nullptr and `MDBX_AVOID_CRT=ON` for Windows. - Fixed the possibility to use invalid and renewed (closed & re-opened, dropped & re-created) DBI-handles (https://github.com/erthink/libmdbx/issues/146). - Fixed 4-byte aligned access to 64-bit integers, including access to the `bootid` meta-page's field (https://github.com/erthink/libmdbx/issues/153). - Fixed minor/potential memory leak during page flushing and unspilling. - Fixed handling states of cursors's and subDBs's for nested transactions. - Fixed page leak in extra rare case the list of retired pages changed during update GC on transaction commit. - Fixed assertions to avoid false-positive UB detection by CLANG/LLVM (https://github.com/erthink/libmdbx/issues/153). - Fixed `MDBX_TXN_FULL` and regressive `MDBX_KEYEXIST` during large transaction commit with `MDBX_LIFORECLAIM` (https://github.com/erthink/libmdbx/issues/123). - Fixed auto-recovery (`weak->steady` with the same boot-id) when Database size at last weak checkpoint is large than at last steady checkpoint. - Fixed operation on systems with unusual small/large page size, including PowerPC (https://github.com/erthink/libmdbx/issues/157). TODO: ----- - Engage new terminology (https://github.com/erthink/libmdbx/issues/137). - Resolve few TODOs (https://github.com/erthink/libmdbx/issues/124, https://github.com/erthink/libmdbx/issues/127, https://github.com/erthink/libmdbx/issues/115). - Finalize C++ API. - Packages for [ROSA Linux](https://www.rosalinux.ru/), [ALT Linux](https://www.altlinux.org/), Fedora/RHEL, Debian/Ubuntu. Change-Id: I414b8ef2e4b90e04fb344779c0e3f1b4bd1c06be	2021-02-02 22:18:21 +03:00
Leonid Yuriev	8133d93678	mdbx: add `LIBMDBX_NO_EXPORTS_LEGACY_API` build option. Change-Id: I9d9dcffe63fce843e22132c3829adca57714d818	2021-02-02 00:25:48 +03:00
Leonid Yuriev	38a559b93e	mdbx: Crutches for C11-atomics compiler's bugs. Change-Id: I5a857aa56c831f00c4bc67c95d7aecabc29264da	2021-02-01 20:55:41 +03:00
Leonid Yuriev	25c4df0d3e	mdbx: radix sort for large chunks of PNL and DPL. More for https://github.com/erthink/libmdbx/issues/132 Change-Id: I19b253f78069d4ecd4ec360a12121c78f182fc09	2021-02-01 02:14:13 +03:00
Leonid Yuriev	88bdf4b96f	mdbx: avoid branches inside `bsearch()` loop. Related for https://github.com/erthink/libmdbx/issues/132 Change-Id: Ia843556cc7052e5081a98f56b43fd80e2d0a40c7	2021-02-01 00:39:52 +03:00
Leonid Yuriev	28bd5d81d2	mdbx: incremental lazy merge sort for dirty-page list. The main change for https://github.com/erthink/libmdbx/issues/132 Change-Id: I9907f6abfcf77bd40c7a263f5adb5274d5445864	2021-02-01 00:39:19 +03:00
Leonid Yuriev	0620ec2f2e	mdbx: merge branch `master` into the `devel`. Change-Id: Iab3a0502577f6557e3f8fccc89df49aee372416e	2021-01-31 23:21:16 +03:00
Leonid Yuriev	077989bfed	mdbx: adds pre- and post- gaps to dirty page list to avoid some comparisons and conditional branches. More for https://github.com/erthink/libmdbx/issues/132 Change-Id: I6562c5ff6c559341bb7bb64222b126f06cc13427	2021-01-31 23:20:49 +03:00
Leonid Yuriev	edb6d2d661	mdbx: add audit after nested txn start. Change-Id: I7601994d24e7d2a5b8e9b113f697e4a14b1d2e6a	2021-01-31 23:20:49 +03:00
Leonid Yuriev	df180d1d36	mdbx: provide the gap/reserve for ability of merge sort dirty-page list. Preparation for fix https://github.com/erthink/libmdbx/issues/132 Change-Id: I4aac6927878eb0361588fbfcf9698ba6d2d5fc34	2021-01-31 23:16:10 +03:00
Leonid Yuriev	8b6608a9ca	mdbx: fix `dirtyroom` inheritance for nested transactions. Change-Id: If2036ab3b7909c51e54526a535d65cdee1e0b287	2021-01-31 21:49:20 +03:00
Leonid Yuriev	9f0ff865e8	mdbx: use C11 atomics if available instead of legacy memory barriers. This done better support architectures with a weak/relaxed memory consistency model (ARM, AARCH64, PPC, MIPS, RISC-V, etc). Change-Id: Iee831c8dc564f1d027ff84b0d6daa559325d5a9b	2021-01-30 02:28:12 +03:00
Leonid Yuriev	f698f07ff9	mdbx: fix operation for unusual small/large system page size. More for https://github.com/erthink/libmdbx/issues/157 Change-Id: I4f2ed54b50653d0375538b82c48590d1037cd93b	2021-01-29 21:19:58 +03:00
Leonid Yuriev	6cfac546a1	mdbx: fix `mdbx_env_get_option(MDBX_opt_sync_bytes)` to return number of bytes instead of pages. Change-Id: I815887e82946d9644b05549ec253a52b566c8565	2021-01-29 19:55:40 +03:00
Leonid Yuriev	9c9f6faf38	mdbx: fix `madvise_threshold` for large system pages. Fixed https://github.com/erthink/libmdbx/issues/157 Change-Id: I0e880591d236b6ba96a38d2a3fa953695d9c4df0	2021-01-29 04:58:32 +03:00
Leonid Yuriev	0a2f2e28b4	mdbx: fix minor signed/unsigned comparison warnings. Change-Id: Ice6f9759560d5eda514112e838d57e63207a7559	2021-01-27 19:23:07 +03:00
Leonid Yuriev	62b2e31bf4	mdbx: fix auto-recovery weak->steady with the same boot-id (don't truncate DB to size from steady-meta). Change-Id: Ib1c7f845bdf49fb9101b01aa868f8567172e5590	2021-01-27 16:48:03 +03:00
Leonid Yuriev	943bb552a2	mdbx: fix GC-slot cleanup inside `mdbx_update_gc()` in extra rare complex cases. More for `5f1b684719` and https://github.com/erthink/libmdbx/issues/123 Change-Id: I1b78d6be2babf9ffdd0b77e7b1ee53d1313977bb	2021-01-26 10:28:39 +03:00
Leonid Yuriev	251eda6fb8	mdbx: HNY! Change-Id: I86c7028001b349e3d06b837dc8e2f7e60fb3b1a2	2021-01-26 07:27:13 +03:00
Leonid Yuriev	4fd23c4716	mdbx: fix minor debug typo. Change-Id: Ieffd3cea351681c1d5ccf93b12953eb0d8abb6b9	2021-01-25 23:26:53 +03:00
Leonid Yuriev	5f1b684719	mdbx: fix regression `MDBX_KEYEXISTS` during `mdbx_commit_ex()` and overwriting GC records. Fix regression related to https://github.com/erthink/libmdbx/issues/123 and https://github.com/erthink/libmdbx/issues/128. Related to https://github.com/erthink/libmdbx/issues/131. В lifo-режиме при фиксации транзакции, записи в GC могли быть перезаписаны (с утечкой страниц БД), либо могла возникать ошибка MDBX_KEYEXISTS, по следующему сценарию: - В истории БД были две транзакции с огромным кол-вом retired pages, после которых в GC остались две соответствующие записи. - В ходе очередной транзакции первая из огромных GC-записей попадает в переработку и образует огромный reclaimed list. - При фиксации транзакции производится попытка разбить огромный reclaimed list на чанки размером в одну страницу. Для этого требуется много id для записей, которые в соответствии с lifo должны быть максимально близки к голове GC, т. е. получены путем переработки последних записей GC. - В ходе переработки последних записей очередь доходит до второй огромной записи, при этом переработка прерывается, ибо иначе reclaimed list переполнится. - Однако прерывание переработки внутри mdbx_update_gc() трактовалось как отсутствие записей в GC, поэтому список доступных просто добавлялись соответствующие id-шники. - Если в списке доступных id-шников для помещения в GC были переработанные, то записи с id по всему списку удалялись - тогда вторая большая запись (и возможно предыдущие) удалялись, а содержащиеся в них номера страниц выпадали из оборота. - Если же в списке доступных id-шников не было переработанных, то чистка не проводилась - тогда при последующая попытка помещения чанков reclaimed list в GC завершалась ошибкой MDBX_KEYEXISTS, которая и возвращалась из mdbx_commit_ex(). Change-Id: I3e5d40ef7950b7476da0513c6836fcba1de74879	2021-01-25 23:23:08 +03:00
Leonid Yuriev	ee22ffb878	mdbx-tools: using walked pages count while output statistics if traversal enabled.	2021-01-25 21:35:59 +03:00
Leonid Yuriev	a9cb6a6a90	mdbx: minor fix ASAN controls.	2021-01-25 21:35:59 +03:00
Leonid Yuriev	95ae324580	mdbx: fix reclaimed-list allocation during nested txn start. Change-Id: Ia70e01ed69a001249ce14b4930452a469d04b824	2021-01-24 00:49:46 +03:00
Leonid Yuriev	4ae2a107bf	mdbx: add `MDBX_opt_loose_limit` runtime option. More for https://github.com/erthink/libmdbx/issues/128 Change-Id: I298bf1eef24575df72615ee07e93f5073405e8e0	2021-01-22 23:52:03 +03:00
Leonid Yuriev	dc34041600	mdbx: alter defaults for `MDBX_opt_rp_augment_limit` and `MDBX_opt_txn_dp_limit` runtime options. Change-Id: I08cdbfb18089a3fed4b32d931ca4423027a9939f	2021-01-22 23:16:21 +03:00
Leonid Yuriev	b1a2892038	mdbx: fix minor Coverity warnings. Change-Id: I0c5d23a36120b8d697887462a6ae86d66a435c3d	2021-01-22 20:13:31 +03:00
Leonid Yuriev	b82d1d5063	mdbx: add `MDBX_opt_spill_parent4child_denominator` runtime option. More for https://github.com/erthink/libmdbx/issues/128 Change-Id: If1549c3855eb59c107eb115e6dbca515e81644f9	2021-01-22 18:18:52 +03:00
Leonid Yuriev	56aaad03bc	mdbx: add `MDBX_opt_spill_max_denominator` and `MDBX_opt_spill_min_denominator` runtime options. More for https://github.com/erthink/libmdbx/issues/128 Change-Id: I6b1b00e30ac11e9c2e3d3d3a29cc73079b41d539	2021-01-22 17:25:44 +03:00
Leonid Yuriev	e0d4eaf819	mdbx: minor refine `mdbx_txn_merge()`.	2021-01-21 22:45:34 +03:00
Leonid Yuriev	1d58ad6d9b	mdbx: fix Valgrind/ASAN controls. Change-Id: Idf526cbdb8ce8e43600efebbd1d12a8306a58184	2021-01-21 22:45:28 +03:00
Leonid Yuriev	58e4eda1c6	mdbx: fix spilled page list memleak. Change-Id: I8b3b3664711943b0809be7bcc6580aafd4e4c286	2021-01-21 22:45:28 +03:00
Leonid Yuriev	d26ae6875b	mdbx: fix assertion to avoid false-positive UB detection by CLANG/LLVM. Assume this resolve https://github.com/erthink/libmdbx/issues/153 Change-Id: I02ceba1063a338b6dedf17629b51b3466358b0b8	2021-01-21 22:45:28 +03:00
Leonid Yuriev	afe93137fc	mdbx: fix minor assertions. Change-Id: Ib3e2dcb2cb419f41717351b2ac2264ffed906014	2021-01-21 22:45:28 +03:00
Leonid Yuriev	bed14e60c2	mdbx-cmake: add `-fsanitize-undefined-trap-on-error` to compile flags and `ENABLE_UBSAN` to `config.h`. Change-Id: Ic18c0d59ccf32f9783a44de456893fbc8a0a7d32	2021-01-21 22:45:23 +03:00
Leonid Yuriev	730b9ea3fd	mdbx: add `MDBX_PNL_ASCENDING` build option and dependency for `MDBX_DATA_MAGIC`. Change-Id: I55283240b1dbbbc093927be5eaa5d42b87294f72	2021-01-20 23:31:14 +03:00
Leonid Yuriev	6bd0277020	mdbx: minor fix `mdbx_cursor_close()`. Avoids reference to txn which could be already freed. Change-Id: I4e1fadd9786ced1533bb8468d30e013455601228	2021-01-20 09:55:11 +03:00
Leonid Yuriev	7d09de489d	mdbx: fix minor MSVC warnings. Change-Id: I633b8847698dca25b6c395216744e157f6fb240d	2021-01-20 09:55:11 +03:00
Leonid Yuriev	0d09c2cda9	mdbx: avoid overflow for dirty & leftover space inside `mdbx_txn_info()`. Change-Id: I36f4d62881e68f1bfe0d11fde2e849cdf1408ed2	2021-01-20 02:07:44 +03:00
Leonid Yuriev	42670aa64a	mdbx: fix MSVC warnings aroung `size_t` and `unsigned` conversion. Change-Id: I32bd3ee4fe02ac62cc121f33b2f84bf63c81cb75	2021-01-20 01:39:21 +03:00
Leonid Yuriev	6d7daf6401	mdbx: fix audit for complex nested txn cases. Change-Id: I2419cbe0e8d3167e77ac99f397b97edb22717833	2021-01-19 23:53:16 +03:00
Leonid Yuriev	f28da7c9e3	mdbx: rework spilling, page-lists, commit & abort for nested transactions, etc (squashed). Change-Id: I09e4744586342aeae4efcfb71f41a3248ee47758	2021-01-19 23:53:16 +03:00
Leonid Yuriev	7bae2a7cd2	mdbx: provide `MDBX_ENABLE_REFUND` build option. Change-Id: I0e4c94a22f3b0957176431709604a7595f85252a	2021-01-19 23:53:16 +03:00
Leonid Yuriev	7183f62e13	mdbx: rework `DBI_DIRTY` and `MDBX_TXN_DIRTY` propagation. Change-Id: Ief12ee320ce7c7142632bd1142d847aac314db0b	2021-01-19 23:53:16 +03:00
Leonid Yuriev	4afc30c79f	mdbx: rework `mdbx_page_alloc()`. Change-Id: I5c6e2ef23abf79096dd699f9dfbecf97bfc4fe37	2021-01-19 23:53:16 +03:00
Leonid Yuriev	c6a8f0f9af	mdbx-tools: minor refine `mdbx_chk` error output. Change-Id: I4692a46c3e007fa2910ef67ec7fe21c7285e92eb	2021-01-19 23:53:16 +03:00
Leonid Yuriev	966d7027a3	mdbx: minor fix `bad_page()` debug output. Change-Id: I14531fdceaad054ad8c45bf9042fee73de1f9a36	2021-01-19 23:53:16 +03:00
Leonid Yuriev	dfc92d9f96	mdbx: minor fix `mdbx_page_new()` debug output. Change-Id: If60f972cc3271ca91feea923fb4f4be48d488b22	2021-01-19 23:53:16 +03:00
Leonid Yuriev	ac0f4e14a8	mdbx: minor fix `mdbx_page_new()` debug output. Change-Id: I2f386ec6276cab404607b5c3a79d8028d73dad62	2021-01-19 23:53:16 +03:00
Leonid Yuriev	ca597f4314	mdbx: fix `mdbx_page_flush()` for possibility of memleack. Change-Id: Ieab0c98fcd1020d49cce73234125ceb11a8f0b64	2021-01-19 23:53:16 +03:00
Leonid Yuriev	c1fef9b51d	mdbx: fix `mdbx_update_gc()` for retired page list change case. Change-Id: Ic454262edcda8881182a15d6a521b90990e5551d	2021-01-19 23:53:16 +03:00
Leonid Yuriev	b8bb4b4cc4	mdbx: fix propagation child txn DBI-state to parent. Change-Id: I7d92fa99131a937af1a1a75b38af57bc6787ab37	2021-01-19 23:53:16 +03:00
Leonid Yuriev	4425fb0b83	mdbx: minor refine flags-reset inside `mdbx_page_flush()`. This produces little bit less code for most architectures. Change-Id: I0440ec7b465ae2f12a8b09b0226f2c42bc52f7de	2021-01-19 23:53:16 +03:00
Leonid Yuriev	5bb254e629	mdbx: allow fastpath-commit for pure nested txns with parent-spilled pages. Change-Id: I471fd5e057c323e3701158761631e0a9999bf54a	2021-01-19 23:53:16 +03:00
Leonid Yuriev	8fce97dca9	mdbx: fix `mdbx_cursors_eot()`. Change-Id: I6021ff019f25110db96f9ef351d31a1f48b76c18	2021-01-19 23:53:16 +03:00
Leonid Yuriev	f6ff075335	mdbx: rework/speedup spill-pages list. Change-Id: I97e63f8d4c82ae682e898e9b04edceb0b01d82a5	2021-01-19 23:53:16 +03:00
Leonid Yuriev	d64b81c673	mdbx: remove senseless assertions from `mdbx_refund_loose()`. Change-Id: I028ae6bafb9358b61287fc0201c246baf160ca03	2021-01-19 23:53:16 +03:00
Leonid Yuriev	0ab263b329	mdbx: purge deleted spilled pagenums on refund. Change-Id: I325fbad82cbecb71c35dd1edd1a2abccb8108541	2021-01-19 23:53:16 +03:00
Leonid Yuriev	7bf147d8c2	mdbx: fix assertion inside `mdbx_txn_commit_ex()` for nested spilled txn. Change-Id: I54b37ea1b9591bdec9d8bd16d0f57280a1f9ee77	2021-01-19 23:53:16 +03:00
Leonid Yuriev	6ef7b2f588	mdbx: fix assertion inside `mdbx_txn_begin_ex()` for nested txn with spilled parent. Change-Id: Ie1f3cd3df6beb296a7bbdc72b39c1c4cb9105083	2021-01-19 23:53:16 +03:00
Leonid Yuriev	f0d79df9b9	mdbx: fix `mdbx_page_flush()`. Change-Id: I467c2367f2e99ae50996d0859ae22f70c9649a2d	2021-01-19 23:53:16 +03:00
Leonid Yuriev	05958a708e	mdbx: fix minor/potential mem-page leak inside `mdbx_page_unspill()`. Change-Id: I4398a4d81eda494e4de9d62d81e3936c6357b744	2021-01-19 23:53:16 +03:00
Leonid Yuriev	21fbc36311	mdbx: minor refine `mdbx_page_retire()`. Change-Id: I29d20ed47f56e17dde8c9417bfa1ec95302c1966	2021-01-19 23:53:16 +03:00
Leonid Yuriev	cea29fe485	mdbx: fix assertion inside `mdbx_page_retire()`. Change-Id: I5d8f92b9fde1c961252757ea508403b5f51e7646	2021-01-19 23:53:16 +03:00
Leonid Yuriev	fe386a66df	mdbx: minor refine `mdbx_page_unspill()`. Change-Id: I20bbd4c502a2258b945996fa1cf761eab7f88a80	2021-01-19 23:53:16 +03:00
Leonid Yuriev	92527a5206	mdbx: rename `mdbx_page_spill` to `mdbx_cursor_spill()`. Change-Id: I71628951d29ea39055b920a76521a19cb10ac8da	2021-01-19 23:53:16 +03:00
Leonid Yuriev	266bb70b7d	mdbx: add debug to `mdbx_kill_page()`. Change-Id: Ifbb3164989a19d8ea48288b4eda1a8bcf31790ff	2021-01-19 23:53:16 +03:00
Leonid Yuriev	56758372cf	mdbx: drop unused `mdbx_audit()`. Change-Id: I6d31c6ad83c058892319da6bbf38506b3f55085f	2021-01-19 23:53:16 +03:00
Leonid Yuriev	1314b29557	mdbx: add `const` for bsearch functions. Change-Id: Ie63eafa145bc8a63ae56b2693aaaf69bd21893aa	2021-01-19 23:53:16 +03:00
Leonid Yuriev	ef7814c018	mdbx: clean zero item of DPL-list. Change-Id: I7c60f3996783d97cee7cf2f0f9a7b856f4272641	2021-01-19 23:53:16 +03:00
Leonid Yuriev	d50fff8410	mdbx: minor refine `mdbx_page_check()`. Change-Id: I325c20fe042635a0641cc24f5661408f3476139b	2021-01-19 23:53:16 +03:00
Leonid Yuriev	44089b03df	mdbx: minor refine `mdbx_page_get()`. Change-Id: Ie0ca17883ed88e4d9addf8b90061d25a80d77022	2021-01-19 23:53:16 +03:00
Leonid Yuriev	a906569c58	mdbx: merge branch 'master' into devel-rebase. Change-Id: I96d944f283029b9c60e45683ee66b4564273b407	2021-01-19 23:51:52 +03:00
Leonid Yuriev	b98895b8c7	mdbx: fix unaligned access to `bootid` on the meta-pages. Assume this fixes https://github.com/erthink/libmdbx/issues/153 Change-Id: I062c1bd99795a7b875d1cf60658790c1071a6775	2021-01-18 14:27:58 +03:00
Leonid Yuriev	e766df658c	mdbx-backport: avoid 4-byte aligned (i.e. unaligned) access to 64-bit integers. Historically, the page header provides 4-byte data alignment. Therefore, unfortunately, the meta page data is also aligned on a 4-byte boundary, but contains 64-bit values. This commit eliminates potentially unsafe access (SPARC, MIPS, etc) to these 64-bit values aligned on a 4-byte boundary. Thus, a build with the `-fsanitize=undefined` now passes the tests both with CLANG 11 and GCC 10. Change-Id: Ie441103e53ed96fd40507d8c0be0689e3fee69f5	2021-01-18 14:08:49 +03:00
Leonid Yuriev	082df3a573	mdbx: refine MDBX_opt_* descriptions and defaults. Change-Id: I99ddf530d5683b755bc8bab1ea1098b0cc00b181	2020-12-17 22:03:14 +03:00
Leonid Yuriev	697fce7ebc	mdbx: rename `MDBX_END_PURE_COMMIT` (cosmetics). Change-Id: Ia3bdeca5989c841c0dc969e22981044fb334bf32	2020-12-17 22:03:14 +03:00
Leonid Yuriev	70e76bcb4d	mdbx: merge branch 'master' into devel. Change-Id: Idc8838922081cbc8ebe6c564555e4d304b529588	2020-12-17 21:52:35 +03:00
Leonid Yuriev	d77af0bc1f	mdbx: more checks against the use renewed (re-created or re-opened) DBI-handles. More for https://github.com/erthink/libmdbx/issues/146 Change-Id: I09e40598aca18e7ebd9798dc3be8675de3f8d976	2020-12-17 10:36:05 +03:00
Leonid Yuriev	735da5fedd	mdbx: auto-shrink env's DBI table. Change-Id: I9f423dab41863119a4491491e0ecd0a4aee42a82	2020-12-17 01:57:06 +03:00
Leonid Yuriev	cda64ca663	mdbx: rework open/import/export of DBI-handles for robustness Resolve https://github.com/erthink/libmdbx/issues/146 Change-Id: Idd18dc0d038eeba47668983ecf4ff46eabd16de5	2020-12-17 01:57:02 +03:00
Leonid Yuriev	166ed1c7d4	mdbx: refine prev commit (avoids `SIGSEGV` but assertion failure). More related to https://github.com/erthink/libmdbx/issues/146 Change-Id: Ie5277a8cc56421d20a7c9aad83724991b2efdc2d	2020-12-15 15:43:19 +03:00
Leonid Yuriev	3758e7697e	mdbx: more checks inside `mdbx_cursor_close()`. Related to https://github.com/erthink/libmdbx/issues/146 Change-Id: I7b90a0e515aa6320b0e89ec52fe01bc0be126071	2020-12-15 15:07:42 +03:00
Leonid Yuriev	315ef41455	mdbx: use `MDBX_PGL_LIMIT` for DPL as a soft-limit and options.dp_limit as spilling-pressure to avoid false-positive `MDBX_TXN_FULL`. Change-Id: I0caae71d044cefa2f36286c2ae9fe14e356a6b51	2020-12-06 14:42:13 +03:00
Leonid Yuriev	c1210d7c73	mdbx: refine `mdbx_page_alloc()` to avoid `MDBX_TXN_FULL`. More for https://github.com/erthink/libmdbx/issues/123 Change-Id: I527b7e9507f4c2aa565f1567924cfb1c477966dd	2020-12-06 14:39:19 +03:00
Leonid Yuriev	a4df0acb00	mdbx: more logging for `FD < STDERR_FILENO`. More for https://github.com/erthink/libmdbx/issues/144 Change-Id: I8dcd3cab8a39b16a1836c88ec92b30d6b0de8b51	2020-12-06 14:35:38 +03:00
Leonid Yuriev	c4944a58d5	mdbx: avoid spelling errors (cosmetics). Change-Id: Ibf14e003ba740ba757b5403e92fd220e68930ce4	2020-12-05 22:51:45 +03:00
Leonid Yuriev	d116e7235a	mdbx-posix: safeguard for DB corruption in case FD <= `STDERR_FILENO`. Resolve https://github.com/erthink/libmdbx/issues/144 Change-Id: Ic3467338d494b021fa0d1863c8227976d0a2bcd5	2020-12-05 22:51:45 +03:00
Leonid Yuriev	3e7459b428	mdbx-windows: fix `mdbx_realloc()` for nullptr and `MDBX_AVOID_CRT=ON`. Change-Id: I129221186d65254da5b1d84747e5c59d53864b70	2020-12-05 09:45:03 +03:00
Leonid Yuriev	338de2e1fb	mdbx: refine `mdbx_page_spill()`. More for https://github.com/erthink/libmdbx/issues/132. Change-Id: I40788c13b54453c17d5e5dae6c3d2f93226f8e00	2020-12-04 15:38:26 +03:00
Leonid Yuriev	12ee5e6cac	mdbx: minor refine `mdbx_page_flush()`. More for https://github.com/erthink/libmdbx/issues/132. Change-Id: I703e1359d859b8901fcbdf57211f7805cd6d5ff1	2020-12-04 15:38:26 +03:00
Leonid Yuriev	262e4981db	mdbx: refactor `mdbx_pages_xkeep()`. More for https://github.com/erthink/libmdbx/issues/132. Change-Id: Ie81b5c9efafa06e61d6d983769ff1f11a0e59a1e	2020-12-04 15:38:15 +03:00
Leonid Yuriev	df8260e29a	mdbx: add `mdbx_pnl_purge_odd()`. More for https://github.com/erthink/libmdbx/issues/132. Change-Id: I1926ee48785f30b82e827a8e1e69be1e7a0a209f	2020-12-04 15:38:15 +03:00
Leonid Yuriev	87c765c7be	mdbx: fix/check lower border for dirty-pages list's limits/options. More for https://github.com/erthink/libmdbx/issues/128. Change-Id: Ie9dccee5cf90d26968db04f4f6d9afa3018fcf0e	2020-12-04 15:38:15 +03:00
Leonid Yuriev	0b02e080c4	mdbx: use `pnl_xmerge()` to merge spill-pages lists. More for https://github.com/erthink/libmdbx/issues/132. Change-Id: I1f84a2be1fa5da6cf0e2783ff56f7a4c20782a7f	2020-12-04 15:38:15 +03:00
Leonid Yuriev	d9bd306da3	mdbx-load: add `-p` option (purge subDB). Change-Id: I678950c99c8b4aea1add4ce548c9b4fe4ab8bfe6	2020-12-03 21:52:22 +03:00
Leonid Yuriev	90309ec0bf	mdbx: merge branch 'master' into devel. Change-Id: Ib1d07cf6eb2e4c76b3be969b28bf2317cb326835	2020-12-03 18:42:10 +03:00
Leonid Yuriev	eb31b765a5	mdbx-tools: use `MDBX_SAFE_NOSYNC \| MDBX_ACCEDE` inside `mdbx_load`. Change-Id: Id5a3a447d6b80b96a97ec76c258825583546d791	2020-12-03 17:58:21 +03:00
Leonid Yuriev	76716c23b0	mdbx: add `MDBX_opt_txn_dp_initial` & `MDBX_opt_txn_dp_limit`. More for https://github.com/erthink/libmdbx/issues/128 Change-Id: I4be3c7476e9ce16ed4f27691d0df653552930e3c	2020-12-03 17:17:30 +03:00
Leonid Yuriev	84235c7903	mdbx: drop unnecessary `MDBX_HUGE_TRANSACTIONS` option. Change-Id: I86116c2bada268d6e0a5c97deff808aaffe3e599	2020-12-03 17:17:28 +03:00
Leonid Yuriev	c5061f9289	mdbx: dynamic dirty-page-list size. Resolve https://github.com/erthink/libmdbx/issues/123 Change-Id: I5d9b2d8c2259132617fd2b226b9d9a6790fcad88	2020-12-03 17:17:07 +03:00
Leonid Yuriev	6a5cec1f87	mdbx: refine `mdbx_dpl_search()`. Change-Id: I8acc87d9c2f306c981ad42cc859d32b7cfd7330e	2020-12-03 10:25:36 +03:00
Leonid Yuriev	d8d89cca7d	mdbx: refactor dirty-page-list (preparation to rework). Change-Id: Ib52bb52f73ef1d31f55838d879de081fc0a140c2	2020-12-03 10:25:36 +03:00
Leonid Yuriev	7210f994fb	mdbx-windows: fix `mdbx_realloc()` for nullptr and `MDBX_AVOID_CRT=ON`. Change-Id: I129221186d65254da5b1d84747e5c59d53864b70	2020-12-03 10:25:24 +03:00
Leonid Yuriev	a987301204	mdbx++: refine abort/commit. More for https://github.com/erthink/libmdbx/pull/143 Change-Id: I07de4c43d039f904495f0f4caf586d8764174dcf	2020-12-03 09:32:25 +03:00
sasgas	5c693ccd96	mdbx++: fix missing null assignment. Resolves https://github.com/erthink/libmdbx/pull/143 Change-Id: Ifb88cebe2f07297a2f6cf70e31ae6abe61a0c0b2	2020-12-03 09:17:36 +03:00
Leonid Yuriev	5636dbf12b	mdbx: add `mdbx_dpl_alloc()` & `mdbx_dpl_free()`. Change-Id: I0f05ff02d4a45d02faa1076cbb1a2a8e17b7e2b9	2020-12-02 20:07:59 +03:00
Leonid Yuriev	c530c83337	mdbx: drop `me_dirtylist` field. Change-Id: I93ee802c1b6ef5c6a2443e19754e1a20dbe0aea9	2020-12-02 20:07:59 +03:00
Leonid Yuriev	0b62453f6d	mdbx: introduce `MDBX_PGL_LIMIT`. Change-Id: Ifab1156ec22fb0908284298393f52c09c0731829	2020-12-02 20:07:59 +03:00
Leonid Yuriev	4cd08f0ef9	mdbx: add `MDBX_opt_rp_augment_limit`. More for https://github.com/erthink/libmdbx/issues/128 Change-Id: I94f3350b72ad11d0b586aaef1574f7654223bc40	2020-12-02 20:07:55 +03:00
Leonid Yuriev	461ba000e3	mdbx: add `MDBX_opt_dp_reserve_limit`. More for https://github.com/erthink/libmdbx/issues/128 Change-Id: I620b6dcd833fcff19680770974f32431ab91c0ab	2020-12-02 12:42:16 +03:00
Leonid Yuriev	42019e0b8d	mdbx: add `dp_reserve_limit` with 1024 default. More for More for https://github.com/erthink/libmdbx/issues/128 Change-Id: Ia92b1aea58640f183202495e3f6e2d531057afd2	2020-12-02 12:42:16 +03:00
Leonid Yuriev	8f60050991	mdbx: initial support for set/get_options. Initial for https://github.com/erthink/libmdbx/issues/128 Change-Id: I540784c8b54d7443748e3c95f89a7390b818c811	2020-12-02 12:42:13 +03:00
Leonid Yuriev	a8ed534cd3	mdbx: avoid 4-byte aligned (i.e. unaligned) access to 64-bit integers. Historically, the page header provides 4-byte data alignment. Therefore, unfortunately, the meta page data is also aligned on a 4-byte boundary, but contains 64-bit values. This commit eliminates potentially unsafe access (SPARC, MIPS, etc) to these 64-bit values aligned on a 4-byte boundary. Thus, a build with the `-fsanitize=undefined` now passes the tests both with CLANG 11 and GCC 10. Change-Id: Ie441103e53ed96fd40507d8c0be0689e3fee69f5	2020-12-01 20:23:23 +03:00
Leonid Yuriev	adcb052915	mdbx: fix minor MSVC warnings.	2020-11-29 06:04:55 +03:00
Leonid Yuriev	2dab009e76	mdbx-windows: handling `EXCEPTION_POSSIBLE_DEADLOCK`. Change-Id: If42c7833e9c4e02fef25634e69c0bd2e926686c1	2020-11-29 05:49:15 +03:00
Leonid Yuriev	6d2914c99b	mdbx: minor/insignificant fix checking `mdbx_rdt_lock()` result for cases mutex-recovery after `EOWNERDEAD`. Change-Id: Ia5e13ea0d72afc97f7d678832a765a192dfacdff	2020-11-25 17:55:29 +03:00
Leonid Yuriev	2a740d3807	mdbx-windows: fix `ERROR_NOT_SUPPORTED` while opening UNC pathnames. Resolve https://github.com/miranda-ng/miranda-ng/issues/2627 Change-Id: Iec06554dfcb9e0db215662d93fb5824cfe9ac7ef	2020-11-24 15:53:14 +03:00
Leonid Yuriev	23fd4444b5	mdbx-windows: remap whole section for mmap-resize if `NtExtendSection()` not available (Wine). Some workaround for https://github.com/miranda-ng/miranda-ng/issues/1209 Change-Id: I8ce3cb0fb8bdc9bd36a05ab53343efbe4080d1f3	2020-11-23 10:47:07 +03:00
Leonid Yuriev	ddee04d991	mdbx: set DXB/LCK files position outside of a data. Set the position in files outside of the data to avoid corruption due to erroneous use of file descriptors in the application code. Change-Id: I8750f6e726edaddee254885756d5f91576a6bcb1	2020-11-23 09:25:24 +03:00
Leonid Yuriev	f76bf72021	mdbx-windows: retry resize-mmap always with reservation (less chance to failure). Change-Id: I472651f6906b88ba674868e0cd6c81318bfc255b	2020-11-20 11:52:44 +03:00
Leonid Yuriev	537e3d18ae	mdbx: minor clarify mmap-resize logging. Change-Id: Ibb6e4b8ee84d03a22ad0e0d1b437989739d43bb9	2020-11-20 10:38:04 +03:00
Leonid Yuriev	1bbf20bf39	mdbx: refine multi-thread flipping of buffers during env-copy. Change-Id: Id132c1af0e1131da70ab1b35bce9f6a6548edbe3	2020-11-19 11:59:42 +03:00
Leonid Yuriev	9054b25441	mdbx: fix fast completion of nested txn for case ones was open present DBIs. Change-Id: I87d28d1da5f72cc7ad77f8dd3f9a181f7eaa0024	2020-11-19 09:26:33 +03:00
Leonid Yuriev	862cfb9a3b	mdbx-windows: refine WSL1 detection. Try to fix https://github.com/snej/nimdbx/issues/1 Change-Id: Iec1c77c82ced8095e3f4e03a27a58e0bba3df76b	2020-11-18 22:38:26 +03:00
Leonid Yuriev	26767a5e06	mdbx: relax big-page size checking for compatibility. i.e. allow an overflow page be larger than required by placed data.	2020-11-18 03:42:05 +03:00
Leonid Yuriev	96c2a56aa1	mdbx: use `MDBX_SET_LOWERBOUND` in `mdbx_get_equal_or_great()`. Change-Id: I5dd72fe82bd15938afc60cbc0f92e23c00f0d344	2020-11-17 08:13:46 +03:00
Leonid Yuriev	5e02e7fb56	mdbx: add `MDBX_SET_LOWERBOUND` for `mdbx_cursor_get()`. Change-Id: I3638fdd10be8dfe128c43b465e9ca71f89175b3e	2020-11-17 08:13:46 +03:00
Leonid Yuriev	9ea6922a2f	mdbx: minor simplify `mdbx_cursor_set()`. Change-Id: I034f396368024af21e8ee741c13a28c9bc277121	2020-11-17 07:59:51 +03:00
Leonid Yuriev	56a52b0b01	mdbx: merge branch 'fix-131' (early part) into devel. Change-Id: I0df5ffa9f06da1196a60d5a7c68fed59b7027e4c	2020-11-16 07:07:53 +03:00
Leonid Yuriev	149b3d09e6	mdbx: don't export DBIs from nested txn. Change-Id: I8c354ac7f889debe2fcf830263cb060253887652	2020-11-16 07:07:39 +03:00
Leonid Yuriev	1c925a0f2e	mdbx: minor fix/avoid assertion inside `mdbx_cursor_set()`. Change-Id: I2cc38da698765b3eaa2bb575e16505d5d9438431	2020-11-16 07:07:39 +03:00
Leonid Yuriev	0c3deac9db	mdbx: fix cursors-EOF after search. Change-Id: Ie578611b64cca8dbcc00f958510143e8d1dc262a	2020-11-16 07:07:39 +03:00
Leonid Yuriev	21bbba82fb	mdbx: minor fix cursor_on_first/last for empty sub-db. Change-Id: I68c2e1bd28e62c9512bf8ef711fe21573e3450b9	2020-11-16 07:07:39 +03:00
Leonid Yuriev	4ea2bea22e	mdbx: fix save/restore/commit cursors for nested txn. Change-Id: Ibaf356bbc631ca2e41058787bd3e4aaaa8bc085a	2020-11-16 07:07:38 +03:00
Leonid Yuriev	e328c1f829	mdbx: refactor/move `mdbx_cursor_count()`. Change-Id: I5487342013dfc3a9cf12d9081471ace0c37de23d	2020-11-16 07:07:38 +03:00
Leonid Yuriev	ca115dd6a4	mdbx: refactor/rename/refine `tw.cursors` internals. Change-Id: Ie46d15f52a9d7365b52534a630754a31d3005a69	2020-11-16 07:07:38 +03:00
Leonid Yuriev	9a2dbb845c	mdbx: refactor/refine cursor next/prev. Change-Id: I0bfe0fed62e137e933027ba90cec23dbf1a6310b	2020-11-16 07:07:38 +03:00
Leonid Yuriev	5f09ec73c9	mdbx: return `MDBX_ENODATA` instead of `MDBX_EINVAL` for non-positioned/EOF cursor and `MDBX_GET_CURRENT`. Change-Id: I2adf76f8f662e77e5a6aa077344fab6b430975c4	2020-11-16 07:07:38 +03:00
Leonid Yuriev	c55f99073b	mdbx: fix `MDBX_NEXT` for EOF case. Change-Id: I84c033a24d2215a4867affab5b148bf6ba5d57dc	2020-11-16 07:07:38 +03:00
Leonid Yuriev	b1446b7752	mdbx: minor fix/distinction `MDBX_EBADSIGN` and `MDBX_EINVAL` errors for cursors. Change-Id: I6d72638a69ff0f793156fe5e0e7ca5531a97c7cf	2020-11-16 07:07:38 +03:00
Leonid Yuriev	b6f0070f85	mdbx: add `mdbx_cursor_copy()`. Change-Id: I476f1230beec6a550897bef236745530154c1079	2020-11-16 07:07:38 +03:00
Leonid Yuriev	2489e0ba6e	mdbx: refactor/rename `cursor_copy_internal()`. Change-Id: I334e68d3d424ef15cafcaafd23d61f80611fce01	2020-11-16 07:07:38 +03:00
Leonid Yuriev	459e769844	mdbx: engage cursor tracking for all merge/rebalance operations. Assume this resolves https://github.com/erthink/libmdbx/issues/131. Change-Id: I5111618a34d91d083b81245ac959b744a86c4495	2020-11-16 07:07:27 +03:00
Leonid Yuriev	37a1d546b7	mdbx: minor refine `mdbx_rebalance()`. Change-Id: I10a6a208b173bdee1d325aa7b2624de879814647	2020-11-16 06:28:11 +03:00
Leonid Yuriev	b209e91ad4	mdbx: zeroed `mc_top` while tracking nested cursors. This avoids scanning dummy cursors during tracking. Change-Id: Id4edc665010215b4a946f9438475691f1387313c	2020-11-16 05:48:44 +03:00
Leonid Yuriev	0c78da99b0	mdbx: add `cursor_is_tracked()` and assertions. Change-Id: I83db1a714597b134aa30e4ca7019bb7f541a2428	2020-11-16 05:48:23 +03:00
Leonid Yuriev	10681a53ae	mdbx: cleanup/refine GC-flags inside `mdbx_page_alloc()`. Change-Id: Ie81c703815a7b3fbe59ad9b406811d5ed2913d02	2020-11-16 05:43:53 +03:00
Leonid Yuriev	06691aeafc	mdbx-load: fix/preserve DB geometry without the `mapsize` header item. More for https://github.com/erthink/libmdbx/issues/136. Change-Id: I385869f2894ebe83b00b4e5b7ac4cacaabaf25d9	2020-11-16 00:53:34 +03:00
Leonid Yuriev	462df477b0	mdbx-load: cosmetic fix missed space. Change-Id: Ifb9deb7c31d2d191b621280b6afd63fad9d436a3	2020-11-15 07:57:46 +03:00
Leonid Yuriev	74e495569e	mdbx-load: fix DBI-error without `-s name` option. Related to https://github.com/erthink/libmdbx/issues/136 Change-Id: I1e634456867f92dc1488a826eabf65ab28e64c1b	2020-11-15 07:57:15 +03:00
Leonid Yuriev	3ed58c281a	mdbx-load: fix hang at EOF in the 'plain text' (i.e. no headers) mode. Related to https://github.com/erthink/libmdbx/issues/136 Change-Id: I6ac9762bc5ac6aaf8b947b2e4abb0b4ff6a14444	2020-11-15 07:54:09 +03:00
Leonid Yuriev	21d2af9e90	mdbx: merge branch 'c++' into devel. Change-Id: Ibd7f6c323aaf4f681a2c2dd442d36f4a9459d400	2020-11-01 00:39:19 +03:00
Leonid Yuriev	4cb8067dce	mdbx++: always provide implementation for `mdbx::path == std::string`. Change-Id: I8ef5c1531dc378b4141637ec4ddae3bbc67f1570	2020-10-31 23:24:05 +03:00
Leonid Yuriev	586e25c48c	mdbx++: add `operator<<(ostream, pair_result)`. Change-Id: I44cc28f7f4f7d65225239d62f5bb8a15a8de16a8	2020-10-31 23:23:46 +03:00
Leonid Yuriev	e3f32ec6b4	mdbx++: refine `operator<<(ostream, pair)`. Change-Id: I0f42c17a241cf4e2ed6ae8f18e84a13ba5500a3b	2020-10-31 23:23:30 +03:00
Leonid Yuriev	4e198915f2	mdbx++: fix `slice::is_printable()`. Change-Id: I7f572f8e2179313e3cd312a58e46d445b920ba3e	2020-10-31 23:22:31 +03:00
Leonid Yuriev	5ad167410c	mdbx: fix handling `MDBX_GET_BOTH_RANGE`. Partially revert 77e84ccca8d634db087fc710b1c4aea69ee5a6a6 and 7522246ccdb3c1b0928aa3e0f593133db0fadae5. Resolves https://github.com/erthink/libmdbx/issues/130 Change-Id: Ib9f49a3e6a108a0d914ccde7ccb4dc0ef6056ff7	2020-10-31 20:54:53 +03:00
Leonid Yuriev	70241e25db	mdbx: don't limit reclaimed-pglist if DB full. More for 55d190bad9723fd9766466005b1a14e70779fc89 and https://github.com/erthink/libmdbx/issues/123 Change-Id: Iecd19fe8f159d29a1434d03f43f0b277f2d6ab86	2020-10-30 19:22:37 +03:00
Leonid Yuriev	d9ceb84445	mdbx-tools: use `mdbx_cursor_bind()` inside the `mdbx_load`. Change-Id: I632841817331dfd493125c95350ec79e26147171	2020-10-30 17:44:51 +03:00
Leonid Yuriev	0f64d0ee95	mdbx: update internal `MDBX_NO_ROOT`.	2020-10-30 17:44:51 +03:00
Leonid Yuriev	d5658c496f	mdbx: fix `mp_txnid` check for spilled pages. This is OMG stupid bug. Тем не менее, ошибка не была замечена по трём причинам: - some TODOs should be resolved, like [this](`faddc71eac/src/core.c (4014)`) and some others; - test cases should be extended to triggering the page spilling threshold; - mdbx_env_set_option() should be provide to tunning such threshold(s) (https://github.com/erthink/libmdbx/issues/128). Resolves https://github.com/erthink/libmdbx/issues/126 Change-Id: If76336620aa83e6916e3aeaa838e0b6e68c34fd7	2020-10-30 17:44:31 +03:00
Leonid Yuriev	16c900b0a1	mdbx: fix assertion inside `mdbx_cursor_del0()`. Change-Id: I87ad3777215bee8a2b19f53ec92299db89431fa4	2020-10-29 00:55:42 +03:00
Leonid Yuriev	105947b50c	mdbx: minor refine internals comments/docs. Change-Id: Ie1dd2233259948b4906e66fb191832dbc6526c47	2020-10-29 00:55:12 +03:00
Leonid Yuriev	faddc71eac	mdbx-tools: cleanup/refine `mdbx_dump` & `mdbx_load`.	2020-10-27 01:08:01 +03:00
Leonid Yuriev	3fd079262c	mdbx: fix extra-rare `MDBX_KEY_EXIST` during `mdbx_commit()`. The MDX_KEYEXISTS error could occur inside mdbx_update_gc() in the extremely rare case: - no GC records was reclaimed before mdbx_txn_commit() called; - there were few loose pages during the transaction; - some reader prohibit reclaiming, therefore mdbx_page_alloc(MDBX_ALLOC_GC), which called for obtain present GC-record's Id, returns MDBX_NOTFOUND; - immediately then the reader completes its transaction and unlocks reclaiming; - mdbx_update_gc() decide that no reclaimable GC entries, i.e. no GC-entries with ID < find_oldest(), and it is safe to use find_oldest() - 1 to store loose page list; - but find_oldest() actually returns new/larger ID than expected, So KEYEXISTS will returned if using this ID. Change-Id: I9726217d6b5983f1e31a211c0eeb3edc8ff94282	2020-10-26 14:37:16 +03:00
Leonid Yuriev	1804b78406	mdbx-debug: alter begin/end debug-includes. Change-Id: I024e992f6864befa1a6cfbf2dd696c19095d3cdf	2020-10-26 14:36:59 +03:00
Leonid Yuriev	77e84ccca8	mdbx: refine `mdbx_cursor_set()` around the exact-flag. Change-Id: Ifbad6bb4a3a4eabaf85c7986f9566705d53c45b9	2020-10-26 03:52:07 +03:00
Leonid Yuriev	7522246ccd	mdbx: fix intenals for `mdbx_get_equal_or_great()`. Change-Id: I7b44df14c6f9ede4844d53e28c1b34d84fc664fa	2020-10-26 00:42:21 +03:00
Leonid Yuriev	005517539b	mdbx: adds `SIGPIPE` suppression inside the env_copy-thread. Change-Id: Ib7d22b8db7435b396bd997b65ae1d6d5d3431ba9	2020-10-23 03:22:22 +03:00
Leonid Yuriev	fed14c8f4c	mdbx: minor tweak `mdbx_pages_xkeep()`. Change-Id: I6df699aeb49640b0365918c33cff05dcbcef2b71	2020-10-23 03:18:00 +03:00
Leonid Yuriev	55d190bad9	mdbx: avoid `MDBX_TXN_FULL` while searching for a large multi-page region. Resolves https://github.com/erthink/libmdbx/issues/123 but with TODO: - provide a user-configurable threshold instead of currently hard-coded default (MDBX_PNL_MAX/2). Change-Id: Ia7bfd5f8d36e027444d234e3c3aabe4832313466	2020-10-22 18:04:02 +03:00
Leonid Yuriev	8a7caec54a	mdbx: cleanup deletion internals. Change-Id: Ibcc5e02d5274c4eac5d6f269bc2b029f6b30c5ab	2020-10-22 16:28:44 +03:00
Leonid Yuriev	b0928219c3	mdbx: fast completion pure nested transactions. Change-Id: I467cc0f2f3e781bf23bf8c45eb021987ae7c123b	2020-10-21 02:24:39 +03:00
Leonid Yuriev	daf37363b4	mdbx: fix cursor state after delete current entry. The fix affect enough of code sections, so there is a chance that some more changes will be required. Resolves https://github.com/erthink/libmdbx/issues/121 Related to https://github.com/ledgerwatch/turbo-geth/issues/1147 Change-Id: I45b7637516de410923a0d723dbda8d818662ba15	2020-10-21 02:24:33 +03:00
Leonid Yuriev	b964b2abf5	mdbx: more spelling. Change-Id: I45e42c1d8ef51f910b8e41279b92e54a6b2ce772	2020-10-21 01:00:48 +03:00
Leonid Yuriev	7001d971e1	mdbx: clarify/refine mdbx_flush_iov(). Change-Id: Ib9462efdbf97e42b1e80bf130f8150072102d9ed	2020-10-21 01:00:48 +03:00
Leonid Yuriev	f73a8a8680	mdbx: add latency gathering for commit stages. Change-Id: If68ceb6e69e5e565ce9de0fd9a80424b6da280c5	2020-10-21 01:00:48 +03:00
Leonid Yuriev	7cf92b66cf	mdbx: add LIBMDBX_INLINE_API (both inline and non-inline of some API functions). Change-Id: I00c2b6d3d2a0467080791ea0c1c2242742a20c78	2020-10-17 01:00:36 +03:00
Leonid Yuriev	38485c9f30	mdbx: minor refine `cursor_sibling()`. Change-Id: I2c92ef2c3081dfa0a9bdcd47de0f912a9927519e	2020-10-16 18:57:07 +03:00
Leonid Yuriev	112ce742f5	mdbx: refine `update_gc()`. Change-Id: I877cdf2efb623c61dc810ec1cebb985fe925a120	2020-10-12 00:09:06 +03:00
Leonid Yuriev	62da4db09a	mdbx: fix/refine the use of C11 atomics. Change-Id: I5d925d4625b06296fd82f4b35ee36be682e7b2d3	2020-10-11 18:54:07 +03:00
Leonid Yuriev	041a4c0aa5	mdbx: make enabling of read-ahead strategy more aggressive. Change-Id: I7765c1a1ac27db86ce9676846ec5a723860dc934	2020-10-11 01:14:30 +03:00
Leonid Yuriev	071ad525c8	mdbx: refine `handle_env_pathname()` for direct pathname of data-file inside sudir-mode. Change-Id: I5b7e7c7ea5c17e00c344fedb5c96f8d94fc04fc8	2020-10-11 00:14:53 +03:00
Leonid Yuriev	1d71c677f6	mdbx++: add `env::remove()` method. Change-Id: If0396d38738df88d054eb8fb752c7bd3afbd8487	2020-10-10 18:31:15 +03:00
Leonid Yuriev	0627d902dd	mdbx: add `mdbx_env_delete()`. Resolves https://github.com/erthink/libmdbx/issues/119 Related to https://github.com/Kerollmops/heed/issues/58 Change-Id: Iec5bf5978e45bb6843f3ed8dd06ea4d34f2895cb	2020-10-10 00:58:53 +03:00
Leonid Yuriev	cd0c727880	mdbx: internally split-out `mdbx_handle_env_pathname()`. Change-Id: Ibe387662d737d4d1e274ac0e126053872be503f9	2020-10-10 00:52:41 +03:00
Leonid Yuriev	9bf7d53dc2	mdbx: `MAX_MAPSIZE32` value has been reduced to `0x7f000000`. Change-Id: Ia45dd56621cd92441a45b8e80420a124cd111fdc	2020-10-10 00:52:41 +03:00
Leonid Yuriev	7ba13d8e72	mdbx: add internal bits/flags table. Change-Id: Ia9d0e9f678b51d8ffd1830998e9cd5d04c749974	2020-10-10 00:52:41 +03:00
Leonid Yuriev	c139eacb2d	mdbx-chk: avoid use GetTickCount64() for Windows 2000/XP. Change-Id: Ibad5c5ec0590cd3776283237de2cb83126785726	2020-10-08 01:50:18 +03:00
Leonid Yuriev	9b64b95bbc	mdbx-windows: fix mdbx_RegGetValue() for Windows 2000/XP. Change-Id: I436a254300fcba8dbf75ea7568c2bf0c963fe060	2020-10-08 01:50:18 +03:00
George Hazan	e8fecd1eec	mdbx: fix opening DB on a network shares (pass MDBX_EXCLUSIVE from env). Change-Id: Ic5c68033ba81043ac7800f99aae364bf082c868f	2020-10-08 01:50:18 +03:00
Leonid Yuriev	0f3b82f661	mdbx: minor refine WITH_CURSOR_TRACKING macro. Change-Id: I61a4782ae76aed624fe37f7dde2b0ef7eb5dfb64	2020-10-08 01:50:18 +03:00
Leonid Yuriev	b274fdd142	mdbx: clarify page-merge strategy. Change-Id: I1bb843ab6bdfcd53deae6d219a5b164bd3a79fd3	2020-10-08 01:49:56 +03:00
Leonid Yuriev	f5ce471ebb	mdbx: fix minor copy&paste typo. Change-Id: I5a1be230d0ca92123006e709aaaf78496918c91a	2020-10-07 12:18:28 +03:00
Leonid Yuriev	fe65c122d2	mdbx: fix `pthread_yield()` for non-GLIBC. Change-Id: I080e37a42b62e524896dea8747e9f23e2fcd584f	2020-10-06 00:28:12 +03:00
Leonid Yuriev	8d4e7994c0	mdbx-load: fix minor false-positive GCC warning. Change-Id: Ie75c793712d050e8d3da76a4d0a8df9b81dc5275	2020-10-05 19:15:18 +03:00
Leonid Yuriev	70b615e8d4	mdbx: don't use `yield` instruction on ARM if unsupported. Change-Id: I0b01d783fe4336b089f4b051fb61c203b5879aa5	2020-10-05 19:15:07 +03:00
Leonid Yuriev	280ed17ea2	mdbx: fix obsolete `__noreturn`. Change-Id: Ic78843d6f16de2a409c16ceecc7acb2ed8aa3e68	2020-10-05 19:14:20 +03:00
Leonid Yuriev	fc965c57ac	mdbx: fix merge_sync_flags() to preserve MDBX_UTTERLY_NOSYNC. Change-Id: I59dbd1ef8ac1747dd20565ff444e4feb5d0e0e71	2020-09-30 04:01:36 +03:00
Leonid Yuriev	f6850f5367	mdbx: Support for user-settable cursor context. Change-Id: I9bd60c432924e39020b2d3af3280f13c44d6cd91	2020-09-29 21:15:25 +03:00
Leonid Yuriev	72e136b9da	mdbx-doc: fix/refine README & Doxygen docs. Change-Id: I79cfb44f84fbf0f118b0d209af1ef62bb9dae72a	2020-09-29 21:15:25 +03:00
Leonid Yuriev	c8a0951566	mdbx: rework API and Docs around Handle-Slow-Readers (no algorithmic changes). Change-Id: I5b76a8400ce6f5f241f8e4a7f53d746fe39f8e1e	2020-09-29 21:15:25 +03:00
Leonid Yuriev	6294e1710a	mdbx: support for user-settable transaction context. Change-Id: Ib4a345628e2c1ca2f95ac7615ea53d94911e5198	2020-09-29 20:59:55 +03:00
Leonid Yuriev	10c50aaf2e	mdbx-cmake: minor refine MDBX_BUILD_TARGET/MDBX_BUILD_TYPE, etc. Change-Id: I34f99c50ced56b310576743c56422a1e1992c03b	2020-09-29 20:59:55 +03:00
Leonid Yuriev	5374d06d92	mdbx: fix minor MSVC warning. Change-Id: Ie3c9fa7ba21cd88f7a0c08a1529542ba394fe9c8	2020-09-29 20:59:55 +03:00
Leonid Yuriev	2a0c9d83e0	mdbx-load: refine usage-help for `-n` option. Change-Id: I4af2ea041bca323f8647601f49610f93a8f97d38	2020-09-28 15:48:21 +03:00
Leonid Yuriev	c0cc531b50	mdbx-doc: minor refine man-pages for `-n` utils option. Change-Id: Ie81145fc1ec70f66e6c7be7332b2106d6636dc6b	2020-09-28 15:48:21 +03:00
Leonid Yuriev	92bc728f39	mdbx: update warnings/errors for old version GCC/CLANG/MSVC/GLIBC. Change-Id: I355316f6c8d96eae4bd5d9743f0b6e50caddcbcd	2020-09-27 17:01:59 +03:00
Leonid Yuriev	1e3f633665	mdbx: fix build with uclibc. Change-Id: I907fecd84b335a84d5f1dcaa44ac489c4dfb1907	2020-09-27 17:01:59 +03:00
Leonid Yuriev	5627521f16	mdbx++: more spelling. Change-Id: I3f33e695fb918c6a57c39047bba54a72ecb9bc5b	2020-09-27 17:01:59 +03:00
Leonid Yuriev	5d582b1b3a	mdbx-chk: refine output (bootid, steady/weak, kv-kind). Change-Id: Ia2474f7bb9a25adf761a561d0704362dca930796	2020-09-27 17:01:58 +03:00
Leonid Yuriev	6eaa838e3e	mdbx: clarify logging for MDBX_WANNA_RECOVERY in case sync-needed in rdonly-mode. Change-Id: I7032cfbce857e2acfb93de383272a4f41ab6a7fb	2020-09-27 17:01:58 +03:00
Leonid Yuriev	12339d4e7c	mdbx: rename bootid' fields to be neutral for endianess. Change-Id: I7d52d3c2c93dcc6e886d336885070eb1aee1c284	2020-09-26 02:23:09 +03:00
Leonid Yuriev	12652852bd	mdbx-doc: update man-pages. Change-Id: Ia9caf0082c32cf95526cc1080507c61f9269c9dc	2020-09-25 02:10:55 +03:00
Leonid Yuriev	af331a9e7c	mdbx-tools: fix getopt's messages for windows. Thank to Andrey Sporaw for the reporting. Change-Id: I7531427c48b1a2f5483e2f04175cded2d34062a8	2020-09-25 01:53:43 +03:00
Leonid Yuriev	75a4463811	mdbx: minor misc cosmetics & refines. Change-Id: I84b70aeded047ab3786a57c864dbc89364969afa	2020-09-25 01:21:45 +03:00
Leonid Yuriev	860aa017db	mdbx: Merge branch 'master' into devel. Change-Id: Ic130cd181097332aa2f49019d75403e18d8cba0d	2020-09-25 01:14:57 +03:00
Josh Soref	448728f584	mdbx: a lot of spelling (squashed). Many Thanks to Josh Soref for these fixes. https://github.com/jsoref Resolves https://github.com/erthink/libmdbx/pull/118. Change-Id: I4e09347da5c9d7a77cdd918a3b15284371440076	2020-09-25 01:01:25 +03:00
Leonid Yuriev	4eab5b238a	mdbx-chk: support for turn to a specified meta-page. Change-Id: I9d088681e7bd66a2f8b5917067c4f847733d17ac	2020-09-23 10:05:38 +03:00
Leonid Yuriev	58708f7162	mdbx: add mdbx_env_turn_for_recovery(). Change-Id: Ic02a5adf9ad398ae5b499e8808157e41ec42457e	2020-09-23 10:05:38 +03:00
Leonid Yuriev	9b5097fe9d	mdbx: add paranoid checks for txnid overflow. Change-Id: I0036a080d40a0da9ffc55ff838d91799ff0ceadb	2020-09-23 10:05:38 +03:00
Leonid Yuriev	c67a611313	mdbx-chk: refine output basic info of sub-databases. Change-Id: Ia51b753990eb7a552dab016aab352b37c62ce4c3	2020-09-23 10:05:37 +03:00
Leonid Yuriev	7762e6e836	mdbx-chk: show last modification of each sub-database. Change-Id: Ib424d17371adaef543a10b4f1d8a456cd6466046	2020-09-23 10:05:37 +03:00
Leonid Yuriev	d4b16c981d	mdbx: fix minor Coverity warning. Change-Id: Id92d85a7032a20a4b06d87878e32d8997b6558e3	2020-09-23 10:05:37 +03:00
Leonid Yuriev	45909eca61	mdbx-chk: fix minor typo. Change-Id: Ib120f7af827463dd93af352fc8b4ce6af1926b75	2020-09-23 10:05:37 +03:00
Leonid Yuriev	7fe4fccda8	mdbx: acquire exclusive lock for the destination file during mdbx_env_copy(). Change-Id: Ic75796025dd2a649840b96b1f71aecac9360d010	2020-09-23 10:05:37 +03:00
Leonid Yuriev	24c0749eb8	mdbx: rework/refine mdbx_mresize() for POSIX and MAP_FIXED_NOREPLACE (Linux 4.17). Change-Id: I2e531b5e3e009b2a18ae1901fc7e2e6e4df667cd	2020-09-22 04:07:43 +03:00
Leonid Yuriev	a7a8631bc3	mdbx: allow sync_file_range() to fail for Valgrind/QEMU cases. Change-Id: I9aa77d1debfbd0cb18e940946533e4ed758d08e8	2020-09-21 17:18:07 +03:00
Leonid Yuriev	c01750be2e	mdbx: provide MDBX_USE_SYNCFILERANGE option. Change-Id: Icf1f27d6203653b4e2f2180a59a65e958c4d5e2e	2020-09-21 17:18:07 +03:00
Leonid Yuriev	a2e2e5c8a0	mdbx: allow sendfile() and copy_file_range() to fail for Valgrind/QEMU cases. Change-Id: I37ee8d652d91a8d2106c782beceaacb13e9f667f	2020-09-21 03:29:38 +03:00
Leonid Yuriev	25e3968199	mdbx: provide MDBX_USE_SENDFILE and MDBX_USE_SENDFILE options. Change-Id: Icd9a6487ae6e398276a9e720926ff24de5897c1a	2020-09-20 20:16:26 +03:00
Leonid Yuriev	765a18ed59	mdbx_chk: support for checking using specified meta-page. Change-Id: Iadb930154acb966f03aa1dec9cc7cbdc76779f05	2020-09-19 02:55:19 +03:00
Leonid Yuriev	d9daf2944d	mdbx: add env_open_for_recovery() (squashed). Change-Id: I0151b21610def433745c33d1f6e0b66ce655d1a9	2020-09-19 01:48:24 +03:00
Leonid Yuriev	b321f67ed2	mdbx: Merge branch 'master' into devel. Change-Id: I4f180753fe52b54f37f4fd12af2ba1b3ca541726	2020-09-19 01:47:12 +03:00
Leonid Yuriev	73647a5e46	mdbx: fix/refine mdbx_walk_tree() for working with invalid/corrupted DB. Change-Id: I2594b785f675319027ff129d12683c4392e6e2f4	2020-09-19 01:44:21 +03:00
Leonid Yuriev	6a99303ec1	mdbx: fix mdbx_strerror() for MDBX_BUSY error. Change-Id: Iea02f1daa3f52a9b737366e9af3c7def748ab523	2020-09-18 23:57:35 +03:00
Leonid Yuriev	e762442917	mdbx: don't resize mapping beyond used part of DB for read-only txn. This allow reading extra large DB when used part is acceptable for current platform, i.e. reading DB >4G on a 32-bit platform.	2020-09-18 15:02:36 +03:00
Leonid Yuriev	488a272f8b	mdbx: more for opening large DB from 32-bit env. - return `MDBX_TOO_LARGE` only when used part of DB is too large for current platform; - auto lowering both of `mm_geo.lower` and `mm_geo.upper` if the used part of DB is acceptable for current platform; Change-Id: If67109ebb96063451c50f279c473ed38355a098a	2020-09-18 13:34:34 +03:00
Burak Arslan	efe400264f	mdbx: minor fix msvc build (#117 ).	2020-09-15 20:03:42 +03:00
Leonid Yuriev	10b170c6cd	mdbx: add mdbx_cursor_create() and mdbx_cursor_bind(). Change-Id: I223de3cca7865d58f17a59ab27ec6be730e04a90	2020-09-15 02:05:25 +03:00
Leonid Yuriev	234d65dc9d	mdbx++: update copyright & license note. Change-Id: If6aac3dec6d05247aec5af956385066619685c35	2020-09-14 21:19:56 +03:00
Leonid Yuriev	cacc4aa829	mdbx++: changes after codereview-1 (part 2 of 2). Change-Id: I8e1ca134bb8c5d447895f116247dfd12fa6871f0	2020-09-14 21:19:56 +03:00
Leonid Yuriev	04b0d258ff	mdbx++: changes after codereview-1 (part 1 of 2). Change-Id: If58c4281ce29f95fd566bc615082963a9500c381	2020-09-14 17:18:20 +03:00
Leonid Yuriev	da151e52a7	mdbx++: hide/move `trouble_location` to unused section. Change-Id: If0cb1ae18e164819f916ff6fc1b5e6e487f50368	2020-09-14 02:23:19 +03:00
Leonid Yuriev	17d9ed31f9	mdbx: support for building by GCC 4.8 Change-Id: I4ad5c5be60233ae68936e0cbca1a0f01ec786bad	2020-09-13 21:22:41 +03:00
Leonid Yuriev	6c70a7fe11	mdbx++: enables C++ API for amalgamated source code. Change-Id: Ie73f32ee6b9a565eee69fa7267798a0fd67db4b0	2020-09-13 21:22:41 +03:00
Leonid Yuriev	cd4caeb03d	mdbx: add mdbx_panic() to C API. Change-Id: I009a7889311b57ae2210822a8087889f900919f8	2020-09-10 15:37:59 +03:00
Leonid Yuriev	58bcfb006e	mdbx: add mdbx_printf_args() macro. Change-Id: I7fca72f8cc912d8644ecf149b755c78fb3cc7e23	2020-09-10 15:35:43 +03:00
Leonid Yuriev	50c25f479d	mdbx++: more Doxygen descriptions and refinement. Change-Id: Iec4cfa220f140c0fcc858f51283af2f9c4dd7a65	2020-09-10 01:15:35 +03:00
Leonid Yuriev	9249297d31	mdbx: fix MSVC compiler version requirements. Change-Id: Iabf7ab571ca887bd7995ae6293d3c70bb85a947b	2020-09-07 12:38:08 +03:00
Leonid Yuriev	538d2e4d62	mdbx: skip update meta-geo in read-only mode. Change-Id: I1c9610920ad87dc8110e8d03038ef385220000c8	2020-09-07 12:38:08 +03:00
Leonid Yuriev	81f82ae7b3	mdbx++: added partial doxygen descriptions and refined some methods. Change-Id: I98bd4cb6e296970abbd40ffa049eff6051f30135	2020-09-07 03:10:25 +03:00
Leonid Yuriev	2bcd2e510e	mdbx: Merge branch 'devel' into c++. Change-Id: Iedfe7e7ae21d08628c24b4dd5a788bc43cced2f5	2020-09-05 13:48:40 +03:00
Leonid Yuriev	ab9f47a5fe	mdbx: fix MSVC compiler version requirements. Change-Id: Iabf7ab571ca887bd7995ae6293d3c70bb85a947b	2020-09-05 12:16:00 +03:00
Leonid Yuriev	54ccb92444	mdbx: skip update meta-geo in read-only mode. Change-Id: I1c9610920ad87dc8110e8d03038ef385220000c8	2020-09-05 11:57:34 +03:00
Leonid Yuriev	c24e566591	mdbx: alter notice/warning/verbose level of some log-messages. Change-Id: I08c3f5cf6489095f04c8becc4818d34b8db61422	2020-09-05 11:48:29 +03:00
Leonid Yuriev	6d7ec5a257	mdbx: enable non-debug logging in non-debug builds. Change-Id: I295de5ef6369a55500b023abc3dcb26f5071c2da	2020-09-05 01:57:02 +03:00
Leonid Yuriev	b1877d08ae	mdbx: rework mdbx_chk & tree-traversal. Change-Id: Idc131539426fe0cbb97a105cff2d0a12b1496bfe	2020-09-05 01:57:02 +03:00
Leonid Yuriev	9a5df2b284	mdbx: refine errors returning from get_page(). Change-Id: I2da37d3b35679f345324d6dd97d2a3f634449b56	2020-09-05 01:57:02 +03:00
Leonid Yuriev	6867c13bd1	mdbx: more runtime checks/errors instead of assertions. Change-Id: I843f28b7faeb23f986154dd92a0e2b50d66a1dde	2020-09-05 01:57:02 +03:00
Leonid Yuriev	a758e32f91	mdbx: remove assertions from page_check(). Change-Id: Ic157e7fc43d9c3a84e530d0001409ff2a5c1f818	2020-09-05 01:57:02 +03:00
Leonid Yuriev	6e339fc849	mdbx: add bad_page(). Change-Id: I5233e4a701ee11fd59d7083576f40f7df3068ddd	2020-09-05 01:57:02 +03:00
Leonid Yuriev	f0de3ff098	mdbx: continued page-check. Change-Id: Id4aa37284a12f49e359a6c9391d2fd5b6acb2ad0	2020-09-05 01:57:02 +03:00
Leonid Yuriev	d6645f84f2	mdbx: more error logging. Change-Id: I3757e587514450634b5d3ebf8721c9ed4ac182f1	2020-09-05 01:57:02 +03:00
Leonid Yuriev	cd6aa4a708	mdbx: parent-page-txnid checking. Change-Id: I6d37326c4ff2aa32587704b971bd650d9221b06f	2020-09-05 01:57:02 +03:00
Leonid Yuriev	cd4f732a87	mdbx: drop internal unused fields. Change-Id: I634d3e0695f300df79129a15da752a23b277a0ce	2020-09-05 00:55:00 +03:00
Leonid Yuriev	b095ad872c	mdbx: add MDBX_ALLDUPS & MDBX_UPSERT, rework handling of others. Change-Id: I27d437540d883935d78242e4fc7e28951ab9f496	2020-09-05 00:26:06 +03:00
Leonid Yuriev	0671114bbb	mdbx++: Add support for C++17 polymorphic allocators. Change-Id: I76054829551c247a4d8f81288fc47db47ead0288	2020-09-05 00:26:06 +03:00
Leonid Yuriev	5ec0f5b299	mdbx: refine mdbx_replace_ex(). We can skip update only when a data exactly the same, but user's md_dcmp() may returns zero even data is NOT matches byte-to-byte. So to skip update the cmp_len fast() should be used instead of md_dcmp(). Change-Id: I6ad0f7cfc6a18722b46e565deef3a544ddf9968a	2020-09-05 00:26:06 +03:00
Leonid Yuriev	33b1cf2931	mdbx++: Initial C++ API (some extra methods are not implemented). Change-Id: I0478d0c94dcd12b52916e87815e5731817407c3c	2020-09-05 00:26:06 +03:00
Leonid Yuriev	89dba59ce2	mdbx: refine/fix handling MDBX_MULTIPLE in the mdbx_cursor_put(). Change-Id: I06ac9d73cec01afb492b5c663acf310d19e4900b	2020-09-05 00:26:06 +03:00
Leonid Yuriev	426d207fc4	mdbx: fix page_get() null-defer when DB corrupted. Change-Id: Ia4b5870e6718cd376d25893d33b9c659e3cd151a	2020-09-04 23:56:43 +03:00
Leonid Yuriev	362df3a031	mdbx: workaround for MSVC 19.27 static_assert() bug. Change-Id: Ia143795a57e800bc39e126cd90f34a6abde81ca3	2020-09-01 21:41:52 +03:00
Leonid Yuriev	bf31cca375	mdbx-chk: fix 'differentent' typo. Change-Id: Id56171bdbfe92a589f574a4803beab4abf2d9cdb	2020-09-01 20:54:15 +03:00
Leonid Yuriev	6b1c2ff762	mdbx: fix mdbx_env_open() for re-opening after non-fatal errors. Change-Id: Ibbe9a8e017837a21fe1eeebb86e1b3a7a370e77c	2020-09-01 20:54:15 +03:00
Leonid Yuriev	e6696178db	mdbx++: refine exceptions. Change-Id: I56d3fd4716320af7a5aec1824fbded5f9efc416c	2020-09-01 16:20:17 +03:00
Leonid Yuriev	500609736c	mdbx++: rename default_allocator to legacy_allocator. Change-Id: I48118a9424be3063b916c00c73715aed4e244ac8	2020-09-01 14:46:37 +03:00
Leonid Yuriev	883c9f960c	mdbx++: don't use obsolete MDBX_MAPASYNC. Change-Id: I328772a36d14a7593f3b9ee31796fb33d30de7b0	2020-09-01 14:12:12 +03:00
Leonid Yuriev	cd9ac17d59	mdbx++: Done rest of NOT_IMPLEMENTED. Change-Id: I4707416ce4a7b41a04824749be34e338d73f9ea0	2020-09-01 14:12:12 +03:00
Leonid Yuriev	baeca4109a	mdbx++: Implements std::ostream << operators. Change-Id: Iec4b6fc0344e3d3f3ff665ce28e23c2f315d8bdb	2020-09-01 13:23:03 +03:00
Leonid Yuriev	62be36cc9e	mdbx++: is_printable() for UTF8. Change-Id: I96a58dc97e2f4261eafceb358a1dca7ba55cfa0d	2020-08-31 16:35:49 +03:00
Leonid Yuriev	ee902621db	mdbx++: Implements most of C++ API (except related for iostreams). Change-Id: Ia61c208506c3d94700a240725cb854275c7de087	2020-08-31 16:34:58 +03:00
Leonid Yuriev	6ca0f144fa	mdbx: workaround for MSVC 19.27 static_assert() bug. Change-Id: Ia143795a57e800bc39e126cd90f34a6abde81ca3	2020-08-31 02:35:11 +03:00
Leonid Yuriev	eca3904dfa	mdbx++: minor fix env::setup(). Change-Id: I751cbf5c9d1d83a3b4da2af1f5950d85ce2934cd	2020-08-29 16:36:30 +03:00
Leonid Yuriev	12e19cedc0	mdbx: minor fix mdbx_replace_ex(). Change-Id: I2e1f27b1d73b450643743cf9d4ad35d5cd4547de	2020-08-29 16:36:30 +03:00
Leonid Yuriev	317816d6c7	mdbx: refine/simplify mdbx_cursor_del(). Change-Id: Ibd72817a33427483a4440eecc911815420b2e13f	2020-08-29 14:46:15 +03:00
Leonid Yuriev	1d48cb88fe	mdbx: Add mdbx_txn_break(). Change-Id: Id38a09a0a95d092d75f2eb4fad2cbd7805cd59d0	2020-08-28 21:20:51 +03:00
Leonid Yuriev	04a77d3bf3	mdbx: add MDBX_ALLDUPS & MDBX_UPSERT, rework handling of others. Change-Id: I27d437540d883935d78242e4fc7e28951ab9f496	2020-08-28 19:08:45 +03:00
Leonid Yuriev	aa7695c513	mdbx++: Add support for C++17 polymorphic allocators. Change-Id: I76054829551c247a4d8f81288fc47db47ead0288	2020-08-28 16:45:30 +03:00
Leonid Yuriev	08faeda430	mdbx: refine mdbx_replace_ex(). We can skip update only when a data exactly the same, but user's md_dcmp() may returns zero even data is NOT matches byte-to-byte. So to skip update the cmp_len fast() should be used instead of md_dcmp(). Change-Id: I6ad0f7cfc6a18722b46e565deef3a544ddf9968a	2020-08-28 16:45:30 +03:00
Leonid Yuriev	88a4b8cb9b	mdbx++: Initial C++ API (some extra methods are not implemented). Change-Id: I0478d0c94dcd12b52916e87815e5731817407c3c	2020-08-28 16:45:30 +03:00
Leonid Yuriev	e3f0db7708	mdbx: refine/fix handling MDBX_MULTIPLE in the mdbx_cursor_put(). Change-Id: I06ac9d73cec01afb492b5c663acf310d19e4900b	2020-08-28 16:45:29 +03:00
Leonid Yuriev	c53627f5ac	mdbx: fix null-deref during MDBX_TXN_RDONLY_PREPARE in the MDBX_EXCLUSIVE mode. Change-Id: I20b2bd4137293261a546910c8175be531d38b2c9	2020-08-23 16:28:00 +03:00
Leonid Yuriev	0a75417d5f	mdbx: add pure- & const-function attributes to C API. Change-Id: Ie4d1742f3d4717a0cd1fd5677b9b1ae641193d45	2020-08-23 13:29:44 +03:00
Leonid Yuriev	54a09967a1	mdbx: refine mode_t for lck-file. Change-Id: I7674a3a1c0a5778f0f362faa1d608c25e242d92d	2020-08-06 01:48:56 +03:00
Leonid Yuriev	17380fe079	mdbx: minor fix for MDBX_DBG_LEGACY_MULTIOPEN. Change-Id: I7d1c30699708c4b9e47e1b781e96c9a4b6c2b109	2020-08-06 01:48:56 +03:00
Leonid Yuriev	ffa10a25d6	mdbx: use enums & bool in the C API. Change-Id: I952f578cceb7d02ade16f545d47245d4d9106441	2020-08-06 01:48:56 +03:00
Leonid Yuriev	3bcf808005	mdbx: separate and describe MDBX_DB_ACCEDE. Change-Id: I1a846d196eb00138c1c5ec453537757b1df78d31	2020-08-06 01:48:56 +03:00
Leonid Yuriev	87de3fc25f	mdbx: add MDBX_TXN_RDONLY_PREPARE. Change-Id: I95647d1679b69d1e97514a45f20d7373174244d5	2020-08-06 01:48:56 +03:00
Leonid Yuriev	1e7a1da14e	mdbx: separate transaction flags. Change-Id: Ib9a0f6946e1ecf35059e2dccc91319ae130c9f9b	2020-08-06 01:48:56 +03:00
Leonid Yuriev	5e43ee61a2	mdbx: drop/deprecate MDBX_MAPASYNC. Change-Id: I472f97f568a32325eb056c8ee4d2f2350a473bda	2020-08-06 01:48:56 +03:00
Leonid Yuriev	135bead730	mdbx: disable warning C4204 for MSVC. Change-Id: Idf7246f5ee349294cea1ed15d69daa49e4dddedb	2020-07-31 01:33:16 +03:00
Leonid Yuriev	7ce33be933	mdbx: fix zero-length arrays for C++. Change-Id: I24ee4b34064f1face40d63861fb2f8982b922f7d	2020-07-31 01:33:16 +03:00
Leonid Yuriev	f4021c8028	mdbx: refine mdbx_dump_val(). Change-Id: I72dac7c44c842d16d6b8776248ba20014d0709a9	2020-07-31 01:33:16 +03:00
Leonid Yuriev	0a01b46112	mdbx: add mdbx_thread_register() and mdbx_thread_unregister(). Change-Id: I605bc75a20631e781043fafcc26f5e59cb40adaa	2020-07-31 01:33:16 +03:00
Leonid Yuriev	b91918b027	mdbx: add mdbx_env_get_maxdbs(). Change-Id: Ie4bdd2f8a46130f277ef98861a5fca98f55bad54	2020-07-31 01:33:16 +03:00
Leonid Yuriev	9e90718bd5	mdbx: add check_env(). Change-Id: Iff9258d1e31349da77ef030cfe6da7bcfc5c5a19	2020-07-31 01:33:16 +03:00
Leonid Yuriev	0387d6f6d4	mdbx: rename MDBX_ENV_CHECKPID. Change-Id: Id0afbea99b0747c6d7a5062c1c4a82ebc69f4f40	2020-07-31 01:33:16 +03:00
Leonid Yuriev	1e3c4dc0ef	mdbx: define & use bool type for C API. Change-Id: Icb6cd635a4813bfc92d31bdc527414bdddce4a63	2020-07-31 01:33:16 +03:00
Leonid Yuriev	c778d3cfd4	mdbx: bump version to 0.9.x (not a release, but API changes). Change-Id: I756f1224739df53d8503cf308c2c908f6ecd3fd1	2020-07-31 00:45:34 +03:00
Leonid Yuriev	dcd61289d8	mdbx-doc: more for Doxygen (refs, build options). Change-Id: I8b15bce3d6638a24bdafa3171ae10f01311862d7	2020-07-29 02:18:44 +03:00
Leonid Yuriev	a902538e34	mdbx: more Doxygen tags (almost done). Change-Id: I696e717e37a905f68af059c51f9df327c257332e	2020-07-24 22:49:21 +03:00
Leonid Yuriev	2cd7fcb16d	mdbx: fix minor Coverity issues. Change-Id: I21c44de18e4e620ecec38ec837446150736faf79	2020-07-24 17:43:35 +03:00
Leonid Yuriev	5f4f828bae	mdbx-doc: provide non-API docs via doxygen (squashed). Change-Id: Ie33858517f964f794ec182a1e8bb630730a0f172	2020-07-23 18:44:32 +03:00
Leonid Yuriev	3d31884c3b	mdbx-chk: always skip key ordering checking to avoid `MDBX_CORRUPTED` when using custom comparators. Change-Id: Ieb6ea4a1c36b0e661afc13da365505ffbb5d0b5e	2020-07-23 11:47:05 +03:00
Leonid Yuriev	9720ed39f5	mdbx: using `enum` instead of #define for flags/modes. Resolve https://github.com/erthink/libmdbx/issues/108 Change-Id: I45897300375d2b5b9361aaba81dadcf9801fe3cf	2020-07-08 02:26:46 +03:00
Leonid Yuriev	2e0d2e65af	mdbx: fix minor typos.	2020-07-07 23:16:43 +03:00
Leonid Yuriev	e989cb05ed	mdbx: deprecate mdbx_dbi_open_ex() and custom comparators. Change-Id: I1d20f77b9ba5d8d5ec891df17019377afb466b06	2020-07-07 19:33:59 +03:00
Leonid Yuriev	fab6ddee14	mdbx: add MDBX_DEPRECATED macro. Change-Id: I87e14b37a6d152fa1f69f4a74e16244870dedb0f	2020-07-07 19:33:17 +03:00
Leonid Yuriev	3351c1f869	mdbx: implements remapping of the database file when it it possible. Change-Id: Ida15ba1f396a33b2c6063e680dff612f39a9608f	2020-07-06 16:23:52 +03:00
Leonid Yuriev	2d0a5c42a9	mdbx: avoids unnecessary remap in case geometry changed concurrently by another process(es). Change-Id: Ibf3a90bc79b1e8e0fa752dabc21b129a697c08d4	2020-07-06 14:35:41 +03:00
Leonid Yuriev	5dbb0b4cfe	mdbx: rename internal flags & fields for clarity. Change-Id: I79d6d8e88b0b4c30cbb8a464ca17f07dc2ab44c6	2020-07-06 14:35:41 +03:00
Leonid Yuriev	c22749a630	mdbx: add TODO for auto-recovery. Change-Id: I7d5fd83a2fdeaec0501ba0339bbe865d06356bad	2020-07-05 00:34:32 +03:00
Leonid Yuriev	e6f5998b76	mdbx: refine mode bits while auto-creating LCK-file. Change-Id: Ideb603cf6a1709188b3c121a9d6bf2097b9c244d	2020-07-05 00:34:32 +03:00
Leonid Yuriev	e6eeed6cf2	mdbx: return MDBX_CORRUPTED in case all meta-pages are weak and no other error. Change-Id: I38c85738d8ccdb87856fa1a6e989ddaf75109722	2020-07-05 00:34:32 +03:00
Leonid Yuriev	5a25c7c5fb	mdbx: fix __pure_function & __const_function for CLANG & C++ exceptions. This is crutch for https://bugs.llvm.org/show_bug.cgi?id=43275 Change-Id: I6d29456cd83f8e713a5b1f6b50ac721bf985148f	2020-07-05 00:34:23 +03:00
Leonid Yuriev	505ee31635	mdbx: add __fallthrough workaround for LCC. Related to https://bugs.mcst.ru/bugzilla/show_bug.cgi?id=5093	2020-06-26 03:28:15 +03:00
Leonid Yuriev	0afc21eed9	mdbx: add mdbx_get_keycmp() & mdbx_get_datacmp(). Change-Id: I11f8a54f7eb21b0bab575c8f6b89081b7eaf1bb8	2020-06-24 17:15:56 +03:00
Leonid Yuriev	428f753c03	mdbx: add key-to-value functions. Change-Id: Ie0acd8c58833047931444fd9d94d5b82e6d541bb	2020-06-24 17:15:56 +03:00
Leonid Yuriev	0fc2d39cce	mdbx: allow mixind with/without MDBX_WRITEMAP for the same database. Change-Id: I916bb9e9b44a58cf78786e76a8c42d62e0bfc579	2020-06-20 23:55:15 +03:00
Leonid Yuriev	35313d18bc	mdbx-posix: refine mdbx_lck_init(), allow multi-opending with MDBX_LOCKING_SYSV.	2020-06-15 12:51:35 +03:00
Leonid Yuriev	e008f3132d	mdbx: support for huge transactions (MDBX_HUGE_TRANSACTIONS option). Change-Id: I5d6cce6a7fb816add8cb4c066cc50f31cdebf9d5	2020-06-13 03:06:20 +03:00
Leonid Yuriev	7ab9d24d3b	mdbx: fix env_set_geometry() for opened-env + outside-txn case. Change-Id: I4526aa8011895ef7b5529995503966117c37e107	2020-06-08 19:12:12 +03:00
Leonid Yuriev	03cc19babb	mdbx: preserve error from env_set_geometry() inside setup_dxb(). Change-Id: I8dae0b38eb09cfaa07cdd80cb37dc414e2f99d7a	2020-06-08 19:12:12 +03:00
Leonid Yuriev	0117473cbc	mdbx: bump version to 0.8.x Change-Id: I6d2a1a3b04341461288e18c66d11e79d343750b0	2020-06-05 03:00:43 +03:00
Leonid Yuriev	36dc9e26b6	mdbx: avoid forward-invalidation of DBI-handle when it just closing. Change-Id: I379f07c2eae9ea68ddf554d10d7d1deed1a00d2b	2020-06-04 12:24:11 +03:00
Leonid Yuriev	0146b3e2c0	mdbx: avoids using pwritev() for single-writes (up to 10% speedup for some kernels & scenarios). Change-Id: I71fbf0e113b1de4d05b2a43e8532a977c42b8f91	2020-05-29 18:39:43 +03:00
Leonid Yuriev	a159ae4b06	mdbx-tools: fix using ENODATA for FreeBSD. Change-Id: I3092e79116de96aa5e12e61e0963dc7545a1cf1b	2020-05-27 23:16:12 +03:00
Leonid Yuriev	ea353471d5	mdbx: fix minor typo. Change-Id: I02ab17d1867e8b1a0b9ef971c9922688eca9dc7c	2020-05-27 21:48:14 +03:00
Leonid Yuriev	1f301e7e6f	mdbx: explicit sync lck-file after re-write/re-create. Change-Id: I2fad76b1d04e4b0cd2ca08cb722bd819153f9824	2020-05-27 21:48:14 +03:00
Leonid Yuriev	5cc1cb3f87	mdbx: add mdbx_dbi_dupsort_depthmask(). Change-Id: Ib056663f26baea517d6f2b9d58cd64c643619ef9	2020-05-25 14:53:38 +03:00
Leonid Yuriev	51a016245a	mdbx: using couple of condvars/events to avoid glitches on Windows. Change-Id: I3256a8dcbb95c78e8dea3eb31ca73f42c58d2f61	2020-05-24 13:29:55 +03:00
Leonid Yuriev	a2bdbc97dc	mdbx: truncate clk-file when DB closed in sync-state. Change-Id: I2e2438606118e3aa3fa9d60811fea99994403d32	2020-05-23 01:34:52 +03:00
Leonid Yuriev	86a4085bf9	mdbx-windows: minor cleanup lck_downgrade(). Change-Id: I7f36baefe3e3d76083171ae0c0f97d21ad1e877a	2020-05-23 01:34:52 +03:00
Leonid Yuriev	d1d65f8090	mdbx: removes wrong condition from the assertion. Fixes https://github.com/erthink/libmdbx/issues/105 I decided to remove the extra check, since a sub-cursor cannot return data and there is no point in adding assignments just for this check. Change-Id: I6a983930abb37b8f6ab768602763495572adf7fd	2020-05-22 22:12:08 +03:00
Leonid Yuriev	78e592579a	mdbx: refine update_gc() for small pages with huge transactions. Change-Id: I66080e11a780a6a711691918179bc21d9a121347	2020-05-17 19:16:35 +03:00
Leonid Yuriev	d3e609d7ff	mdbx: simplify page-merge for LEAF2. Change-Id: I25ad34f02b86b47562fc3c74f5454432f687cbde	2020-05-17 19:16:19 +03:00
Leonid Yuriev	5e2067decd	mdbx-tools: use MDBX_ACCEDE to open DBI with custom comparators.	2020-05-15 22:03:29 +03:00
Leonid Yuriev	6fa2748fc7	mdbx-tools: refine mdbx_stat.	2020-05-15 22:03:29 +03:00
Leonid Yuriev	efe4fd2cc9	mdbx-tools: use equal-or-greater comparator for dont-check-ordering mode.	2020-05-15 22:03:29 +03:00
Leonid Yuriev	3f0d2a6ac2	mdbx-tools: extends dump/load to support all mdbx attributes. Change-Id: I04772ce0083c46b70f5342e92c7509c9a425724d	2020-05-15 22:03:29 +03:00
Leonid Yuriev	8f31aad0fb	mdbx: use MAX_TXN internally (cosmetics). Change-Id: Ic8171dbfa8bb32272e46e939223316f6182d3a7a	2020-05-15 18:13:10 +03:00
Leonid Yuriev	463a8af35b	mdbx: copy unaligned keys/values instead of return error to avoid break compatibility. Change-Id: I2f95674a3836568a5c51155ca70da0683c50b424	2020-05-15 11:30:35 +03:00
Leonid Yuriev	c2c74075e7	mdbx: fix Valgrind minor warning with MDBX_DEBUG > 1. Change-Id: Idb93c6a3843e76071a55cbd6c34ddd22541c77d3	2020-05-15 11:30:35 +03:00
Leonid Yuriev	c6edd6fb91	mdbx: exclude MDBX_NOSUBDIR from persistent flags.	2020-05-15 11:30:35 +03:00
Leonid Yuriev	e28d223d42	mdbx: fix MDBX_NODUPDATA handling for key-value data. More for https://github.com/erthink/libmdbx/issues/99 in continue to 9428efd2ae9f7fe984422b5eb1fc47f732236b51 Change-Id: I56050ddf5e56807a11d8613780c3ba76cc16d324	2020-05-15 11:30:35 +03:00
Leonid Yuriev	8c8c86038a	mdbx: fix unsigned-to-ptrdiff casting inside estimate(). Fixup after a238179c23e7378b2019de5229b2166cdfe515c7 Change-Id: I316e4aa1f41462fd0017f8e0a7f6d6e82aa4f3db	2020-05-15 11:30:35 +03:00
Leonid Yuriev	e6b48b613a	mdbx: more checking for MDBX_DEBUG. Change-Id: Ie6bedda942bc5623e5d7cee5d2011e41009ea3d9	2020-05-15 11:30:35 +03:00
Leonid Yuriev	f6fe3b44de	mdbx: fix fetching of first/lower key in case starting from LEAF2-page during page merge. More for b3f375c57f9ff0f1f58e77227374b1cfddcd3278	2020-05-15 11:30:35 +03:00
Leonid Yuriev	57d76d1f7a	mdbx: checking the order of keys on all pages during the audit (squashed).	2020-05-15 11:29:23 +03:00
Leonid Yuriev	30bb2363e1	mdbx: use comparators instead of is_samedata().	2020-05-15 08:59:10 +03:00
Leonid Yuriev	b7fb9bdeb1	mdbx: fix mdbx_xcursor_init1() for prev created databases.	2020-05-15 08:59:10 +03:00
Leonid Yuriev	d986d09b7b	mdbx: rework min/max length checking for keys & values (squashed).	2020-05-15 08:59:03 +03:00
Leonid Yuriev	9736a36efb	mdbx: add branch-less flags_db2sub().	2020-05-11 02:03:55 +03:00
Leonid Yuriev	e4ce115876	mdbx: fix MSVC warnings (minor). Change-Id: I614ee9ec1c21586fbe08c6cedb395ac57a81914f	2020-05-10 03:56:25 +03:00
Leonid Yuriev	5b4b3fa9ea	mdbx-windows: fix MDBX_AVOID_CRT option & ntdll.def distribution. Resolve https://github.com/erthink/libmdbx/issues/100 Change-Id: I18ab055e79e249fca856353b2585739c88e01758	2020-05-10 03:41:28 +03:00
Leonid Yuriev	a238179c23	mdbx: rename/reorganize internal fields for clarity. Change-Id: I9b23a8ca271f30ebedda9cd8d21094b4797f8bb3	2020-05-09 20:00:31 +03:00
Leonid Yuriev	8ee3c6ddb0	mdbx: minor fix return MDBX_EBADSIGN. Change-Id: Ia0da8b4c2a5f0776688c92ad50433eed5e83b73c	2020-05-09 20:00:25 +03:00
Leonid Yuriev	9428efd2ae	mdbx: avoid upsertion (early exit) the same key-value data. Resolve https://github.com/erthink/libmdbx/issues/99 Change-Id: I6aac66d6cb6818951e29bc8a3626c342d6137151	2020-05-09 03:25:20 +03:00
Leonid Yuriev	86dad2d727	mdbx: drop obsolete/unused mn_hi & mn_lo. Change-Id: Ie0099c5afa66ccb679b124f3feb095a364519edc	2020-05-09 03:25:20 +03:00
Leonid Yuriev	db635c9fbb	mdbx: fix/don't clean env-signature if open failed.	2020-05-09 02:48:56 +03:00
Leonid Yuriev	83cf4cd3d5	mdbx: refine/fix mdbx_dbi_open_ex() to safe concurrently opening the same handle from difference threads. Change-Id: Ib01b6015bbb28eb2777f9206d6a5ac2cf9c2575f	2020-05-09 02:46:35 +03:00
Leonid Yuriev	f11607dfa6	mdbx: minor fix/workaround to avoid UBSAN traps for memcpy(ptr, nullptr, 0).	2020-05-03 01:48:12 +03:00
Leonid Yuriev	175c361018	mdbx: avoid gcc-anylyzer false-positive warnings.	2020-05-02 22:38:53 +03:00
Leonid Yuriev	b943466727	mdbx: fix missing comma in err-msg array (Coverity). Change-Id: Ic441e63cf8ed14108dfe7c38e269f819879e21ce	2020-05-01 02:42:28 +03:00
Leonid Yuriev	1488457641	mdbx-tools: hide '-n' option (NOSUBDIR) since now it guessed automatically. Change-Id: I8668ec919f2f90b133270a566f380066dbb8589f	2020-04-30 16:59:46 +03:00
Leonid Yuriev	b3f375c57f	mdbx: fix branch-page merge. Change-Id: I48dce339d1735cd8d270f1ba1c091572daa897a6	2020-04-30 16:57:29 +03:00
Leonid Yuriev	eec465704d	mdbx: fix div-by-zero while copy-with-compaction for non-resizeable DB. Change-Id: Ice7f5675c3b2864195874f2e3c4ade9148cad048	2020-04-29 18:57:00 +03:00
Leonid Yuriev	fac0d47913	mdbx: add MDBX_CP_FORCE_RESIZEABLE option. Change-Id: I5fcdae7933dbbfbf8629e8a0423545a4f6b9f6b6	2020-04-29 18:57:00 +03:00
Leonid Yuriev	37abc146b4	mdbx-tools: minor refine mdbx_chk output. Change-Id: I0d1b70029b861a6048bba8c0239138160c7c6425	2020-04-29 18:39:20 +03:00
Leonid Yuriev	b44520b7d1	mdbx: don't reset last txnid while copy with compactification. Change-Id: Ia7c1b968ab6a21a3c178b45408088c84647276b1	2020-04-29 18:37:37 +03:00
Leonid Yuriev	eea1432e80	mdbx: auto-reset running transaction in mdbx_txn_renew(). Change-Id: If93ad13bb5a6dab8dd5fcb80882b5eb83fdf3dad	2020-04-26 03:32:50 +03:00
Leonid Yuriev	3b741a6d5f	mdbx: automatically abort errored transaction in mdbx_txn_commit(). Change-Id: I2cfac73c69a8ff46870778f174555724f8363a79	2020-04-26 03:23:04 +03:00
Leonid Yuriev	673570ec2a	mdbx: auto-choose pagesize for a large databases. Change-Id: I3f8279ba077a8c31c70504d32fb619b6601cc5c4	2020-04-23 17:15:55 +03:00
Leonid Yuriev	a5fb85f0fc	mdbx: avoiding MDBX_UTTERLY_NOSYNC as result of flags merge. Change-Id: Ia39de7b60a00b04a92ddf1468c995c4684f45474	2020-04-22 20:35:12 +03:00
Leonid Yuriev	21f9a445e8	mdbx: rework env_open() to auto-handling MDBX_NOSUBDIR for any exists database. Change-Id: Id8a26937c9013c750323646df01c3080a909a4c0	2020-04-22 17:33:59 +03:00
Leonid Yuriev	30f7f15778	mdbx: automatic MDBX_NOSUBDIR while opening existing database. Change-Id: Ieb2042d70b42bc2a572ac1083c160fa3cdbb7556	2020-04-22 16:58:38 +03:00
Leonid Yuriev	5765d92ac7	mdbx: return MDBX_EBADSIGN when mdbx_env_close() called concurrently from several threads. Change-Id: I03a8c87bc51eefc5236baa52cee8b12a9f8aa0e2	2020-04-20 17:00:41 +03:00
Leonid Yuriev	83e303b059	mdbx: alter MDBX_CURSOR_FULL description. Change-Id: I70d13e7503d10c6050bd17e4dd8bd814e46799af	2020-04-19 17:33:32 +03:00
Leonid Yuriev	1e9cc6b0a5	mdbx: more 'const' for API. Change-Id: Iedea253733105acc4010e07a65a594f8ea52ce56	2020-04-19 17:33:32 +03:00
Leonid Yuriev	90bf7eb817	mdbx: fix/refine MDBX_BUILD_SHARED_LIBRARY definition. Change-Id: If4e3d32b0ce360eb7275d962fff4b31e53926054	2020-04-17 00:37:57 +03:00
Leonid Yuriev	971f924c44	mdbx-build: rearrange source files, rework CMakeLists.txt and refine GNUMakefile (squashed). Change-Id: Id73d346695011dab2f670bb9e6293a1e5a1835ca	2020-04-17 00:37:57 +03:00
Jens Alfke	f414876e99	mdbx: fixed AddressSanitizer errors after closing db. Unpoison memory before unmapping, to avoid leaving dangling poisoned address space. This caused Clang AddressSanitizer false errors after database was closed. More for https://github.com/erthink/libmdbx/issues/73 Close https://github.com/erthink/libmdbx/pull/93 Change-Id: I9cf19a06521330a90a62ed15317e1f966f0bd56f	2020-04-15 02:29:05 +03:00
Leonid Yuriev	ab2c98e41c	mdbx: support for Android/Bionic. Change-Id: Ia6a4d8a7848ffe3e488b4a92c9ec53c61c78a9bb	2020-04-13 23:36:56 +03:00
Leonid Yuriev	595482ca57	mdbx: fix typo (extra closing parenthesis). Change-Id: Icae740a640ab59dedc7608a725cc24623dba62bd	2020-04-13 23:35:08 +03:00
Leonid Yuriev	0986cb9379	mdbx-posix: fix feature-testing for PTHREAD_MUTEX_ROBUST. Change-Id: I16f008b8448a70d4145ba2bcfe22b3326c8a0e21	2020-04-13 22:46:55 +03:00
Leonid Yuriev	abf38e97cc	mdbx: minor fix prev commit. More for https://github.com/erthink/libmdbx/issues/97 Change-Id: I09ffe3430aa07bf5b01d9ad991affa004bb998a6	2020-04-11 20:51:24 +03:00
Leonid Yuriev	f89c3eda17	mdbx: crutch for WSL. Fixes https://github.com/erthink/libmdbx/issues/97 Change-Id: Ia863ffc8cd939b1af65f21ab0c5c8197abf4e793	2020-04-11 20:33:36 +03:00
Leonid Yuriev	5a81413f17	mdbx-posix: fix comment typo. Change-Id: I4573926a50ba392222dc738be3a7b9b3fabbb368	2020-04-11 17:21:36 +03:00
Leonid Yuriev	c590eb656f	mdbx: fix null-deref in an ASAN-enabled build while opening DB with error. More for https://github.com/erthink/libmdbx/issues/95 Change-Id: I6250fe7b0fbbcae497c2b5c1da9b4e9f78ecf0f0	2020-04-11 14:55:03 +03:00
Leonid Yuriev	17d7d48281	mdbx: fix null-deref in an ASAN-enabled build while opening DB with MDBX_RDONLY. Fixes https://github.com/erthink/libmdbx/issues/95 Change-Id: I1c000d3a456897f73367a590ef9fbda8ae90391c	2020-04-11 03:06:05 +03:00
Jens Alfke	48b6f76159	mdbx: Don't include <sys/vmmeter.h> on Apple platforms (#94 ) A simpler fix for the issue of this header being missing on iOS. It's not actually needed at all on Mach-based OSs. Fixes https://github.com/erthink/libmdbx/issues/92	2020-04-10 21:40:58 +03:00
Leonid Yuriev	99f07f5054	mdbx: add iOS notes to README. Change-Id: Ia46a43376370a73b179dbc4ab65e43956ee8c43a	2020-04-08 02:05:18 +03:00
Leonid Yuriev	81dca1f7e9	mdbx-cmake: add MDBX_BUILD_TOOLS option. Change-Id: Ib6329fdea66dd52720021b80a6fecdaa078ceb2b	2020-04-07 23:06:18 +03:00
Leonid Yuriev	ed6863851e	mdbx: crutch for iOS. Workaround for https://github.com/erthink/libmdbx/issues/92 Change-Id: Id8ed900d1310212ae0edd4bf6ab11bdba9c106a1	2020-04-07 17:35:49 +03:00
Leonid Yuriev	921f43da6f	mdbx: fix ceiling/flooring madvise-edge inside mdbx_sync_locked(). Fixes https://github.com/erthink/libmdbx/issues/91 Change-Id: I17da72d9a53a2c7453d81488bd3297063de0b7d1	2020-04-07 03:54:48 +03:00
Leonid Yuriev	94e58d7acc	mdbx: more explicit casting to size_t (paranoia). Change-Id: I1c65943cdcdd77cc12bc27d9ced19765ea7911bb	2020-04-07 03:48:23 +03:00
Leonid Yuriev	bf0cff9a8a	mdbx: add & use floor_powerof2(). Change-Id: Ib5be7d5a68dc7944e208d75094050383ccdfa6d0	2020-04-07 03:48:20 +03:00
Leonid Yuriev	a846fb0d21	mdbx: rename roundup_powerof2() to ceil_powerof2(). Change-Id: Ie22f10ffa6637ef74f2c705fad5fc45a8d19d22e	2020-04-07 03:45:11 +03:00
Leonid Yuriev	4ad1c2daed	mdbx: minor fix/workaround to avoid GCC 10.x pedantic warnings. Change-Id: If67c1ae593ad2c39130054475c37321dca761f5b	2020-04-07 01:54:58 +03:00
Leo Yuriev	3f7c9846e7	mdbx: use uintptr_t instead of size_t for pointer-wide values and types. More for https://github.com/erthink/libmdbx/issues/88 Change-Id: Ic625096df3c09d0dd578c7b79aa302be35480699	2020-04-04 16:52:44 +03:00
Leo Yuriev	75de63dff1	mdbx: refine type-casting inside mdbx_thread_self() to avoid warning. 2 of 2 for https://github.com/erthink/libmdbx/issues/88 Change-Id: Ic4994141d23a5417b18f6b03a3e4038859fb9210	2020-04-04 16:52:42 +03:00
Leo Yuriev	089d7212e7	mdbx: fix mdbx_build_info for undefined flags case. 1 of 2 for https://github.com/erthink/libmdbx/issues/88 Change-Id: I079b329abe8f20793dc78c90ea55f874693dde43	2020-04-04 16:52:39 +03:00
Leo Yuriev	d329ea1fe0	mdbx-tools: fix txnid_t casting inside mdbx_stat. Change-Id: I69799d8caca3e6692a433b2e62e7b2867b152b00	2020-04-04 16:01:05 +03:00
Leonid Yuriev	8f5ae79b51	mdbx: bump version to 0.7.x Change-Id: I6cb06fbd7119eed086b54a9760db1e0edf5de07b	2020-03-18 17:19:12 +03:00
Leonid Yuriev	251d34d6e6	mdbx-doc: more for custom comparators. Change-Id: I3326c5bdedbbdb01b1865bff68aa7ba8bc7056cc	2020-03-02 13:50:33 +03:00
Leo Yuriev	76e29c21f1	mdbx: merge branch 'devel' (crutches for Wine). Change-Id: I1779bc6987449e403216584cdd2846e910f34c8a	2020-02-28 19:05:47 +03:00
Leo Yuriev	5072b45026	mdbx: rename MDBX_MAP_RESIZED to MDBX_UNABLE_EXTEND_MAPSIZE. Change-Id: I22fbdb4f08fd7a6ae37da42e6827677ae8a8337b	2020-02-28 16:40:56 +03:00
Leo Yuriev	63449a44c5	mdbx-cmake: #if/#endif instead of cmake-conditions for posix/windows sources. Change-Id: Ic95bd3ba345160cf1d68c79f11d6560d4c41cb2b	2020-02-28 15:51:12 +03:00
Leonid Yuriev	ecffc831fa	mdbx-tools: avoids extra error messages "bad txn" from mdbx_chk when DB is corrupted. Change-Id: I6b92aced83bcf7e0c8e5c7108ddcf60714c9b30c	2020-02-27 16:04:00 +03:00
Leonid Yuriev	6248b67f75	mdbx-windows: more for running under Wine. Wine unable create mapped-view large tran secton size. More for https://github.com/erthink/libmdbx/issues/83 Change-Id: I93e98d58a827c785f8257cd9cac387a333e59621	2020-02-24 20:46:36 +03:00
Leonid Yuriev	fbf55e17cb	mdbx-windows: one more workaround for Wine. SetFileInformationByHandle() is not implemented by Wine. Change-Id: I61783c8d173397094cd6cbad7efc9d7aac57b470 002c:Call KERNEL32.SetFileInformationByHandle(00000060,00000006,0022f890,00000008) ret=127dd1b2 002c:fixme:file:SetFileInformationByHandle 0000000000000060, 6, 000000000022F890, 8 002c:Ret KERNEL32.SetFileInformationByHandle() retval=00000000 ret=127dd1b2 Related to https://github.com/erthink/libmdbx/issues/83	2020-02-22 20:02:17 +03:00
Leonid Yuriev	289f2896d0	mdbx-windows: more for Wine. Related to https://github.com/erthink/libmdbx/issues/83. UnlockFile() cold return ERROR_LOCK_VIOLATION when file not locked, instead of ERROR_NOT_LOCKED. Current versions of Wine seem to work correctly. Change-Id: Ibc5bd4352184efc7f88705e7ae04d6656286a96e	2020-02-21 19:58:32 +03:00
Leonid Yuriev	4fed2d9fc0	mdbx-windows: minor workaround for MSVC "unresolved external symbol __except1 ..." Workaround for MSVC error LNK2019: unresolved external symbol __except1 referenced in function __ftol3_except.	2020-02-19 16:31:25 +03:00
Leo Yuriev	9aa816dc73	mdbx-windows: using RegGetValueA() instead of wchar_t version. Change-Id: I0848eaf2083985ae27fec605358329830b0733c2	2020-02-19 16:00:40 +03:00
Leo Yuriev	f750086bc1	mdbx-windows: rework workaround for Wine. Resolves https://github.com/erthink/libmdbx/issues/83 in accordance with https://bugs.winehq.org/show_bug.cgi?id=48620 Change-Id: Ieb4385efdcd86c865184a783363cf6e90da14f61	2020-02-18 22:51:34 +03:00
Leonid Yuriev	bd3f234bce	mdbx: update github repo address. Change-Id: Ifa8bf0e09b297ba6f495dd8e04e5c67f6626d9cb	2020-02-18 02:22:47 +03:00
Leo Yuriev	60a6560a3b	mdbx: workaround for NtExtendSection() on Wine. This fixes https://github.com/erthink/libmdbx/issues/83 Change-Id: I8e00aa91c86348fad9dbe4285143671d9cb3f802	2020-02-17 22:55:17 +03:00
Leo Yuriev	d1173a1596	mdbx: drop unused WindowsNT API prototypes. Change-Id: Ic929646653d0576671d6150a698e892d2145ae30	2020-02-17 19:44:05 +03:00
Leonid Yuriev	2356f3281b	mdbx: use underscores for GNU-attributes. Change-Id: Iefd371dd91da1db8ee86554208536b3004535317	2020-02-17 14:01:11 +03:00
Leonid Yuriev	cd0d84dbb6	mdbx: fix error message typo. Change-Id: I25db309ff4fb063893c7c39d623e62eaceb8b60f	2020-02-03 23:35:43 +03:00
Leonid Yuriev	8214d674be	mdbx: refine SEARCH_IMPL macro. Change-Id: I975e480c047b88e0200aaf889334e8b83ab760ad	2020-02-03 18:13:17 +03:00
Leonid Yuriev	62a39d84b3	mdbx: fix aligned_alloc() usage.	2020-02-02 20:49:51 +03:00
Leonid Yuriev	6009bac1ed	mdbx: move is_powerof2() and roundup_powerof2() into header.	2020-02-02 20:41:04 +03:00
Leonid Yuriev	e475db7ade	mdbx: add MDBX_DBG_LEGACY_OVERLAP. Change-Id: I7aecb925b553587efd6698dc3d52682ca98aa950	2020-02-02 15:07:04 +03:00
Leonid Yuriev	49d9779c84	mdbx: remove obsolete ASAN-related comment. Corresponding drawback was fixed by 8c7cdfdc79e1ad0a7786d8039a52bffde673f7a5 Change-Id: I43ccf508377dc4b0bf5de6245e88c58dde0fc63e	2020-02-02 02:46:41 +03:00
Leonid Yuriev	a594f79e5f	mdbx: refine/clarify error messages. Change-Id: If2a38bdfb4a9fce176acb87fa452709bcfc5c972	2020-02-02 02:46:41 +03:00
Leonid Yuriev	17fe5f106b	mdbx: check read/write txn overlapping for the same thread (MDBX_TXN_OVERLAPPING). Change-Id: If3488df96bd1903d5e4ca0a1fea504075dbd4a20	2020-02-02 02:46:41 +03:00
Leonid Yuriev	db27654330	mdbx: rename MDBX_LAST_LMDB_ERRCODE and fix description. Change-Id: I9a855871ae8821d0d10472c48b5467fd507c01a5	2020-02-02 02:46:41 +03:00
Leonid Yuriev	1cbad5bd3f	mdbx: don't store thread-id into reader lock-slot in MDBX_NOTLS mode. Change-Id: I8453565a8c0a7c56b6dbd383c31ff5be828c8679	2020-02-01 23:08:07 +03:00
Leonid Yuriev	08753b46a1	mdbx: cleanup tabs (cosmetics). Change-Id: If941ea89d844f98f274da4ddfc3f2ae97986eeb7	2020-02-01 20:44:29 +03:00
Leonid Yuriev	fb1d600597	mdbx: speedup debug/checked build. This resolves https://github.com/leo-yuriev/libmdbx/issues/80 Change-Id: I20596f87db17ce01379dae5f58f4c2b158a04a4a	2020-01-29 03:29:42 +03:00
Leonid Yuriev	c1ad86c368	mdbx: fixes for modern Coverity. This resolves https://github.com/leo-yuriev/libmdbx/issues/81 Change-Id: Id501bf49055b54240da14723aef0115fc3a27672	2020-01-28 19:37:56 +03:00
Leonid Yuriev	7ea1a4e0e8	mdbx: fix key_from_jsonInteger() for MSVC. Change-Id: I3fc6a6da57707750cb2e8429bbaf10ff1de2dde2	2020-01-28 01:47:50 +03:00
Leonid Yuriev	2c08ec21fd	mdbx: fix compatibility (use zero for invalid DBI). Change-Id: I4ab6430eb96d97991cbd0c151dfd98a9930805d2	2020-01-27 03:00:13 +03:00
Leonid Yuriev	d159a8252d	mdbx: refine network-sorting. Change-Id: I086626c3da05b11362612d87eae23371f67ea1b0	2020-01-27 00:47:18 +03:00
Leonid Yuriev	308548e226	mdbx: minor refine/speedup mdbx_page_get(). Change-Id: Ia11a76f0255db1a56948438cdc333ebd67d88193	2020-01-26 19:07:00 +03:00
Leonid Yuriev	a8c5daf46a	mdbx: minor refine/speedup mdbx_node_search(). Change-Id: Ie3dd42de25e37bff177018cd15108b97cfcb049c	2020-01-26 18:00:35 +03:00
Leonid Yuriev	2ce9ace4d3	mdbx: documenting and checking key and value alignment for MDBX_INTEGERKEY and MDBX_INTEGERDUP. This resolves https://github.com/leo-yuriev/libmdbx/issues/79. Change-Id: I819a6eca3018361e5896d5ccce7e4c0ca57c8b38	2020-01-26 14:54:40 +03:00
Leonid Yuriev	1ee1b269e6	mdbx: minor optimization around memcpy(). Change-Id: Id0dd4ac693a4ddb6294bdb0f2fc5d2aec69d0efd	2020-01-26 14:44:50 +03:00
Leonid Yuriev	ebcbcbfe31	mdbx: avoud int64-to-double conversion key_from_jsonInteger(). More for https://github.com/leo-yuriev/libmdbx/issues/76 This is expected to be a workaround for the MSVC2019 bug "MSVCRT.lib(ftol3.obj) : error LNK2001: unresolved external symbol __except1". https://ci.appveyor.com/project/leo-yuriev/libmdbx/builds/30273569/job/lurrftum1nkbu5a3#L109 Change-Id: Ie6da02b14d0b973c7172af063caf4fdc44bf89ac	2020-01-22 19:41:01 +03:00
Leonid Yuriev	b77f4faadd	mdbx: fix major typo in prev commit. More for https://github.com/leo-yuriev/libmdbx/issues/76 Change-Id: I9a3d1adf1467a542b36330978d53cc15f4afbbdb	2020-01-22 03:51:12 +03:00
Leonid Yuriev	bf28856ac5	mdbx: add key-making functions. Related to https://github.com/leo-yuriev/libmdbx/issues/76 Change-Id: I1edc8efd323af9adb53e6c2155e2ea39a1e575f4	2020-01-22 03:43:09 +03:00
Leonid Yuriev	700f3514b3	mdbx: bump version to 0.6.x Change-Id: I925ab0aaefb1a8f9860925c2e8e7c81015428b2e	2020-01-21 00:17:55 +03:00
Leonid Yuriev	2d334185cb	mdbx-tools: rework/fix mdbx_load for custom comparators. Change-Id: I9bc15fb878d1586839768f97567806208bfcc5b8	2020-01-21 00:17:55 +03:00
Leonid Yuriev	2c1d3a3fda	mdbx: refine dbi_open_ex(). Change-Id: I32bc1c6609e14ba90b2f4eaf9b8b11ea06f2eb8b	2020-01-21 00:17:55 +03:00
Leonid Yuriev	7d880a37dd	mdbx: refine internal sort. Change-Id: If07d9f6b7a7976e5e048eb1b8b7e0b65c4ed3fdd	2020-01-21 00:17:55 +03:00
Leonid Yuriev	d12b546a7d	mdbx: fix MDBX_APPEND check inside cursor_put(). Change-Id: If21dedbd72b3a038252b9dc10c5c6543328362e7	2020-01-21 00:17:55 +03:00
Leonid Yuriev	6184024a80	mdbx: more __has_builtin(). Change-Id: Ie23e170e12d96ad47bf2f25c7dde974673109b54	2020-01-21 00:17:55 +03:00
Leonid Yuriev	2bfcbe980e	mdbx: refine/fix dbi_bind(). Change-Id: Ic4245c349870198f79efd537cf12d9bdf691b7ca	2020-01-21 00:17:55 +03:00
Leonid Yuriev	0710b07d7c	mdbx: refine/speedup dpl_search(). Change-Id: I712e22ea69f23f61c92be976069f09a85831d086	2020-01-21 00:17:55 +03:00
Leonid Yuriev	7c894f0542	mdbx: HNY! Change-Id: Idbd21263408f87ac2715675c9f7ccc6c44d41c9a	2020-01-21 00:17:55 +03:00
Leonid Yuriev	c05875befd	mdbx: refine/speedup internal sort (10-30% faster). - more friendly for Russian Elbrus's predicates (512-bit wide VLIW). - more CMOV-friendly for x86 (nicely optimized by gcc-9.x and clang-8.x). - use bitonic sort for small chunks. - less branches in the outer loop. Change-Id: I0510f5a0b2c39a19caa9e829a20e34dfbd160a01	2020-01-21 00:17:54 +03:00
Leonid Yuriev	995a26cf19	mdbx-windws: refine/fix handling STATUS_CONFLICTING_ADDRESSES. Change-Id: I501acb2d5d653c74ab210907dd955d7167956af8	2020-01-06 01:23:11 +03:00
Leonid Yuriev	f282ae45e0	mdbx: more unlikely (minor). Change-Id: I9052d89d4b297615af199a0e2f468cda1482297a	2020-01-05 00:49:16 +03:00
Leonid Yuriev	9de65acf3e	mdbx: fix env_set_geometry() for large pagesize. Change-Id: Ide12e705abf76184f839d1670b0ca1c1e1c64da5	2020-01-05 00:49:16 +03:00
Leonid Yuriev	6fa79d49b4	mdbx: fix MDBX_RESULT_TRUE from page_alloc(). Change-Id: Ib285e98f967b9aefac8facfba31618a80c5e8129	2019-12-31 20:44:40 +03:00
Leonid Yuriev	66f3c0a77e	mdbx: merge branch 'refine' into devel. Change-Id: I3f6a787c66b4e7fca3c43d72e4b4083782cc94c4	2019-12-31 19:39:22 +03:00
Leonid Yuriev	5eafc6e738	mdbx: minor refine txn_commit(). Re-assign `rc` variable to release register from allocation. Change-Id: Ibafd70efd53591d3bf190417e1b2f3b20299e7d2	2019-12-31 19:38:41 +03:00
Leonid Yuriev	7d1eff5116	mdbx: minor refine cursor_put(). Use `rc2` variable to simplify register(s) allocation. Change-Id: Ie47210a4b494e9aeaa8492830cfbcbbde02b485c	2019-12-31 19:38:41 +03:00
Leonid Yuriev	36c7d7a435	mdbx: minor refine page_alloc (MIN_TXNID). Change-Id: Iac20f79280e5b464b39f7ac5b1efe01585c5bf02	2019-12-31 19:38:41 +03:00
Leonid Yuriev	03a68e87ba	mdbx: fix commit typo (minor). Change-Id: I3e6564eb9a1404c3aaffb7dd9143dc64e7d822af	2019-12-31 19:38:41 +03:00
Leonid Yuriev	8c7cdfdc79	mdbx: fix ASAN issues (minor). This resolves https://github.com/leo-yuriev/libmdbx/issues/73 Change-Id: Ifb59f5ba66321bb362b81085e0f25a82a2d76d5f	2019-12-29 01:19:31 +03:00
Leonid Yuriev	c7ae4ace9d	mdbx: fix assertion for MDBX_NOTLS option. This fixes https://github.com/leo-yuriev/libmdbx/issues/72 Change-Id: I9e2b02e33e7e702eb093c0c1049c54b76d8d23b5	2019-12-28 02:17:38 +03:00
Leonid Yuriev	7b6880bdc9	mdbx-windows: treat STATUS_INVALID_ADDRESS same as STATUS_CONFLICTING_ADDRESSES for some cases. Change-Id: I542c7f4010f880428e3c7b10413e4f98c4aa7b48	2019-12-25 00:46:01 +03:00
Leonid Yuriev	379a789839	mdbx: minor refine MDBX_MMAP_INCOHERENT_FILE_WRITE. Change-Id: I1e77eccc64b470bf3c7aeb8f6b905b72e818f7a0	2019-12-25 00:46:01 +03:00
Leonid Yuriev	bdb4ccb352	mdbx: copy for txn only used dbiseqs. Change-Id: I6fd2d8598b5e86c0d5b8d7eef535e81525cd14ee	2019-12-25 00:46:01 +03:00
Leonid Yuriev	53d5cb0151	mdbx: rework MADV_DONTNEED threshold. Change-Id: I99058b96e9c54c56d37c6c963b01cf18458d37ba	2019-12-24 18:16:04 +03:00
Leonid Yuriev	f2fd2280e4	mdbx: more for QEMU cross-testing. Change-Id: Iad5e7f977c744b2edf1987d38523ba0e1f6e46ab	2019-12-23 00:02:54 +03:00
Leonid Yuriev	2acaaeb2ff	mdbx-chk: fix - don't check some numbers if btree-walking was disabled. Change-Id: I3e1abb7fa7720ecb3fc22e6b4a9b1b56494fb8a0	2019-12-22 14:01:50 +03:00
Leonid Yuriev	a5fb5887f9	mdbx: minor refine/fix lock-related erro logging. Change-Id: Id507819b6b2b0c1a57ec71bd031c5068cb2098e1	2019-12-21 23:33:12 +03:00
Leonid Yuriev	e3d328621e	mdbx-posix: checking for file removal during LCK-seizing. Change-Id: I7626ceda62fc4dac86323bec4194ae46bc19d9d3	2019-12-21 23:33:12 +03:00
Leonid Yuriev	ccb45730f2	mdbx: use page's mp_txnid for basic integrity checking. Change-Id: I50d6f1251e4fd84e535a708e78dd24d84ec53780	2019-12-21 23:33:12 +03:00
Leonid Yuriev	d11bfef36b	mdbx: aligned page-buffer. Change-Id: Id469c353c47a5a486747bf2c21ee8c003cd2d103	2019-12-21 23:33:12 +03:00
Leonid Yuriev	e70a7f620e	mdbx: clarify field description (minor). Change-Id: Ide20e32b4ee6784a7baf2044f52877afbd9ceff1	2019-12-21 23:33:12 +03:00
Leonid Yuriev	7abd625c05	mdbx-tools: print warning about Windows system limitation. Change-Id: I8a7765bfe604dc2a4016d3e27622d41f93f06b04	2019-12-21 23:33:12 +03:00
Leonid Yuriev	c79879f290	mdbx-tools: update mdbx_stat captions. Change-Id: Ic78f7e5bec97a67e8dc3ce21847dcaa1f66a45f9	2019-12-21 23:33:12 +03:00
Leonid Yuriev	e8686a4170	mdbx-cmake: add MDBX_FORCE_ASSERTIONS.	2019-12-21 23:33:12 +03:00
Leonid Yuriev	78e146692a	mdbx: alter rule for wipe of steady-point. Change-Id: Idac7ffd5e89d282aebcbe7382e20a960d5b39f25	2019-12-21 23:33:12 +03:00
Leonid Yuriev	cddf9ca8a2	mdbx: toggle of readers-refresh after wipe steady-point. Change-Id: I43985fb667b727a8b41dcd5c33e6012160dee16e	2019-12-21 23:33:12 +03:00
Leonid Yuriev	c554b5c45d	mdbx: move toggle of readers-refresh to sync_locked(). Change-Id: I99adf32fb39d600a37c4b25f7e8ea49e5bac6cf0	2019-12-21 23:33:12 +03:00
Leonid Yuriev	0350fc41f8	mdbx: clean copy for undo meta. Change-Id: I2abc1d701dc52caa268210489aa27803fd7a2c3b	2019-12-21 23:33:12 +03:00
Leonid Yuriev	edbdb682d5	mdbx: refine page_flush(). Change-Id: I8270226e4eae721404dbb56d5d591bceaa4613b9	2019-12-21 23:33:12 +03:00

... 12 13 14 15 16 ...

2300 Commits