ISAR/libmdbx
3
0
Fork 0
mirror of https://github.com/isar/libmdbx.git synced 2025-01-10 03:44:12 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,455 Commits 5 Branches 68 Tags 13 MiB
Commit Graph

162 Commits

Author SHA1 Message Date
Leonid Yuriev
d5658c496f mdbx: fix mp_txnid check for spilled pages. 
This is OMG stupid bug.

Тем не менее, ошибка не была замечена по трём причинам:
- some TODOs should be resolved, like [this](faddc71eac/src/core.c (4014)) and some others;
- test cases should be extended to triggering the page spilling threshold;
- mdbx_env_set_option() should be provide to tunning such threshold(s) (https://github.com/erthink/libmdbx/issues/128).

Resolves https://github.com/erthink/libmdbx/issues/126

Change-Id: If76336620aa83e6916e3aeaa838e0b6e68c34fd7
 2020-10-30 17:44:31 +03:00
Leonid Yuriev
16c900b0a1 mdbx: fix assertion inside mdbx_cursor_del0(). 
Change-Id: I87ad3777215bee8a2b19f53ec92299db89431fa4
 2020-10-29 00:55:42 +03:00
Leonid Yuriev
3fd079262c mdbx: fix extra-rare MDBX_KEY_EXIST during mdbx_commit(). 
The MDX_KEYEXISTS error could occur inside mdbx_update_gc() in the extremely rare case:

- no GC records was reclaimed before mdbx_txn_commit() called;

- there were few loose pages during the transaction;

- some reader prohibit reclaiming, therefore mdbx_page_alloc(MDBX_ALLOC_GC),
  which called for obtain present GC-record's Id, returns MDBX_NOTFOUND;

- immediately then the reader completes its transaction and unlocks reclaiming;

- mdbx_update_gc() decide that no reclaimable GC entries,
  i.e. no GC-entries with ID < find_oldest(),
  and it is safe to use find_oldest() - 1 to store loose page list;

- but find_oldest() actually returns new/larger ID than expected,
  So KEYEXISTS will returned if using this ID.

Change-Id: I9726217d6b5983f1e31a211c0eeb3edc8ff94282
 2020-10-26 14:37:16 +03:00
Leonid Yuriev
77e84ccca8 mdbx: refine mdbx_cursor_set() around the exact-flag. 
Change-Id: Ifbad6bb4a3a4eabaf85c7986f9566705d53c45b9
 2020-10-26 03:52:07 +03:00
Leonid Yuriev
7522246ccd mdbx: fix intenals for mdbx_get_equal_or_great(). 
Change-Id: I7b44df14c6f9ede4844d53e28c1b34d84fc664fa
 2020-10-26 00:42:21 +03:00
Leonid Yuriev
005517539b mdbx: adds SIGPIPE suppression inside the env_copy-thread. 
Change-Id: Ib7d22b8db7435b396bd997b65ae1d6d5d3431ba9
 2020-10-23 03:22:22 +03:00
Leonid Yuriev
fed14c8f4c mdbx: minor tweak mdbx_pages_xkeep(). 
Change-Id: I6df699aeb49640b0365918c33cff05dcbcef2b71
 2020-10-23 03:18:00 +03:00
Leonid Yuriev
55d190bad9 mdbx: avoid MDBX_TXN_FULL while searching for a large multi-page region. 
Resolves https://github.com/erthink/libmdbx/issues/123
but with TODO:
 - provide a user-configurable threshold instead of currently hard-coded default (MDBX_PNL_MAX/2).

Change-Id: Ia7bfd5f8d36e027444d234e3c3aabe4832313466
 2020-10-22 18:04:02 +03:00
Leonid Yuriev
8a7caec54a mdbx: cleanup deletion internals. 
Change-Id: Ibcc5e02d5274c4eac5d6f269bc2b029f6b30c5ab
 2020-10-22 16:28:44 +03:00
Leonid Yuriev
b0928219c3 mdbx: fast completion pure nested transactions. 
Change-Id: I467cc0f2f3e781bf23bf8c45eb021987ae7c123b
 2020-10-21 02:24:39 +03:00
Leonid Yuriev
daf37363b4 mdbx: fix cursor state after delete current entry. 
The fix affect enough of code sections,
so there is a chance that some more changes will be required.

Resolves https://github.com/erthink/libmdbx/issues/121
Related to https://github.com/ledgerwatch/turbo-geth/issues/1147

Change-Id: I45b7637516de410923a0d723dbda8d818662ba15
 2020-10-21 02:24:33 +03:00
Leonid Yuriev
b964b2abf5 mdbx: more spelling. 
Change-Id: I45e42c1d8ef51f910b8e41279b92e54a6b2ce772
 2020-10-21 01:00:48 +03:00
Leonid Yuriev
7001d971e1 mdbx: clarify/refine mdbx_flush_iov(). 
Change-Id: Ib9462efdbf97e42b1e80bf130f8150072102d9ed
 2020-10-21 01:00:48 +03:00
Leonid Yuriev
f73a8a8680 mdbx: add latency gathering for commit stages. 
Change-Id: If68ceb6e69e5e565ce9de0fd9a80424b6da280c5
 2020-10-21 01:00:48 +03:00
Leonid Yuriev
7cf92b66cf mdbx: add LIBMDBX_INLINE_API (both inline and non-inline of some API functions). 
Change-Id: I00c2b6d3d2a0467080791ea0c1c2242742a20c78
 2020-10-17 01:00:36 +03:00
Leonid Yuriev
38485c9f30 mdbx: minor refine cursor_sibling(). 
Change-Id: I2c92ef2c3081dfa0a9bdcd47de0f912a9927519e
 2020-10-16 18:57:07 +03:00
Leonid Yuriev
112ce742f5 mdbx: refine update_gc(). 
Change-Id: I877cdf2efb623c61dc810ec1cebb985fe925a120
 2020-10-12 00:09:06 +03:00
Leonid Yuriev
62da4db09a mdbx: fix/refine the use of C11 atomics. 
Change-Id: I5d925d4625b06296fd82f4b35ee36be682e7b2d3
 2020-10-11 18:54:07 +03:00
Leonid Yuriev
041a4c0aa5 mdbx: make enabling of read-ahead strategy more aggressive. 
Change-Id: I7765c1a1ac27db86ce9676846ec5a723860dc934
 2020-10-11 01:14:30 +03:00
Leonid Yuriev
071ad525c8 mdbx: refine handle_env_pathname() for direct pathname of data-file inside sudir-mode. 
Change-Id: I5b7e7c7ea5c17e00c344fedb5c96f8d94fc04fc8
 2020-10-11 00:14:53 +03:00
Leonid Yuriev
0627d902dd mdbx: add mdbx_env_delete(). 
Resolves https://github.com/erthink/libmdbx/issues/119
Related to https://github.com/Kerollmops/heed/issues/58

Change-Id: Iec5bf5978e45bb6843f3ed8dd06ea4d34f2895cb
 2020-10-10 00:58:53 +03:00
Leonid Yuriev
cd0c727880 mdbx: internally split-out mdbx_handle_env_pathname(). 
Change-Id: Ibe387662d737d4d1e274ac0e126053872be503f9
 2020-10-10 00:52:41 +03:00
George Hazan
e8fecd1eec mdbx: fix opening DB on a network shares (pass MDBX_EXCLUSIVE from env). 
Change-Id: Ic5c68033ba81043ac7800f99aae364bf082c868f
 2020-10-08 01:50:18 +03:00
Leonid Yuriev
0f3b82f661 mdbx: minor refine WITH_CURSOR_TRACKING macro. 
Change-Id: I61a4782ae76aed624fe37f7dde2b0ef7eb5dfb64
 2020-10-08 01:50:18 +03:00
Leonid Yuriev
b274fdd142 mdbx: clarify page-merge strategy. 
Change-Id: I1bb843ab6bdfcd53deae6d219a5b164bd3a79fd3
 2020-10-08 01:49:56 +03:00
Leonid Yuriev
f5ce471ebb mdbx: fix minor copy&paste typo. 
Change-Id: I5a1be230d0ca92123006e709aaaf78496918c91a
 2020-10-07 12:18:28 +03:00
Leonid Yuriev
fe65c122d2 mdbx: fix pthread_yield() for non-GLIBC. 
Change-Id: I080e37a42b62e524896dea8747e9f23e2fcd584f
 2020-10-06 00:28:12 +03:00
Leonid Yuriev
70b615e8d4 mdbx: don't use yield instruction on ARM if unsupported. 
Change-Id: I0b01d783fe4336b089f4b051fb61c203b5879aa5
 2020-10-05 19:15:07 +03:00
Leonid Yuriev
fc965c57ac mdbx: fix merge_sync_flags() to preserve MDBX_UTTERLY_NOSYNC. 
Change-Id: I59dbd1ef8ac1747dd20565ff444e4feb5d0e0e71
 2020-09-30 04:01:36 +03:00
Leonid Yuriev
f6850f5367 mdbx: Support for user-settable cursor context. 
Change-Id: I9bd60c432924e39020b2d3af3280f13c44d6cd91
 2020-09-29 21:15:25 +03:00
Leonid Yuriev
c8a0951566 mdbx: rework API and Docs around Handle-Slow-Readers (no algorithmic changes). 
Change-Id: I5b76a8400ce6f5f241f8e4a7f53d746fe39f8e1e
 2020-09-29 21:15:25 +03:00
Leonid Yuriev
6294e1710a mdbx: support for user-settable transaction context. 
Change-Id: Ib4a345628e2c1ca2f95ac7615ea53d94911e5198
 2020-09-29 20:59:55 +03:00
Leonid Yuriev
5374d06d92 mdbx: fix minor MSVC warning. 
Change-Id: Ie3c9fa7ba21cd88f7a0c08a1529542ba394fe9c8
 2020-09-29 20:59:55 +03:00
Leonid Yuriev
5627521f16 mdbx++: more spelling. 
Change-Id: I3f33e695fb918c6a57c39047bba54a72ecb9bc5b
 2020-09-27 17:01:59 +03:00
Leonid Yuriev
6eaa838e3e mdbx: clarify logging for MDBX_WANNA_RECOVERY in case sync-needed in rdonly-mode. 
Change-Id: I7032cfbce857e2acfb93de383272a4f41ab6a7fb
 2020-09-27 17:01:58 +03:00
Leonid Yuriev
12339d4e7c mdbx: rename bootid' fields to be neutral for endianess. 
Change-Id: I7d52d3c2c93dcc6e886d336885070eb1aee1c284
 2020-09-26 02:23:09 +03:00
Leonid Yuriev
75a4463811 mdbx: minor misc cosmetics & refines. 
Change-Id: I84b70aeded047ab3786a57c864dbc89364969afa
 2020-09-25 01:21:45 +03:00
Leonid Yuriev
860aa017db mdbx: Merge branch 'master' into devel. 
Change-Id: Ic130cd181097332aa2f49019d75403e18d8cba0d
 2020-09-25 01:14:57 +03:00
Josh Soref
448728f584 mdbx: a lot of spelling (squashed). 
Many Thanks to Josh Soref for these fixes.
https://github.com/jsoref

Resolves https://github.com/erthink/libmdbx/pull/118.

Change-Id: I4e09347da5c9d7a77cdd918a3b15284371440076
 2020-09-25 01:01:25 +03:00
Leonid Yuriev
58708f7162 mdbx: add mdbx_env_turn_for_recovery(). 
Change-Id: Ic02a5adf9ad398ae5b499e8808157e41ec42457e
 2020-09-23 10:05:38 +03:00
Leonid Yuriev
9b5097fe9d mdbx: add paranoid checks for txnid overflow. 
Change-Id: I0036a080d40a0da9ffc55ff838d91799ff0ceadb
 2020-09-23 10:05:38 +03:00
Leonid Yuriev
d4b16c981d mdbx: fix minor Coverity warning. 
Change-Id: Id92d85a7032a20a4b06d87878e32d8997b6558e3
 2020-09-23 10:05:37 +03:00
Leonid Yuriev
7fe4fccda8 mdbx: acquire exclusive lock for the destination file during mdbx_env_copy(). 
Change-Id: Ic75796025dd2a649840b96b1f71aecac9360d010
 2020-09-23 10:05:37 +03:00
Leonid Yuriev
a7a8631bc3 mdbx: allow sync_file_range() to fail for Valgrind/QEMU cases. 
Change-Id: I9aa77d1debfbd0cb18e940946533e4ed758d08e8
 2020-09-21 17:18:07 +03:00
Leonid Yuriev
c01750be2e mdbx: provide MDBX_USE_SYNCFILERANGE option. 
Change-Id: Icf1f27d6203653b4e2f2180a59a65e958c4d5e2e
 2020-09-21 17:18:07 +03:00
Leonid Yuriev
a2e2e5c8a0 mdbx: allow sendfile() and copy_file_range() to fail for Valgrind/QEMU cases. 
Change-Id: I37ee8d652d91a8d2106c782beceaacb13e9f667f
 2020-09-21 03:29:38 +03:00
Leonid Yuriev
25e3968199 mdbx: provide MDBX_USE_SENDFILE and MDBX_USE_SENDFILE options. 
Change-Id: Icd9a6487ae6e398276a9e720926ff24de5897c1a
 2020-09-20 20:16:26 +03:00
Leonid Yuriev
d9daf2944d mdbx: add env_open_for_recovery() (squashed). 
Change-Id: I0151b21610def433745c33d1f6e0b66ce655d1a9
 2020-09-19 01:48:24 +03:00
Leonid Yuriev
b321f67ed2 mdbx: Merge branch 'master' into devel. 
Change-Id: I4f180753fe52b54f37f4fd12af2ba1b3ca541726
 2020-09-19 01:47:12 +03:00
Leonid Yuriev
73647a5e46 mdbx: fix/refine mdbx_walk_tree() for working with invalid/corrupted DB. 
Change-Id: I2594b785f675319027ff129d12683c4392e6e2f4
 2020-09-19 01:44:21 +03:00