ISAR/libmdbx
3
0
Fork 0
mirror of https://github.com/isar/libmdbx.git synced 2025-01-08 06:24:13 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,942 Commits 5 Branches 68 Tags 13 MiB
Commit Graph

964 Commits

Author SHA1 Message Date
Leonid Yuriev
01ae72a570 mdbx-dump: fix output (don't print version caption to stdout). 
Change-Id: Id9986a79c0bceb3637c3aee4b669adab6a68dc2f
 2019-11-30 01:29:48 +03:00
Leonid Yuriev
2f383d8de3 mdbx: use getmntent() for determine filesystem type. 
Change-Id: I92921c5083a822c891889668e51726e2f1ce98cd
 2019-11-30 01:29:48 +03:00
Leonid Yuriev
4e4a56eda2 mdbx-tools: fix mdbx_chk for new limits API. 
Change-Id: I67f077296a477ea258b0b0d9e02319f2134a8a74
 2019-11-30 01:29:48 +03:00
Leonid Yuriev
d80654fa07 mdbx: rework max key-length and limit API. 
Change-Id: I3d783f69d4ea438d8a8a0505fa9163715fbdcf9c
 2019-11-30 01:29:48 +03:00
Leonid Yuriev
9bd88d80d0 mdbx-chk: refine user-break (ctrl+c) handling. 
Change-Id: I5b1a71a2945990091c0f472d5e2256ace8dc2065
 2019-11-28 12:37:42 +03:00
Leonid Yuriev
c00f484813 mdbx: fix nested txn. 
Change-Id: Iff752d23a880ed4f5322145446be9c989b837479
 2019-11-26 15:27:45 +03:00
Leonid Yuriev
acde45ff3a mdbx: pre-sync range before mresize(). 
Change-Id: Id205394cf488b5a954ec021af7f2924a549c9a0e
 2019-11-18 16:29:47 +03:00
Leonid Yuriev
4af2deb8cd mdbx: drop obsolete assertion & refine related code. 
Fixes https://github.com/leo-yuriev/libmdbx/issues/69

Change-Id: Iedf988e9788acb250493032bf55f5c75784652cc
 2019-11-18 16:29:30 +03:00
Leonid Yuriev
f285ab59e6 mdbx: fix mdbx_runtime_flags for ALLOY-build. 
Change-Id: I16a7e3475043066cea7733ed31b7e5d5a5824516
 2019-11-18 11:50:21 +03:00
Leonid Yuriev
497aa53e28 mdbx: fix minor typos. 
Change-Id: Ib0c62eace9c766844a3f44124b525a3c6373c620
 2019-11-18 00:13:27 +03:00
Leonid Yuriev
72c944974a mdbx-tools: refine mdbx_chk (use boot-id, explicitly notify about sync-to-disk). 
Change-Id: I520df734d9b806bc94b53f0817b71cd8223a7a62
 2019-11-18 00:09:47 +03:00
Leonid Yuriev
d390300e60 mdbx: fix lck-file mode-flag while opening existent DB. 
Change-Id: I3b8d446f6a620e911c0d5e325d8d912f2ca19d93
 2019-11-18 00:02:37 +03:00
Leonid Yuriev
d20b9d9ed7 mdbx: move boot-id from LCK to meta. 
Change-Id: I7a371feb1a2c43e3606c516fe7b4c7d7a4ff6e73
 2019-11-18 00:02:37 +03:00
Leonid Yuriev
7ef61e12c0 mdbx: refine update_gc() for large-transaction cases. 2019-11-17 23:57:03 +03:00
Leonid Yuriev
c250500afd mdbx: performs long assertion-loops only when audit enabled. 2019-11-17 23:57:02 +03:00
Leonid Yuriev
baee0be7ad mdbx-tools: minor refine mdbx_chk (use const strings). 
Change-Id: I402c8d97cfa860f21b97bd20b6d6feb190af654e
 2019-11-17 23:57:02 +03:00
Leonid Yuriev
7703312b88 mdbx-tools: fix mdbx_chk to avoid creation of missing DB. 
Change-Id: Ieaeee75c1c8f8b1e426817df86ef1769e691e504
 2019-11-16 00:23:03 +03:00
Leonid Yuriev
af6aa30c7c mdbx: don't sync-on-close deleted files. 
Change-Id: Ie9358dfd79c9c5b26777e690079b3f081f0a7158
 2019-11-16 00:23:03 +03:00
Leonid Yuriev
84ae40172e mdbx: refine/fix madvise(MADV_DONTDUMP). 
Change-Id: I3cb56d5d704a60c17da9ae2a276587cf495ce30c
 2019-11-16 00:23:03 +03:00
Leonid Yuriev
42d9e06598 mdbx: add MDBX_ACCEDE environment opening flag. 
Change-Id: If0a08d6fce127f35ff2992988715b7dc1fdb70a9
 2019-11-16 00:23:03 +03:00
Leonid Yuriev
cb8fac6f5f mdbx: prohibit non-WRITEMAP modes under OpenBSD. 
Temporary `workaround` for OpenBSD kernel's bug.
See https://github.com/leo-yuriev/libmdbx/issues/67
 2019-11-14 15:12:19 +03:00
Leonid Yuriev
f0c6292fa3 mdbx: ignore ENOSYS/ENOTSUP from madvice()/posix_madvise()/posix_fadvise(). 2019-11-13 23:50:38 +03:00
Leonid Yuriev
c09fbc2ad2 mdbx: refork mdbx_flush_incoherent_mmap(). 2019-11-13 23:50:38 +03:00
Leonid Yuriev
fe40af160d mdbx: split-off mdbx-options into options.h. 2019-11-13 23:50:38 +03:00
Leonid Yuriev
057812fe02 mdbx: use MAP_CONCEAL when available (compatibility). 2019-11-13 15:49:41 +03:00
Leonid Yuriev
b95fb5b124 mdbx: add auxiliary debug-begin/debug-end includes. 
Change-Id: I9fad95e7e73a581c49388da31895aed94a3abbe4
 2019-11-13 15:47:38 +03:00
Leonid Yuriev
ac75fe2604 mdbx: move platform-related options into osal.h 
Change-Id: I4bdbc5f89fc468f0068f97cc30f911eb0ab151d3
 2019-11-13 11:31:22 +03:00
Leonid Yuriev
0dc544fefd mdbx: use SysV semaphores on systems without shared mutexes. 
Change-Id: Ib2ad9ed137ab76999a2a8e832f9f77ff1a0788ca
 2019-11-13 11:31:22 +03:00
Leonid Yuriev
2f45c37320 mdbx-posix: refine locking build-options. 
Change-Id: I09c0dd453dd39e0105176ad8d9e414e2582849fb
 2019-11-13 11:31:22 +03:00
Leonid Yuriev
e2ae62bdb2 mdbx: refine gc_update() to avoid fragmentation on rare cases. 2019-11-13 11:24:44 +03:00
Leonid Yuriev
df44539486 mdbx: fix unused warning for Wpedantic_format_voidptr(). 
Change-Id: I3ac5f83ceb8f9aa28deb56d983595fc55bfcfa93
 2019-11-13 11:24:44 +03:00
Leonid Yuriev
a6bf73a817 mdbx: don't rollback when boot-id matches. 
Change-Id: Iee4656e120bd4205f8528f1fc613cbff1ab4a859
 2019-11-13 11:24:44 +03:00
Leonid Yuriev
a7e0b3ccdf mdbx-build: SunOS/Solaris/OpenIndiana support, etc. 2019-11-11 15:14:03 +03:00
Leonid Yuriev
5af02290e6 mdbx: portability fixes for SunOS/Solaris/OpenIndiana. 
Change-Id: I0442367e798903598d706c65b536a127ca982fce
 2019-11-11 15:13:56 +03:00
Leonid Yuriev
4dfa97cda9 mdbx-posix: fix mdbx_lck_seize() and mdbx_lck_destroy() for rare race-case. 
Change-Id: I49c1d39665e3ef1eb1422b9da02c5719be3ee3b0
 2019-11-11 13:10:22 +03:00
Leonid Yuriev
6a7499c8fc mdbx: refine POSIX-options detection. 2019-11-11 13:10:22 +03:00
Leonid Yuriev
51440b5542 mdbx: minor fix auto-readahead for buggy platforms (i.e. DragonflyBSD, NetBSD). 2019-11-11 13:10:22 +03:00
Leonid Yuriev
fc48751f8f mdbx: use MAP_NOSYNC & MAP_HASSEMAPHORE if defined (compatibility). 2019-11-11 13:10:22 +03:00
Leonid Yuriev
3e7944f732 mdbx: use POSIX.1 IPC semaphores on systems without shared mutexes. 
Change-Id: I5e398257e65c355d1028167f2719232fc55d093a
 2019-11-11 13:08:19 +03:00
Leonid Yuriev
647d832556 mdbx: initial mdbx_check_fs_rdonly() and mdbx_check_fs_local(). 
Change-Id: Iff48f1ad1ef54c1e51dceebce16097be030206bd
 2019-11-08 18:40:29 +03:00
Leonid Yuriev
b7ed67543f mdbx-windows: use CreateFileW() instead of CreateFileA(). 
Resolves https://github.com/leo-yuriev/libmdbx/issues/66

Change-Id: I0266a8a77460940332045c19cb561553a5047e7c
 2019-11-08 18:39:51 +03:00
Leonid Yuriev
fff19d878f mdbx: fix update_gc() to avoid rare MDBX_KEYEXIST. 
Change-Id: I6798e587f62cd570b43b095554c5f3f6adf5198d
 2019-11-04 12:31:54 +03:00
Leonid Yuriev
2cfe632296 mdbx: rework/fix rebalance & page merge (fix MDBX_PAGE_FULL). 
Change-Id: Ice610861d76390e76685c1bfad56fb8fe3462ed2
 2019-11-04 12:31:54 +03:00
Leonid Yuriev
cf884f082f mdbx: initial osal_bootid(). 
Change-Id: I103f61714a1d2e58d4f508b7d814a56f5b58573c
 2019-11-04 12:31:51 +03:00
Leonid Yuriev
55395820e3 mdbx: set MDBX_MIN_PAGESIZE to 256 (useful for testing). 
Change-Id: Ie7f0b68ef7b21bb2f02267752555e2d0e853fcbe
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
582fdd7ed2 mdbx: refine mdbx_env_set_geometry(). 
Change-Id: Ib685de60c9109971e3ab42b13ee085a6ed50a1c5
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
e7b3a15d54 mdbx: fix/refine mdbx_setup_dxb() for case open existing DB with new geo-params. 
Change-Id: Iebb9b19c8f81d8629c4b28ed547d27f1a139dc7f
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
3cc8e5222c mdbx: undo/promote geo-changes made by child txn on abort. 
Change-Id: Ieb291231909ef8e2a0205ffe1708d66b67ac5af7
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
415cb5f886 mdbx: refactor me_dbgeo usage and osal-mmap/mresize(). 
Change-Id: I1f29c953abcbd4f2bab7ba52e7dd9da85ea48354
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
b4729bd1d6 mdbx: minor refine pgno_align2os_bytes() usage. 
Change-Id: I4b83792c298aaa4c3ac5f412489a31f639f6d016
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
d869e20941 mdbx-chk: don't treat mm_geo.current < dxbfile_pages as an error 
This it is valid usual case on Windows, since windows can't shrinking a
mapped file. So we shouldn't see an error while checking such files on Linux.

Change-Id: I830c236c9b2fc1eb21768fceb24e67b9486c0795
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
b274c4a730 mdbx: fix to avoid ERROR_USER_MAPPED_FILE on Windows (minor race condition). 2019-11-04 00:22:13 +03:00
Leonid Yuriev
b4a5728455 mdbx: rework readahead management. 
Change-Id: Ic1e2f3f5bd7fb2e9fd8d5820816e3d2def6ec1b3
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
9c89e7c739 mdbx: refine discarding of unused pages (MADV_FREE/MADV_REMOVE/MADV_DONTNEED). 
Change-Id: I657eb7ef9060214d6ed3d75a2deeebc9ff3df5f5
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
40f31ea936 mdbx: add atomic_yield(). 
Change-Id: I0c3be400a880fd97bf1c254fd70a242982aac3f8
 2019-11-04 00:22:13 +03:00
Leonid Yuriev
3ee269ddb6 mdbx: support for txnid of the last modification for sub-dbs/kv-spaces. 
Change-Id: Ifb6684df57608cda88aa9134b275f442358ff46d
 2019-11-04 00:22:09 +03:00
Leonid Yuriev
84bff89eb1 mdbx: conform to and use -Wpedantic. 
Change-Id: I3056af7ae53c5a7c3ecbfe828ab1d5ee94c2bc26
 2019-10-26 00:02:28 +03:00
Leonid Yuriev
c694325ab7 mdbx: fix minor warnings. 
Change-Id: Iaa614a7d4325d3de6d863c20020c62954da7a1bf
 2019-10-25 23:09:23 +03:00
Leonid Yuriev
a0ec89e468 mdbx: fix check-for-unique for the case when more than one new database are opening (i.e. with creation of LCK-files). 
Change-Id: If712e1ead2e0cdfd72a115bd442d613a8d730839
 2019-10-25 21:05:44 +03:00
Leonid Yuriev
42f8154c39 mdbx-cmake: rename MDBX_USE_VALGRIND option. 
Change-Id: I985befb6c60e8a8c8db1b5d9dd085eb4645b038b
 2019-10-25 08:10:15 +03:00
Leonid Yuriev
b905dea2ee mdbx: fix Coverity warning (insignificant). 
Change-Id: I046b0e7d5b16f6f1b91dac4d96616dbcd7c601d2
 2019-10-25 08:08:24 +03:00
cryptozoidberg
edf5ddad4f mdbx: get rid of macro redefinition warnings under MSVC. 
This resolves https://github.com/leo-yuriev/libmdbx/pull/63

Change-Id: Id5ca071fe3060b8d508a28fd48ae13430a7e78a8
 2019-10-24 22:15:28 +03:00
Leonid Yuriev
8de8072078 mdbx: minor refine options and build-info. 
Change-Id: Iadabd8524991c10e76c0d38e4eef10c65224906e
 2019-10-24 22:12:14 +03:00
Leonid Yuriev
81fd0beb1a mdbx: rework/fix unaligned access. 
Change-Id: Ib0208e78786ac84551384ed57ac580fe0717840e
 2019-10-24 22:12:14 +03:00
Leonid Yuriev
b7d27c1b36 mdbx: rework internals for using C99 flexible array member (preparation for -fsanitize=undefined). 
Change-Id: I0d1836d6108ef379c43231720ef703ff69fc426d
 2019-10-24 22:12:14 +03:00
Leonid Yuriev
70350bad81 mdbx-cmake: require C99 or use C11 when available. 
Change-Id: I241e8c38232750efb537a0b581f822540f207cdc
 2019-10-24 22:12:14 +03:00
Leonid Yuriev
83a0c31b35 mdbx: converts macros to inline functions, rework page_fill_enough() and thresholds. 
Change-Id: I18ff12bdcafac37cc73b6228788ce5bbc752773f
 2019-10-24 22:12:14 +03:00
Leonid Yuriev
ed515d4642 mdbx: fix static library build on Windows. 2019-10-24 11:51:25 +03:00
Leonid Yuriev
411ed3e578 mdbx: fix Coverity warnings (minor). 
Change-Id: I8636560583c11eeaa6d37ba9f7f66e1afc2232da
 2019-10-21 11:46:17 +03:00
Leonid Yuriev
efa855b497 mdbx: drop unused dpl_mark4removal(). 
Change-Id: I23dcbbad8b0fc4691a755125c2e58fa9b529423b
 2019-10-21 10:00:28 +03:00
Leonid Yuriev
2eab9c2957 mdbx: refine/optimize list-related loops. 
Change-Id: I15b2305d1400819fdc1ae0ad306df70bc5f20388
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
e6462dfe58 mdbx: minor refine mdbx_chk output. 
Change-Id: I2c2560910d2908afe0f4a3aee0dc465ca7e24030
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
f5d75a85b0 mdbx: minor refine setup_dxb() logging. 
Change-Id: I985ded5fce6d829563591d9b5ddb5b172100e43d
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
081603e6bc mdbx: alter update-gc for intermediate refunding of pages. 
Change-Id: I551e94ed897c04af09f59a3fd96c694ef243d3a5
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
4e386be914 mdbx: don't hold dbi-lock during tree deletion inside mdbx_drop(). 
Change-Id: I29824271ba09a4443196bc1207279a257a8e26c0
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
15ce797863 mdbx: refine/optimize mdbx_page_alloc(). 
Change-Id: Iebbb8a611a82a379cf23b683bb21c9b6626ea9a5
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
36477ef408 mdbx: minor refine/optimize mdbx_page_new(). 
Change-Id: Ie1b227cbeceec8b1fc64630b8d1c12210d98dc20
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
b11d655173 mdbx: refine/optimize update-gc (remove anything in our spill list from parent's dirty list). 
Change-Id: I945bdbc1431bac39173121210e1a08787e027b0c
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
781a814864 mdbx: refine/optimize update-gc (filter-out list of dirty-pages from loose-pages). 
Change-Id: I73caa11e8a6378c307eb2e0a8199d0428dc14e05
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
363841caf8 mdbx: rework/optimize pages refunding. 
Change-Id: I9315ea9187eaff4572536ab9c895fb6995eebd94
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
7f0dd35702 mdbx: more checking in mdbx_dirtylist_check(). 
Change-Id: I4bf5b3ee03a816f34000586b760fd7b01994d3aa
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
5c54566c5c mdbx: rework/fix retire-to-parent-txn pages (fix LMDB bug). 
Change-Id: I81c3d48f19b4c7e62d77cfecc167235374f66402
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
659933d0c9 mdbx: rework mdbx_page_flush(), providing flush_begin & flush_end. 
Change-Id: Id7366d427d204b444ab76c880ad1c0757a7de94e
 2019-10-21 07:50:11 +03:00
Leonid Yuriev
6a01955810 mdbx: rework atomic-ops & safe64_reset_compare() to avoid use libatomic on true-32-bit arches. 
Change-Id: I27aa8dc9505a469e35a7fe06660e9944e4c1974c
 2019-10-19 00:16:48 +03:00
Leonid Yuriev
a907109cce mdbx: fix MDBX_node for big-endian. 
Change-Id: I436fc01e379908df07bcb829f0d9cf6999c8c133
 2019-10-16 14:22:38 +03:00
Leonid Yuriev
0f3994d506 mdbx: fix/refine mdbx_is_dirty(). 
Change-Id: I70bb46b47e7c313fdfd0b130ee55b82dd75e92d2
 2019-10-16 11:34:33 +03:00
Leonid Yuriev
b84bb4f805 mdbx: add MDBX_TXNID_STEP macro for debugging. 
Change-Id: I4768c8b39f3317ec3a5da8627d736f2f28bf0d51
 2019-10-15 23:53:00 +03:00
Leonid Yuriev
8467552f0b mdbx: fix internal audit. 
Change-Id: I9b3360216bbfc1a1a6f6052aca78331b01dc80ec
 2019-10-15 23:52:17 +03:00
Leonid Yuriev
5f8ecf0144 mdbx: fix Valgrind support. 
Change-Id: I246bddb6536fa03e46d302dcdc6700007ffbe06c
 2019-10-15 21:54:38 +03:00
Leonid Yuriev
a0e9c33e54 mdbx: rework page loosing/retirement. 
Change-Id: I194bee1ba21f5bac53342924f00555620151a43d
 2019-10-15 21:54:31 +03:00
Leonid Yuriev
ee77920a2e mdbx: refine loose-pages refunding. 
Change-Id: I7b76476e8c0ac3d35c1de53edfc943a14389d167
 2019-10-15 21:48:09 +03:00
Leonid Yuriev
06193f4267 mdbx: refine page-number-list checking. 
Change-Id: I89524075b416eb8bc63b1e0910baf3a37d6589f4
 2019-10-14 17:28:53 +03:00
Leonid Yuriev
137b19aac2 mdbx: workaround for Apple-LLVM bug. 
Change-Id: Ib1b504240d71fe20cc306b81b175bbb63737bea0
 2019-10-12 23:05:22 +03:00
Leonid Yuriev
3df5f60a70 mdbx: include <malloc_np.h> for FreeBSD & OpenBSD. 
Change-Id: I4b9c29bf63a03c281017f50bbdfe3495740804af
 2019-10-12 22:47:27 +03:00
Leonid Yuriev
bb922c208c mdbx: add mdbx_is_readahead_reasonable(). 
Change-Id: Iac090a9050d6b046b62b2c79cefbc70cc62c9144
 2019-10-12 22:38:36 +03:00
Leonid Yuriev
c51a6e6d95 mdbx: move madvise(MADV_RANDOM) to under control of MDBX_NORDAHEAD flag. 
Change-Id: Ied2473ad054797a20ec2c177106a9a7e85fab1d1
 2019-10-12 11:07:21 +03:00
Leonid Yuriev
e04ea50c18 mdbx: refine madvise(MADV_REMOVE_OR_FREE_OR_DONTNEED), add 256K threshold. 
Change-Id: I1fe314fa10062dca0870ec035454370bfacf20f0
 2019-10-12 11:07:21 +03:00
Leonid Yuriev
f6ba670cd0 mdbx: minor fix for __gnu_linux__. 
Change-Id: Ic262bf863927fe86ab0091d809388569f0d59bec
 2019-10-12 11:07:21 +03:00
Leonid Yuriev
8921da2787 mdbx: fix internal comments. 
Change-Id: Ica95587f74501e78259805cba4393a430af0437b
 2019-10-12 11:07:21 +03:00
Leonid Yuriev
4560ddcd1e mdbx: refine ending of read-only transactions. 
Change-Id: I56d07d75e4f5f64fd34e5b780024c145eb8299ed
 2019-10-12 11:07:21 +03:00