ISAR/libmdbx
3
0
Fork 0
mirror of https://github.com/isar/libmdbx.git synced 2024-10-31 11:50:27 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,229 Commits 5 Branches 68 Tags 11 MiB
cd1b9ea1cf
Commit Graph

530 Commits

Author SHA1 Message Date
Leo Yuriev
e8ae506773 mdbx: minor refine env-init. 2018-02-02 19:06:14 +03:00
Leo Yuriev
7b59452aed mdbx: less memset overhead while txn-init. 2018-02-02 19:05:41 +03:00
Leo Yuriev
5db134c816 mdbx: minor refine defs. 2018-02-02 19:04:33 +03:00
Leo Yuriev
5cfec7a832 mdbx: workaround for Windows LockFileEx/WriteFile bug. 
This resolves https://github.com/leo-yuriev/libmdbx/issues/25
 2018-01-31 15:26:44 +03:00
Leo Yuriev
5c9baa06b9 mdbx: fix mdbx_txn_end() assert for mt_owner. 2018-01-30 19:52:39 +03:00
Leo Yuriev
1143390e58 mdbx: fix/allow mdbx_txn_end() to re-aborting txn. 2018-01-24 18:45:42 +03:00
Leo Yuriev
ca06c1973e mdbx: fix/allow mdbx_txn_renew() after an renew-error. 2018-01-24 17:40:57 +03:00
Leo Yuriev
a45612e6d0 mdbx: fix lower_size overwrite. 
Change-Id: If9addb1f549628866e3ce9597f1a542684ef8f2d
 2018-01-14 22:40:11 +03:00
Leo Yuriev
ab7cb2c39e mdbx-build: minor cleanup after pul-request/merge. 
Change-Id: Ia612dbd939be7acd938fca8eb3f93f650560417a
 2018-01-14 22:09:52 +03:00
Leonid Yuriev
506caee9e5
mdbx-buiid: Merge pull request #21 from vvromanov/master 
Add CMake build files and rpm generation.
 2018-01-14 21:42:34 +03:00
Leonid Yuriev
8d4b6b187f mdbx-windows: resize file on umnap. 
Change-Id: Ia4739bfcd2cc7b91c14e294c7569cbee582165b1
 2018-01-14 21:16:52 +03:00
Leo Yuriev
5acf93c54d mdbx: rework allowing open large DB from a 32-bit environment. 
Change-Id: Id7d9e2041158d0715496b852a5ddb297bde1495e
 2018-01-14 21:16:52 +03:00
Leo Yuriev
915830d0d3 mdbx: fix mapsize_min typo inside mdbx_read_header(). 
Change-Id: I65ffebb37f1332832a0e17796ba184be5d3fc929
 2018-01-14 21:16:52 +03:00
Leo Yuriev
c2fe0a71bc mdbx-windows: reserve address space to avoid occupy it by other threads. 
Change-Id: Ia5caec6bbeb55c7894de70e349e6e9479572b688
 2018-01-14 21:16:52 +03:00
Leonid Yuriev
5c058287d5 mdbx-windows: check ability of address space for growth before umnap. 
Change-Id: Ibb62dae26ebab8f3efdbf6aed1b26d88ed63a2b7
 2018-01-14 21:16:52 +03:00
Leonid Yuriev
373d4ad81d mdbx: allowing open large DB from a 32-bit environment. 2018-01-14 15:39:11 +03:00
Leo Yuriev
8a08df9188 mdbx: check txn inside mdbx_cursor_renew(). 
Change-Id: I444ff36739d875dda835e8ded7a7aae37c8bd2be
 2018-01-11 21:49:29 +03:00
Leo Yuriev
c4007cbc70 mdbx: check txn inside mdbx_cursor_txn(). 
Change-Id: Ia3d24800890369e3b6cab23d8f69c27246a4f017
 2018-01-11 21:48:47 +03:00
Leo Yuriev
6b5533338f mdbx: prohibit recursive txn-begin by MDBX_BUSY. 
Change-Id: I46f5159cec72df9c8aece07fbfb462682499a272
 2018-01-11 21:15:33 +03:00
Leo Yuriev
18432ebfab mdbx-windows: minor refine LCK_BODY_LEN. 
Change-Id: Id02434a12ba66f15b2aa624819c068f6e6fce0d3
 2018-01-10 01:02:23 +03:00
Leo Yuriev
455f60eec1 mdbx: minor fix OSAL (extra assert). 
Change-Id: I2caad4a9c4638f124a2bae534bff4d9ed7b57f30
 2018-01-10 01:01:49 +03:00
Leo Yuriev
abcacea543 mdbx: more pid and MDBX_FATAL_ERROR checks. 
Change-Id: Ifa223f270312cb7bbba01bdb76173f8230efb91b
 2018-01-09 21:14:42 +03:00
Leo Yuriev
c0be0d6fb7 mdbx: fix mdbx_env_set_geometry() for case remap failed. 
Change-Id: I0850692737eaee3c7f33194dfa19b88ce74497c8
 2018-01-09 21:13:04 +03:00
Leo Yuriev
8e8c00aadf mdbx-windows: raise MDBX_PANIC if remap failed. 2018-01-09 15:46:42 +03:00
Leo Yuriev
963da34412 mdbx: fix mdbx_env_set_geometry(). 2018-01-09 15:38:03 +03:00
Leo Yuriev
e7922b65fa mdbx-windows: refine mdbx_mresize(). 2018-01-09 15:37:52 +03:00
Leo Yuriev
59ad929d36 mdbx-windows: fix and refine mdbx_suspend_threads_before_remap(). 
Change-Id: I4f289f5d603ca18e6714455604dd4ce98931af41
 2018-01-08 18:19:25 +03:00
Leo Yuriev
30bd7d3078 mdbx: shrinking memory-mapping for Windows (initial). 
Change-Id: I3c3c2df0747c788ea36d7764c1e8139098ca62be
 2018-01-08 17:47:41 +03:00
Leo Yuriev
f10f5b376f mdbx: account freelist-backlog while shrinking DB. 
Change-Id: I8b211f281483e7cb6344ef99c571f3516d16f61d
 2018-01-07 22:31:34 +03:00
Leonid Yuriev
7812476518 mdbx: fix readonly mapping for Windows. 
Change-Id: Ie301d7af74ff91e802aa78af8cfb329f587137ee
 2018-01-07 17:08:47 +03:00
Vladimir Romanov
4ed8eddf42 Improve cmake support. Add rpm generation 2018-01-07 15:10:06 +03:00
Leonid Yuriev
d14ca5cc4f mdbx: fix _InterlockedExchangeAdd64 for some 32-bit SDKs. 
Change-Id: I18280e8ef6432b9db3c5073fd59eaa102462f98d
 2018-01-07 14:35:47 +03:00
Leo Yuriev
897d4dbf87 mdbx: fix growth memory-mapping on Windows. 
This resolves https://github.com/leo-yuriev/libmdbx/issues/22

Change-Id: I25c2e65d9f68da8012ee097d3ad579cd548f2e09
 2018-01-07 14:31:29 +03:00
Leo Yuriev
91a9d4d916 mdbx: more ntpapi for Windows. 
Change-Id: I616b09502302be9e3017db7e99cf4dcf8697f32f
 2018-01-07 14:22:17 +03:00
Vladimir Romanov
18a261a6dd Add CMake support 2018-01-04 09:27:09 +03:00
Leo Yuriev
24a8bdec49 mdbx: fix SIGSEGV in case mdbx_env_close_ex() called without mdbx_env_open(). 2017-12-20 14:22:55 +03:00
Leo Yuriev
3e9308eb0e mdbx: check for running write-txn inside mdbx_env_close(). 2017-12-19 16:38:21 +03:00
Leo Yuriev
b1c7fa30c0 mdbx: fix MDBX_BUSY comment/description (typo). 2017-12-19 16:37:20 +03:00
Leo Yuriev
96a0647253 mdbx-windows: fix mmap-resize (add MEM_RESERVE afrer NtExtendSection). 2017-12-19 16:07:30 +03:00
Leo Yuriev
8008e23cfa mdbx-windows: minor fix for legacy Windows SDK. 2017-12-19 16:07:25 +03:00
Leo Yuriev
a5b077b2f0 mdbx: minor clarify mdbx_env_set_geometry(). 2017-12-19 15:33:25 +03:00
Leo Yuriev
46a3d4e0a3 mdbx: fix assertion (minor, not a malfunction). 
The `env->me_sync_pending` could be zero
when `mdbx_sync_locked()` called from `mdbx_env_set_geometry()`.

Therefore `mdbx_assert(env, !META_IS_STEADY(head) || env->me_sync_pending != 0)` at the top of `mdbx_sync_locked()`
could be trigger assertion failure.
 2017-12-18 14:39:41 +03:00
Leo Yuriev
fc1bbf3a4b mdbx: disable 'unreachable code' for MSVC. 
Change-Id: I4f9887b557885cb9a3829d19a56d332c76656cf8
 2017-10-29 03:23:39 +03:00
Leo Yuriev
866ca18970 mdbx: add few __fallthrough and __unreachable. 
Change-Id: Ife18986a3a6391c76f63d12f8102bd6670ae63eb
 2017-10-29 02:12:05 +03:00
Leo Yuriev
aec2445161 mdbx: rework '_noop' and related macros. 
Change-Id: Ic9ff3662a6abeb64aa0816e448007dd524794b1e
 2017-10-29 02:12:05 +03:00
Leo Yuriev
db4ab61a0c mdbx: drop '__packed'. 
Change-Id: Idf3e510733adb2b12b94fe1dcd22f76e02df955b
 2017-10-29 00:59:11 +03:00
Leo Yuriev
6f6b360aba mdbx: add/fix 'fallthrough' for GCC 7.x 
Change-Id: I45c57ea910978aaa857086d7794ad92ba0ae7157
 2017-10-28 11:45:04 +03:00
Leo Yuriev
d1f04656ab mdbx: more robustness for thread checking while reset/renew/abort of txn. 2017-10-27 18:01:32 +03:00
Leo Yuriev
d4bf0a3332 mdbx: refine/simplify mdbx_find_oldest(). 
Simplify b6f14780e3
 2017-10-27 15:43:06 +03:00
Leo Yuriev
1a27e40701 mdbx: Merge branch 'fix-after-txntry'. 2017-10-27 14:17:43 +03:00
Leo Yuriev
b6f14780e3 mdbx: fix performance degradation in the absence of readers. 
Change-Id: I59a51b61918463e68d3e0490c715f4dcc9ecb788
 2017-10-27 13:36:10 +03:00
Leo Yuriev
0a7a290d06 mdbx: drop mdbx_txn_trylock(). 2017-10-26 21:49:39 +03:00
Leo Yuriev
5e1721efdd mdbx: fix mdbx_robust_trylock(). 2017-10-26 21:49:38 +03:00
Leo Yuriev
17b8e48bf4 mdbx: cleanup after last pull-request. 
Cleanup after 4e40af60e7 (Merge pull request #20 from rouzier/feature/txn_try).
 2017-10-26 21:49:38 +03:00
James Rouzier
7c466e53f0 Add the ability to not block when opening a write transaction 2017-10-25 19:41:28 -04:00
Leo Yuriev
4f1c846437 mdbx: rollback to not-a-weak instead to steady. 2017-10-10 18:14:07 +03:00
Leo Yuriev
b7121d7711 mdbx: fix meta.mm_psize typecast. 2017-10-09 17:41:13 +03:00
Leo Yuriev
9fd7056b4f mdbx: fix loose/dirty bug. 
Change-Id: I725b640cfc29e1c0710abb155e05d44bb7bb3cc3
 2017-10-05 09:01:19 +03:00
Leo Yuriev
f4ca6ed6b9 mdbx: fix handling MAX_MAPSIZE32 limit. 2017-10-02 18:01:08 +03:00
Leo Yuriev
2ce817b438 mdbx: ensure checks to avoid using meta-pages. 
Change-Id: I21959b8a26961bb65f3bc3b87b24a3c4f6a673f7
 2017-09-26 20:13:43 +03:00
Leo Yuriev
dc31d7d1a3 mdbx: fix shrinking below a lower-bound. 
Change-Id: Ia6d497e2d7c6d7ee646b23b8df944a01d96445fc
 2017-09-26 19:37:34 +03:00
Leo Yuriev
6a2ce93f19 mdbx: minor simplify mdbx_dbi_open_ex(). 
Simplify prev commit.

Change-Id: Id6a5abd6b18ceefae4cf259935bd6d9d9adb7d76
 2017-09-07 09:52:53 +03:00
Leo Yuriev
5b23d7e452 mdbx: fix mdbx_dbi_open_ex(MDBX_CREATE) for rdonly txn. 
Fix https://github.com/leo-yuriev/libmdbx/issues/19

Change-Id: I3ae1ab3188482fd8c31de51d62e34591082cd60a
 2017-09-07 09:43:44 +03:00
Leo Yuriev
26dab6dee0 mdbx: import - ITS#8722 fix FIRST_DUP/LAST_DUP cursor bounds check. 
Change-Id: I6dbba19b594a4bd3545d430a3438cf3b1c5a0a0b
 2017-09-07 09:43:43 +03:00
Leo Yuriev
ee9d0903c8 mdbx: use <winternl.h> for Windows. 2017-09-05 21:02:03 +03:00
Leo Yuriev
e6e92134a6 mdbx: fix PVS-Studio warnings. 2017-09-05 21:02:03 +03:00
Leo Yuriev
ace062f4a7 mdbx: fix warning around mode_t. 
More for https://github.com/leo-yuriev/libmdbx/issues/15

Change-Id: I1743e01e9111400942fd2a4846a21c475101a148
 2017-08-16 11:28:38 +03:00
Leo Yuriev
728252058d mdbx: fix/refine comment. 
Change-Id: I8f09ca755ebcc1e58531504a8998391e7a3c8c9a
 2017-08-16 09:29:30 +03:00
Leo Yuriev
9b5e28e8e6 mdbx: fix mdbx_setup_dxb() for a case when db-size not (pre)configured by user. 
Fix https://github.com/leo-yuriev/libmdbx/issues/11

Change-Id: I6fccd4877fed563cfb3a03f887bbba73eff5ac84
 2017-08-16 08:46:20 +03:00
Leo Yuriev
0dc145aa2d mdbx: fix typo and endif comment. 
Change-Id: Iae7ae3ce55698c1d6f03111b7d1945f3ac4e9394
 2017-08-08 23:42:45 +03:00
Leo Yuriev
7b8a1c9794 mdbx: fix typo. 
Change-Id: Ib491469a2a7ebb6bdadf995fa3a964d23fdf7036
 2017-07-28 21:53:15 +03:00
Leonid Yuriev
c91885de67 mdbx: use _ASSERTE() for MSVC. 
Change-Id: Ibb277e8c98fbfb1e658c85dc49e57769f2683da3
 2017-07-28 14:39:44 +03:00
Leonid Yuriev
82a716847b mdbx: fix/workaround mmap-resize for Windows. 
Change-Id: I58b5784f1309cd1e88af860828f561fe29f51ff0
 2017-07-28 14:37:50 +03:00
Leonid Yuriev
128cc2d308 mdbx: fix pnl_sort(). 
Change-Id: I57f9a8dd8d61c6f11f8f30d15f8812cf2f850789
 2017-07-28 14:37:06 +03:00
Leo Yuriev
0f37ae56d8 mdbx: minor cleanup version-info. 
Change-Id: I1c208af0264ed6254d942b29b9e0fc25a745f4e0
 2017-07-27 18:10:07 +03:00
Leo Yuriev
c6fc062cfd mdbx: fix MSVC warnings. 
Change-Id: Ida49e653510358d7c81fe5da73a0131dcb6268f6
 2017-07-27 17:35:00 +03:00
Leo Yuriev
684847db39 mdbx: relax backlog estimation/preparation for freelist_save(). 
Change-Id: I931b76179855c16cb8b6265db262309061ac196d
 2017-07-27 16:58:45 +03:00
Leo Yuriev
aa5403ad38 mdbx: 1/1 as default grow/shrink for MDBX_DEBUG. 
Change-Id: I90fa2705113f134984f9ec341ef37131e598d121
 2017-07-27 16:58:34 +03:00
Leo Yuriev
c49d1bc97a mdbx: provide refunding pages into unallocated space. 
Change-Id: I9d4f953adc6f3b745a9822044f3933adba4ca6fe
 2017-07-27 16:58:22 +03:00
Leo Yuriev
dcc179f412 mdbx: more checks for pgno-list ordering. 
Change-Id: I6c6093532e8d2c07c42f62d23579ef86cbbd43b7
 2017-07-27 16:58:09 +03:00
Leo Yuriev
b8b3ba8e91 mdbx: provide configurable ascending/descending sort-order for pgno-lists. 
Change-Id: I3134c100880ff28bb0aaf46ed91affc9f6347110
 2017-07-27 16:57:52 +03:00
Leo Yuriev
552b759878 mdbx: refine pgno-lists. 
Change-Id: Id38e4aff508437210d4c0e63962067dfe518eb31
 2017-07-27 16:53:42 +03:00
Leo Yuriev
592c064873 mdbx: refine freelist_save() to simplify loose-pages handling (preparation for pages refunding). 
Change-Id: I1f15487383fbfb6770e1f7128a2d8349a1cfdf25
 2017-07-27 16:53:01 +03:00
Leo Yuriev
7ed97d50b1 mdbx: guard put-data inside freelist_save() by C_RECLAIMING (paranoia). 
Change-Id: I9cb6bf27717f76dc97259d48e4253a30c2345afd
 2017-07-27 16:52:59 +03:00
Howard Chu
7626bcfdde mdbx: backport - ITS#8699 more for cursor_del ITS#8622. 
Set C_DEL flag on reinit'd subcursor

Change-Id: I8ad1c10afd481f61b8e521d02c4d2de3be5089d7
 2017-07-27 04:45:03 +03:00
Leonid Yuriev
092156ee4f mdbx: fix/redefine ssize_t, PRI*PTR nad PRI*size macros for MSVC. 
Change-Id: I6cb565087350cf1d1e1735bff1c5480c3d4c02db
 2017-07-26 19:17:11 +03:00
Leo Yuriev
336bef7e51 mdbx: make internal 'atomics' compatible with C++. 
Change-Id: I1381f477e977edf4bf56871a2e34af1b302867a0
 2017-07-26 17:38:06 +03:00
Leo Yuriev
fb9d7a4471 mdbx: refine freelist_list() to avoid coverity warnings. 
Change-Id: I38eee44e4ca926e7d11ef5e3f7f3ce2e92f71259
 2017-07-26 17:36:32 +03:00
Leonid Yuriev
a78edd314e mdbx: more fix MSVC '/Wall' warnings. 
Change-Id: I359a3056d6bb5db762fe6b6b8a89e8ed066f8a87
 2017-07-26 16:02:49 +03:00
Leonid Yuriev
006f531757 mdbx: turn /Wall for MSVC. 
Change-Id: Idc264a9fe40a2af8629d96121fb91cba94e7147f
 2017-07-26 16:02:19 +03:00
Leo Yuriev
8ca23d8735 mdbx: add missing <signal.h> 
Change-Id: I3f2d0587db84598a0157aae50cdff3361935f2b3
 2017-07-26 15:11:25 +03:00
Leo Yuriev
88ca23caa5 mdbx: misc refines (minor). 
Change-Id: Ia58e2d75e320bbd47dd352e082cf6f41afde075f
 2017-07-26 12:43:54 +03:00
Leo Yuriev
1b09605a06 mdbx: clarify mdbx_filesync(). 
Change-Id: I39029a52fd44c81901aff6114a5c58a62b92098b
 2017-07-26 12:43:54 +03:00
Leo Yuriev
1f7f3af16c mdbx: minor refine mdbx_mmap(). 
Change-Id: Ic5026b6412ca93a00faeb8306975d896d85b475d
 2017-07-26 12:43:54 +03:00
Leo Yuriev
f57931f614 mdbx: apply only substantial geo-changes and pre-shink while opening database. 
Change-Id: If62ac64cc820ed0201cecf4b89ea3096029abb0a
 2017-07-26 12:43:54 +03:00
Leo Yuriev
1dab822324 mdbx: growth/shrink datafile with alignment. 
Change-Id: I46deb885654d2bb1d164009159c9364567ab88a9
 2017-07-26 12:43:52 +03:00
Leo Yuriev
4f06a38a50 mdbx: use saturated pgno_add() to avoid overflows. 
Change-Id: I70000a86a69c9b3399d0a2c345d57ca1908f2881
 2017-07-26 12:41:52 +03:00
Leo Yuriev
a9927e7214 mdbx: refine page_alloc(). 
Change-Id: I9932847ef244132df9d909b41a1760a3e89288ac
 2017-07-26 12:30:50 +03:00
Leo Yuriev
3d53f2ff2a mdbx: refine mdbx_reclaiming_detent() for MDBX_UTTERLY_NOSYNC. 
Change-Id: I7847f2b375f3792927a55c90bb26d3220e71b576
 2017-07-26 12:28:27 +03:00
Leo Yuriev
94af9e02b0 mdbx: fix mdbx_env_close_ex() for MDBX_RDONLY. 
Change-Id: I5ff79a93e026d4b40412294956dd222081a1b821
 2017-07-26 12:27:34 +03:00
Leo Yuriev
ab8fa36033 mdbx: refine mdbx_meta_ot() and dependents. 
Change-Id: I449d501f0c3710fdb906e01931e10300ab3b7c9d
 2017-07-26 12:26:02 +03:00
Leo Yuriev
0b07749fba mdbx: major fix - madvise(MADV_REMOVE) only for exclusive mode. 
Change-Id: I6799df7b85eaf32a1c46f251ca64a4df4ff092b2
 2017-07-26 12:09:57 +03:00
Leo Yuriev
a3ee20e4f6 mdbx: more NUM_METAS inside mdbx_chk and mdbx_stat. 
Change-Id: I93f4fddcff6b038c5a5143e52c7db233e77ec30b
 2017-07-26 12:09:57 +03:00
Leo Yuriev
9e473ab6f2 mdbx: remove obsolete mlock(). 
Change-Id: I23df282d545eac9dd7bf9df1bd71dedbccc45cfd
 2017-07-26 12:09:57 +03:00
Leo Yuriev
4fa4129add mdbx: cleanup freelist_save(). 
Change-Id: I552e6d7edac61e66b8954f6b58485d6b07194ab5
 2017-07-26 12:09:57 +03:00
Leo Yuriev
1babb0a4f7 mdbx: don't put loose pages into befree in lifo mode. 
Change-Id: Ibb409e3447e42f1b9f38ed0a33ecb7715fa54d31
 2017-07-26 12:09:57 +03:00
Leo Yuriev
ad48fd54fb mdbx: minor refine freelist_save(). 
Change-Id: Ifed9b8d363d45d24c44c1b0a803dad34aada96d3
 2017-07-26 12:09:57 +03:00
Leo Yuriev
3ba5bebec4 mdbx: refine mdbx_txl_alloc(). 
Change-Id: I624a92c8a845ab563f13619b3638227d012a780b
 2017-07-26 12:09:57 +03:00
Leo Yuriev
d5a8bcebbf mdbx: preserve current meta-extra fields/flags. 
Change-Id: Id458a85178839bd196435891633c4dd1f3a51d45
 2017-07-23 21:33:17 +03:00
Leo Yuriev
58f7674fa5 mdbx: fix mdbx_set_attr(). 
Change-Id: I6628a0629a17f99f39098b8ccb76259cd65dd353
 2017-07-23 21:07:08 +03:00
Leo Yuriev
b4e0344de7 mdbx: check for oldest-aware corruption by writer in txn_renew(). 
Change-Id: I1a49e4264feb93dc84963db426b11f467f31fcf6
 2017-07-23 21:07:08 +03:00
Leo Yuriev
ddc5b9f34f mdbx: start find_oldest() from steady-point. 
Change-Id: Icc102f98f86e557e1ccba9cd74255c3da9225d41
 2017-07-23 18:39:31 +03:00
Leo Yuriev
425254aba5 mdbx-tools: hush MSVC's internal warnings. 
Change-Id: I2b2bdb149149aa8bafff0bb7df205547f645fe10
 2017-07-21 22:45:51 +03:00
Leo Yuriev
f96bb5ef4a mdbx-tools: fix coverity issue (minor). 
Change-Id: I8031a59336134a355ea31d6f41b241dbc176f577
 2017-07-21 22:39:15 +03:00
Leo Yuriev
c5d1384c64 mdbx-tools: more fix MSVC warnings. 
Change-Id: Ib5f78a89fea09dc78d4922519eab6eaed4b1a7e6
 2017-07-21 16:54:46 +03:00
Leo Yuriev
63af619080 mdbx: #ifdef-guard for FILE_PROVIDER_EXTERNAL_INFO_V1. 
Change-Id: I4bc4eb012f7d6ea874a10abd4a2bfcfb789c4a22
 2017-07-21 15:49:05 +03:00
Leo Yuriev
242baf761f mdbx: fix/rework shrinking, add MDBX_SHRINK_ALLOWED. 
Change-Id: I014440850aa4be927843aa2a6a268794a4da9b2a
 2017-07-21 13:55:21 +03:00
Leo Yuriev
599711a007 mdbx: fix/avoid meta-update from setup_dxb() in read-only mode. 
Change-Id: I60359f92aba31bb5a22e9a39ea4658d2393e957d
 2017-07-21 13:54:06 +03:00
Leonid Yuriev
c8a5df650b mdbx: fix/rework exclusive-locking for Windows. 
Change-Id: I1b129a10ed7523024481480647317f1643f2ea70
 2017-07-19 14:13:31 +03:00
Leo Yuriev
17e8429a29 mdbx: rework mmap-functions for osal. 
- add 'length' and 'current' fields to mmap-object;
 - drop mdbx_mremap();
 - do remap on-demand inside mdbx_mresize();
 - add mdbx_mapresize() which re-creates Valgrind's region.
 - call resize on txn-begin.

Change-Id: I82780f92c4947804e3f14fb7cb71ee655382f9bb
 2017-07-19 14:13:31 +03:00
Leo Yuriev
53c2b0abe4 mdbx: checking and reject network/remote files. 
Change-Id: I77e8b8bc94785d705461d162cbc40ad58ead67ca
 2017-07-12 03:31:20 +03:00
Leo Yuriev
4d1df6ea11 mdbx: rework rollback on dxb-setup to avoid troubles under Windows. 2017-07-12 03:31:20 +03:00
Leo Yuriev
455de97d36 mdbx: rework using of mdbx_mmap_t and mdbx_msync(). 2017-07-12 03:31:20 +03:00
Leo Yuriev
70d54f6f2c mdbx-msvc: refine IntDir/OutDir for msbuild projects. 2017-07-12 02:21:50 +03:00
Leo Yuriev
0167694457 mdbx: building mdbx-tools for Windows. 
Change-Id: I9019c4382b7108ec7c442d2b0d4be044a3cb136a
 2017-07-12 02:20:47 +03:00
Leo Yuriev
6f00854034 mdbx: take LTO_ENABLED in account for AddressSanitizer default options. 
Change-Id: I691eae23ca2cb60c6e2a9260ab41e3c80c8aaeb8
 2017-07-07 00:45:52 +03:00
Leo Yuriev
0047ce4bd6 mdbx: add default AddressSanitizer options. 
Change-Id: I99b7aee5010f1d43008b2a61efe3fb9bb023ab31
 2017-07-07 00:02:56 +03:00
Leo Yuriev
84b4883f00 mdbx: fix returning MDBX-errors after the merge. 
Change-Id: Id49b7f341749709cdee476c88c1066e76b6937c1
 2017-07-05 19:38:39 +03:00
Leo Yuriev
d01a97f729 tools: fix minor defects (coverity). 
Change-Id: I3a80dcb31c54718d22cdca6272aa028685956243
 2017-07-04 13:21:16 +03:00
Leo Yuriev
14484a6f32 mdbx: fix minor defects (coverity). 
Change-Id: I1a5b0788a87ab2a138b342140648642fd5855ae3
 2017-07-04 13:21:16 +03:00
Leo Yuriev
beda690227 mdbx: fix resource-leak in mdbx_env_open_ex() in case of error (coverity). 
Change-Id: I9e808e2de4a64d05205a79c9d90feacc87ec930d
 2017-07-04 13:21:16 +03:00
Leo Yuriev
93d92db43d mdbx: fix mischecking in mdbx_reader_check0() (coverity). 
Change-Id: I2e3aaba1426c3b152a39b90f6d171380948da0a7
 2017-07-04 13:21:16 +03:00
Leo Yuriev
bf8507f3ec mdbx: fix mdbx_env_info() to avoid null-deref in lck-free mode (coverity). 
Change-Id: Ica8fe6c7f5a18af3a4d7d38ce8a1a092d5f1b2f7
 2017-07-04 11:45:48 +03:00
Leo Yuriev
aec35300c4 mdbx: fix new API function after the merge. 
Change-Id: Ic929444ceb137ccaa2ab4fe82b4f93a3cb5a92aa
 2017-07-04 10:46:46 +03:00
Leo Yuriev
b34e92d308 mdbx: cleanup/reformat after the merge. 
Change-Id: I3e0fe8f1292a6387e8d3ff8b904170f05d8e1770
 2017-07-04 10:35:32 +03:00
Leo Yuriev
594834bc9c mdbx: Merge branch 'nexenta' into devel. 
Change-Id: I7a00f98e088f21ebc91a3861309b697f01e1fa66
 2017-07-04 09:22:09 +03:00
Leo Yuriev
3c5ae4cc9c mdbx: disable C4548 as workaround for buggy WinSDK 10.0.10240.0 2017-07-03 12:50:48 +03:00
Leo Yuriev
78ae12aa10 mdbx: fix MSVC 'padding' warnings, minor refine fields ordering. 2017-07-03 11:41:24 +03:00
Leo Yuriev
1d702aa94f mdbx: more warning control for MSVC. 2017-07-03 06:45:41 +03:00
Leonid Yuriev
3e6a672286 mdbx: fix MSVC warnings, add uint16-range-asserts. 
Change-Id: Ie67a728035eeae250efbf962270b5c17c974db23
 2017-07-03 04:41:00 +03:00
Leo Yuriev
2ed74ee78f mdbx: fix MSVC size_t/uint64_t warnings (minor). 
Change-Id: I580eea87e9c557c61b1ff0b66feaafce139d2c45
 2017-06-30 07:25:56 +03:00
Leo Yuriev
186d2ee065 mdbx: add 'mti_reader_finished_flag' for speedup find_oldesd(). 
Change-Id: I4a2c8b80efad0cfc12918969125d258043cbffba
 2017-06-30 00:43:11 +03:00
Leo Yuriev
acfa096aba mdbx: more for lockless/readonly mode (testing needed). 
Change-Id: I28f46f5a373212ebb5df780f4d2b5e216d8cdae2
 2017-06-30 00:43:11 +03:00
Leo Yuriev
5fbb8d1018 mdbx: fix C11 warnings abount atomic. 2017-06-24 19:33:34 +03:00
Leonid Yuriev
ca83480c34 mdbx: pragma lib ntdll.lib 2017-06-21 01:42:41 +03:00
Leo Yuriev
9a2fff91f3 mdbx: dynamic mapsize/geometry and API (mostly done). 
Change-Id: Ifb768ff3207cae1755c53c211a3ae552c6455e12
 2017-06-21 01:42:41 +03:00
Leo Yuriev
45defdc170 mdbx: refine err returning (MDBX_EPERM, etc). 
Change-Id: Iaa21a0e6632be47d6ef2a3676ba5e1381fc03b4d
 2017-06-21 01:42:27 +03:00
Leo Yuriev
10b0197026 mdbx: drop mdbx_get_errno_checked(). 
Change-Id: Ifa829b465083f17eba911e19947bdae854f9759c
 2017-06-21 01:41:25 +03:00
Leo Yuriev
151d4540de mdbx: refine internal constant (use UINT32_C, etc minors). 
Change-Id: I0f994ee75b5aa1494fcc8ca42a46120865676e25
 2017-06-21 01:39:53 +03:00
Leo Yuriev
f93818a926 mdbx: fix MAX_MAPSIZE for Win32. 
Change-Id: I04cbffb14ab7c73d935614b2f5c8140000b78d76
 2017-06-21 01:36:49 +03:00
Leo Yuriev
edc936dc28 mdbx: rework mdbx_oomkick() and speedup mdbx_find_oldest(). 
Change-Id: Icc2c450e7f10efe1b4ab8705e6a659cece256dc1
 2017-06-16 05:27:01 +03:00
Leo Yuriev
81661ff952 mdbx: add shared cache for oldest reader's txnid. 
Change-Id: I48cbc778b873445dffa8ecef1fc3633e0193131f
 2017-06-16 05:21:49 +03:00
Leo Yuriev
c01aeb5c68 mdbx: refine meta_txnid(). 
Change-Id: I4d78b2ebed8850c90dc762405ba939be7385c9a3
 2017-06-16 05:21:49 +03:00
Leo Yuriev
ae71c2aa36 mdbx: simplify find-oldest inside mdbx_page_alloc(). 
Change-Id: I88dfc8ee268eba2452bffd3c4e6cfd066bcd8b04
 2017-06-16 05:21:27 +03:00
Leo Yuriev
760f7d1331 mdbx: fix nasty 'inverted if-condition' inside mdbx_reader_check0(). 
Fix c2087f186e
 2017-06-15 15:05:14 +03:00
Leo Yuriev
ddc3787936 mdbx: fix MDBX_RESULT_TRUE handling inside mdbx_mutex_failed()...mdbx_oomkick(). 2017-06-15 14:56:25 +03:00
Leo Yuriev
71e2fe3df0 mdbx: add MDBX_DBG_DUMP for mdbx_setup_debug(). 
So, meta-pages and lck-section now will be included into a coredump.
 2017-06-15 13:45:16 +03:00
Leo Yuriev
0ef41bef2b mdbx: fix mdbx_txn_straggler() for write-txn. 2017-06-13 19:27:52 +03:00
Leo Yuriev
6f53dd0719 mdbx: add mdbx_dbi_flags_ex(). 2017-06-09 16:44:34 +03:00
Leo Yuriev
3ca64535b6 mdbx: add NTAPI to OSAL. 2017-06-07 18:17:21 +03:00
Leo Yuriev
d2d513014d mdbx: add mdbx_lck_upgrade() to OSAL. 2017-06-06 20:28:00 +03:00
Leo Yuriev
204904df7c mdbx: disallow begin txn if env not yet opened. 2017-06-06 20:28:00 +03:00
Leo Yuriev
fbce45cb98 mdbx: allow calling mdbx_env_sync() inside transaction. 2017-06-06 20:28:00 +03:00
Leo Yuriev
1d15ae4b13 mdbx: zeroing MDBX_page.mp_validator for Valgrind/AddressSanitizer. 2017-06-06 17:47:46 +03:00
Leo Yuriev
465459dc58 mdbx: add MDBX_txn.mt_owner and MDBX_THREAD_MISMATCH. 2017-06-06 17:11:29 +03:00
Leo Yuriev
3bf3a08f96 mdbx: fix write-txn thread cleanup. 2017-06-06 17:09:49 +03:00
Leonid Yuriev
318646794e mdbx: partial fix MSVC level-4 warnings. 2017-06-06 04:15:08 +03:00
Leonid Yuriev
bfa6dea784 mdbx: fix size_t/unsigned/int warnings. 
Change-Id: Ic5a8684aed232b8b732d6e7a87a6757f3f7afcec
 2017-06-06 04:15:08 +03:00
Leonid Yuriev
7e85ad82f1 mdbx: refine read_header(), add MDBX_TOO_LARGE. 
Change-Id: I25b9bb2e3817993d627b2b784dfa496d9ba7e7b0
 2017-06-06 04:15:08 +03:00
Leo Yuriev
61d7ea283f mdbx: size_t for sync_threshold and mapsize. 2017-06-06 04:15:08 +03:00
Leo Yuriev
802c10f13f mdbx: log2shift instead of multiplication by pagesize. 
Change-Id: I72c4c7699a409795459b466ff74c388b15b13687
 2017-06-06 04:15:08 +03:00
Leo Yuriev
9ef81ac16c mdbx: add 'unlikely' to IS_OVERFLOW(). 
Change-Id: Ia92aac948046890ca4f9d9c3fbff0b4ac5728fab
 2017-06-06 04:15:08 +03:00
Leo Yuriev
439ae3983c mdbx: use 2^N constants for fill-threshold. 
Change-Id: I3e190f5af77282a7995ae733c7a6865a21daa6c3
 2017-06-06 04:15:08 +03:00
Leo Yuriev
59c22ab036 mdbx: use 32-bit pgno_t (page numbers). 
Change-Id: Ie9f3528e12b7be27765c0225edde26e4d8282692
 2017-06-06 04:15:08 +03:00
Leo Yuriev
1343b46466 mdbx: add txnid-list functions. 2017-06-06 04:15:08 +03:00
Leo Yuriev
52f52de2d5 mdbx: include meta-pages into a coredump. 2017-06-06 04:15:08 +03:00
Leo Yuriev
95ebdb7065 mdbx: MAX_PAGESIZE always 64K. 2017-06-06 04:15:08 +03:00
Leo Yuriev
19dd181b6f mdbx: fix STATIC_ASSERT for MSVC. 2017-06-06 04:15:08 +03:00
Leo Yuriev
61a3766e23 mdbx: update DB format and signatures. 
Change-Id: I9c4b187e8ebc3df63fef15ae98872e27d56a01ab
 2017-06-06 04:15:08 +03:00
Lorenz Bauer
d99b2a4b16 mdbx: use F_SETNOSIGPIPE to SIGPIPE husing on a OS X. 2017-06-06 04:15:08 +03:00
Leo Yuriev
98a8fbdc7a mdbx: restore SIGPIPE hushing in the db-copy-thread. 2017-06-06 04:15:08 +03:00
Leonid Yuriev
e7ee0bc762 mdbx: refine testing-jitter, add MDBX_DBG_JITTER. 
Change-Id: Ibc3bd8a16626e97aabc2cc544a3803f2e2bc3a10
 2017-06-06 04:15:08 +03:00
Leo Yuriev
009618560f mdbx: refine mdbx_is_dirty(). 2017-05-30 15:32:05 +03:00
Leo Yuriev
d5b0e68326 mdbx: fix merge/rebase error (remove mm_txnid field). 2017-05-29 20:44:17 +03:00
Leo Yuriev
a36b065cd9 mdbx: logging MDBX_PROBLEM reasons. 2017-05-29 20:17:02 +03:00
Leo Yuriev
11e8727483 mdbx: fix missing braces. 2017-05-29 20:16:09 +03:00
Leo Yuriev
70fe982c3a mdbx: fix MDBX_WANNA_RECOVERY description. 2017-05-29 19:38:43 +03:00
Leo Yuriev
d91785f635 mdbx: disable unnecessary assertion in mdbx_is_dirty(). 2017-05-29 19:38:43 +03:00
Leo Yuriev
0f676db491 mdbx: add locking while open/close/drop dbi-handles (avoid dbi-related races). 
This avoid races and collisions between threads when opening,
closing and deleting DBI-handles.

unfortunately, this does not resolve collision in the case an one thread
closing the DBI-handle while the another thread performs transaction.

Change-Id: I48c3ffb11a8f83739fae1712db3476645f573e09
 2017-05-29 19:38:43 +03:00
Leo Yuriev
bd5d092a2b mdbx: check system pagesize (paranoia). 
Change-Id: I596c686a996f7d1521789f22900022c4da629e1b
 2017-05-28 18:55:18 +03:00
Leo Yuriev
a0ddf167dd mdbx: common database format for 32/64 targets (remove 'size_t' structures). 
Change-Id: I2d7c77603ee27c5ae4b82f762a726f71136527c8
 2017-05-28 18:35:58 +03:00
Leo Yuriev
fca74ab80c mdbx: refine meta-commit in WRITEMAP mode. 
Change-Id: Ieb53bf6144a104fc88b0b07b4abdde20f4b01978
 2017-05-28 18:35:58 +03:00
Leo Yuriev
2347282b4f mdbx: add assertions for reclaiming-edge. 
Change-Id: I87e11f69423b4e7841c4f8ec6b5ecfdff9e96b0d
 2017-05-28 17:06:04 +03:00
Leo Yuriev
236ddda1ae mdbx: more assertions for mdbx_txn_renew0(). 
Change-Id: I3c179d105c3e6388c08b2c371ada4d457af50bed
 2017-05-28 17:06:04 +03:00
Leo Yuriev
2ea97ae281 mdbx: refine find_oldest() and meta_head(). 2017-05-28 17:06:04 +03:00
Leo Yuriev
91bc3129d5 mdbx: refine mdbx_page_search(). 
Change-Id: I9c87ae2ffe317538813ebec971ad093936f4c504
 2017-05-28 17:06:04 +03:00
Leo Yuriev
f945e8a062 mdbx: fix cache-aligned size for MDBX_reader. 
Change-Id: I1e48dd279106daa629fbcd427ec841828799c8f6
 2017-05-28 17:06:04 +03:00
Leo Yuriev
bb5e1b43af mdbx: relax mdbx_is_dirrty() assertion for map-range. 2017-05-28 17:06:04 +03:00
Leo Yuriev
17c8057684 mdbx: fix gcc 'uninitialized' warning with -Og. 2017-05-28 17:06:04 +03:00
Leo Yuriev
77f0e5e38e mdbx: drop unused debug features. 2017-05-28 17:06:04 +03:00
Leo Yuriev
60fed8bbca mdbx: fix first-rdonly-blocker bug. 2017-05-28 17:06:04 +03:00
Leo Yuriev
5c3691eff1 mdbx: split atomics for 32/64 uints. 2017-05-28 17:06:04 +03:00
Leo Yuriev
76f459c08e mdbx: two-phase txnid to avoid bottom-top DMA updates. 2017-05-28 17:06:04 +03:00
Leo Yuriev
dd33bea1d8 tools: mdbx_chk - don't 'rolled-back' in cooperative more. 2017-05-28 17:02:19 +03:00
Leo Yuriev
bd70135db1 mdbx: re-read and check meta-pages in mdbx_read_header() for consistency. 2017-05-28 17:02:19 +03:00
Leo Yuriev
93c5a84bcd mdbx: more checks mdbx_read_header() for metapage's content. 2017-05-28 17:02:19 +03:00
Leo Yuriev
1c170cb866 mdbx: add MAX_PAGENO, MIN_PAGENO, MAX_MAPSIZE, MIN_MAPSIZE. 2017-05-28 17:02:19 +03:00
Leo Yuriev
18cf804d0b mdbx: add STATIC_ASSERT_MSG, refine STATIC_ASSERT. 2017-05-28 17:02:19 +03:00
Leo Yuriev
4293840055 mdbx: fix meta-invalidate race in MDBX_WRITEMAP mode (when target == head). 2017-05-28 17:02:19 +03:00
Leo Yuriev
f4d3b76f81 mdbx: minor refine and rename mdbx_sync_locked(). 
Change-Id: Iab650b091006e5646d9d22316d19aa58a517684b
 2017-05-28 17:02:19 +03:00
Leo Yuriev
9959fe8711 mdbx: reorder fields in metapages. 2017-05-28 17:02:19 +03:00
Leo Yuriev
c02a3ac687 mdbx: ignore meta-pages with wrong pagesize. 2017-05-28 17:02:19 +03:00
Leo Yuriev
0e49b1b2b4 mdbx: update 'mapsize' while opening with txn-increment. 2017-05-28 17:02:19 +03:00
Leo Yuriev
d642127d10 tools: fix 'tail' show in mdbx_chk. 2017-05-28 17:02:19 +03:00
Leo Yuriev
5d836d2b03 mdbx: clarify steady/fluid/weak names of a head. 2017-05-28 17:02:19 +03:00
Leo Yuriev
1e0654a4a8 tool: show operational txnid in mdbx_chk. 2017-05-28 17:02:19 +03:00
Leo Yuriev
47cc45dec4 mdbx: don't check present durability mode for MDBX_RDONLY. 2017-05-28 17:02:19 +03:00
Leo Yuriev
700f3e9c2a mdbx: more checks for meta-params. 2017-05-28 17:02:19 +03:00
Leo Yuriev
9eeb00f448 mdbx: trinity of meta-pages. 2017-05-28 17:02:19 +03:00
Leo Yuriev
141306644d mdbx: fix mdbx_env_copy_asis(). 2017-05-26 03:10:31 +03:00
Leo Yuriev
7315b99b9d mdbx: fix MSVC/Windows warnings. 2017-05-25 19:12:51 +03:00
Leo Yuriev
b9dbe7c577 mdbx: fix segfault and double-free (in case twice abortion of the same write-txn). 2017-05-25 18:39:45 +03:00
Leo Yuriev
96de36baef mdbx: refine mdbx_cursor_count() API. 2017-05-25 16:21:29 +03:00
Leo Yuriev
3a166e1970 test: temporary crutch. 2017-05-25 15:30:35 +03:00
Leo Yuriev
b94e761d73 mdbx: fix 'magic' bug. 2017-05-25 15:08:45 +03:00
Leo Yuriev
5519d568f0 mdbx: fix mdbx_filesize() for Windows. 2017-05-25 09:40:29 +03:00
Leo Yuriev
15e2a45425 mdbx: check size of lck-file. 2017-05-25 09:40:29 +03:00
Leo Yuriev
c335b16c81 mdbx: rework mapsize's stuff inside mdbx_setup_dxb(). 2017-05-25 09:40:29 +03:00
Leo Yuriev
af7b468e63 mdbx: use uint64_t or size_t insted of off_t (buggy on Windows). 2017-05-24 18:50:24 +03:00
Leo Yuriev
7ef7e70012 mdbx: add STATIC_ASSERT. 2017-05-24 18:45:08 +03:00
Leo Yuriev
96b9af0b4d mdbx: minor refine idl functions. 2017-05-24 17:06:18 +03:00
Leo Yuriev
924e81ed92 mdbx: refine includes, drop midl.h and mdbx_osal.h 2017-05-24 17:05:59 +03:00
Leo Yuriev
dd7855c30d mdbx: cleanup tabs (minor). 2017-05-24 13:37:06 +03:00
Leo Yuriev
06de7a5155 mdbx: rename the rest MDBX_xyz. 2017-05-24 02:24:38 +03:00
Leo Yuriev
62ebc59330 mdbx: rework version info (stub for now). 2017-05-24 02:17:10 +03:00
Leo Yuriev
88ea2768f5 mdbx: fix gcc 'comparison is always true' warning. 2017-05-23 22:35:59 +03:00
Leo Yuriev
2c43997026 mdbx: change mdbx_env_set_oomfunc() API. 2017-05-23 22:18:21 +03:00
Leo Yuriev
132c9c994e mdbx: add mdbx_fastmutex_t. 2017-05-23 22:18:21 +03:00
Leo Yuriev
8c18622592 mdbx: rework MDBX_val. 2017-05-23 22:18:21 +03:00
Leo Yuriev
ac8e987346 mdbx: rework MDBX_txn. 2017-05-23 22:18:21 +03:00
Leo Yuriev
34213c554a mdbx: rework MDBX_reader. 2017-05-23 22:18:21 +03:00
Leo Yuriev
a3ed42b999 mdbx: rework MDBX_page, drop COPY_PGNO. 2017-05-23 22:18:20 +03:00
Leo Yuriev
8f2c21e2ba mdbx: rework MDBX_node. 2017-05-23 22:18:20 +03:00
Leo Yuriev
8828e90ff9 mdbx: mdbx_condmutex_t instead of mutex/condvar pair. 2017-05-23 19:57:26 +03:00
Leo Yuriev
2f97939efd mdbx: more cleanup mdbx_midl_sort(). 2017-05-23 19:57:26 +03:00
Leo Yuriev
eff0f92fa7 mdbx-tools: replace size_t/PRIuPTR with uint64_t/PRIu64. 2017-05-23 19:57:26 +03:00
Leo Yuriev
0cd30792bb mdbx: split MDB_ID into pgno_t and txnid_t. 2017-05-23 19:57:26 +03:00
Leo Yuriev
5c2042c466 tools: internal minor renames (preparation for changes). 2017-05-23 17:45:58 +03:00
Leo Yuriev
8b9e391dd0 mdbx: cleanup internals (mostly formatting, but not only). 2017-05-23 17:45:58 +03:00
Leo Yuriev
398b839b98 mdbx: drops old/obsolete API (mdbx_env_copy and mdbx_env_copydf). 2017-05-23 17:45:58 +03:00