ISAR/libmdbx
3
0
Fork 0
mirror of https://github.com/isar/libmdbx.git synced 2024-10-30 23:39:19 +08:00
Code Issues Packages Projects Releases Wiki Activity
321 Commits 5 Branches 68 Tags 11 MiB
a3a98a7a2e
Commit Graph

206 Commits

Author SHA1 Message Date
Hallvard Furuseth
84b6ecb9a8 lmdb: Hide internal flags in mdb_env_get_flags(). 
Change-Id: I9ff2888a61a53fb0c7471de980ec7b97c59c6096
 2015-08-04 13:57:13 +03:00
Leo Yuriev
295beda00c lmdb: fix ABI compatibility with original liblmdb.so 
Change-Id: I770a49b7a506f3f2a21ea3af36fd07c16a32dc30
 2015-06-04 19:12:14 +03:00
Hallvard Furuseth
f71cb6d69e lmdb: ITS#8156 Fix MDB_MAXKEYSIZE doc. 
Change-Id: Ia9dae2e68f28dcb715ac34226b358212317199c2
 2015-06-01 15:38:18 +03:00
Hallvard Furuseth
55ae3dfa8b lmdb: ITS#8157 mdb_txn_renew0(): init after error checks. 
Change-Id: I9ea344b98cb8c99a25ba7087abefbfe62b3417a0
 2015-05-28 16:00:27 +03:00
Hallvard Furuseth
bb7b923fdd lmdb: Set/clear mp_pad, md_pad (MDB_DUPFIXED data size). 
mdb_xcursor_init1(): md_pad is only used when MDB_DUPFIXED.
mdb_page_split():    Copy mp_pad too. Used by mdb_page_list().

Change-Id: Ia35cba3a367c04929a34a5879abc968202086e89
 2015-05-21 21:40:39 +03:00
Hallvard Furuseth
476c5b02ea lmdb: ITS#8117 Fix MDB_INTEGERDUP keysize doc. 
Change-Id: I7cf7c456f35fe9c5449a37ad9130864617197726
 2015-05-21 21:40:39 +03:00
Leo Yuriev
104312d15e lmdb: update mdb_chk for checkpoints, minor cosmetics. 
This is 9/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: I05f59313b4346c08bcd63d62e6c48a5f53c47852
 2015-05-21 21:40:39 +03:00
Leo Yuriev
21705fd9a2 lmdb: seek to steady meta-page on db-open. 
This is 7/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: If59a6bfc7c6198e6b1e85f4bdc5b534ecff03123
 2015-05-21 21:40:39 +03:00
Leo Yuriev
633f2a10ad lmdb: forces a steady checkpoint if OOM occurred 
because of reclaiming stops on a weak ones.

This is 6/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: I91d8a3dfaf06e1917326d8f73c4a65565cde0b47
 2015-05-21 21:40:39 +03:00
Leo Yuriev
312135169f lmdb: weak/steady for meta-pages. 
This is 5/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: Ica2dbe0bfd6ba58c00de161e2cd50594ee39c44d
 2015-05-21 21:40:39 +03:00
Leo Yuriev
a283d782f6 lmdb: bigbang for sync-to-disk path and related. 
This is 4/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Here a lot of changes:
 - deleted a secondary DSYNC-mode file descriptor;
 - deleted a pointers to meta-pages and toggle-selection of ones;
 - removed MDB_FDATASYNC_WORKS/FDATASYNC_MAYBE_BROKEN stuff;
 - reworked use of fdatasync/fsync for safety without performance degradation;
 - txn-to-meta updating moved info mdb_txn_commit();
 - removed mdb_env_write_meta();
 - rewrited mdb_env_sync0() for clarify;

Change-Id: I985464baa3cf486a2ceccf2c9dcb7a7fea698c46
 2015-05-21 21:40:24 +03:00
Leo Yuriev
1c37139b2a lmdb: drops no-lock operation mode (now MDB_NOLOCK is UNSUPPORTED). 
This is 3/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: I7cd5d90c41424d6635accbb10c5801adeb1087e9
 2015-05-21 20:23:12 +03:00
Leo Yuriev
eec1ccaa77 lmdb: drops support for non-POSIX. 
This is 2/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: I7ab3d5416381c9477edba4ce9db2f3fdc58a2d3d
 2015-05-21 18:43:00 +03:00
Leo Yuriev
c5db4043ee lmdb: prepare to bigbang (separated minor changes). 
This is 1/9 for https://github.com/ReOpen/ReOpenLDAP/issues/1
and https://github.com/ReOpen/ReOpenLDAP/issues/2

Change-Id: I3ba943b2e4597f3e796376a5a54851aa411b1aa1
 2015-05-21 18:05:00 +03:00
Leo Yuriev
548d9d4b03 lmdb: bugfix, OOM-handler couldn't help if LIFO-reclaiming disabled. 
This is fixes https://github.com/ReOpen/ReOpenLDAP/issues/28

Change-Id: Ifc33e1202ae38f0a4fa0cb9d572394a4dac7ec6c
 2015-05-15 01:31:22 +03:00
Leo Yuriev
bd05dd24ab lmdb: fix mdb_chk for case MainDB's records isn't a sub-db. 
Change-Id: I3a4ae1f50972fde6edab828b58199dde9b84550c
 2015-05-09 01:00:27 +03:00
Leo Yuriev
f2703156f0 lmdb: mdb: b-tree walk, page-map check in mdb_chk. 
Change-Id: I6678b4d891c8fbfbc49ed600212f4ade39e25282
 2015-05-08 15:49:33 +03:00
Leo Yuriev
23720958b6 lmdb: mdb_chk tool (initial). 
Change-Id: I7d31e0fb45ab56cf8d6df56939e5b3ded6b8e3e5
 2015-05-08 03:47:17 +03:00
Leo Yuriev
4a04e59dba lmdb: refork debug. 
Change-Id: I47d3e300b47fcba5600644ff28c68a900640c39c
 2015-05-08 03:45:30 +03:00
Howard Chu
0ac9ba6472 lmdb: ITS#8117 better fix. 
LY: This is not required for ReOpenLDAP, because it
is not such issues related to int/long in cmp/dcmp.
But let be more close to origin's sources.

Origin: Don't change mc_dbx because we would need
to undo the change if the txn aborts. Make the fix
(for get) match existing code for put.

Change-Id: I36f7ff99b4adf821cace5af6b0b84f5210eb454d
 2015-05-07 17:15:14 +03:00
Leo Yuriev
59d6560fc3 lmdb: cleanup Windows support. 
Change-Id: I7bc7f3e997eeea4c5678a97e2faf10525ba7eee6
 2015-05-04 03:48:22 +03:00
Leo Yuriev
f97cc739cb lmdb: ITS#8117 - reworks of comparison for MDB_INTEGERKEY and MDB_INTEGERDUP. 
Change-Id: Icd24589c7a139c4395de1e7c40f16d2c7ea54cf7
 2015-05-01 06:50:04 +03:00
Howard Chu
d4bddde7aa lmdb: ITS#8109 fix mdb_cursor_del0 on empty DB. 
Change-Id: Idba0acfd64b597f2bc5cb847ca99fe4560eed875
 2015-04-24 22:39:21 +03:00
Hallvard Furuseth
8103d0b458 lmdb: Clear error from previous txn on renew. 
Change-Id: I45e608d4d1ad3ffa3ad20e8a6b579708f25c3966
 2015-04-19 23:44:07 +03:00
Leo Yuriev
38789b6c0a lmdb: refine sync/async writes of meta-pages. 
Change-Id: If309023214e60f349762d337f98ee6fd515faa31
 2015-04-18 17:18:50 +03:00
Howard Chu
347c1d6dfb lmdb: ITS#8106 retry writes on EINTR. 
Change-Id: Ib422f62f6e1fc81cd773ca600524a53f8f16629e
 2015-04-18 16:44:17 +03:00
Howard Chu
d0b4943352 lmdb: ITS#8062 - fix rebalance, also handle subcursors. 
(Probably fixes the ITS, definitely fixes a bug) when collapsing
the root page, fixups of other cursors was incomplete.
 2015-04-16 13:38:42 +03:00
Hallvard Furuseth
5ac6404059 lmdb: Cleanup MDB_env.me_txn0. 
More fallout from 4d02c741b120786df1b87ee9ed49c1d3f9bc7522.

Change-Id: I3bbd913c7da3e45f00f1d40c0aac6e7bf5f48c69
 2015-04-09 13:25:02 +03:00
Hallvard Furuseth
dba429d608 lmdb: Fix per-txn MDB_NOMETASYNC, MDB_NOSYNC. 
Fallout from 4d02c741b120786df1b87ee9ed49c1d3f9bc7522. The flags
were ignored: mdb_txn_renew0/begin cleared and/or did not set them.

Change-Id: Ic7dab1e9a4cf3754e05a3c3df6a10e0efa48af5c
 2015-04-09 13:23:59 +03:00
Hallvard Furuseth
c4097ec898 lmdb: Renumber MDB_TXN_* flags, simplify flag code. 
Change-Id: I91b0836a84ce80049dbe0829dfc3101fae94c7c9
 2015-04-09 13:22:49 +03:00
Hallvard Furuseth
5daf811dcb lmdb: Clear error from previous txn in mdb_txn_renew(). 
Change-Id: I72b55bfd91c87e4608fbf50f3c70951952855f8f
 2015-04-09 13:22:16 +03:00
Leo Yuriev
4a1574c998 all: refine #defines that controls memory checking. 
LDAP_DISABLE_MEMORY_CHECK removed, LDAP_MEMORY_DEBUG is used instead.
LDAP_MEMORY_DEBUG_ASSERT replaced with LDAP_MEMORY_ASSERT.

Change-Id: I0f43b9ae10b76c1af39f2c52b34b4ab804521e78
 2015-03-26 01:04:14 +03:00
Leo Yuriev
602fdd16b9 lmdb: define MDB_INLINE macro instead of __inline. 
Change-Id: I3a2f47138a80b09f8c3682a9a26dbf5aca3445f7
 2015-02-24 15:14:01 +03:00
Quanah Gibson-Mount
3766484c9e all: 2015 copyright timestamp (from OpenLDAP). 
Change-Id: I76f457e30a0478bfc0246c760a2302d380d6f181
 2015-02-18 16:04:11 +03:00
Leo Yuriev
ddbda992c7 lmdb: refines Valgrind usage. 
Change-Id: I5f30a609b9053bbf8a693b7ca64dc57dc176f6e9
 2015-01-18 06:57:49 +03:00
Leo Yuriev
b6b2609f9e lmdb: minor refine (rename md_pad => md_psize). 
Change-Id: I60f95d171abebce5967c9bb398c21dbb01ca3d36
 2015-01-18 06:57:49 +03:00
Leo Yuriev
48e85e891e lmdb: use pwritev() on non-windows systems (MDB_USE_PWRITEV). 
Change-Id: Iebd69846fc87cd6bb584002b366837ecb631b603
 2015-01-18 06:57:49 +03:00
Leo Yuriev
1ca2b54966 lmdb: more coherent-barriers where reader's pid updated. 
Change-Id: I6262021c074a99e2f548c1fda94fd53c584d2b89
 2015-01-17 17:20:33 +03:00
Hallvard Furuseth
ae747bb4ce lmdb: ITS#7971 Fix reader allocation and me_numreaders. 
Change-Id: I75c8325de342c2a28592fb0c7a718f95855e7e4d
 2015-01-17 16:58:32 +03:00
Hallvard Furuseth
62181cfe87 lmdb: Reject CHANGELESS flags in mdb_env_set_flags(). 
Reverts part of a2ac10107e2fb845c4a38a339239063ec4407d84.
MDB_ROBUST needed to be accepted, but that flag is gone.

Change-Id: I2aba1e9e02da716d4509e465767bf8be05895c29
 2015-01-16 01:26:50 +03:00
Leo Yuriev
1f58fb66ae lmdb: ITS#7969 properly compiler/memory/coherent barriers. 
Change-Id: I875d0908a2c828626df544fed48b3144e95e3982
 2015-01-16 01:26:50 +03:00
Howard Chu
e7a0c74c09 lmdb: Fix potential null deref (coverity). 
Change-Id: Icc5cadfddecbea81c835d84e4ada785e34638514
 2015-01-16 01:26:50 +03:00
Hallvard Furuseth
eb885ab910 lmdb: Make SysV semaphores robust. Cleanup MDB_ROBUST. 
Backport from master: 66e3f5139105822196aea6a6e63596d25734222a.

Change-Id: Idda165be19ee95c2a0839a180a2ece395502ce26
 2015-01-16 01:26:49 +03:00
Leo Yuriev
3015e8d03e lmdb: account pages from penging txn in mdb_txn_straggler(). 
Backport from master: f756a26a43ad933a98909a974ae84f7d43c30266.

Change-Id: I0f8af7af722977ddeff88d2e8129bcde23ffd06f
 2015-01-16 01:26:49 +03:00
Howard Chu
13b144dc5d ITS#8021 env_sync is invalid in RDONLY env 
Change-Id: I2c9c8bcf4b28ea002cb5e4caa117396a82289924
 2015-01-16 00:25:18 +03:00
Leo Yuriev
3fd4f9cce0 lmdb: rework workaround for potential ext3/ext4 corruption issue. 
Reworked from branch 'mdb.master' origin OpenLDAP:
  8b6c425 2015-01-12 More cleanup for fdatasync hack
  ea89e3d 2015-01-11 Tweak conditionals for fdatasync hack
  462dc09 2015-01-08 fdatasync hack, again
  e86072a 2015-01-08 Revert "Note MDB_SAFE_FDATASYNC"
  293d6bb 2015-01-08 Note MDB_SAFE_FDATASYNC
  9585c01 2015-01-08 Simpler fdatasync hack
  0ef1e0b 2015-01-08 Revert "Fix prev commit for env_sync0"

Imported early while forking ReOpenLDAP:
  985bbbb 2014-12-21 Fix prev commit for env_sync0
  0018eeb 2014-12-18 Hack for potential ext3/ext4 corruption issue

Change-Id: I187fd320620b9ced2e3773cac96f281ff65f97d4
 2015-01-16 00:24:31 +03:00
Leo Yuriev
f00d2cdef6 lmdb: MDB_LIFORECLAIM & MDB_COALESCE modes. 
Reclaim FreeDB in LIFO order - this is a main feature.
Also aim to coalesce small FreeDFB records.

Change-Id: I76aa062ef59359616e5b697233ec47cbd14f43cd
 2015-01-15 23:19:52 +03:00
Leo Yuriev
9eedc88441 lmdb: ITS#7974 oom-handler feature. 
Change-Id: I2c56e003fa1e4abe934288581e4c52c80db27c08
 2015-01-15 23:19:52 +03:00
Leo Yuriev
84ce8b4cd8 lmdb: properly sync meta-pages in mdb_sync_env(). 
Meta-pages may be updated during data-syncing in mdb_sync_env(),
in this case database would be inconsistent.

Check-and-retry if lead txn-id changed during flushing data in mdb_sync_env().

Change-Id: I806e6d3766d028dcd4e6b0591aabc718107056fb
 2015-01-15 23:19:52 +03:00
Leo Yuriev
fcfe2b7042 lmdb: auto-sync with kbytes threshold (aka checkpoint by kbytes). 
Change-Id: If29a3d70e775a65d832f578f0c3edd3ea41dcc67
 2015-01-15 23:19:52 +03:00
Leo Yuriev
c9489da920 lmdb: lock meta-pages in writemap-mode to avoid unordered write. 
Without locking the meta-pages may be writen by OS before data pages,
in this case database would be inconsistent.

Change-Id: I6a262709b0741d7b57cb68231c4ae1c62a10a743
 2015-01-15 23:19:51 +03:00
Leo Yuriev
2df38ad58b lmdb: ITS#7974 get a lag of the reading for dreamcatcher. 
Change-Id: I7fc93ce4fa851904521a58a225f04c65eca2d998
 2015-01-15 23:19:51 +03:00
Leo Yuriev
7984f8817f lmdb: more usefull info from mdb_stat tool. 
Change-Id: I64015952431aebabf792b912acd022a6ddc79903
 2015-01-15 23:19:51 +03:00
Leo Yuriev
1b8398b413 lmdb: Use last page (off-by-one error). 
Change-Id: Ie1fd90d1562ab8ea8e53701188e3a17495a697e1
 2015-01-15 23:19:51 +03:00
Leo Yuriev
1b5de44e23 fix: uninitialized (warnings). 
Change-Id: I0f5eab80546a602a616209c6b585605826a06371
 2015-01-15 23:19:51 +03:00
Leo Yuriev
83055127c1 OpenLDAP mdb.master at 985bbbbdd5d64e57f55249ffdeb7c08035b240b2 (2015-01-01). 2015-01-07 18:12:57 +03:00