log lshlib.cpp @ 770:c54bc2ffbf92 tip

age author description
Thu, 25 Nov 2010 13:42:40 +0000 mas01mc Adding mkc_lsh_update branch, trunk candidate with improved LSH: merged trunk 1095 and branch multiprobe_lsh mkc_lsh_update
Thu, 25 Nov 2010 13:42:40 +0000 mas01mc Adding mkc_lsh_update branch, trunk candidate with improved LSH: merged trunk 1095 and branch multiprobe_lsh fewerQueryDatumReads
Thu, 22 Oct 2009 12:51:04 +0000 mas01cr (probably) restore buildability on Cygwin
Tue, 13 Oct 2009 20:17:06 +0000 mas01cr hack lshlib into happiness with mingw
Tue, 11 Aug 2009 21:42:13 +0000 mas01cr Header file rearrangement
Sun, 22 Feb 2009 15:04:44 +0000 mas01mc Fixed error in pointID bit processing (logical ! used instead of bit-wise ~). Fixed LSH table row disk/core dump routines. multiprobeLSH
Sun, 22 Feb 2009 03:44:25 +0000 mas01mc Added a test program and lshlib functionality to inspect on-disk and in-core hashtable representations. multiprobeLSH
Sat, 21 Feb 2009 21:56:57 +0000 mas01mc Added public lsh hashtable inspection methods. multiprobeLSH
Sat, 21 Feb 2009 12:00:03 +0000 mas01mc Simplified (logically reduced) bit-processing operations in lshlib multiprobeLSH
Wed, 28 Jan 2009 17:18:58 +0000 mas01mc _LSH_DEBUG_ option now reports correct point counts per hashtable read. multiprobeLSH
Wed, 28 Jan 2009 16:02:17 +0000 mas01mc Fixed a bug in LSH hashtable writing to disk that doesn't always sort the t2 entries into strict weak ordering. Now it does. Lots of debugging informational code inserted. multiprobeLSH
Wed, 28 Jan 2009 05:18:14 +0000 mas01mc insert some statistics gathering for hash tables, add _LSH_DEBUG_ macro to output LSH statistics on INDEX and QUERY multiprobeLSH
Tue, 27 Jan 2009 14:52:28 +0000 mas01mc Fixed upper-limit (T) boundary error in MultiProbe::generatePerturbationSets(x, T). Setting this too high spins algorithm1 into infinite heap allocations without possiblity of terminating. This is now silently capped at --lsh_k * 2; the algorithm halts up to this threshold. multiprobeLSH
Tue, 27 Jan 2009 03:49:19 +0000 mas01mc Working version of multiprobe LSH. Passes tests. But needs testing vis-a-vis TP improvement. In the process, found a bug in hash function projections on rare occasions admitting negative values. This only shows for large datasets and was fatal for multiprobe. multiprobeLSH
Mon, 26 Jan 2009 13:19:09 +0000 mas01mc Fixed boundary {-1,+1} order, array syntax in generate_multiprobe_keys(), boundary error in MultiProbe::valid() multiprobeLSH
Mon, 26 Jan 2009 05:42:15 +0000 mas01mc lshlib MultiProbe glue added. Compiles and links against audioDB. Fails LSH tests at the moment. multiprobeLSH
Sat, 24 Jan 2009 19:51:46 +0000 mas01mc New branch to implement multiprobe LSH. Copy of trunk:802. Added multiprobe.{cpp,h} source files. multiprobeLSH
Sat, 24 Jan 2009 06:16:00 +0000 mas01mc Removed redundant copy in LSH hashfunction computation when #!defined USE_U_FUNCTIONS. Moved LSH macro definitions into lshlib.h
Fri, 23 Jan 2009 21:44:32 +0000 mas01mc Added hook for dumping LSH INDEX tables on load via compile-time switch: -DLSH_DUMP_CORE_TABLES
Fri, 23 Jan 2009 18:45:44 +0000 mas01mc Implemented correct LSH table via compile-time switch -DLSH_DUMP_CORE_TABLES. Dumps on LSH load. memory-leaks
Sat, 10 Jan 2009 13:23:41 +0000 mas01mc plugged IndexName memory leak in lshlib.cpp memory-leaks
Sat, 10 Jan 2009 13:23:01 +0000 mas01mc added file descriptor close() in lshlib.cpp memory-leaks
Fri, 09 Jan 2009 18:05:32 +0000 mas01mc Fixed memory leaks, added WS --no_unit_norming, and removed capping of LSH_N_POINT_BITS to 15 bits, instead allow any number of bits to encode points, remaining bits encode tracks
Wed, 12 Nov 2008 15:23:32 +0000 mas01cr gcc-4.3 warning cleanups for lshlib.cpp gcc-4.3-cleanups
Tue, 07 Oct 2008 21:03:26 +0000 mas01mc unionized punning of the sbucket.snext field into {subucket* ptr, unsigned numBuckets}snext; so that list-head code is 64-bit friendly.
Tue, 07 Oct 2008 20:08:22 +0000 mas01mc added portable C++ reinterpret_cast<Uns32T> instead of C-style cast to fix 64-bit compile error in query.cpp. This is in advance of re-writing bucket class to include a union{} of pointer and counter fields.
Wed, 10 Sep 2008 18:55:16 +0000 mas01mc Added LSH_CORE_ARRAY structure for hashtables instead of linked lists. Maintained Backwards Compatibiliity with indexes build for linked list format. Added tests for indexing and merging. Tested backwards compatibility OK.\n\n The purpose of the LSH_CORE_ARRAY data structure is greater space efficiency and L1/2 cache usage. Essential for multiple indexes with multiple hashtables in RAM
Fri, 05 Sep 2008 14:16:21 +0000 mas01mc converted read/write into fread/fwrite for LSH hashtable serialize and unserialize. INDEXING is now faster.
Tue, 19 Aug 2008 14:27:21 +0000 mas01mc Adding large_adb support (up to 1M tracks) large_adb
Thu, 07 Aug 2008 17:05:22 +0000 mas01mc Fixed persistent index bug where indexName identifier was an un protected string pointer rather than a copy of the string. Hence the index name was getting deleted and the test for persistent index was failing.
Thu, 07 Aug 2008 01:53:38 +0000 mas01mc Added server-side loading of persistent index (LSH hashtables) via --load_index -d dbName -R radius -l sequenceLength. Queries using these parameters will lookup the memory-resident hashtable instead of loading one from disk.
Tue, 05 Aug 2008 22:40:38 +0000 mas01mc changed FORMAT2 index serialization so that token bits don't scribble over point index for >=32768 tracks
Fri, 01 Aug 2008 15:45:10 +0000 mas01mc fixed recently-introduced strict point ordering bug when LSH index is initially empty
Fri, 01 Aug 2008 15:04:31 +0000 mas01mc fixed file size allocation for FORMAT2 files. Made LSH index size() in bytes an unsigned long long. Changed the name of lsh_inCore flag to lsh_on_disk (to reverse the sense of the 'flag').
Wed, 30 Jul 2008 18:00:50 +0000 mas01mc fixed UNIT_TEST_LSH.cpp to work with refactored lshlib and fixed default LSH file FORMAT on serialization.
Wed, 30 Jul 2008 15:22:22 +0000 mas01mc Refactored LSH interface to separate hashfunctions and parameters from insertion/retrieval/serialization
Tue, 29 Jul 2008 22:01:17 +0000 mas01mc Completed merge of lshlib back to current version of the trunk.