log audioDB.h @ 755:37c2b9cce23a multiprobeLSH

age author description
Mon, 02 Feb 2009 17:41:02 +0000 mas01mc DELETED LSH_N_POINT_BITS coding. Tracks and points are now identified with a binary search, std::lower_bound(), on *adb->track_offsets return from LSH retrieval. multiprobeLSH
Thu, 15 Jan 2009 13:57:33 +0000 mas01cr Code rearrangements to tease apart library code from C++ audioDB code.
Tue, 13 Jan 2009 21:37:14 +0000 mas01cr Better soap memory correctness.
Tue, 13 Jan 2009 21:26:26 +0000 mas01cr Remove vestiges of old allowed_keys implementation of restrict list
Sun, 11 Jan 2009 04:24:24 +0000 mas01mc generalized LSH_N_POINT_BITS compile-time option. Set to <=15 or omit for default (backwards-compatible) behaviour. memory-leaks
Sat, 10 Jan 2009 20:01:53 +0000 mas01mc Fixed bug in LSH_N_POINT_BITS coding when using AudioDB with LSH indexes memory-leaks
Sat, 10 Jan 2009 16:47:57 +0000 mas01cr Merge api-inversion branch (-r656:771, but I don't expect to return to
Sat, 10 Jan 2009 15:33:25 +0000 mas01cr Mostly disentangle API from command-line binary. api-inversion
Fri, 09 Jan 2009 18:05:32 +0000 mas01mc Fixed memory leaks, added WS --no_unit_norming, and removed capping of LSH_N_POINT_BITS to 15 bits, instead allow any number of bits to encode points, remaining bits encode tracks
Tue, 06 Jan 2009 07:02:11 +0000 mas01mc added --no_unit_norming to SOAP interface, added this case to tests/0041
Wed, 31 Dec 2008 15:44:12 +0000 mas01cr YAY! api-inversion
Tue, 30 Dec 2008 23:56:57 +0000 mas01cr No more audioDB::index_allocate and audioDB::index_init_query api-inversion
Tue, 30 Dec 2008 17:16:02 +0000 mas01mc feature DIM upper limit changed. Needed for working with very large data sets
Tue, 30 Dec 2008 15:38:59 +0000 mas01cr audioDB::query_loop and audioDB::query_loop_points are no more. api-inversion
Tue, 30 Dec 2008 10:36:01 +0000 mas01cr Convert index-finding logic to C functions. api-inversion
Sun, 28 Dec 2008 22:43:50 +0000 mas01cr No more global shingle vector of vectors. api-inversion
Sun, 28 Dec 2008 18:44:08 +0000 mas01cr Start using the query state structure. api-inversion
Wed, 24 Dec 2008 10:57:27 +0000 mas01cr Baby steps with index.cpp api-inversion
Wed, 24 Dec 2008 10:57:23 +0000 mas01cr Begin pushing adb_t *adb into index_query_loop and query_loop_points api-inversion
Wed, 24 Dec 2008 10:57:18 +0000 mas01cr No more indata api-inversion
Wed, 24 Dec 2008 10:57:14 +0000 mas01cr Almost finish with audioDB::query_loop. api-inversion
Wed, 24 Dec 2008 10:57:09 +0000 mas01cr No more audioDB::error in audioDB::query_loop api-inversion
Wed, 24 Dec 2008 10:57:05 +0000 mas01cr Miscellaneous trivial de-audioDB::ifications api-inversion
Wed, 24 Dec 2008 10:57:01 +0000 mas01cr No more trackOffsetTable api-inversion
Wed, 24 Dec 2008 10:56:45 +0000 mas01cr Incrementally zapping bits of code. api-inversion
Wed, 24 Dec 2008 10:56:37 +0000 mas01cr No more audioDB::set_up_query{,_from_key} api-inversion
Wed, 24 Dec 2008 10:56:16 +0000 mas01cr audioDB::initialize_arrays no longer depends on anything in the C++ class. api-inversion
Wed, 24 Dec 2008 10:56:07 +0000 mas01cr Hey, who let audioDB::set_up_query into the room? api-inversion
Wed, 24 Dec 2008 10:55:56 +0000 mas01cr begin pushing an adb_query_spec_t * all the way through query. api-inversion
Wed, 24 Dec 2008 10:55:52 +0000 mas01cr adb_t-ize most of audioDB::set_up_db. api-inversion
Wed, 24 Dec 2008 10:55:48 +0000 mas01cr More on the query rationalization api-inversion
Wed, 24 Dec 2008 10:55:40 +0000 mas01cr Punishment gluttony. api-inversion
Wed, 24 Dec 2008 10:55:36 +0000 mas01cr Make the keys std::set in adb_t a std::map instead. api-inversion
Wed, 24 Dec 2008 10:55:32 +0000 mas01cr dataBuf is no more. api-inversion
Wed, 24 Dec 2008 10:55:28 +0000 mas01cr Delete char *db field from audioDB class. api-inversion
Wed, 24 Dec 2008 10:55:24 +0000 mas01cr Move sequence_foo() functions out of audioDB:: namespace... api-inversion
Wed, 24 Dec 2008 10:55:20 +0000 mas01cr Deal with audioDB::UnitNorm api-inversion
Wed, 24 Dec 2008 10:55:16 +0000 mas01cr Begin pushing information through. api-inversion
Wed, 24 Dec 2008 10:55:08 +0000 mas01cr Cheap hackery abounds. api-inversion
Wed, 24 Dec 2008 10:54:59 +0000 mas01cr Code spaghettification continues. api-inversion
Tue, 23 Dec 2008 20:41:58 +0000 mas01mc Small changes to add restrict list to indexed search. Removed redundant methods in indexed query code paths.
Tue, 09 Dec 2008 22:48:30 +0000 mas01cr The lesser of two evils, part 2. api-inversion
Fri, 05 Dec 2008 22:32:49 +0000 mas01cr invert audioDB::insert / audiodb_insert(). api-inversion
Fri, 05 Dec 2008 22:32:43 +0000 mas01cr Begin working towards inverting audioDB::insert() / audiodb_insert(). api-inversion
Wed, 03 Dec 2008 14:53:20 +0000 mas01cr Invert audioDB::l2norm / audiodb_l2norm() api-inversion
Tue, 25 Nov 2008 16:41:01 +0000 mas01cr Invert audioDB::status / audiodb_status(). api-inversion
Tue, 25 Nov 2008 16:40:59 +0000 mas01cr There can be only one (again). api-inversion
Mon, 24 Nov 2008 15:42:15 +0000 mas01cr Include some necessary information in struct adb. api-inversion
Wed, 12 Nov 2008 15:40:40 +0000 mas01cr Merge gcc-4.3-cleanups branch (-r629:642, but I consider that branch as
Wed, 12 Nov 2008 15:23:29 +0000 mas01cr check return values of read() and write(), erroring out on an error gcc-4.3-cleanups
Wed, 12 Nov 2008 14:01:09 +0000 mas01cr More parentheses in ALIGN_FOO_UP() macros. gcc-4.3-cleanups
Wed, 12 Nov 2008 14:01:06 +0000 mas01cr Initialize UseApiError to 0 (false) in audioDB constructors. gcc-4.3-cleanups
Wed, 12 Nov 2008 13:05:10 +0000 mas01cr YET MORE CONST-CORRECTNESS. gcc-4.3-cleanups
Wed, 12 Nov 2008 10:21:06 +0000 mas01ik First version of the API, committed to the main trunk. Thanks Christophe, for all the help!
Wed, 08 Oct 2008 11:06:11 +0000 mas01cr Quieten newer compilers with MORE CONST CORRECTNESS.
Tue, 02 Sep 2008 16:16:59 +0000 mas01mc Added command-line and WS methods to (LI)st key-(S)trings and si(Z)es of (T)racks --LISZT --lisztOffset offset --lisztLength len
Sat, 30 Aug 2008 13:41:50 +0000 mas01mc Added WS support for Radius search by featureFileName via adb__sequenceQueryByKey(). Added relative path support for non-large ADB.
Thu, 21 Aug 2008 21:28:33 +0000 mas01mc Merge of branches/large_adb -r 514:524 onto the trunk. No conflicts. Added LARGE_ADB support. Turn on with --ntracks 20001 or greater. Use --adb_feature_root to locate feature files at QUERY time. A bug fix in LSH indexing that was incorrectly thresholding large numbers of shingles.
Thu, 21 Aug 2008 21:02:14 +0000 mas01mc Fixed an indexing bug where rest of track was ignored after first shingle with power below threshold. Put default O2_LSH_POINT_BITS back to 14 (16384 points), can be altered at compile time with CFLAGS+=-DO2_LSH_POINT_BITS n large_adb
Thu, 21 Aug 2008 19:58:55 +0000 mas01mc Added --adb_root and --adb_feature_root support to server-side Web Services instance. Client does not have to know location of database and features on the server when server performs path substitutions with these arguments. large_adb
Thu, 21 Aug 2008 19:16:21 +0000 mas01mc Added --adb_feature_root=path filename prefix for locating LARGE_ADB features with relative paths at QUERY time. Also added convenience argument --adb_root=path prefix for -d database command option. large_adb
Wed, 20 Aug 2008 13:50:58 +0000 mas01mc working LARGE_ADB support. Activiate at creation time with -N --ntracks 20001 or greater, or with --datasize 1356 or greater, or both. LARGE_ADB blocks non-indexed QUERY. large_adb
Tue, 19 Aug 2008 20:27:15 +0000 mas01mc Added indexing support for O2_FLAG_LARGE_ADB. Tested on indexed query by features. No indexed query-by-key yet. No --lsh_exact yet. large_adb
Tue, 19 Aug 2008 15:50:26 +0000 mas01mc Ammended batchinsert and status to memory map featureFilenameTables, powerFileNameTable and timesFileNameTable for O2_FLAG_LARGE_ADB large_adb
Tue, 19 Aug 2008 14:38:39 +0000 mas01mc Added large_adb Support for batchinsert and status commands large_adb
Tue, 19 Aug 2008 14:27:21 +0000 mas01mc Adding large_adb support (up to 1M tracks) large_adb
Tue, 12 Aug 2008 01:21:44 +0000 mas01mc working SIIGRAPH08 version. Fixed powerTable mmap memory leak in WS calls (only showed up in big databases). Implements radius queries over WS with new wsdl file
Sat, 09 Aug 2008 15:46:42 +0000 mas01mc Check for index-exists on WS --load_index and exit if it does not. Revert unmap_tables because cleanup() did it fine, but there is a memory leak in ws_query calls.
Sat, 09 Aug 2008 15:17:01 +0000 mas01mc unmap tables on ws_query exit.
Fri, 08 Aug 2008 14:01:33 +0000 mas01mc Added Web Services support for --exhaustive and --lsh_exact flags in Radius sequence searches.
Thu, 07 Aug 2008 01:53:38 +0000 mas01mc Added server-side loading of persistent index (LSH hashtables) via --load_index -d dbName -R radius -l sequenceLength. Queries using these parameters will lookup the memory-resident hashtable instead of loading one from disk.
Wed, 06 Aug 2008 21:23:14 +0000 mas01mc Added reporters radius search via Web Services. The ordering for radius search is degenerate if usingQueryPoint, because the query point can only be counted once. This behaviour is changed by specifying -n 1 to emulate the trackAveragingReporter ordering behaviour
Mon, 04 Aug 2008 10:00:34 +0000 mas01cr Implement O((M+N) log(M+N)) duplicate key detection in batchinsert,
Fri, 01 Aug 2008 16:21:51 +0000 mas01mc added more informative status display for flags
Thu, 31 Jul 2008 19:26:04 +0000 mas01mc added cap on number of vectors per track to index: this cap is set relative to the maximum pointID available in the dual <trackID,pointID> indexing scheme that is used to identify points and tracks using a single 32-bit unsigned integer that is passed to lshlib.
Tue, 29 Jul 2008 22:01:17 +0000 mas01mc Completed merge of lshlib back to current version of the trunk.
Mon, 07 Jul 2008 08:57:06 +0000 mas01cr Really finish with the sampling branch, this time merging all of it,
Wed, 02 Jul 2008 14:07:10 +0000 mas01cr Merge sampling branch (-r361:405, though I hope that the branch is now
Wed, 02 Jul 2008 13:53:23 +0000 mas01cr make the RNG a part of the audioDB object. sampling
Tue, 01 Jul 2008 22:17:33 +0000 mas01cr Use the GNU Scientific Library implementation of MT19937 for generating sampling
Tue, 01 Jul 2008 09:12:40 +0000 mas01cr Merge trunk changes -r326:386 into audiodb-debian branch. audiodb-debian
Mon, 23 Jun 2008 09:49:22 +0000 mas01cr Let the user specify the number of samples to take on the command-line. sampling
Sat, 14 Jun 2008 17:13:26 +0000 mas01cr Add initial sampling of database distances. Zillions of FIXME comments sampling
Mon, 09 Jun 2008 19:20:39 +0000 mas01mc Added new query type "onetoonensequence" for matching each query sequence to the single closest match in the database.
Fri, 25 Apr 2008 17:40:19 +0000 map01bf added cmdline stubs for distance switch and skeleton methods for EMD adding-emd
Wed, 16 Apr 2008 09:59:43 +0000 mas01cr Commit patch deprecating the --size argument, replacing it with
Mon, 14 Apr 2008 15:36:29 +0000 map01bf merged in the trunk updates to the adding-emd branch, also added the emd.c and emd.h support files. Actually starting the feature integration now adding-emd
Mon, 31 Mar 2008 11:52:59 +0000 mas01cr Detect when we've run out of per-file space on insert() and
Sun, 17 Feb 2008 14:56:02 +0000 mas01mc Added new query type: nsequence : this reports the n-nearest neighbours for each track in a sequence averaging query.
Fri, 14 Dec 2007 14:41:37 +0000 mas01cr Merge trunk changes -r290:313 into audiodb-debian branch. audiodb-debian
Thu, 13 Dec 2007 14:28:54 +0000 mas01cr OK, time for trackSequenceQueryNN to die.
Thu, 13 Dec 2007 14:23:32 +0000 mas01cr Merge refactoring branch.
Wed, 12 Dec 2007 16:43:04 +0000 mas01cr VERB_LOG macro into audioDB.h refactoring
Mon, 10 Dec 2007 20:01:43 +0000 mas01cr Proof of Reporter concept: restore pointQuery and trackPointQuery refactoring
Thu, 06 Dec 2007 15:28:40 +0000 mas01cr Port from trunk/ the fix for linux/OS X ABI mismatches refactoring
Thu, 06 Dec 2007 14:41:07 +0000 mas01cr And now, the big one: two into one will go. refactoring
Wed, 05 Dec 2007 14:11:04 +0000 mas01cr Merge trunk changes -r275:289 into audiodb-debian branch audiodb-debian
Wed, 05 Dec 2007 14:06:21 +0000 mas01cr Merged trunk changes -r264:274 into audiodb-debian branch. audiodb-debian
Wed, 05 Dec 2007 13:52:51 +0000 mas01cr Fixes from refactoring branch:
Wed, 05 Dec 2007 13:51:34 +0000 mas01cr Bump up O2_MAXFILES. refactoring
Wed, 05 Dec 2007 12:47:33 +0000 mas01cr Move usingQueryPoint logic into set_up_query() refactoring
Wed, 05 Dec 2007 11:09:45 +0000 mas01cr Move query/db times setup into set_up_query() and set_up_db() refactoring
Tue, 04 Dec 2007 12:47:49 +0000 mas01cr set_up_db() analogue to set_up_query() refactoring
Tue, 04 Dec 2007 10:17:30 +0000 mas01cr Move some more code into set_up_query() refactoring
Tue, 04 Dec 2007 09:40:55 +0000 mas01cr set_up_query() refactoring
Fri, 30 Nov 2007 10:19:26 +0000 mas01cr delete_arrays() function. refactoring
Thu, 29 Nov 2007 16:31:09 +0000 mas01cr Deal with x86-64 OS X vs Linux structure padding ABI.
Thu, 29 Nov 2007 10:18:04 +0000 mas01cr Make reading the data in be its own function refactoring
Wed, 28 Nov 2007 17:46:02 +0000 mas01cr New initialize_arrays() helper routine for remaining queries. refactoring
Wed, 28 Nov 2007 17:04:09 +0000 mas01cr Delete pointQuery() and trackPointQuery() refactoring
Wed, 28 Nov 2007 15:10:28 +0000 mas01cr Filewise refactor. refactoring
Fri, 23 Nov 2007 15:53:37 +0000 mas01cr Merge trunk changes -r261:263 to audiodb-debian branch audiodb-debian
Fri, 23 Nov 2007 15:43:51 +0000 mas01cr Alter timesTable handling.
Fri, 23 Nov 2007 11:18:33 +0000 mas01cr Merge trunk changes -r259:260 into audiodb-debian branch audiodb-debian
Fri, 23 Nov 2007 11:08:15 +0000 mas01cr Merge -r228:254 from no-big-mmap branch.
Wed, 21 Nov 2007 11:44:41 +0000 mas01cr Merged trunk changes -r197:258 into audiodb-debian branch. audiodb-debian
Wed, 21 Nov 2007 11:35:44 +0000 mas01cr Merge powertable branch -r168:227 to trunk.
Mon, 19 Nov 2007 18:37:12 +0000 mas01cr Create and status of huge databases works. no-big-mmap
Thu, 15 Nov 2007 17:04:55 +0000 mas01cr inserting the data vectors goes through lseek()/write() no-big-mmap
Thu, 15 Nov 2007 16:38:53 +0000 mas01cr checks for enough free data space don't use dataBuf any more no-big-mmap