log audioDB-internals.h @ 770:c54bc2ffbf92 tip

age author description
Sat, 15 Oct 2011 17:28:07 +0000 mas01mc Adding Kullback-Leibler divergence as alternate distance function
Fri, 26 Nov 2010 09:35:28 +0000 mas01mc A mostly cosmetic fix to query.cpp qpointers allocation, the byte-count vector_size was used a bit too liberally.
Thu, 25 Nov 2010 13:42:40 +0000 mas01mc Adding mkc_lsh_update branch, trunk candidate with improved LSH: merged trunk 1095 and branch multiprobe_lsh fewerQueryDatumReads
Thu, 22 Apr 2010 21:03:47 +0000 mas01cr begin work on sampling API
Fri, 05 Mar 2010 16:00:58 +0000 mas01cr rename struct adbfoo to struct adb_foo
Fri, 05 Mar 2010 16:00:53 +0000 mas01cr Extend results structure to include a key for the query.
Tue, 05 Jan 2010 14:09:43 +0000 mas01cr Add stdio.h include to audioDB-internals.h
Fri, 28 Aug 2009 17:14:06 +0000 mas01cr MORE MEMORY SANITY
Tue, 11 Aug 2009 21:42:44 +0000 mas01cr Make dump.cpp not use mmap()
Tue, 11 Aug 2009 21:42:29 +0000 mas01cr Remove uses of mmap() from open.cpp
Tue, 11 Aug 2009 21:42:24 +0000 mas01cr Address portability issues in database creation
Tue, 11 Aug 2009 21:42:18 +0000 mas01cr Use _locking() to emulate fcntl() locks
Tue, 11 Aug 2009 21:42:13 +0000 mas01cr Header file rearrangement
Tue, 11 Aug 2009 21:42:07 +0000 mas01cr Use _commit() to emulate fsync()
Tue, 14 Jul 2009 15:35:36 +0000 mas01cr API for retrieving a track's data.
Thu, 18 Jun 2009 11:01:31 +0000 mas01cr Work around the non-universality of fdatasync()
Fri, 20 Feb 2009 19:08:45 +0000 mas01mc INDEXING: fixed reverse-lookup roundoff error when data gets very large. Computation of offset was lacking an essential cast to off_t.
Fri, 20 Feb 2009 19:03:17 +0000 mas01mc INDEXING: fixed reverse-lookup roundoff error when data gets very large. Computation of offset was lacking an essential cast to off_t. multiprobeLSH
Sun, 08 Feb 2009 22:32:33 +0000 mas01mc Rework new audiodb_track_id_datum_offset() and audiodb_insert_create_datum_offset() so that all offsets are in num_vectors. Internals of data storage are left the the methods to implement. If we are going to export these methods to the API, how do we expose the cache ? It needs to be passed back to the user and back in by the user on each call for caching to be re-entrant. No (intentional) functional changes this version. multiprobeLSH
Sun, 08 Feb 2009 15:53:57 +0000 mas01mc Expanded interface to audiodb_insert_create_datum() and audiodb_track_id_datum() to include _offset versions of both. Default cache is NULL, but offset and size parameters required. multiprobeLSH
Sat, 07 Feb 2009 16:59:31 +0000 mas01mc Added file caching for sparse datum reads. This required making a new type called adb_fd_cache_t and modifying the read methods audiodb_track_id_datum() and audiodb_insert_create_datum() to use the cache struct if one is provided by the user. multiprobeLSH
Sat, 07 Feb 2009 01:20:05 +0000 mas01mc Optimized the query_loop_points inner loop for memcpy and I/O efficiency. Uses sparse seeks and reads to perform scattered reads across data set. Current version does not cache fid between open calls to the same trackID. multiprobeLSH
Fri, 06 Feb 2009 21:08:35 +0000 mas01mc Added back single-query point I/O behaviour from pre API-inversion. Thus only those query vectors required are loaded when using query-from-file. Tests 0006 and 0007 fail silently with this change. multiprobeLSH
Wed, 04 Feb 2009 13:47:02 +0000 mas01cr Use upper_bound rather than lower_bound in audiodb_index_to_track_id()
Wed, 04 Feb 2009 11:37:07 +0000 mas01cr Compile fix for previous revision
Wed, 04 Feb 2009 10:45:57 +0000 mas01mc Removed LSH_N_POINT_BITS coding for LSH index. Now uses binay search via STL lower_bound to locate tracks and positions from global pointID searching over cumulative track lengths. MERGE of branches/multiprobeLSH -r 819:821 onto trunk. This is a non backward-compatible change; WARNING generated on attempt to use INDEXING with older audioDB databases. Only INDEXES are broken, not ADB instances.
Mon, 02 Feb 2009 17:41:02 +0000 mas01mc DELETED LSH_N_POINT_BITS coding. Tracks and points are now identified with a binary search, std::lower_bound(), on *adb->track_offsets return from LSH retrieval. multiprobeLSH
Fri, 30 Jan 2009 19:44:51 +0000 mas01mc Completed audiodb_datum_qpointers_partial(), fixed bug that was scribbling over pre-computed l2norms when points arrived in original less<PointPair> order, switched to greater<PointPair> order and all is fixed. multiprobeLSH
Fri, 30 Jan 2009 14:58:35 +0000 mas01mc Fixed a problem with inserting into exact_evaluation_queue, duplicate pairs were being inserted when querying multiple hashtables. That is now fixed by adding a unique constraint using set<PointPair> inserts and testing. This should speed things up quite a bit (like, 10-fold with default num tables). multiprobeLSH
Thu, 29 Jan 2009 13:44:47 +0000 mas01mc Added audiodb_datum_qpointers_partial() to make exact evaluation of LSH results more efficient. This routine calculates partial sums only for those vectors needed. multiprobeLSH
Wed, 28 Jan 2009 17:54:18 +0000 mas01mc Set ADB_FIXME_DEFAULT_LSH_N_POINT_BITS to 15 so we can get about 20k vectors per file in the LSH point encoding. This pain and suffering will go away soon, I promise. multiprobeLSH
Thu, 15 Jan 2009 13:57:33 +0000 mas01cr Code rearrangements to tease apart library code from C++ audioDB code.
Sat, 10 Jan 2009 16:47:57 +0000 mas01cr Merge api-inversion branch (-r656:771, but I don't expect to return to
Tue, 06 Jan 2009 16:27:01 +0000 mas01cr const declarations for some API arguments. api-inversion
Wed, 31 Dec 2008 15:44:16 +0000 mas01cr Move audioDB::query over to audioDB.cpp api-inversion
Wed, 31 Dec 2008 15:44:12 +0000 mas01cr YAY! api-inversion
Tue, 30 Dec 2008 23:56:57 +0000 mas01cr No more audioDB::index_allocate and audioDB::index_init_query api-inversion
Tue, 30 Dec 2008 15:38:59 +0000 mas01cr audioDB::query_loop and audioDB::query_loop_points are no more. api-inversion
Tue, 30 Dec 2008 15:38:50 +0000 mas01cr Factor out some bits of audiodb_query_spec_qpointers() api-inversion
Tue, 30 Dec 2008 10:36:01 +0000 mas01cr Convert index-finding logic to C functions. api-inversion
Sun, 28 Dec 2008 18:44:08 +0000 mas01cr Start using the query state structure. api-inversion
Wed, 24 Dec 2008 10:57:30 +0000 mas01cr Sketch out a "query state" structure. api-inversion
Wed, 24 Dec 2008 10:57:14 +0000 mas01cr Almost finish with audioDB::query_loop. api-inversion
Wed, 24 Dec 2008 10:56:37 +0000 mas01cr No more audioDB::set_up_query{,_from_key} api-inversion
Wed, 24 Dec 2008 10:56:33 +0000 mas01cr New (internal) function audiodb_query_spec_qpointers() api-inversion
Wed, 24 Dec 2008 10:56:29 +0000 mas01cr Add more information to adb_t api-inversion
Wed, 24 Dec 2008 10:55:48 +0000 mas01cr More on the query rationalization api-inversion
Wed, 24 Dec 2008 10:55:44 +0000 mas01cr Include track_lengths data structure in struct adb. api-inversion
Wed, 24 Dec 2008 10:55:36 +0000 mas01cr Make the keys std::set in adb_t a std::map instead. api-inversion
Wed, 24 Dec 2008 10:55:24 +0000 mas01cr Move sequence_foo() functions out of audioDB:: namespace... api-inversion
Wed, 24 Dec 2008 10:55:20 +0000 mas01cr Deal with audioDB::UnitNorm api-inversion
Wed, 24 Dec 2008 10:55:16 +0000 mas01cr Begin pushing information through. api-inversion
Wed, 24 Dec 2008 10:54:40 +0000 mas01cr Initial implementation of accumulators for forthcoming audiodb_query(). api-inversion
Thu, 11 Dec 2008 08:54:01 +0000 mas01cr Pavlovian response to compiler warnings... api-inversion
Tue, 09 Dec 2008 20:53:39 +0000 mas01cr The lesser of two evils, part 1. api-inversion
Wed, 03 Dec 2008 17:40:15 +0000 mas01cr Move the struct adb definition from the auidioDB_API.h into the api-inversion
Wed, 03 Dec 2008 14:53:20 +0000 mas01cr Invert audioDB::l2norm / audiodb_l2norm() api-inversion