comparison query.cpp @ 610:e21a3db643af

MORE MEMORY SANITY

Move the logic tracking which points have been visited already
(including the std::set datastructure) into the indexed query codepaths,
rather than inside accumulators.  This has the effect of drastically
reducing the memory used in non-indexed queries, such that the working
set for a 500-file database with 100000 vectors total goes from 1.2GB to
slightly under 3MB.

All this and less code, too!

         adb_result_t r;
         r.key = (*adb->keys)[pp.trackID].c_str();
         r.dist = dist;
         r.qpos = pp.qpos;
         r.ipos = pp.spos;
-        qstate->accumulator->add_point(&r);
+	if(qstate->set->find(r) == qstate->set->end()) {
+	  qstate->set->insert(r);
+	  qstate->accumulator->add_point(&r);
+	}
       }
     }
     qstate->exact_evaluation_queue->pop();
   }