Wednesday, July 05, 2017

Lucene Gets Concurrent Deletes and Updates!

DZone Database Zone
Lucene Gets Concurrent Deletes and Updates!

Long ago, Lucene could only use a single thread to write new segments to disk. The actual indexing of documents, which is the costly process of inverting incoming documents into in-memory segment data structures, could run with multiple threads, but back then, the process of writing those in-memory indices to Lucene segments was single threaded. 

We fixed that more than six years ago now, yielding big indexing throughput gains on concurrent hardware

No comments:

Fun With SQL: Functions in Postgres

DZone Database Zone Fun With SQL: Functions in Postgres In our previous  Fun with SQL  post on the  Citus Data  blog, we covered w...