lucenenet-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Guttesen (JIRA)" <>
Subject [jira] Created: (LUCENENET-108) Heavy Disk I/O when merging.
Date Mon, 28 Jan 2008 17:21:34 GMT
Heavy Disk I/O when merging.

                 Key: LUCENENET-108
             Project: Lucene.Net
          Issue Type: Improvement
         Environment: Lucene.Net
Windows 2003 Intel Dual Core 2Ghz, 2gb RAM, SATA 7200 rpm, 
Framework 2.0
            Reporter: Thomas Guttesen


I am experiencing issues with Lucene when using IndexWriter.AddIndexes() in FSWriter.

I am writing to a subindex that is not searchable from my application. I can write fast and
non-optimized in this. In certain intervals i close the subindex for writing and add it to
the main index and hereby optimized. The main index is searchable. I am running the process
with low priority.

The problem is that disk I/O can be very heavy while merging. So heavy that  response in UI
on the server get slower the larger the index get. Other processes with higher prority gets
slow and sometimes nonresponsive while merging is ongoing.

Checking the CPU load there is hardly none, so it must be a disk I/O issue. I have seen the
same problem on quad CPU systems with RAID5, 10000rpm etc (Windows 2003). Not as baddd, but
it indicates for me that there is a general issue.

Is there any chance that this process can be lifted, so it does not cause this to happen.


Thomas Guttesen

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message