lucenenet-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Herndon <mhern...@wickedsoftware.net>
Subject Re: twitter questions
Date Mon, 20 Aug 2012 17:13:11 GMT
I sent off the TL;DR portion of your answer with a permalink to the
actual response on the archive. Thanks Christopher.

On Mon, Aug 20, 2012 at 12:22 PM, Christopher Currens
<currens.chris@gmail.com> wrote:
> In regards to the NIOFSDirectory, we have no plans on supporting it
> for several reasons, the largest being that NIO (meaning New I/O) is a
> java only API.  I guess it would be good to briefly discuss what NIO
> is in Java (anyone feel free to correct me when I inevitably get some
> of the details wrong :)  The main features that NIO introduced were:
>
> * Regex pattern matching for file contents (used with the new
> abstractions of memory mapping a file to a buffer)
> * Character set encoders/decoders
> * Improved file system support with locking and memory mapping
> * Async I/O (the biggest one, I think)
>
> Most of these abstractions don't exist in .NET, but that doesn't mean
> that comparable features don't either. :)  On that end, since we're
> trying to use .NET constructs, I have personally been experimenting
> with I think would be an equivalent to the NIOFSDirectory in java, one
> that uses Async I/O (this seems to be the only thing that lucene uses
> from the NIO api).
>
> The first thing I was curious about was any speed increases using
> Async I/O for index writing (lucene does not do this), and I was a
> first surprised when I found that it was generally the same speed or a
> little slower.  It was a learning experience because I discovered that
> asynchronous writes are not always run asynchronously in windows.  I
> haven't had much time to experiment with the asynchronous reading,
> which is really the only different in NIOFS from a SimpleFSDirectory,
> but I'm hoping to get something similar to how the NIOFSDirectory is
> designed working in .NET.
>
> I have some other ideas related to memory mapped files, which we
> briefly prototyped but never added to core, but I think it would
> perform very well on SSD devices and so I'd like to revisit it.
>
> I guess the answer would be no we are not creating an NIOFSDirectory,
> but we are looking into an AsyncIODirectory.  In theory, they should
> be pretty much the same, the real difference is the name. ;)
>
>
> Thanks,
> Christopher
>
> On Mon, Aug 20, 2012 at 8:27 AM, Prescott Nasser <geobmx540@hotmail.com> wrote:
>> @prescottnasser  baby! I've had that account for a while, but barely use it. I've
been trying to use it more..
>>
>>> Date: Mon, 20 Aug 2012 17:55:59 +0300
>>> Subject: Re: twitter questions
>>> From: itamar@code972.com
>>> To: lucene-net-dev@lucene.apache.org
>>>
>>> Get MetroTwit or TwitDeck and create your own Twitter account while at it :)
>>>
>>> On Mon, Aug 20, 2012 at 5:52 PM, Prescott Nasser <geobmx540@hotmail.com>wrote:
>>>
>>> > I'm terrible with social media- is there any way to have tweets directed
>>> > at @LuceneDotNet sent to one of our mailing lists? Or should I just get
on
>>> > top of monitoring it more often?
>>> >
>>> > > From: casperOne@caspershouse.com
>>> > > To: lucene-net-dev@lucene.apache.org
>>> > > CC: lucene-net-dev@lucene.apache.org
>>> > > Subject: Re: twitter questions
>>> > > Date: Mon, 20 Aug 2012 14:46:57 +0000
>>> > >
>>> > > Answered:
>>> > >
>>> > > http://stackoverflow.com/a/12039811/50776
>>> > >
>>> > >
>>> > >
>>> > > On Aug 20, 2012, at 10:42 AM, "Michael Herndon" <
>>> > mherndon@wickedsoftware.net> wrote:
>>> > >
>>> > > > Thanks Nicholas for having a look at the SO question. Anyone know
>>> > > > about the NIOFSDirectory off the top of their head?
>>> > > >
>>> > > > Cheers,
>>> > > > Michael
>>> > > >
>>> > > >
>>> > > >
>>> > > > On Mon, Aug 20, 2012 at 10:28 AM, Nicholas Paldino [.NET/C# MVP]
>>> > > > <casperOne@caspershouse.com> wrote:
>>> > > >> I've also found the question on SO, I'll give it a shot later
today.
>>> > > >>
>>> > > >>
>>> > > >>
>>> > > >> On Aug 20, 2012, at 10:18 AM, "Michael Herndon" <
>>> > mherndon@wickedsoftware.net> wrote:
>>> > > >>
>>> > > >>> I went to update the twitter feed and saw these questions
in case
>>> > > >>> anyone wants to answer these:
>>> > > >>>
>>> > > >>> @Nick_Craver
>>> > > >>> @LuceneDotNet - is anyone already working on a NIOFSDirectory
port?
>>> > > >>> Unless I misunderstand, it would be a huge boost to our
SSD
>>> > > >>> environment'
>>> > > >>>
>>> > > >>> @intelligibabble
>>> > > >>> would love it if some #lucene or @LuceneDotNet gurus took
a look at
>>> > my
>>> > > >>> SO question stackoverflow.com/questions/1135…
>>> > > >>>
>>> > http://stackoverflow.com/questions/11354455/using-lucene-net-thread-safe-from-asp-net-web-application
>>> > > >>>
>>> > > >>
>>> > > >
>>> > >
>>> >
>>> >
>>

Mime
View raw message