kafka-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Burroughs (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (KAFKA-40) Time based log rolling
Date Wed, 20 Jul 2011 12:33:57 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Burroughs reassigned KAFKA-40:

    Assignee: Chris Burroughs

> Time based log rolling
> ----------------------
>                 Key: KAFKA-40
>                 URL: https://issues.apache.org/jira/browse/KAFKA-40
>             Project: Kafka
>          Issue Type: New Feature
>            Assignee: Chris Burroughs
>            Priority: Minor
> In some cases we know that consumers are interested in data on time boundaries (for example,
hourly), and when a new consumer of the type is spun up it wants to consume data since the
last boundary (start at 12 noon). 
> OffsetRequest can do this now, but Log:getOffsetsBefore is "very approximate" and it
would be nice for the consumers to not have to iterate over unneeded data that (being older)
is less likely to be in the page cache. 
> Proposal: Optional argument to roll log file if it contains more than n seconds of data.
I think this is reasonable, but wanted to create a ticket for comments in-case I've missed
a reason this infeasible or otherwise a bad idea.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message