flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Camp, Roy" <rc...@ebay.com>
Subject flume-ng data recovery
Date Tue, 15 Jan 2013 00:10:17 GMT
I somehow got one of my instances into a bad state where I continue to get the following error.
 I have two data log files with about 2GB worth of data that I'd like to save.  Removing the
current checkpoint and/or inflight files did not work.  Any ideas?

Thanks,

Roy


Flume-NG 1.3 SNAPSHOT - not the 1.3 stable release

2013-01-14 17:03:53,570 (lifecycleSupervisor-1-1) [INFO - org.apache.flume.channel.file.Log.replay(Log.java:355)]
Replaying logs with v2 replay logic
2013-01-14 17:03:53,574 (lifecycleSupervisor-1-1) [INFO - org.apache.flume.channel.file.ReplayHandler.replayLog(ReplayHandler.java:223)]
Starting replay of [/var/log/flume-ng/collectorfix/data/log-240, /var/log/flume-ng/collectorfix/data/log-241]
2013-01-14 17:03:53,576 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.channel.file.Log.replay(Log.java:373)]
Failed to initialize Log on [channel=collectorfilefix]
java.lang.IllegalStateException: Checksum of inflights file differs from the checksum expected.
    at org.apache.flume.channel.file.FlumeEventQueue$InflightEventWrapper.deserialize(FlumeEventQueue.java:487)
    at org.apache.flume.channel.file.FlumeEventQueue.deserializeInflightPuts(FlumeEventQueue.java:83)
    at org.apache.flume.channel.file.ReplayHandler.replayLog(ReplayHandler.java:226)
    at org.apache.flume.channel.file.Log.replay(Log.java:356)
    at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:258)
    at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask$Sync.innerRunAndReset(Unknown Source)
    at java.util.concurrent.FutureTask.runAndReset(Unknown Source)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(Unknown
Source)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(Unknown
Source)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)
2013-01-14 17:03:53,579 (lifecycleSupervisor-1-1) [ERROR - org.apache.flume.channel.file.FileChannel.start(FileChannel.java:269)]
Failed to start the file channel [channel=collectorfilefix]
java.lang.IllegalStateException: Checksum of inflights file differs from the checksum expected.
    at org.apache.flume.channel.file.FlumeEventQueue$InflightEventWrapper.deserialize(FlumeEventQueue.java:487)
    at org.apache.flume.channel.file.FlumeEventQueue.deserializeInflightPuts(FlumeEventQueue.java:83)
    at org.apache.flume.channel.file.ReplayHandler.replayLog(ReplayHandler.java:226)
    at org.apache.flume.channel.file.Log.replay(Log.java:356)
    at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:258)
    at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask$Sync.innerRunAndReset(Unknown Source)
    at java.util.concurrent.FutureTask.runAndReset(Unknown Source)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(Unknown
Source)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(Unknown
Source)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)

Mime
View raw message