flume-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sutanu Das <sd2...@att.com>
Subject Rest API for Spark Streaming
Date Wed, 24 Feb 2016 18:06:33 GMT
Hi Community,

Is there a Rest API for Spark Streaming?

We are looking to monitor and send pager alert notification using rest api json messages when
our streaming job Active Batches are getting 'queued'

We looked at http://localhost:4040/api/v1/applications/ap-status/stages/ but this info is
not there and http://spark.apache.org/docs/latest/monitoring.html has no specific info on
Batch Status

Any help will be appreciated.
Active Batches (11)
Batch Time

Input Size

Scheduling Delay (?)

Processing Time (?)

Status

2016/02/24 17:56:00 <http://has-dal-0004:4040/streaming/batch?id=1456336560000>

9062 events

-

-

queued

2016/02/24 17:54:00 <http://has-dal-0004:4040/streaming/batch?id=1456336440000>

8522 events

-

-

queued

2016/02/24 17:52:00 <http://has-dal-0004:4040/streaming/batch?id=1456336320000>

7982 events

-

-

queued



Mime
View raw message