Real time dashboard with Streams data

We are interested in creating a real time dashboard using our IBM Streams data. Currently we have a real time dashboard to monitor our streams applications using Grafanna/Promethius. We followed a guide Brian M Williams setup and that works well and alerts us when we have issues with our streams applications. We now want to create a dashboard using our data as it comes across the wire. Has anyone done that? Also, we are persisting our data into HDFS (Parquet format) so if we need to report for there we can do that as well. I just thought it would be really cool if we can grab some of this data in real time to users can see exactly what is going on.

3 answers

Much of the answer depends upon how complex your dashboard is mean to be.

I recently created a fairly simple real time dashboard for a PoC using JavaScript. I persisted data to Cloudant as well as HDFS using MQTT publish so I was able to query my NoSQL database every 60 seconds and grab a cohort of data (time based) and plot it to the screen using D3.js.

I provided drop-down menus to allow different components to be displayed and also to change the query/plot interval within a predefined range.

I hosted my JavaScript in BlueMix so everything was cloud based and the web app for the dashboard was immediately visible.

Yesterday I loaded up the healthcare visualization application and that gives me some good ideas to go along with what you all posted. I will also check out the streamsx.visualization toolkit as well. I did realize how easily you can create UI operators that can be leveraged from a webpage using javascript. Thanks!