Home

Increasing need for insights from vast data sources has given rise to data-driven business intelligence products which build and execute complex data workflows.

A data workflow is a set of inter-dependent data-driven tasks. Simple solutions use cron based approach which works well for simple workflows with few or no task dependencies. However, cron fails if there are complex dependencies between tasks.

At Cognitree, we build and execute complex data workflows for our customers to gather data insights. We built an effective scheduling tool Kronos for our data pipelines which adds features on top of cron.

What is Kronos

Kronos is a Java based replacement for cron to build, run and monitor complex data pipelines with flexible deployment options including embed mode. It handles dependency resolution, workflow management, failures. Kronos is built on top of Quartz and uses DAG (Directed Acyclic Graph) to manage the tasks within a workflow.