Why?

Easy to onboard new workflows/pipelines, with support for late data handling, retry policies

Integration with metastore/catalog such as Hive/HCatalog

Provide notification to end customer based on availability of feed groups

(logical group of related feeds, which are likely to be used together)

Enables use cases for local processing in colo and global aggregations

Captures Lineage information for feeds and processes

Getting Started

Start with these simple steps to install an falcon instance Simple setup. Also refer to Falcon architecture and documentation in Documentation. On boarding describes steps to on-board a pipeline to Falcon. It also gives a sample pipeline for reference. Entity Specification gives complete details of all Falcon entities.