Hortonworks Data Platform

HDP delivers enterprise Hadoop

Architected, developed, and built completely in the open, Hortonworks Data Platform (HDP) provides an enterprise ready data platform that enables organizations to adopt a Modern Data Architecture.

With YARN as its architectural center it provides a data platform for multi-workload data processing across an array of processing methods - from batch through interactive to real-time, supported by key capabilities required of an enterprise data platform -- spanning Governance, Security and Operations.

HDP is the only completely open Hadoop data platform available. All solutions in HDP are developed as projects through the Apache Software Foundation (ASF). There are NO proprietary extensions in HDP.

Fundamentally Versatile

At its heart HDP offers linear scale storage and compute across a wide range of access methods from batch to interactive, to real time, search and streaming. It includes a comprehensive set of capabilities across governance, integration, security and operations.

Wholly Integrated

HDP integrates with and augments your existing applications and systems so that you can take advantage of Hadoop with only minimal change to existing data architectures and skillsets. Deploy HDP in-cloud, on-premise or from an appliance across both Linux and Windows.

HDP

A Complete Enterprise Hadoop Data Platform

Hortonworks Data Platform enables Enterprise Hadoop: Hortonworks Data Platform enables Enterprise Hadoop: the full suite of essential Hadoop capabilities that are required by the enterprise and that serve as the functional definition of any data platform technology. This comprehensive set of capabilities is aligned to the following functional areas: Data Management, Data Access, Data Governance and Integration, Security, and Operations.

Presentation & Applications

Enable both existing and new applications to provide value to the organization.

HDFS & YARN : The core of Hadoop

Data Management

The core components of HDP are YARN and Hadoop Distributed Filesystem (HDFS). YARN is the architectural center of Hadoop that enables you to process data simultaneously in multiple ways. YARN provides the resource management and pluggable architecture for enabling a wide variety of data access methods. HDFS provides the scalable, fault-tolerant, cost-efficient storage for big data.

Access data from a variety of engines

Data Access

YARN provides the foundation for a versatile range of processing engines that empower you to interact with the same data in multiple ways, at the same time. This means applications can interact with the data in the best way: from batch to interactive SQL or low latency access with NoSQL. Emerging use cases for data science, search and streaming are also supported with Apache Spark, Solr and Storm. Additionally, ecosystem partners provide even more specialized data access engines for YARN.

Load and manage data according to policy

Data Governance & Integration

HDP extends data access and management with powerful tools for data governance and integration. They provide a reliable, repeatable, and simple framework for managing the flow of data in and out of Hadoop. This control structure, along with a set of tooling to ease and automate the application of schema or metadata on sources is critical for successful integration of Hadoop into your modern data architecture.

Hortonworks has engineering relationships with all of the data management providers to enable their tools to work and integrate with HDP.

Authentication, Authorization, & Data Protection

Security

Security is woven and integrated into at HDP in multiple layers. Critical features for authentication, authorization, accountability and data protection are in place so that you can secure HDP across these key requirements. Consistent with approach throughout all of the enterprise Hadoop capabilities, HDP also ensures you can integrate and extend your current security solutions to provide a single, consistent, secure umbrella over your modern data architecture.

Provision, manage, monitor and operate Hadoop clusters at scale

Operations

Operations teams deploy, monitor and manage a Hadoop cluster within their broader enterprise data ecosystem. HDP delivers a complete set of operational capabilities that provide both visibilities into the health of your cluster as well as tooling to manage configuration and optimize performance across all data access methods. Apache Ambari provides APIs to integrate with existing management systems: for instance
Microsoft System Center and
Teradata ViewPoint.

Integrates with your data analytics tools

Application Integration

Hortonworks has a thriving ecosystem of vendors providing additional capabilities and/or integration points. These partners contribute to and augment Hadoop with given functionality across Business Intelligence and Analytics, Data Management Tools and Infrastructure. Systems Integrators of all sizes are building skills to assist with integration and solution development.

Deploy on-premise, in the cloud, on Windows too.

Deploy As Needed

HDP provides the broadest range of deployment options for Hadoop: from Windows Server or Linux to virtualized Cloud deployments. It is the most portable Hadoop distribution, allowing you to easily and reliably migrate from one deployment type to another. We also provide automated capabilities for backup to Microsoft Azure and Amazon S3.

Hortonworks Invests in the Hadoop Ecosystem

Hortonworks develops within the governance model of the Apache Software Foundation contributing to and progressing the individual components from the Hadoop ecosystem and ultimately integrating them into the Hortonworks Data Platform (HDP). Our investment across these technologies follows the same pattern.

Vertical

We integrate the projects within our Hadoop distribution with YARN and HDFS in order to enable HDP to span workloads from batch, interactive, and real time and across both open source and other data access technologies.

Horizontal

The enterprise requirements of governance, security, and operations are applied consistently and reliably across the components in HDP. This allows HDP to meet the same requirements of any other technology in the data center.

At Depth

We deeply integrate HDP with the existing technologies within the data center to augment and enhance existing technologies and capabilities so you can reuse existing skills and resources.

Not only open-source - but built in the open.

HDP demonstrates our commitment to growing Hadoop and it's sub-projects with the community and completely in the open. HDP is assembled entirely of projects built through the Apache Software Foundation. How is this different from open-source, and why is it so important?

Proprietary Hadoop extensions can be made open-source simply by publishing to github. But compatability issues will creep in, and as the extensions diverge from the trunk, so too does reliance on the extension's vendor.

Community driven development is different. By combining the efforts of technologists across a diverse range of companies, the roadmap is stronger, and the quality deeper. In the long run we believe community driven innovation will outpace that of any single company.
Learn More...