Transcription

2 Background Financial Services Institutions (FSIs) including large investment banks continue to struggle with massive data volumes, which are now doubling in size with each passing year. They must also deal with increased regulatory scrutiny from their own industry with groups like FINRA, and from their governments in the form of Sarbanes-Oxley (SOX), Dodd Frank Reform, SEC and FDIC regulations. These and other regulatory bodies have mandated strict reporting and data retention requirements. Data retention is only part of the challenge financial institutions must ensure the historical data is available online and fully accessible for look-ups, audits and reports in a timely manner, with penalties assessed for delayed responses. Analysts within the financial services industry estimate that approximately 40% of IT budgets and the corresponding resources at each Bank are consumed by compliance related activities. The sheer volume of regulatory changes continues to challenge the industry s ability to respond in a timely manner and more importantly the business is consumed with cost-effective compliance goals rather than focusing on business and IT innovation. FINRA OATS regulation impacts all brokerage firms that enter equity security orders to the marketplace. All order event types must be captured and include accurate timestamps, account type, destination and other detail. This large volume of information is transmitted as an audit trail to FINRA at the conclusion of each business day. EBS (Electronic Blue Sheet) regulation impacts all brokerage firms that trade in securities listed by ISG selfregulatory organizations. All execution, average price, and allocation events must be captured with appropriate detail. When requested by an ISG member, firms must query their databases and transmit EBS files. Failure to properly fill out blue sheet fields and respond within the stipulated time is a violation of FINRA Rule 8211 and/or FINRA Rule Therefore, efficient data storage of exponentially growing financial data is one of the biggest challenges today. Highlights : Expected $5M in total cost savings over 4 years 90% ROI forecast in four years Break even in 18 months 6x reduction in processing time for compliance needs 3x faster query performance RainStor 2

3 We were pressing the panic buttons! Data growth was causing unsustainable storage growth. Chief Architect, Global Investment Bank About the Organization With nearly 50,000 employees in over 500 offices in 50 countries, this Global Investment Bank is one of the largest in the world. It provides companies, institutional clients and private clients worldwide with advisory services, comprehensive private banking & wealth management, and investment banking services. At the current data growth rate the volume of data at the firm is expected to reach 75 petabytes by the end of The firm was faced with challenges related to the storage and management of trading data in a much more cost effective and easily accessible manner in order to meet the ongoing regulatory demands. Challenges The challenges faced can be broadly classified under 3 categories: Therefore, cutting down the growing storage hardware costs and avoiding inefficient offline tape was imperative given the Bank s tight IT budgets YoY. Complexity of data and trading applications The Bank s trading data was stored in multiple instances of a data warehouse environment, which were located in different data centers around the world. The Bank needed a solution that could not only load data efficiently from disparate trading application sources but also make the data available for query at any given time. Ensure complete compliance of financial regulations The Bank must satisfy a whole host of regulatory requirements. Among these was a requirement that multiple years of data to be available on-demand. Strict SLAs around response and system up time had to be met even with fast data growth. i) Cost, ii) Complexity and iii) Compliance Risk Cost effective archiving and management of data Historically the Bank experienced geometric doubling of data volumes that stood at 1 billion daily records in 2012, to be retained indefinitely for regulatory reasons. Previously, the Bank was keeping one month of data online and stored on expensive Tier-1 SAN hardware. Data older than one month was archived to Tier 3 storage. Neither option was sustainable given the current data volumes and data growth rates. Third option of storing data on offline tape would be labour intensive, time consuming and costly to retrieve. RainStor 3

4 The RainStor Solution Data Management Strategy Responding to the challenge of providing a scalable, secure and highly available database that would not only satisfy data-related compliance and query requirements but also meet current and future capacity requirements at significantly lower costs, the Bank chose RainStor. The RainStor database was deployed as the online data archive solution replacing the existing data warehouse running on Sybase IQ for trade historical data. RainStor was setup to retain all of the Bank s historical trade data. To initiate RainStor as the dedicated online archive solution, 13 years of historical data was loaded into RainStor from the existing Sybase IQ environment and then a daily feed was set-up from the trading application database in to RainStor for ongoing business and regulatory reports and analysis. All data was moved as-is from Sybase IQ to RainStor without any schema change or a single line of code required. With this configuration, the Bank could query and analyze all its historical data within RainStor. Deploying RainStor RainStor was deployed quickly because: RainStor is open and standards based and therefore quickly integrates with existing data warehouse infrastructure RainStor loads data 3X faster than existing infrastructure based on Sybase IQ RainStor supports enterprise-grade security solutions including High-availability, Authentication, Authorization, LDAP integration and Active Directory RainStor 4

6 Speed: Faster Data Load and Analysis After deploying RainStor on VMs/NAS storage to store and manage 13 years of trade history, the nightly transfer of data from the application data warehouse was reduced from an overnight 8-12 hours to just 2 hours (see figure 2). Because of the faster data load, administrators now have up-to-date information at the beginning of the next working day in order to conduct regular daily reports and analysis. The improvement in data query performance on RainStor was up 3X due to both the reduced data footprint and RainStor s built-in dynamic filtering capabilities which speeds up query response rates. In addition, the data load no longer runs into the next working day, avoiding adverse impacts on end users leverage the environment for ongoing reports and lookups. Figure 2: Reduction in Load/Query time RainStor 6

7 RainStor doesn t care what hardware it runs on. Just as good on Tier-2 or Tier- 3 hardware. Lowest cost and you still gain more capacity! Chief Architect, Global Investment Bank Scale: Extremely Scalable Database Meets Future Growth The RainStor database is designed for predictive scalability handling data volumes of hundreds of terabytes to multipetabyte scale. With the Bank s data volumes predicted to double in size every year, reaching 75 petabytes by 2016, RainStor was the ideal solution. The Bank deployed RainStor on Tier 3, NAS storage providing a cost effective, highly scalable technology platform. Safety: Comprehensive built-in Safety Measures As the Bank centralizes its historical trade data on RainStor in a single location, this provides the ability to secure critical data more efficiently. RainStor s built-in LDAP and Active Directory integration combined with authentication, authorization and role-based access capabilities ensure that the Bank s data is tamper-proof and immutable. In addition, RainStor also provides data high-availability features that enable the Bank to adhere to strict SLAs. Simplicity: Efficiently Runs on Low-cost Commodity Hardware RainStor is simple to deploy and manage. It can be deployed on all types of commodity hardware infrastructures - SAN, NAS, CAS, or Cloud. The Bank was able to move data from legacy applications hosted on expensive hardware to RainStor giving them the ability to scale out as needed in the most cost-effective manner consistent with the needs of the business. In addition to the simplicity of deployment, RainStor requires negligible database administration. No additional IT resources were required for ongoing management of RainStor. Calculation of Reduced Cost Savings The Bank commissioned an independent study that did a direct comparison of storage cost savings realized by deploying RainStor on commodity Tier-3 NAS hardware as opposed to Sybase IQ deployed on a combination of Tier-1 SAN and Tier-3 NAS. The results were dramatic (See Figure 3). RainStor 7

8 It s like shrinkwrapping your data forever! VP, Technology Global Investment Bank Figure 3: Annual cost comparison Total cost savings on storage hardware using RainStor was $5.7 million. Benefits Summary The Bank s investment in RainStor is expected to generate total financial and operational benefits of over $5.8 million dollars over four years. The largest portion of the benefits will come through 97% reduction in hardware storage and power costs. The other soft benefits include faster load, improved query response, improved security, lower labor costs and flexibility of deployment. With plans to break even on its investment within 18 months, the project is on track to achieve 90% ROI over a four-year period on CAPEX alone. The Bank found the results nothing short of phenomenal. RainStor 8

WHITE PAPER Teradata and RainStor in a Big Data World Augment Your Data Warehouse Strategy with an Active Archive Running on Hadoop. If you could store the years of history that your business needs and

Optimize Your Data Warehouse with Hadoop The first steps to transform the economics of data warehousing. This white paper addresses the challenge of controlling the rising costs of operating and maintaining

White Paper Protecting Big Data Data Protection Solutions for the Business Data Lake Abstract Big Data use cases are maturing and customers are using Big Data to improve top and bottom line revenues. With

SOLUTION PROFILE Hitachi Cloud Service for Content Archiving, Delivered by Hitachi Data Systems Improve Efficiencies in Archiving of File and Content in the Enterprise Bridging enterprise IT infrastructure

Managing the Unmanageable: A Better Way to Manage Storage Storage growth is unending, but there is a way to meet the challenge, without worries about scalability or availability. October 2010 ISILON SYSTEMS

Harnessing the Power of Big Data for Real-Time IT: Sumo Logic Log Management and Analytics Service A Sumo Logic White Paper Introduction Managing and analyzing today s huge volume of machine data has never

Security Information/Event Management Security Development Life Cycle Version 5 If your enterprise is like most, you are collecting logs from most every device with security relevance. The flood of events

IBM Optim The ROI of an Archiving Project Michael Mittman Optim Products IBM Software Group Disclaimers IBM customers are responsible for ensuring their own compliance with legal requirements. It is the

Data Masking Cost-Effectively Protect Data Privacy in Production and Nonproduction Systems brochure How Can Your IT Organization Protect Data Privacy? The High Cost of Data Breaches It s estimated that

The CIO Guide to Virtual Server Data Protection Server virtualization is changing the face of the modern data center. CIOs are looking for ways to virtualize more applications, faster across the IT spectrum.

SAP HANA Using In-Memory Data Fabric Architecture from SAP to Create Your Data Advantage Deep analysis of data is making businesses like yours more competitive every day. We ve all heard the reasons: the

Meet compliance needs with Microsoft Exchange As the volume and importance of digital information grows, regulatory compliance schemas are broadening to encompass an ever-larger share of data that companies

Transforming Raw Data into Business Results In the rapid pace of today's business environment, businesses must be able to adapt to changing customer needs and quickly refocus resources to meet market demand.

Powerful Management of Financial Big Data TickSmith s solutions are the first to apply the processing power, speed, and capacity of cutting-edge Big Data technology to financial data. We combine open source

Optim The Rise of E-Discovery Presenter: Betsy J. Walker, MBA WW Product Marketing Manager What is E-Discovery? E-Discovery (also called Discovery) refers to any process in which electronic data is sought,

INVESTMENT IN ARCHIVING YIELDS MAJOR RETURNS SYNERGY DOCUMENT MANAGEMENT AND ASSUREON LONG TERM DISK SOLUTION AT Alpine Bank, a successful regional bank is powering its expansion with streamlined and automated

STERLING COMMERCE WHITE PAPER Four Keys to Effectively Monitor and Control Secure File Transfer 2 As more information is digitized and more business data is considered critical, you re spending far more

Datosphere Platform Product Brief No organization is immune to the explosive growth in the volume of electronically stored information (ESI). The rapid growth of ESI is having a tangible impact upon organizations

Identity and Access Management for the Cloud What you need to know about managing access to your clouds Organizations need to control who has access to which systems and technology within the enterprise.

Optimizing Storage for Better TCO in Oracle Environments INFOSTOR Executive Brief a QuinStreet Excutive Brief. 2012 To the casual observer, and even to business decision makers who don t work in information

Big Data and Hadoop for the Executive A Reference Guide Overview The amount of information being collected by companies today is incredible. Wal- Mart has 460 terabytes of data, which, according to the

White paper Archiving Businesses of all sizes are creating and storing more data than ever before. By using archiving, innovative organizations are successfully reining in the costs of data storage while

UniFS A True Global File System Introduction The traditional means to protect file data by making copies, combined with the need to provide access to shared data from multiple locations, has created an

White Paper EMC IT S JOURNEY TO THE PRIVATE CLOUD: APPLICATIONS AND CLOUD EXPERIENCE A series exploring how EMC IT is architecting for the future and our progress toward offering IT as a Service to the

White Paper Data Virtualization: Achieve Better Business Outcomes, Faster What You Will Learn Over the past decade, businesses have made tremendous investments in information capture, storage, and analysis.

Five essential considerations for your Exchange 2010 implementation Whitepaper Dell IT Management Software as a Service THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL

SAP Brief SAP s for Sustainability Objectives Pave the Way for IT Innovation by Reducing Cost, Risk, and Energy Use Charting the course for sustainable IT Charting the course for sustainable IT IT organizations

Enterprise Data Integration Access, Integrate, and Deliver Data Efficiently Throughout the Enterprise brochure How Can Your IT Organization Deliver a Return on Data? The High Price of Data Fragmentation

White Paper Version 1.2 May 2015 RAID Incorporated Introduction The abundance of Big Data, structured, partially-structured and unstructured massive datasets, which are too large to be processed effectively

Data Governance in the Hadoop Data Lake Kiran Kamreddy May 2015 One Data Lake: Many Definitions A centralized repository of raw data into which many data-producing streams flow and from which downstream

W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the

SOLUTION BRIEF KEY CONSIDERATIONS FOR BACKUP AND RECOVERY Among the priorities for efficient storage management is an appropriate protection architecture. This paper will examine how to architect storage

The 10 Substantial Benefits of Software-as-a-Service Business Intelligence Executive Summary Smart businesses are pursuing every available opportunity to maximize performance and minimize costs. Business