Big Data

The well-known three Vs of Big Data - Volume, Variety, and Velocity – are increasingly placing pressure on organizations that need to manage this data as well as extract value from this data deluge for Predictive Analytics and Decision-Making. Big Data technologies, services, and tools such as Hadoop, MapReduce, Hive and NoSQL/NewSQL databases and Data Integration techniques, In-Memory approaches, and Cloud technologies have emerged to help meet the challenges posed by the flood of Web, Social Media, Internet of Things (IoT) and machine-to-machine (M2M) data flowing into organizations.

Big Data Articles

There never has been a more interesting time to be involved in the data management field. Data not only has become "the new oil" but is also the catalyst that is powering organizations to new heights of success. The past year has seen the rise of powerful analytics and an embrace of new tools and platforms emerging to more effectively tap into the power that data offers. DBTA reached out to industry experts to document the most important trends shaping data management in 2018.

Data is a powerful tool, but it's all too often out of reach of the very people who need it most. That is changing as the model for consuming technology and the technology itself evolves to better support the needs of companies working at the speed of digital.

The importance of data to today's modern world becomes more and more clear every day. Organizations are creating, storing, gathering, and managing more data than ever before. If you are reading this article, chances are, you will agree with this statement: "You are managing more data this year than you did last year … and your organization is planning to manage even more data next year."

Of all modern languages, JavaScript has one of the most fascinating backstories. During the early days of the web, Netscape hired Brendan Eich to create a prototype "glue language" that could be used in conjunction with HTML to increase the interactivity of webpages. The prototype was thrown together in just 10 days and named JavaScript. However, JavaScript owes very little to Java—it is often said that JavaScript is to Java as hamburger is to ham.

Breaches are becoming increasingly common as hackers gain more access to personal information such as social security numbers, credit cards, etc. Now another attack could be under way as researchers have discovered a key flaw in the WPA2 Wi-Fi encryption protocol. This flaw could allow hackers to intercept credit card numbers, passwords, photos, and other sensitive information.

Ongroup's MVON# platform can now horizontally scale implementations of MultiValue. MVON# gives MV# developers the tools to write software in MV, transpile to C# and run it in the .NET Common Language Runtime.

Solution4strategy recently used BlueFinity's Evoke Platform to help roll out cloud-based apps for its customers. Solutions4strategy a provider of innovative software and consultancy services serving the Australian, U.K. and U.S. markets used the platform to launch a series of business apps that is helping drive its international business expansion.

The Safety and Emergency Services, Division of Radio and Technology in Pinellas County, Florida was able to provide uninterrupted emergency service during Huricane Irma thanks to its Rocket MultiVlaue Platform. Despite the torrential rain and 90-mile-per-hour winds, the county maintained uptime for emergency response systems to more than a million residents of St. Petersburg, Clearwater, and surrounding communities.

Over the past few years, the scale, speed, and power of analytics have been dramatically transformed. The amount of data available from the internet, combined with advances in software to make use of it, has created a practice called "big data analytics." It can provide types of information that were not available in the recent past and it has the potential to do so in real-time.

Over the past 12 months, there have been many new initiatives aimed at boosting access to and adoption of artificial intelligence. Many resources need to be aligned, including data analytics and computing processing power. But the most important ingredient is human intelligence. AI will only succeed if it is working in partnership with human intelligence, and only humans can provide the business context that gives AI value. This will be the final issue of this newsletter for 2017, and we will resume publishing on January 8th. We wish all our readers a very happy and safe holiday season!

SolarWinds, a provider of IT management software, has released an all-new product and two advanced product updates in a major evolution of its SolarWinds Cloud Software as a Service (SaaS) portfolio. The new capabilities are important, said Christoph Pfister, executive vice president of products, SolarWinds, because application performance and the digital experience of users have a direct and significant impact on business success. With the stakes so high, the ability to monitor across logs, metrics, and tracing is essential, he added.

TIBCO Software, a provider of integration, API management, and analytics technologies has acquired Alpine Data, a cloud-based data science and social collaboration platform. TIBCO says the addition will bolster its data science technology and analytics portfolio, complementing solutions such as Statistica, Spotfire, and StreamBase to help companies accelerate insights and action.

erwin, Inc. has introduced erwin DG, a SaaS solution that expands data governance beyond IT, to enable all organizational stakeholders to discover, understand, govern, and socialize data to mitigate risk, improve organizational performance and accelerate growth. The solution is aimed at helping to mitigate a wide range of risks, from GDPR to cybersecurity, in order to protect customer trust and prevent reputational damage.

IBM announced a new IBM Cloud Private software platform to help companies unlock billions of dollars in technology investment in core data and applications and extend cloud-native tools across public and private clouds. IBM Cloud Private software is designed to enable companies to create on-premises cloud capabilities similar to public clouds to accelerate app development.

Built.io Flow, an integration-as-a-service (iPaaS) platform that unifies and automates disparate IT systems and cloud applications integrations through APIs, and Zilkr are partnering to offer a new integrated platform for telecommunications clouds. Together Built.io Flow and Zilkr extend workflow innovation by bringing telecommunication services and enterprise application products into integrated, automated business processes.

TimeXtender, a recognized global software company enabling self-service BI and analytics, is upgrading its Discovery Hub platform, adding a shared semantic layer that enables users to use the same language across platforms. The update also provides different perspectives—grouping together related data for area-specific purposes, for example, finance, sales, marketing, or cross-business analytics.

Trifacta is expanding support for Amazon Web Services (AWS) along with releasing Wrangler Edge and Wrangler Enterprise on AWS Marketplace. Wrangler Edge and Wrangler Enterprise provide an intuitive, efficient way for teams and organizations to wrangle data across AWS services, including Amazon Simple Storage Service (Amazon S3) and Amazon Redshift for ML and visualization in applications including Amazon QuickSight.

Snowflake Computing has announced the public preview of Snowpipe, an automated service to load data into the Snowflake cloud data warehouse, that is built using Amazon SQS and other Amazon Web Services (AWS) solutions.

Loom Systems, provider of an AI-powered log analysis solution, is launching its newest Streaming 2.0 platform, enabling more precise log analysis in enterprise IT environments. New features of Streaming 2.0 include new data architecture, better options to structure data, improved integration with notification systems, and the ability to do script-less mapping of sources along with creating custom alerts and more.

Databricks, provider of a Unified Analytics Platform and founded by the team who created Apache Spark, has become a partner with Microsoft to expand the reach of its Unified Analytics Platform and address customer demand for Spark on Microsoft Azure.

One of the biggest challenges IT professionals responsible for corporate data will face in 2017 comes from a law passed by the European Union due to take effect in 2018, the General Data Protection Regulation (GDPR). A metadata-driven approach is important for ensuring compliance with this new data privacy law.

Cloudera has announced the upcoming beta release of Cloudera Altus Analytic DB, a data warehouse cloud service that aims to bring the warehouse to the data through a cloud-scale architecture to eliminate costly data movement.

Protecting online systems has become an increasingly difficult job. By shifting your mindset from "if" to "when" a cyberattack happens, certain activities which may appear burdensome, tedious, and sometimes are even ignored, will become relevant and important.

Data integration can seem like a never-ending quest as organizations try to combine and access data from disparate applications and sources. But as we move beyond relational as the only DBMS type that matters and embrace NoSQL and Hadoop data platforms, data integration can become more challenging and require new tools and approaches to achieve success.

SAP is updating the S/4HANA Cloud, making advances in machine learning, user experience, extensibility, and more. As announced in September at SAP TechEd, this latest release of SAP S/4HANA Cloud also includes the launch of the SAP S/4HANA Cloud software development kit (SDK), which provides a simple end-to-end development experience that enables SAP customers, partners, and independent software vendors (ISVs) to easily develop custom applications, extending the capabilities of SAP S/4HANA Cloud.

Wipro Limited, a provider of information technology, consulting and business process services, is launching solutions on SAP Leonardo to focus on the utilities industry. Through this partnership Wipro and SAP are jointly developing use cases that leverage blockchain technology for the utilities industry.

To sustain and drive viable businesses now, and into the rapidly changing future, IT needs to stop firefighting. Reacting when things go wrong—after an incident has caused damage—incurs costs. Taking a proactive, preventative approach using predictive knowhow moves IT out of the proverbial hot seat and gives them much-needed control to keep critical business systems up and running.

Pure Storage, provider of an all-flash data platform, has announced a new Copy Automation Tool (CAT) for SAP systems that allows customers to automate the entire SAP database copy, clone, and refresh process, including database, pre- and post-copy tasks.

Silwood Technology Ltd., a U.K.-based supplier of enterprise application metadata intelligence software, has announced the availability of a GDPR Starter Pack for SAP to give users of the ERP software a kick-start in identifying the precise location of personal data fields in any SAP system.

SnapLogic is launching the Fall 2017 release to its signature platform, adding more Snaps and access to Microsoft products. New innovations added to the SnapLogic Integration Assistant will further accelerate user productivity and time-to-integration.

MapR Technologies, a pioneer in delivering one platform for all data, across every cloud, has announced the availability of the MapR Converged Data Platform 6.0, with new advancements to help organizations achieve greater value from their data through DataOps teams. The major system update from MapR includes innovations that automate platform health and security, and a database for next-generation applications.

Hackolade has announced that its data modeling software tool has been granted certification for MongoDB Enterprise versions 2.6 through 3.4. This includes MongoDB instances deployed on premise, on the cloud, or with the MongoDB Atlas database service. The certification comes on the heels of Hackolade's recent announcement to support the latest version of MongoDB and MongoDB Atlas.

Hazelcast, provider of an in-memory data grid (IMDG), is releasing a new version of Hazelcast Jet, introducing pipeline API to increase developer productivity. In addition to the pipeline API for general purpose programming of batch and stream processing, Hazelcast Jet 0.5 includes fault tolerance using snapshotting with the integrated Hazelcast IMDG.

Citus Data, a provider of a platform for scaling out Postgres databases, is unveiling new features for its Citus Cloud product, making it easier for fast-growing SaaS businesses to scale out without having to re-architect their application. Citus Cloud's suite of new features close the gap with NoSQL and are all about empowering developers from migration tools like Citus Warp, to the zero-downtime shard rebalancer, to offering fork and followers features in a distributed database.

Google has announced that the Google Cloud Platform's BigQuery Data Transfer Service is now publicly available. First introduced at Cloud Next, the Google BigQuery Data Transfer Service was created to automate data movement from SaaS applications to BigQuery on a scheduled, managed basis.

Arcadia Data, a provider of a native visual analytics software for big data, has launched a new partner program to support resellers, independent software vendors (ISVs), and systems integrators (SIs) who work with Arcadia Data and joint customers to develop solutions.

Raytheon and MetTel have announced a global security alliance aimed at protecting government and commercial communications networks against growing cybersecurity threats, including those that exploit the Internet of Things (IoT). The companies plan to provide cybersecurity offerings and support the migration from legacy technologies to ensure cybersecurity is designed into the government's telecom infrastructure.

Compuverde, a provider of software-defined storage, is partnering with Data Dynamics, a provider of intelligent file management. The combination of Data Dynamics' StorageX solution and Compuverde provides a modern platform to manage data assets from migration to file tiering to archival. The goal is to offer enterprise customers the freedom to choose their future storage and cloud direction, eliminating technology lock-in while supporting business transformation with greater speed and agility.

As 2017 is coming to a close, make sure your IOUG membership is up-to-date! With COLLABORATE 18 - IOUG Forum taking place In Las Vegas, NV on April 22-26, 2017 you don't want to miss out on your member pricing!