Product and service reviews are conducted independently by our editorial team, but we sometimes make money when you click on links. Learn more.

Cloudian HyperStore Integrates With Hadoop For In-Place Big Data Analytics

By - Source: Toms IT Pro

Cloudian updated its HyperStore software and appliances today, introducing full Apache Hadoop integration and enabling in-place analytics without having to duplicate data in the Hadoop Distributed File System (HDFS). HyperStore 5.1 eliminates the need for redundant storage for Hadoop analytics, so there’s no need to extract and offload any data to another system; this means less hardware and more timely big data analytics.

Hadoop runs directly on top of HyperStore 5.1, and the software is fully certified and qualified by Hortonworks. This means HyperStore customers are able to get access to the Hortonworks Data Platform (HDP), which is currently the only open source data management platform for Hadoop.

Cloudian HyperStore is an S3-compatible hybrid cloud storage solution that offers automatic data migration, hybrid cloud streaming, and content archiving features, along with data compression, replication, encryption, and a unified management console. Using an object-based storage architecture (which means the data is managed as objects instead of blocks or file systems), HyperStore has the advantage of being highly scalable and is ideal for unstructured data.

Cloudian is calling HyperStore "smart data storage" to differentiate from traditional storage systems that deal with static data and aren't able to offer timely, actionable analytics.

"Traditional data storage is a problem when you’re collecting lots of heuristic data, or information from different devices, or clickstream, which has metadata...traditional storage just doesn't do a very good job with that," Paul Turner, CMO at Cloudian told Tom's IT Pro in an interview. "With Smart Data Storage, and object-storage is key to this, you're able to store the data and the information about that data (metadata) and add analytics on top of that data as well."

HyperStore's Hadoop integration offers distinct business advantages to organizations that rely on big data analytics or have a play in the Internet of Things (IoT) space. It also eliminates redundant storage so you can analyze more with less, Turner added.

"The ability to analyze big data right in the storage bank is a game changer for organizations as they move closer to realizing the potential of the Internet of Things," said Ashish Nadkarni, research director for storage systems and software at IDC Research. "This is what everyone wants to do but it has been too complicated and cost-prohibitive, until now."

The different data sets that the platform is able to handle includes sensor data, server log data, data from social media, device tracking, metadata and more.  In the retail and marketing spaces this also includes clickstream and sentiment data and consumer activity, such as GPS and WiFi data.

Even Cloudian is taking advantage of the new Hadoop integration to offer proactive customer support, through SmartSupport Analytics. The new support program offers end user analysis, capacity planning and trend analysis, and abnormal operations analysis to monitor usage patterns and spot any abnormalities that should be examined.

In addition to Hadoop integration, HyperStore 5.1 includes a number of other new features and enhancements such as:

  • Federated geo-replication, which allows for real-time access to metadata from multiple global sites
  • Hybrid cloud chargeback reporting, which was previously only available for public cloud usage
  • Hybrid cloud end user credentials.

The updated HyperStore also supports the latest release of OpenStack "Icehouse."

Cloudian’s software piece, HyperStore 5.1, can run on commodity storage (like Dell's or HP’s storage), but the company does offer its own software-defined storage (SDS) appliances, which were introduced last September. (See: Cloudian Packages SDS Cloud Storage Appliances)

To learn more about Cloudian's HyperStore 5.1 visit; to learn more about Hortonwork's certification of HyperStore, visit