HP today at its Big Data Conference in Boston unveiled a series of new products, services, and programs designed to help organizations better leverage data and analytics.

The company announced:

• A new release of HP Vertica, called Excavator, that feature data streaming and advanced log file text search to power high-speed analytics on Internet of Things (IoT) data.
  
• Broader support for and contributions to open source technologies, including optimized Hadoop performance, integration with the Apache Kafka distributed messaging system, and advancements in Distributed R predictive analytics.
  
• The HP Haven Startup Accelerator program, which provides early-stage companies with fast, affordable access to both HP Big Data and Application Delivery Management software and services.

"Big data helps us make more sense of it all, a byproduct of what we do everyday," said Robert Youngjohns, Executive Vice President and General Manager at HP Software, in a keynote address. "Big data solves everyday problems like security, inventory, and empowers workers ... and you can now exploit 100 percent of your data."

Youngjohns said that HP at its HP Protect show in a few weeks will announce how to better mine IT systems analytics to make enterprises more secure.

"Big data changes the game in the idea economy," said Colin Mahony, Senior Vice President and General Manager of Big Data at HP. "Big data is core to all apps, but customized composite analytic applications are coming."

The key question for enterprises is, how can you embed analytics into the role you play in your organization?, said Mahony, adding that, enterprises need to spin up new apps constantly to identify and analyze via context, which they cannot get from packaged apps.

"Developers are the new heroes of the idea economy," said Mahony. "Through our Haven and Haven OnDemand platforms, we are empowering these heroes to transform their business through data, by allowing them to harness the value of all forms of information, rapidly connect and apply open source, and quickly access the tools they need to build winning businesses." [Disclosure: HP Enterprise is a sponsor of BriefingsDirect podcasts.]

Also addressing the keynote audience was recent Turing Award winner Mike Stonebraker, CTO and co-founder of Tamr. He said that the development of the column store database was the most disruptive thing I ever did. "It transformed the market," he said, and lead to the Vertica big data platform that HP acquired in 2011.

But he cautioned against getting caught up in marketing buzz over data science substance. "I’ve been doing big data forever. The buzzword is meaningless, it’s about solving data volume, velocity, and variety problems."

"Analytics is moving to complex analytics, using machine learning and statistics, so you need to get smart at data science," said Stonebraker.

'Excavator'

Capabilities in the new version of Vertica, codenamed "Excavator," include:

• Data-streaming analytics offering native support for the Apache Kafka open-source distributed messaging system to enable organizations to quickly ingest and analyze high-speed streaming data, including IoT, in near real time. This capability delivers actionable insight for a wide range of use cases, including manufacturing process control, supply-chain optimization, healthcare monitoring, financial risk management, and fraud detection.
  
• Advanced machine log text search to enable organizations to collect and index large log file data sets generated by systems and business applications, helping IT organizations quickly identify and predict application failures and cyber-attacks, and investigate authorized and unauthorized access.

HP also released a series of solutions designed to enable organizations to combine the innovation of open source with the enterprise-scale, reliability, and security. These include:

• HP Vertica for SQL on Hadoop native file support, bringing significant increase in performance on popular Hadoop formats like ORC and Parquet. Specifically, HP worked collaboratively with Hortonworks to develop a new high-performance access layer that enables SQL queries to run directly on ORC files, resulting in a 5x increase in execution times.
• HP Vertica Flex Zone Table Library with which HP has open sourced its innovative Flex Table "schema on-need" technology to the global developer community. With this move, organizations will be able to fully harness virtually any form of semi-structured data to meet their unique needs.
• HP announced its commitment to integrate Vertica with Apache Spark. This will enable accelerated data transfer between Vertica and Spark, allowing organizations to take full advantage of their Spark-based deployments. This future capability will enable the developer community to build their models in Spark and run them in Vertica for high-speed and sophisticated analytics.

Startup Accelerator

HP also unveiled The HP Haven Startup Accelerator, a new program designed to support and expand HP's ecosystem of developers and innovators by making HP Big Data and Application Delivery Management software products accessible to early-stage companies. The program removes traditional barriers for organizations looking to leverage analytics and data to build powerful, differentiated applications. Qualified participants will benefit from the following program components:

• Free use of the community versions of HP IDOL and HP Vertica with expanded capacity.
  
• Premium version of HP IDOL and HP Vertica with attractive pricing
  
• HP Application Delivery Management tools including HP Agile Manager, HP LeanFT, and HP LoadRunner.

HP also announced an innovative framework of technology and proven best practices to accelerate the development of next-generation analytical applications. This framework extends the HP Haven Big Data Platform with quick-start visualization, syndicated data feeds, open on-premise and cloud-based APIs. This enables HP Professional Services and HP partners to quickly deliver a range of solutions, such as voice of customer, smart cities, and fraud detection.

Optimized platforms for big data include traditional HP ProLiant DL380 clusters, purpose-built Apollo 4510, 4530 and 4200 compute and storage servers, and HP's innovative asymmetric Big Data Reference Architecture. These systems enable customers to optimize their big data workloads, delivering the power of Haven to their business.

Availability Planned availability for new HP Haven Big Data offerings and services is set for fall of 2015.

You may also be interested in:

• How eCommerce sites harvest big data across multiple clouds
• How Localytics uses big data to improve mobile app development and marketing
• Full 360 takes big data analysis cloud services to new business heights
• HP hyper-converged appliance delivers speedy VDI and apps deployment and a direct onramp to hybrid cloud
• Enterprises opting for converged infrastructure as stepping stone to hybrid cloud
• How big data technologies Hadoop and Vertica drive business results at Snagajob
• Zynga builds big data innovation culture by making analytics open to all developers
• How big data powers GameStop to gain retail advantage and deep insights into its markets
• Data-driven apps performance monitoring spurs broad business benefits for Swiss insurer and Turkish mobile carrier
• How Malaysia’s Bank Simpanan Nasional implemented a sweeping enterprise content management system
• Redcentric Uses Advanced Configuration Database to Focus Massive Merger Across Multiple Networks
• HP at Discover delivers the industry's first open, hybrid, ecosystem-wide cloud architecture
• How Tableau Software and Big Data Come Together: Strong Visualization Embedded on an Agile Analytics Engine
• Big Data Helps Conservation International Proactively Respond to Species Threat in Tropical Forests
• How Globe Testing helps startups make the leap to cloud- and mobile-first development
• GoodData analytics developers on what they look for in a big data platform

• HP Doubles Down on Big Data Opportunity With New Products, Services, and Developer Programs
• Cloud Expo Silicon Valley: Big Data Analytics with Google Cloud Platform
• EMC Isilon Delivers World's Largest Single File System for Big Data