HP Big Data Blog
Big Data changes everything. The HP Big Data team is powering data analytics, information governance, and information management across the enterprise. Join the conversation.

Information Analytics

The ability to understand your information allows you to capture valuable insights, and uncover opportunities that can help you gain a competitive advantage.

Information Governance

Information today must be managed for compliance with a range of guidelines for business, legal, and government regulations.

Information Management

Protect your information regardless of where it resides, including on premises, in the cloud, or on mobile devices.

Know before you go: Last-minute details for HP Big Data Conference 2015

Westin.jpgAs we ramp up for HP Big Data Conference 2015 next week, we wanted to share some last-minute details for travelers visiting Boston for the event. Haven’t registered yet? Get in on the Big Data action now before it’s too late!


Keep reading to get the travel details for your time in Boston.

Join the discussion @ the Developers Lounge during HP Big Data Conference 2015

Developers lounge.PNGNext week, hundreds of Big Data experts and customers will convene in Boston for real-world conversations about data analytics at this year’s HP Big Data Conference. If you ask HP employees and previous attendees what they’re looking forward to the most at the conference, many say the Developers Lounge.


Keep reading to find out why this area of the convention is so popular.


by Big Data Blog Editor

An Information Governance Approach to Cybersecurity Threats

hack.jpgCorporate and organizational cybersecurity efforts have been traditionally focused on protecting an organization’s network perimeter. While network security is extremely important, insider threats that exploit the lack of security layers within an organization’s network have proven to be where an organization is most vulnerable.


HP Big Data Conference Comes to Boston

The summer sun is not the only hot thing to come to the streets of Boston this August.  HP's Big Data Conference is in its third year and features some enlightening discussions that dive deep into the HP Haven platform, including Vertica, IDOL and distributed R.

Tags: Haven| IDOL| Vertica

5 things to check out while in Boston for #HPBigData2015

5 things to check out while in Boston for BDC.jpgThe HP Big Data Conference 2015 is only weeks away – have you registered yet? When you do, you will have access to dozens of Big Data sessions, trainings, certifications, Hack Day and so much more. So don’t wait any longer – register now!


The Big Data Conference is being held at the Westin Waterfront Hotel, right at the corner of Summer and D streets in South Boston. Your view will be epic; the hotel is located right on the historic Boston Harbor. But if you’re looking to take in some sights during your Big Data downtime, you’re in luck: here are 5 recommendations to help make your trip to Boston the biggest and best yet.

Capturing the value from the Internet of Things

HP-image-7.jpgWe have all heard about the Internet of Things (IoT) and the promise it brings to transform businesses and industries.  Almost daily we hear about new innovations and connected products. 


Industry experts estimate trillions of dollars in economic impact from IoT. But have you thought about how your business can capture this value?  Keep reading to get a new perspective on IoT and what it can mean for your business.

Prepare for Hack Day @ HP Big Data Conference 2015

HP Big Data Conference 2015 - Hack Day.jpgHP Big Data Conference 2015 in Boston isn’t all about sessions – there’s a big challenge involved, too!


Hack Day, held Aug. 10 at the Big Data Conference, is your chance to work alongside fellow peers and innovators to build an app that could win you great prizes. There is no cost to sign up for Hack Day, and while conference registration is not required to participate, it is highly recommended.

HP Structured Data Manager retains leadership in Gartner 2015 MQ for Structured Data Archiving

HP named a leader in Gartner 2015 MQ for Structured Data Archiving.jpgWhen it comes to managing information – it’s all about the intelligence.  At HP, we’re laser focused on delivering backup, recovery and archiving solutions that are built on enterprise-grade and big data tested analytics to support virtual, physical, converged, hyper-scale, and cloud platforms.  No small undertaking to be sure, but certainly a requirement in today’s datacenter. 


Continue to see why Gartner named HP a leader in their 2015 Magic Quadrant for Structured Data Archiving and Application Retirement. 

Changing the dynamic for women in technology at #HPBigData2015

HP Big Data Conference 2015 - Women in Tech.jpgAre you a woman working in technology? Have you ever wanted to make a bigger impact? Do you want to share your experiences with your peers?


Here’s your chance to join the conversation at #HPBigData2015.

The evolution of an idea: #HPBigData2015

HP Big Data Conference 2015 - Developers Lounge.jpgGuest blog post by Colin Mahony, SVP/General Manager of HP Software Big Data Group


Three years ago, we had an idea. We had such a passionate and knowledgeable group of customers who were always looking to share best practices, learn from each other, and have a great time.  So we thought let’s bring them together and give them the opportunity to tell their stories and ask their questions, while we provide a cool venue with good food & drinks!   This was the birth of the Big Data Conference... 

Plan your HP Big Data Conference 2015 schedule now with our Session Catalog

HP Big Data Conference 2015 - Session Catalog.jpgHP Big Data Conference 2015 in Boston is right around the corner – have you registered yet? The event gives you the opportunity to participate in dozens of Big Data sessions, network with your peers, and learn from our experts and partners about how you can maximize your Big Data analytics outcomes.


Save time once you’re at the conference and familiarize yourself with our session lineup now, using our Session Catalog feature on the #HPBigData2015 website.

No Summer Camp for HP Information Management & Governance: 5 Proof Points of Solid Business Momentum

No summer camp for HP Information Management and Governance.jpgOftentimes, the summer is a bit of a dead period for technology companies.  Many employees take time off to travel with family, and other distractions crop up that can stall business momentum for a few months.  It’s almost like technology vendors go to summer camp for a period of time. 


Not so for HP’s Information Management & Governance portfolio.  We have been hard at work investing in infrastructure and analytics. Here are a few highlights from the last few months that clearly demonstrate the business is on a positive trajectory, even through the summer lull.

What would the Six Million Dollar Man look like if he was file analysis software?

The Six Million Dollar Man.jpgWonder no more. HP has released HP ControlPoint 4.6.


Compared with its predecessor (v4.5), HP ControlPoint 4.6 is a new and improved version – we made it better, faster stronger… "What was the main driver for this release?" you might ask… Our customers!


Continue reading to learn more about the latest enhancements in HP ControlPoint 4.6.


Big Data - It Takes (H)a(ve)n Ecosystem

BDC - TW.jpgAs we prepare for our third annual HP Big Data Conference in just a few short weeks - it keeps getting clearer that our partner ecosystem is critical to our customers' success - which is why we're so thrilled to have so many of them joining us in Boston!


Continue reading to learn more about the role our partners are playing #HPBigData2015. 

Uplevel Big Data Analytics with Graph in Vertica – Part 3: Yes, you can make it go even faster

Uplevel Big Data Analytics with Graph in Vertica - ICON.jpgSo far in this blog series, I’ve discussed the concept of graph analysis and provided an example of how we implemented and benchmarked one common algorithm – single source shortest path – comparing HP Vertica to several common graph engines.  In this post, I’ll discuss the observed performance characteristics in more detail and provide some insights as to how we can further optimize performance of graph analytics in the Vertica engine.


Continue reading to see how you can make graph analysis go even faster. 

Optimizing Vertica query workloads: A real-world use case

Optimizing Vertica query workloads - ICON.jpgIn this blog, I will discuss an HP internal use case that consists of many concurrent queries of diffent complexities.  The challenge is designing a HP Vertica workload solution to optimize this complex query workload.  These queries were generated by a front-end BI tool and their syntax could not be changed.  To perform the tests, the HP team has extracted 5,636 queries of varying complexity (from the simple one table selects to extremely complex types having 10+ table joins and 50+ GBY columns).  


Continue reading to hear more about this Vertica workload performance tuning exercise. 

Why move storage optimization to the top of your list?

Why move storage optimization to the top of your list - ICON.jpgI am sure that there are a lot of projects on your list to improve IT operations just as there are a lot of challenges you are facing right now. So how do you prioritize what goes to the top of your list? We developed a graphic to show you just a few of the reasons why and specifically how HP Storage Optimizer can help. A picture is worth a thousand words!


Continue reading to see why you should move storage optimization to the top of your list. 


Is your data cloud-ready?

File Analysis for the Cloud.pngIf you have considered adopting cloud, have you given any thought to which data should go to which cloud? 


Chances are you have considered cloud. A recent research report by ESG Lab indicates Cloud appears twice in the top 10 IT priorities for 2015. However, you may not have thought much about the type of data you have and its suitability.


Continue reading to learn why it's crucial that you analyze what files you're storing in the cloud. 

Six signs that your Big Data expert, isn’t

Asking big data questions.jpgI’ve recently read a number of articles on the phenomenon we’re all calling “Big Data,” and I’ve uncovered a disturbing, yet totally predictable, trend in this latest tech bubble.  Because Big Data is hot, trendy, sexy and superficially interesting, everybody is weighing in as if they were an expert.  It’s not an accident that this is starting to feel like an intellectual discourse on international politics on Facebook.  There’s about as much expertise and experience being demonstrated in these Big Data discussions as there is in those Facebook rants.


What makes a Big Data expert an expert? Continue reading to learn more. 

“Make the best of” with HP Storage Optimizer

HP Storage Optimizer Screenshot.pngAs I sat and pondered this weekend over this blog introducing HP Storage Optimizer, my creative juices just were not working. Usually when I develop a blog, I already have an idea in my mind and it just starts to flow. I decided to do a little research so I searched online for a definition of optimize.


Continue reading to learn more about HP Storage Optimizer. 

No boot device – No problem with HP Connected MX

HP Connected MX KeyView.pngA few weeks ago I had the opportunity to meet with HP Partners in NY at a Big Data Summit. The focus of the event was to introduce our partners to our products, use-cases, roadmaps and successes as it relates to data protection (backup, recovery, archive and analytics).


Read more to see how HP Connected MX saved the day.

New Informatica PWX connector for HP Vertica

Informatica has released a new version of the HP Vertica Power Exchange (PWX) connector that features some outstanding updates for Power Exchange users.  

#TBT to HP Big Data Conference 2014

HP Big Data Conference 2014 video.pngTime for a Throwback Thursday: Last year I attended the HP Big Data Conference for the first time. The conference delivered on its promise to feature the brilliant minds behind HP’s big data platform and executive keynotes on how big data changes everything. The pre-conference hackathon was highly collaborative and rewarding. There was value in all the track sessions for anyone, from developers to the C-level, involved in big data. And thanks to the details shared so far, this year’s event looks to be even better.


Continue reading for a look back at HP Big Data Conference 2014 .

Uplevel Big Data Analytics with Graph in Vertica – Part 2: Yes, you can write that in SQL

SQL Analysis.jpgIn my prior blog post on graph, I described a very basic form of graph analysis and how one of our customers applied this technique in the HP Vertica big data analytics database to significantly improve their business.  What I’ll do in this entry is review how a common graph algorithm – single-source shortest path – is set up and executed in Vertica.  I’ll also provide performance results comparing the performance of shortest path between Vertica and two popular graph engines.


Continue reading to see how you can write graph analysis in SQL. 

Get it right the first time with big data analytics

Amazon offer - Get it right the first time with big data analytics.jpgImagine my surprise when, as a very frequent Amazon buyer, I logged in and found this personalized offer waiting just for me. As the mom of a 25-year-old daughter who is long past the diaper stage, I laughed out loud.  And then I thought about all the offers that pop up in my browser windows, my Twitter and Facebook newsfeeds, and in every other online engagement I choose.  There’s only a split second chance to get it right.


Continue reading to learn how Amazon could be using big data analytics to better understand their customers. 

Postcards from Thailand: HP Data Protector highlights from the HP APJ Tech Symposium

Wat Arun Temple in Bangkok.jpgLast month I attended the HP APJ Tech Symposium (Asia, Pacific and Japan). The week-long conference was held at the Shangri-La hotel on the Chao Phraya River in Bangkok, Thailand. It’s always great to be back in Asia; the level of participation and enthusiasm is often imitated, seldom duplicated. HP really pulled out the stops in the delivery of enablement training to our field representatives and partners.  


Continue reading to learn more about the latest enhancements to HP Data Protector and HP Backup Navigator. 

Chasing the dream or trying to change the world? Insights and opinion on Hackathons

LA Hack Pano.jpg

For many, the term “hackathon” immediately conjures up thoughts of a bunch of mischievous or malicious coders hiding in a basement in some far off land, conspiring to do no good. From Silicon Valley, to Silicon Beach and Silicon Alley, these events are taking place just about every weekend somewhere in the US. Enterprise companies are embracing hackathons as a way to reintroduce innovation, collaboration, and a sense of agility back into their organizations. 

Born in a data-driven world

Millennial companies in a data-driven world.png

Can Boomers adapt to a world where text messages have replaced phone conversations, and social media is the foundation of relationships?   How do the Gen X’ers, known as the generational “middle child,” manage the change?  Are the Millennials so focused on their mobile devices, expectations of real time everything, and innate multitasking that they will struggle to form lasting human connections? 


Continue reading to see how these characterizations can be applied to businesses in today's data-driven world. 

Uplevel Big Data analytics with HP Vertica - Part 1: Graph in a relational database? Seriously?

Graph Analysis TW.jpgOne of the most interesting ways in which the world has changed in the last twenty years is that there are now many aspects of our life which are “machine-readable.”  By that I mean, twenty years ago, if we wanted to say something to a friend we might pick up the phone or maybe write a letter. 


As we’ve introduced the computer as an intermediary, we now create information about our relationships (among other things) which can be read and analyzed in very powerful ways.


Continue reading to see how game company Zynga used HP Vertica to perform graph analysis. 


Seize the Data! Registration for HP Big Data Conference 2015 is now open

Register for the HP Big Data Conference 2015.jpgREGISTER TODAY - It’s that time of year again. Registration for the HP Big Data Conference 2015 is now open, and you’re invited.


There’s a lot of buzz around Big Data. So what makes this Big Data event a “can’t miss” event? What makes this conference different from all other events is that we make it real. Zero, nada, null “marketing-ish” presentations that you find at some many other vendor events. Every technical, business and strategic Big Data session is delivered by real-world engineers, developers and data-scientists so you get the real unvarnished insight about what is happening in Big Data today.


Continue reading to learn more about the HP Big Data Conference 2015. 

Showing results for 
Search instead for 
Do you mean 
About the Author(s)
  • With over 15 years’ experience in product marketing and sales with enterprise software companies, Becky brings considerable expertise to HP’s Information Archiving product marketing team. In her role, she is responsible for cultivating go-to-market strategy, messaging, and content. Becky enjoys working with clients, partners, and prospects to gain a better understanding of the information archiving needs, priorities, and issues affecting enterprises
  • Beth Demirjian leads HP Autonomy's digital strategy including search, social, mobile and email and has 15 years experience in enterprise software. She resides in San Diego, CA.
  • Chris Surdak is a Subject Matter Expert on Information Governance, analytics and eDiscovery for HP Autonomy. He has over 20 years of consulting and technology experience, and holds a Juris Doctor from Taft University, an MS from the Wharton School at the University of Pennsylvania, a CISSP Master's Certificate from Villanova and a BS in Mechanical Engineering from Penn State. Chris is author of the Big Data strategy book, "Data Crush," which was recently nominated as International Book of the Year for 2014, by GetAbstract. Chris is also contributing editor and columnist for European Business Review magazine.
  • Claire Dominy is a Digital Marketing Manager at HP Autonomy and is currently based in Houston, TX.
  • David Brown is a Product Marketing Manager at HP Autonomy, where he leads product marketing for several of HP’s Information Governance solutions.
  • David Humphrey, CTO of Video Surveillance for HP Autonomy oversees operations for Video, pioneering intelligent video-analytic technologies for international installations. Mr Humphrey has over twenty years experience in advanced video-analytics, with seventeeen years on security applications, as a leading provider of security and surveillance solutions to defense agencies, governments and major corporations around the globe.
  • Dominic Brown is VP of Information Governance HP Big Data. At HP, Mr. Brown employs his 15 years of legal and IT experience, along with HP Big Data’s unique technology, to help organizations address challenges with eDiscovery, compliance, and records management.
  • Fernando Lucini has been with Autonomy since 2000 and serves as Chief Technology Officer. As Chief Technology Officer, based at Autonomy’s headquarters in Cambridge, UK, Mr Lucini is responsible for defining the overall technology vision and strategy for HP Autonomy including the long term product roadmap and evangelising to customers and to the rest of HP, overseeing and sponsoring some of the world’s largest and most complex information systems across a range of industries.
  • Gagan Bhatia serves as WW product marketing manager for Enterprise Data Protection software within HP Autonomy business unit. He has over 15 years of experience in developing and marketing enterprise software including archiving, data protection, and information management solutions. He is based in San Francisco Bay Area.
  • This account is for guest bloggers. The blog post will identify the blogger.
  • Jeff Veis is Vice President of Solution Marketing for HP Autonomy responsible globally for product, partner and field marketing initiatives. Jeff has been in the enterprise software industry for more than 20 years and has experience in marketing, strategy, sales, and partnerships. During his time at HP Autonomy, Jeff has founded the Liberty Alliance Project, a first-in-class standards organization with a global membership that provides a holistic approach to identity.
  • Joe Garber is Vice President of Information Governance at HP Autonomy. In this role, he leads product messaging and go-to-market efforts for the organization’s eDiscovery, information archiving, and ECM market offerings. Garber has more than 10 years of experience in information governance and eDiscovery.
  • Joe has over 13 years of experience in technology marketing and is currently focused on the analytics solution portfolio. Prior to this role, he was responsible for product marketing of the enterprise application data management solution.
  • Delivering subject matter expertise in the area of financial services compliance and product marketing for HP’s eDiscovery and Supervision/Surveillance products. John has been a legal and compliance professional in the financial services industry for over 12 years. Prior to joining HP Autonomy, John was a compliance officer, auditor, and consultant for major banks, broker-dealers, investment banks, hedge funds, and asset management firms.
  • Luis Romero is a Senior Product Marketing Manager at HP Autonomy, where he leads product marketing for HP’s Information Archiving solutions. Luis has over 12 years of experience in enterprise software and information archiving.
  • For years I've been doing video and music production back and forth between Boston MA and New Orleans LA. Starting in 2010, I've began working with Vertica (now HP Vertica) in the marketing team, doing customer testimonials, product release videos, and website management. I'm fascinated by Big Data and the amazing things my badass team at HP Vertica has done and continues to do in the industry every day.
  • Michelle is the Global Product Marketing Manager for HP Records Manager and HP ControlPoint within the Information Governance portfolio. Responsible for solution messaging, positioning and GTM strategy, Michelle works closely with the product, sales, marketing and channel organisations within HP to develop these. Michelle has 13+ years experience in the Information Management space having worked closely with customers, industry and business partners over this time.
  • Po Hong, PhD, is a senior solutions architect in HP Big Data Platform Corporate Presales specializing in HP Vertica performance tuning and workload management.
  • Randy manages worldwide public relations, analyst relations, social media, and employee communications for HP Autonomy.
  • Responsible for Cloud Server Data Protection products, including LiveVault and Data Protector. Based in Boston, MA. Twitter: @sraldous
  • Stephen Spellicy is known as a virtualization and data protection subject matter expert with 17+ years of experience in the technology industry. As the Director of Product Management for Data Protection within HP Software's Division, he manages a portfolio of software products that over 60k customers leverage worldwide. His expertise within the backup/recovery, storage, virtualization, and cloud technology areas have also gained him recognition with HP internally and externally, with many contributed articles published technology focused magazines & periodicals.
Follow Us

HP Blog

HP Software Solutions Blog

The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation.