HP Big Data Blog
Big Data changes everything. The HP Big Data team is powering data analytics, information governance, and information management across the enterprise. Join the conversation.

Information Analytics

The ability to understand your information allows you to capture valuable insights, and uncover opportunities that can help you gain a competitive advantage.

Information Governance

Information today must be managed for compliance with a range of guidelines for business, legal, and government regulations.

Information Management

Protect your information regardless of where it resides, including on premises, in the cloud, or on mobile devices.

What does HP Discover in Las Vegas have in common with sorting laundry in Australia?

Laundry vs. File Analysis.jpgMore than you think!


While I was sorting the laundry over the weekend (yes, I live in Australia), I thought, ‘Wouldn’t it be great to have a tool that could sort it for me and save some time?’ I started to think about the different categories I could put my laundry into: my clothes, my husband’s, my son’s and my daughter’s, school clothes, work clothes, going out clothes, old clothes, new clothes, clothes that no longer fit that should be thrown out (so I don’t keep washing them), or those that could be donated to charity. You get the point.


Continue reading to see how sorting laundry has to do with file analysis and HP Discover Las Vegas.

Challenging the status quo with big data analytics

Michael Stonebraker.jpgGuest blog post by Joy King, VP, Communications & Enablement, HP Software Big Data

I was very proud when Michael Stonebraker, co-founder of Vertica, was named the winner of the Turing Award, granted annually to "an individual selected for contributions of a technical nature made to the computing community." More simply, the Turing Award is recognized as the Nobel Prize of computer science. But to me, the Turing Award is a testimony to the power of vision, innovation, and most of all, determination...


Continue reading to how innovators like Stonebraker disrupt the status quo. 

#HPDiscover 2015: Building resilient IT? Think adaptive backup first

Meet HP Data Protection experts at HP Discover 2015.jpgIf you pick up the latest datacenter trends reports from ESG, Gartner, and IDC, you will notice that improving backup and recovery appears among the top IT priorities for organizations. The reason for that is simple: as the velocity, variety and complexity of data continue to accelerate, so do the risks of not being able to speedily restore critical systems and applications in case of disaster or data loss.

Continue reading to see why IT organizations need to adopt an adaptive approach to backup and recovery. Plus, get a preview of what the team has planned for HP Discover Las Vegas. 

Join the HP Discover 2015 roundtable: Big Data in financial services

HP Discover - Financial Roundtable.jpgIt’s about that time of year again where we get together with our worldwide customers and partners at HP Discover in Las Vegas to talk about the topics, trends, and issues that are impacting all of our organizations. In particular, the financial services industry continues to deal with greater regulatory scrutiny, increased risk exposure, and a continuous threat of financial penalties which all are directly affected by its most value asset—enterprise information...


Continue reading to learn more about the information governance challenges faced by financial organizations. Plus, see what the HP Big Data team has planned for HP Discover Las Vegas. 

Gartner 2015 eDiscovery Magic Quadrant: The keys to longevity in an ever-changing market

Gartner eDiscovery Magic Quadrant 2015 - HP named a leader.jpgGartner has recently published its 2015 Magic Quadrant for E-Discovery Software, and HP has been named a Leader – AGAIN! In fact, HP is the ONLY company to have been named a leader in this MQ every year since its inception in 2011. In an ever-changing eDiscovery market, this is quite an accomplishment!  HP’s ability to maintain its leadership status in such a competitive, evolving market has gotten me to thinking about the keys to longevity in business for any company...


Continue reading to see how HP has managed to remain a leader in the eDiscovery market and download a copy of the Gartner Magic Quadrant.

Everything is BIG in Vegas – Including Big Data and HP Discover 2015!

Welcome to Las Vegas.jpgOne of the reasons that I like Las Vegas so much is that everything is huge. The hotels, the hotel rooms, the casinos, the city blocks, the glitz, the glamor – huge! And since I am from Texas where everything is “big,” it takes a lot to impress me! I also like Vegas because every time I go out there I find something new that I have never experienced before. Based just on those two reasons, the perfect time for my next visit to Las Vegas is for HP Discover 2015 from June 2-4.


Continue reading to see what the HP Information Governance team has planned for HP Discover 2015.

On the road to Big Data - Harnessing analytics to create disruption

The road to big data.jpgIf you’ve been following HP recently, you may have noticed that we’re “all in” with our bet on Big Data. Every day we see our clients and ourselves being transformed by the power of massive amounts of data being analyzed in new ways, leading to entirely new insights about the world around us. A recent ebook, On the road to Big Data 20/20, discusses how HP IT is using Big Data tools and techniques to create new and disruptive business outcomes.


Much of this discussion comes from Saum Mathur, former CIO of HP Software. Mathur makes three key points in his summary of the work performed by HP IT. Let’s review each in turn and put them in context of our increasingly datafied world... 


Continue reading for more on big data disruption, predictive analytics, and security. 

Modernizing SAP HANA environments? Think adaptive backup first

Holger Meyer.jpgPost by guest blogger Holger Meyer, Master Solutions Architect for HP Big Data


SAP HANA administrators, I feel your pain!


You face many challenges when it comes to protecting the database: Backing up massive databases quickly to meet strict service level objectives. Maintaining low recovery time objectives (RTO) and a zero recovery point objective (RPO) in case of disaster. The list goes on. You have to address it all… without increasing IT costs or impacting the efficiency and performance of the database.


Continue reading to learn why you need an adaptive approach to backup and recovery in your SAP HANA environment. 

Dodd-Frank, information governance, and the regulatory battle

Dodd-Frank, information governance, and the regulatory battle.jpgIt has been almost five years since the Dodd-Frank Act (DFA) was passed. With it, the financial services industry has had to deal with sweeping legal, regulatory, and policy changes directly impacting their business. Perhaps most difficult has been the transformation in how they must now manage and access the escalating volume and variety of enterprise information in order to meet compliance obligations.


Continue reading to see how Dodd-Frank has created a regulatory nightmare for financial institutions and how information governance helps address those issues. 

A closer look at HP Connected MX

HP Connected MX.jpgHP recently announced the release of HP Connected MX, the next generation of its end-point protection solution, HP Connected. The growing demand of features and ease-of-use from end users is constantly shifting. Our customers’ growing demand for a solution that can complement both end user functionality with business control was the driving factor behind HP Connected MX.


Continue reading to learn more about the vision behind HP Connected MX and its key business and end user features.

The Goldilocks Scenario: Finding Big Data technologies which are “just right” for business

Walt Maguire.jpgGuest blog post by Walt Maguire, HP Software Big Data Chief Field Technologist


This week I had the pleasure of reading an interview with Dr. Michael Stonebraker by Barron’s.  I’ve met him several times, and am always impressed by what a truly sharp guy he is.  His commentary in the interview crystallized something about big data technologies that’s been on my mind for a while.  Goldilocks was onto something with the “just right” porridge. 


Let’s recap Dr. Stonebraker’s points and frame them up in “Goldi-speak”.


Continue reading to learn what big data technologies are "too hot," "too cold," and "just right" for business.

The Big Data shift in a data-driven world

Colin Mahony.jpgBlog post by Colin Mahony, SVP/General Manager of HP Software Big Data Group


The simplest things can have the greatest impact.  What if a single word could drive the most successful email fundraising campaign for a national presidential election.  That’s exactly what happened with the word “Hey” in the 2012 Obama campaign.  It proved to be the most effective subject line to drive recipients to open and act on email.  That insight came from data … a lot of data!


We’ve always had data.  We’ve always used data. We’ve produced countless reports from that data.  So what really has changed?  Yes, there’s more data.  A lot more data.  But that’s a small part of a much bigger story.


Continue reading to see how a shift in big data analytics is transforming the data-driven world.

Structured data archiving – What’s all the buzz about?

Structured Data Archiving and Big Data buzz.jpgBig Data seems to be the new “buzz” word and for many good reasons. Data is growing exponentially daily, and while having this big data offers new opportunities to us, it also poses real problems.  The growth of structured data is especially a concern as enterprises are being forced to look at data archiving and try to separate out useful data from the non-essential. In short, Big Data is actually accelerating the adoption of structured data archiving.


Continue reading to learn why structured data archiving matters in today's world of growing data and IT.

How does Big Data change physical security?

Safe City - How can Big Data change physical security.JPGImagine an emergency scenario where several power lines have just been knocked down by a falling tree during a severe storm. A concerned citizen takes a picture and tweets about it. That tweet is picked up immediately by a command center, which automatically analyzes the situation based upon the social media data and any other applicable data from sources such as surveillance cameras to assess overall risk. It then triggers alerts and issues appropriate recommendations for action based upon historical data of similar events...


Continue reading to learn how HP Haven, our Big Data platform, can help you navigate the fast-paced world of surveillance and physical security. 

Welcome to a new dimension: Introducing HP Vertica Dimension

Happy April Fools.jpgHP Vertica announced this morning they will be releasing their newest version later this year. Taking the column store architecture, this version combines traditional row store for a more intelligent platform.


This new row and column hybrid architecture is being code named “Dimension.” It represents the platform’s ability to now store data in two dimensions, storing more bits in each sub-micrometer magnetic region of storage devices. With this technology, real-time OLATP processing (online analytical transaction processing) is possible...


Continue reading to learn more about HP Vertica Dimension.

Can your healthcare data change your balance sheet?

HP Healthcare Analytics.jpgA recent report estimates the volume of healthcare data at 153 exabytes in 2013, and expects it to grow to 2314 exabytes by 2020 at an annual rate of 48%! This kind of growth further exacerbates the already intense pains of managing storage, compliance, security, and so on in an increasingly taxing environment of tough mandates on patient outcome and cost control.


More and more healthcare IT executives are beginning to explore how to transform this massive amount of data into an asset by unlocking the value within. So, it is not surprising to see that 54 % of healthcare IT executives rated analytics as their highest IT priority in a recent healthcare industry survey...


Continue reading to learn how HP Haven can help healthcare organizations maximize data value. 

Happy World Backup Day! Don’t let this backup mishap happen to you

Happy World Backup Day.jpgThis is a story about how I ended up with my palm on my face. We all have probably been in the predicament where you look at your remaining hard drive space and realize either: 1. You need to buy a bigger hard drive, or 2. You need to delete files to free up space.


Indeed, I was faced with this scenario just the other day. However, in anticipation, I had set up a small network-attached storage (NAS) device to hold some important work files that I needed to retain and use...


Happy World Backup Day! Continue reading to hear Luigi's backup mishap. 

Taking information governance to the top

Taking information governance to the boardroom.jpgDue to a number of high profile incidents such as the Snowden revelations, Hillary Clinton’s email scandal and security breaches at SONY, NSA, Target, and numerous others, information governance is now a topic escalated to the boardroom. Too many corporations have either felt the results of being exposed, or are scared to death that it might happen to them. Gone are the days where data was managed reactively and in silos...


Continue reading to see why information governance has become such a hot topic in boardrooms around the world. 

Up in the clouds: HP Data Protector is now Helion Ready

HP Data Protector is now Helion Ready.jpgThe HP Helion Ready Program for Solution Providers enables ISVs and SaaS application provider vendors to test and certify their products to deliver the New Style of IT to enterprise customers.


HP Helion uniquely combines OpenStack® and Cloud Foundry to deliver a cloud platform based on open standards, and enterprise-grade security, reliability and manageability. HP Helion helps customers build and manage hybrid cloud services at enterprise scale...


Continue reading to learn more about HP Data Protector's native integration with HP Helion OpenStack. 

Don’t end up on the couch: Syncing files is not the same as backup

Syncing data vs backing up data.jpgThe ability to sync and share your files is available everywhere, and there are a variety of vendors out there that offer this ability for businesses and consumers. Users want their data on all their devices now, and syncing files has become the norm. But it has also brought new challenges for businesses. Businesses need to offer the convenience of files anywhere while maintaining control over the data...


Continue reading to learn more about the challenges business face and why syncing your files isn't the same as backing them up. 

Top trends in information governance and archiving

Many legacy archiving systems can't handle the volume of today's information.jpgThere are forces of change impacting almost every organization today. Some are related to the current political climate, the economy, and other global events that we have less control over. Others, such as Big Data, the cloud, and the demand for anytime anywhere information access, are having just as significant if not a greater effect on businesses around the world. These forces, however, are sometimes dismissed as also being uncontrollable or overwhelming. By better understanding these information forces, it’s possible for companies to not only control them, but actually take advantage of them with the right information governance and archiving strategy...


Continue reading to learn more about how top trends are impacting information governance and archiving. 

Big need in Big Data & Government: Forge stronger links between Federal & the best minds in business

Dr. DJ Patil at Strata Hadoop World 2015.jpgPost by guest blogger Lewis Carr, Senior Director, HP World-Wide Software Industry Marketing


The keynote by Federal Chief Data Scientist DJ Patil at Strata + Hadoop World in San Jose was inspiring, but more must be done to bring together business experts and Federal employees to discuss in detail how big data analytics can be used in government, and explore what some thought leaders in government are already doing. Here are some thoughts about the role HP wants to play.

Inside HP Haven: Full life cycle development in HP Vertica

HP Vertica Development Cycles (Initial & Incremental).pngRecently, on several customer visits, I was asked questions like: What is it like to do database development in HP Vertica? What is the development methodology for HP Vertica?


First and foremost, Vertica is a relational database management system (RDBMS). As such, from a process point of view, there is nothing special about implementing a database design in Vertica.


Continue reading to learn more about full life cycle development in HP Vertica. 


You’ve got HP Data Protector friends to turn to – and books too

Planning, Deploying and Installing Data Protector 9.jpgPost by guest blogger Greg Baker, leading independent expert in Asia and the Pacific on HP Data Protector. 


Here's one way you can tell if a product is something you can trust. Look at the amount of documentation you can that isn’t written by the vendor. A quick check on Amazon shows me that there are hundreds of books on Oracle and thousands on Microsoft's SQL Server, mostly written by outside consultants and practitioners. Windows: check. Linux: check. If it is good, someone will have written about it. This tells you that there's a real community of users and experts that you can turn to. You can find out what works and what doesn't. 


Not many backup products have that sort of community. But HP Data Protector does, and I've just finished writing another two books...


Continue reading to learn more about Greg Baker's books on HP Data Protector 9.

Three simple reasons Morgan County chose HP LiveVault for their disaster recovery requirements

Why Morgan County chose HP LiveVault.pngMore than 10,000 customers rely on HP LiveVault to protect their critical application data across virtual and physical environments in the cloud or in a hybrid cloud; Morgan County is one of them.


Continue reading to see the three reasons why Morgan County chose HP LiveVault for their disaster recovery requirements. 

Global Information Governance Day: Helpful hints on how to celebrate

Global Information Governance Day 2015.jpgWhen I was asked this week what HP Software was planning for Global Information Governance Day (GIGD), I was taken aback. I mean, we just celebrated Valentine’s Day, President’s Day, and Mardi Gras. Why does Information Governance need its own day?


Keep reading to see why information governance deserves its own day and how you can celebrate. 

Trends in eDiscovery – What’s old is new again

HP Info Gov Booth at LegalTech 2015.jpgLast week I attended LegalTech New York for the eleventh time. The first time I attended LegalTech in 2004, the New England Patriots had just won another Super Bowl, and I was working in the litigation support department of a large Boston law firm. There were far fewer eDiscovery vendors exhibiting back then, but eDiscovery was still a main theme of the LegalTech show as it is today. However, the focus of many law firms at the time was in finding eDiscovery companies to which they could outsource much of their work while they were working on staffing and beefing up their own in-house eDiscovery team...


Continue reading to see how eDiscovery has changed over the years.

Inside HP Haven: HP Vertica concurrency and workload management

HP Vertica Concurrency and Workload Management.JPGEditor’s note: Last fall, the HP IDOL and HP Vertica teams joined forces to form the HP Big Data unit, centered on HP Haven. We’ve invited a group of HP Big Data experts to share their expertise on the blog. Po Hong, PhD, is a senior solutions architect at HP Big Data Platform Corporate Presales. He has a broad range of experience in various relational databases such as HP Vertica, Neoview, Teradata, and Oracle.


Analytic databases, such as HP Vertica, often need to process different types of workloads. These workloads can range from the simplest primary-key lookups to analytical queries that include several large tables and joins between them. Different types of load jobs (such as batch ETL and near real-time trickle load) must keep the data up to date in an enterprise data warehouse (EDW)...


Continue reading for a preview of our latest technical white paper, HP Vertica Concurrency and Workload Management. 

Data Protection: Don’t just report on your backup environment, analyze it!

The Value of Analytics in Backup Environments.pngIs the ever-growing data that your organization has to back up seen as anything more than just ‘something to deal with’? What if it could be leveraged as an asset which adds value to the business? In this post, I’m going to show you the value behind analyzing your backups and about the HP Adaptive Backup and Recovery solution that helps organizations.


Continue reading to learn more about the importance of backup analysis and get a re-cap of last week's webcast with Gartner analyst Dave Russell. 

Inside HP Haven: Copying data between Vertica clusters

Copying Data Between Vertica Clusters.JPGEditor’s note: Last fall, the HP IDOL and HP Vertica teams joined forces to form the HP Big Data unit, centered on HP Haven. We’ve invited a group of HP Big Data developers to share their expertise. Norbert is a HP Accredited Solutions Expert for the HP Big Data Platform team.


The HP Vertica Analytics Platform supports different methods for copying data between Vertica Clusters. The most holistic method, using the vbr.py utility, allows the entire database to be copied between environments. However, this approach may not be suitable for use cases in which more granular control over what is copied is needed or if the topology of the clusters differs.


Continue reading to learn the different ways you can copy data between clusters. 

Showing results for 
Search instead for 
Do you mean 
About the Author(s)
  • With over 15 years’ experience in product marketing and sales with enterprise software companies, Becky brings considerable expertise to HP’s Information Archiving product marketing team. In her role, she is responsible for cultivating go-to-market strategy, messaging, and content. Becky enjoys working with clients, partners, and prospects to gain a better understanding of the information archiving needs, priorities, and issues affecting enterprises
  • Beth Demirjian leads HP Autonomy's digital strategy including search, social, mobile and email and has 15 years experience in enterprise software. She resides in San Diego, CA.
  • Chris Surdak is a Subject Matter Expert on Information Governance, analytics and eDiscovery for HP Autonomy. He has over 20 years of consulting and technology experience, and holds a Juris Doctor from Taft University, an MS from the Wharton School at the University of Pennsylvania, a CISSP Master's Certificate from Villanova and a BS in Mechanical Engineering from Penn State. Chris is author of the Big Data strategy book, "Data Crush," which was recently nominated as International Book of the Year for 2014, by GetAbstract. Chris is also contributing editor and columnist for European Business Review magazine.
  • Claire Dominy is a Digital Marketing Manager at HP Autonomy and is currently based in Houston, TX.
  • Da Hye Huh serves as the Director of Product Marketing for Autonomy IDOL.
  • David Brown is a Product Marketing Manager at HP Autonomy, where he leads product marketing for several of HP’s Information Governance solutions.
  • David Humphrey, CTO of Video Surveillance for HP Autonomy oversees operations for Video, pioneering intelligent video-analytic technologies for international installations. Mr Humphrey has over twenty years experience in advanced video-analytics, with seventeeen years on security applications, as a leading provider of security and surveillance solutions to defense agencies, governments and major corporations around the globe.
  • Dominic Brown is Vice President, Meaning Based Governance at Autonomy, Inc. At Autonomy, Brown employs his 15 years of legal and IT experience, along with Autonomy’s unique technology, to help organizations address challenges with eDiscovery, compliance, and records management.
  • Fernando Lucini has been with Autonomy since 2000 and serves as Chief Technology Officer. As Chief Technology Officer, based at Autonomy’s headquarters in Cambridge, UK, Mr Lucini is responsible for defining the overall technology vision and strategy for HP Autonomy including the long term product roadmap and evangelising to customers and to the rest of HP, overseeing and sponsoring some of the world’s largest and most complex information systems across a range of industries.
  • Gagan Bhatia serves as WW product marketing manager for Enterprise Data Protection software within HP Autonomy business unit. He has over 15 years of experience in developing and marketing enterprise software including archiving, data protection, and information management solutions. He is based in San Francisco Bay Area.
  • George Tziahanas leads product management and strategy for HP Autonomy’s Legal and Compliance Portfolio, including its Compliant Archiving, eDiscovery, Legal Hold, and Supervision/Surveillance solutions. George also works closely with HP Autonomy financial services clients, overseeing deployment and ongoing management of solutions designed to meet regulatory requirements.
  • This account is for guest bloggers. The blog post will identify the blogger.
  • Jeff Veis is Vice President of Solution Marketing for HP Autonomy responsible globally for product, partner and field marketing initiatives. Jeff has been in the enterprise software industry for more than 20 years and has experience in marketing, strategy, sales, and partnerships. During his time at HP Autonomy, Jeff has founded the Liberty Alliance Project, a first-in-class standards organization with a global membership that provides a holistic approach to identity.
  • Joe Garber is Vice President of Information Governance at HP Autonomy. In this role, he leads product messaging and go-to-market efforts for the organization’s eDiscovery, information archiving, and ECM market offerings. Garber has more than 10 years of experience in information governance and eDiscovery.
  • Joe has over 13 years of experience in technology marketing and is currently focused on the analytics solution portfolio. Prior to this role, he was responsible for product marketing of the enterprise application data management solution.
  • Delivering subject matter expertise in the area of financial services compliance and product marketing for HP’s eDiscovery and Supervision/Surveillance products. John has been a legal and compliance professional in the financial services industry for over 12 years. Prior to joining HP Autonomy, John was a compliance officer, auditor, and consultant for major banks, broker-dealers, investment banks, hedge funds, and asset management firms.
  • Luis Romero is a Senior Product Marketing Manager at HP Autonomy, where he leads product marketing for HP’s Information Archiving solutions. Luis has over 12 years of experience in enterprise software and information archiving.
  • Michelle is the Global Product Marketing Manager for HP Records Manager and HP ControlPoint within the Information Governance portfolio. Responsible for solution messaging, positioning and GTM strategy, Michelle works closely with the product, sales, marketing and channel organisations within HP to develop these. Michelle has 13+ years experience in the Information Management space having worked closely with customers, industry and business partners over this time.
  • Po Hong, PhD, is a senior solutions architect in HP Big Data Platform Corporate Presales specialized in HP Vertica performance tuning and workload management.
  • Randy manages worldwide public relations, analyst relations, social media, and employee communications for HP Autonomy.
  • Scott speaks, blogs, writes articles and specializes in driving competitively differentiated integrations for storage and virtualization. VMware Certified Professional, recognized as a vExpert, VMWorld speaker, VMUG keynote speaker, and a contributing author of the book Virtualization Changes Everything.
  • Responsible for Cloud Server Data Protection products, including LiveVault and Data Protector. Based in Boston, MA. Twitter: @sraldous
  • Stephen Spellicy is known as a virtualization and data protection subject matter expert with 17+ years of experience in the technology industry. As the Director of Product Management for Data Protection within HP Software's Division, he manages a portfolio of software products that over 60k customers leverage worldwide. His expertise within the backup/recovery, storage, virtualization, and cloud technology areas have also gained him recognition with HP internally and externally, with many contributed articles published technology focused magazines & periodicals.
Follow Us

HP Blog

HP Software Solutions Blog

The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation.