Is Big Data Good for Data Professionals?

Big Data isn't well defined, but it makes a lot of people sit up and pay attention.

Big Data isn’t well defined, but it makes a lot of people sit up and pay attention.

There’s a lot of hype around “big data”, a term being thrown around so much in the media that I’m not really sure what it means anymore. Is 1TB “big data”? Is 10,000 transactions/sec big data? Or does it mean that you have more data than your systems can handle, causing queries and reports to run slow?

I almost hope it’s the latter. I hope that our managers start to think that when our systems run slower that we’re dealing with big data, and we need more resources. The whole big data phenomenon could be a way for data professionals to start a new hardware renaissance, where hardware budgets grow and we begin to replace our current systems with bigger, faster servers.

Or perhaps it’s a way to offload some of the system administration for individual servers and move to cloud services. I don’t think that’s necessarily a bad move for many DBAs as it would allow them to focus on data management, and information extraction rather than dealing with storage and hardware management.

Big Data is in the news, and it’s being used by vendors to sell new products and services. From Hadoop to new SANs to BI interfaces, there’s no shortage of places where the term “Big Data” might be used to try and shorten the sales cycle. As a data professional, it’s important that you understand what your needs really are, and if the term is being in a way that actually provides some value to your company for the money spent.

Steve Jones

The Voice of the DBA Podcasts

We publish three versions of the podcast each day for you to enjoy.

About way0utwest

Editor, SQLServerCentral
This entry was posted in Editorial and tagged , . Bookmark the permalink.