Voice of the DBA

Category: Editorial

  • Pop Tarts and Hurricanes

    The second most dold item at Wal-Mart before a hurricane.

    What do people buy most of before a hurricane? Wal-Mart determined that batteries are the number ones sales item before a hurricane, but the second most sold item was surprising: pop-tarts. That’s the type of intelligence that can come from analysts asking the right questions about their customers and then IT delivering systems that can help them get an answer.

    More and more companies are starting to deal with big data. Big data is usually seen as extremely large sets of data. Those data sets  often exceed the capability of what a single database server can handle, and place a strain on existing IT infrastructures, especially when there is an explosion of new datab types. Hadoop is an open source framework that’s designed to deal with large sets of data and help with the processing and analysis of these large data sets.

    Microsoft recently added support for Hadoop to SQL Sever. Granted it’s only in the Parallel Data Warehouse, which is a highly specialized version of SQL Server integrated with specific hardware. However I am sure this will eventually make its way to other editions over time.

    Update: I made a mistake, there is a connector for non PDW SQL Server 2008 R2 instances.

    I don’t know if I would recommend learning Hadoop, but the techniques of processing large sets, and performning analysis on big data is important., Even more important might be the writing of well performing T-SQL code that will be used. I’d recommend you read about ways to write better code, and learn to integrate those skills into your daily work. You don’t always need them, but you often don’t know that when you are writing the code.

    It doesn’t take much more effort to write better code the first time, but it does take more effort to learn to do so. It’s an investment in your career that you ought to be regularly working on to become one of those talented people that is in demand in the future.

    Steve Jones

    The Voice of the DBA Podcasts

  • The Talent Crunch

    IT Jobs are everywhere. Check out the listings on any of these sites.

    Is it a good time to be in the technology business? I think so, as the US unemployment rate stands at just above 9%, but the rate in IT is listed as about 4%. There might be some errors in how they are classifying and counting IT jobs, and the unemployment is not evenly distribute across the US, but that still seems like a significant difference. As a comparison, much of the medical profession is similarly employed, as are teachers (yeah!), but construction trades are showing  > 20% unemployment.

    Not only are there lots of jobs in the technology area, but overall technology pays a much higher salary (or wage) than many other industries. Whether you think you are paid well or not, peruse some other professions on Dice, Monster, or another job board and compare salaries. Keep in mind the US median income is $48k, meaning half the people make more and half make less. I suspect most IT workers are in the “more” side of that range.

    I think it’s also likely that the unemployment rate in technology could decline further. There’s an interesting report from Dice (2MB PDF) that indicates we are in a talent crunch as well that could become more problematic in the future. More than a few places predict that we will have a shortage of skilled technology workers in the future. Some of those predictions are based on enrollment in college math and science programs, which can be faulty. IT work doesn’t require a college degree, and perhaps shouldn’t.

    However it does seem that we have an ever increasing need for people to work in technology. I’ve had friend worry that our own efforts to improve and automate things would result in fewer jobs, but it seems that’s not the case. The gains in individual productivity in both the development and administrative areas are easily outstripped by the huge growth in the numbers of applications and servers to manage.

    Hopefully you have a good career in IT, and will have one for as long as you want one. I’d caution you to think carefully about the title of this piece. There’s a crunch for talented people, not just people. You need to work on your technical skills, and your soft skills, regularly if you want to be in demand in the future.

    Steve Jones

    The Voice of the DBA Podcasts

  • Virtual Security

    The State of New Mexico is being careful with virtual machine security

    I have a few friends that are working virtualize almost their entire computer infrastructures.  They work in large and small companies, but there is a constant push to avoid the bare metal installation of any operating system onto physical hardware, making every Windows or Unix machine a virtual machine on top of a hypervisor. I was surprised to hear that companies were being to aggressive, but the cost benefits can be huge, and when virtualization is done in a smart way, performance doesn’t suffer.

    However virtualization can change security, especially when you have VMs that are allowed to move from physical host to physical host. The state of New Mexico embarked on a similar project, and were concerned over security of the virtual machines. Their department had dismissed some employees because of a security breach a few years earlier and security was on the forefront of their minds. Additional security as well as network controls were used in their project, and I hope they also implemented strong auditing procedures.

    As we move to newer infrastructures that include virtualization, physical security becomes more important, and additional controls are needed. The ability for someone to potentially move a VM outside of a data center, or even to a less secure remote data center becomes a point of concern. Moving the storage itself might be an even bigger problem as virtual storage becomes more commonplace.

    Ultimately, however, we can’t all have dedicated security employees, nor can we expect every DBA, sysadmin or even security officer to be able to protect against and mitigate all attack vectors. Auditing is ultimately the best way to handle breaches. We can’t prevent all of them, but responding quickly, learning, and perhaps more importantly informing the appropriate people to be ready to respond to the information disclosure.

    Steve Jones

    The Voice of the DBA Podcasts

  • A Flock of SQL Servers

    Check out the #sqlhelp hashtag on Twitter

    Twitter is an amazing application. I still remember hearing about it in the spring of 2008 as some type of “let others know what you’re doing” service. It seemed a little silly to me and I couldn’t understand the value. My first tweet is lost for now, but I know that I struggled to find a use for the service at the beginning. Like many people, I ended up updating my status with inane things like “Getting a latte from Starbucks.”

    Since then I’ve found Twitter to be a very exciting way of keeping in touch with people around the world, learning new things, and even getting information at various events. It’s the ultimate water cooler that makes me smile, laugh, and share interesting information. There is a great SQL Server community on Twitter, and an amazing hashtag (#sqlhelp) that might help you solve some complex SQL issue. It’s happened before, and it’s amazing when it does, especially considering that responses are limited to 140 characters.

    It seems that there are any number of ways in which people use the service to spread information and interact with others. However there are security implications in using Twitter, and that leads me to this week’s poll:

    Do you want your SQL Servers tweeting?

    If you find some way in which it might be useful for your database server to send information out through a broadcast service, would you want to use Twitter? Are you worried about potential security implications, or maybe just the potential load from a large number of broadcasts. Would you ever consider letting your application or database server read twitter updates and respond to them?

    If you haven’t tried Twitter, I’d recommend you do so. It isn’t for everyone, but I’ve found a lot of value and inspiration from the service.

    Steve Jones

    The Voice of the DBA Podcasts