Voice of the DBA

Author: way0utwest

  • T-SQL Tuesday #027 – The Big Data Valentine’s Edition

    tsqltuesdayIt’s T-SQL Tuesday time again, and I’m honored to be able to host the party for February 2012. This is my second time hosting, with the first being #013.

    T-SQL Tuesday is the brainchild of Adam Machanic, who hosted the very first blog party. If you’d like to be a host, contact Adam on his blog. The complete list of older topics is here: T-SQL Tuesday Topics – February 2012, so you can pick a new one if you’d like to host.

    Note, this is advance notice. The party is NOT today, it’s next week, February 14, 2012.

    The Rules

    Here are the rules your post must follow.

    1. Your post must go live between 00:00:00 GMT on Tuesday February 14, 2012 and 00:00:00 GMT on Wednesday February 15, 2012.
    2. Your post must link back to this post, and the link must be anchored from the logo (found above) which must also appear at the top of your post.
    3. Leave a comment or a trackback here on this blog regarding your post.
    4. ‘T-SQL Tuesday #027’ should be included in the title of the post.
    5. If you’re on Twitter, tweet about your post using the hash tag #TSQL2sDay

    Big Data

    godivaThe party falls on Valentine’s Day this month, and I thought a little notice would let you get your post done early, and then spend the day with your loved ones

    Since the media has a love affair with Big Data right now, I thought this would make an interesting topic. Data is the lifeblood of our careers and of many organizations. Slowly governments, companies, and individuals are becoming aware of just how important data is to us, and as they do, they want more of it. More storage, more access, and more analysis.

    That creates challenges for us as data professionals. We will have to learn to better manipulate, aggregate, summarize, and handle larger volumes of data in the future. I think this means we will have lots of employment in this area, and it means tremendous opportunity for those that learn to work with data well.

    This month I want to hear what big data problems you’ve solved, or interesting ways of working with big data, challenges that you struggle with, or cool hardware tricks that mask the problems in your code.

    Think big, and let us know how you work with Big Data.

  • Do You Need a Coach?

    Most of us reach a point in our careers where we think we can tackle most of the challenges we face ourselves. We may ask questions, we may need to read, study, practice, or more, but we tend to have the self confidence to go it alone, making our own decisions and giving ourselves feedback on how things work.

    However maybe there’s a better way. I read this piece about a surgeon that tried a coach and found it to be very helpful. To be fair, I’ve read Dr. Gawande’s book and enjoyed it: The Checklist Manifesto.

    It’s an interesting idea. We often pay teachers and coaches to help us with sports, with some areas of our lives, but most of us don’t bother. I wonder if there’s something that’s worth investing in here professionally.

    I think there is, and that’s probably the easy thing. Finding someone that you trust to be a coach, and you’d be willing to pay.

  • Anonymous Research

    Anonymity is important

    It’s no secret that anonomizing data doesn’t always work well. We have heard about this when Netflix released their data for people to build algorithms with. Some people were identified based on the data released being correlated with other data the people had entered on the Internet themselves. I know that there are dangers with sharing too much information on the Internet, but people are going to share and there will only be more services in the future for us to use that require data.

    I ran across a post recently from Microsoft researchers that showed similar issues with other anonymous data sets that contain IP information. A number of logs containing traffic from Bing and Hotmail were analyzed with the intention of identifying particular hosts. Even when the data was anonymized, it was possible to identify hosts with a high degree of accuracy.

    You might not think this is a big deal, but as more data is gathered by companies and used for secondary purposes, like analysis, it becomes more likely to be inappropriately released. Is a log on a server more secure, or a copies of multiple logs on analysts’ laptops? I’d think the former, or at least I’d hope the former. If that’s true, then we should really be anonymizing data on a regular basis once it leaves hardened server machines.

    That means we ought to have better algorithms for preventing any identifying information from being retrieved. I would hope that this is an area where research can help, and one that receives a lot of attention in the near future.

    Steve Jones

    The Voice of the DBA Podcasts

    We publish three versions of the podcast each day for you to enjoy.

  • Hardware Fun

    This has been a bit of a hardware week for me, which is strange. I used to love hardware, building my own computers, picking out the components, and making something work out of a pile of parts.

    Now I just want my tools to work.

    Our Windows Home Server died a few months ago. This is the third time I’d lost a boot drive in the WHS server, though to be fair I was reusing a few older drives in it. However when you lose the boot drive, not only do you need to reload WHS, but it can’t reload your content from the old drives. The drive extender technology is flawed, which is why it might be cut loose from the WHS 2011 product.

    I’ve delayed actually rebuilding things, but with my wife traveling one week, the kids occupied, I took it apart and connected the drives one at a time to check how things were working. They all connected and seemed to work, which was strange. Perhaps bad blocks?

    I reconnected the 160GB drive as the boot drive, since that was the smallest, added in two 1TB drives in a RAID 1 array, and a 1TB drive as a spare. I booted to WHS 2011, but it promptly failed. This is a Dell E521, an AMD x64 CPU, but it didn’t want to load. No problem, I was planning on virtualizing anyways.

    I booted to Windows 7 x64, and got through the initial install, but on boot, the 160GB drive failed. Aha! I removed that, replaced with a 1TB drive, and reloaded Windows 7.

    Only to find that there aren’t x64 drivers for a number of components for Win 7. Grrrr. This is why I don’t like to mess with hardware. I want stuff to just work.

    I fell back to Windows XP, x64 (since I want 64 bit guests) and got that installed. I had RAID drivers, but for some reason Windows setup doesn’t want to install them or load onto a RAID set. That feels like a waste of the purpose of hardware RAID, but whatever.  I got Windows loaded, patched, drivers installed, and added Virtual Box 4.

    Then the harder part. I created a guest on my R1 array, which too time for VirtualBox to format the drive. Once it was done, however, I booted up a guest, installing WHS 2007 on there and connecting to the network. I killed the host firewall, and bridged the network adapter. Not sure which one fixed things, but I don’t do anything on the host, and it’s firewalled from the outside world.

    Now I had two spare 2TB drives from the old system, where I copied off the pictures, video, and music to my desktop. A long transfer process in the background added them to the WHS server, and I have a home network again.

    It’s RAID protected, so I should be OK for now, but we’ll see what happens. I have an external enclosure with 2 2TB drives in it, but I don’t want to add them for now. At least until I need more space.