Voice of the DBA

Author: way0utwest

  • API Changes

    Not the best API documentation

    There’s an interesting set of predictions about the possible new APIs (application programming interfaces) that we may see in the future. It’s a look forward into 2012, and a guess that setting standard ways in which we can build systems will become more important in the future. There were two items that I found of particular interest to the data professional.

    The first was the idea that we might have more data APIs in the future, designed to make the exchange of data easier. The people that work with data imports and exports have probably been hoping for his to become more prevalent, and it has gotten better. However I do think that data is becoming the most important part of the technology world. It isn’t the software, or the platform, or the device, but the data that’s available that is the most valuable part of a technology system.

    It isn’t likely that any company can create and manage all this data themselves, especially in a rapidly evolving world where so much of it changes from day to day. A successful business will need to acquire data from other sources and easily integrate the information into its systems,, and an API will make this process smoother. I expect that standards like OData will become something that we work with more in the future.

    The second interesting part of the article talked about the possibility of us seeing more Enterprise APIs, developed and built by individual customers so that their systems can be more easily integrated with others. That would seem to be counterintuitive, but with so much knowledge and talent available outside your company from others that want to build apps to interact with you, I expect this may catch on, at least for those companies that see a demand from partners and customers. One very valuable effect of building an API? You get more data on how your customers use your API, allowing you to better understand how your company might change to enhance its performance.

    Building an API means setting a standard, one you have to support and maintain for years. It can evolve, but the core elements of it will live for a long time, so it helps to gain experience here. Think about providing APIs as you develop software inside yout company, rather than just assuming you’ll build all the functionality needed.

    Steve Jones

    The Voice of the DBA Podcasts

    We have one version of the podcast back and are working to get the others back soon.

  • Going Solo

    This editorial was originally published on Mar 20, 2007. It is being republished as Steve Jones is on vacation. 

    Are you ready to leave the corporate world and become a consultant? It’s a tempting thought and probably one that everyone in corporate America considers at one time or another. Especially those of us in technology who have skills that can easily be used to help some other company.

    Here are 10 reasons not to go into business for yourself, which is an interesting list. It’s from someone who evangelizes the benefits, joys, and methods of escaping the corporate cubicle. If you’re seriously considering becoming a consultant, starting your own business, or going out in any way on your own, I’d recommend her site as a place to learn some things.

    Coming from someone that helped start this site and has worked for it for 3 years this might sound funny. I don’t really like being in business for myself. I know, I’ve been successful, had a good life, let you all know about large parts of it, but the truth is I didn’t love working for myself. If not for Andy and Brian supporting me, I’m not sure I’d have done it.

    Working for yourself, even when you’re successful, isn’t this easy, amazing job. It’s a hassle and it’s hard to worry about the different parts of a business. I’m a writer and a techie. As much as I pay attention to marketing, sales, and other groups, I don’t want to do their jobs. I have an opinion and am happy to express it, but I don’t want to get more involved than that.

    I’m not really advocating one way or the other that you should or shouldn’t start a business or stay in a cubicle. Rather I want to caution you that it’s not as easy as tuning queries. The marketing, accounting, and collections will be as much as the job as the T-SQL.

    Read about other’s experiences, think hard about it, and consider all the parts of the job that you’ll need to do. There’s always more than you think and remember that just as with a new job in corporate America.

    The grass is not always greener.

    If you want to go into consulting, read this book.

  • Feedback and Big Data

    Data Feedback loop
    The Data Feedback Loop

    How do we improve the way we do things? We measure them, observe, make a change based on our observation, measure again, and then repeat, looking to make our process, product, or idea better over time. We design our software this way as well, especially in any of the rapid and agile development methodologies. We get feedback as we make changes, adapating our efforts to improve the end product.

    We should be doing this with data as well, especially as we start to drown in waves and waves of data that grow over time. This piece from Alistair Croll talks about the ways in which we can adapt feedback to our data process. The various parts of the feedback loop, from collection to storage to analysis are all challenges we face as we start to encounter Big Data.

    The challenges that companies will face as they try to find competitive advantages in all their data create huge opportunities for those of us working as data professionals. Whether we learn how to better manage the storage of data, we study techniques for pattern recognition or machine learning from large data sets, or we find ways to present complex data to humans for deeper analysis, this is a good time to work with databases.

    We have seen SQL Server evolve and grow, and become incredibly complex. It’s expanded into spreadsheets (PowerPivot), high speed data collection (StreamInsight), and even other platforms (Hadoop). It’s too much for any one person to master, but the complexity and breadth of the platforms gives you the chance to pick an area that interests you. You can learn a bit about the whole feedback loop for data, specialize in the area that speaks to you, and hopefully have a challenging, interesting, and successful career.

    Steve Jones

    The Voice of the DBA Podcasts

    We are experiencing issues with our podcast hosting provider. We are working to resolve the problems and get the podcasts back as soon as we can.

  • T-SQL Tuesday #027 – Invitation to The Big Data Valentine’s Edition

    tsqltuesdayIt’s T-SQL Tuesday time again, and I’m honored to be able to host the party for February 2012. This is my second time hosting, with the first being #013.

    T-SQL Tuesday is the brainchild of Adam Machanic, who hosted the very first blog party. If you’d like to be a host, contact Adam on his blog. The complete list of older topics is here: T-SQL Tuesday Topics – February 2012, so you can pick a new one if you’d like to host.

    Note, this is advance notice. The party is NOT today, it’s next week, February 14, 2012.

    The Rules

    Here are the rules your post must follow.

    1. Your post must go live between 00:00:00 GMT on Tuesday February 14, 2012 and 00:00:00 GMT on Wednesday February 15, 2012.
    2. Your post must link back to this post, and the link must be anchored from the logo (found above) which must also appear at the top of your post.
    3. Leave a comment or a trackback here on this blog regarding your post.
    4. ‘T-SQL Tuesday #027’ should be included in the title of the post.
    5. If you’re on Twitter, tweet about your post using the hash tag #TSQL2sDay

     

    Big Data

    godivaThe party falls on Valentine’s Day this month, and I thought a little notice would let you get your post done early, and then spend the day with your loved ones

    Since the media has a love affair with Big Data right now, I thought this would make an interesting topic. Data is the lifeblood of our careers and of many organizations. Slowly governments, companies, and individuals are becoming aware of just how important data is to us, and as they do, they want more of it. More storage, more access, and more analysis.

    That creates challenges for us as data professionals. We will have to learn to better manipulate, aggregate, summarize, and handle larger volumes of data in the future. I think this means we will have lots of employment in this area, and it means tremendous opportunity for those that learn to work with data well.

    This month I want to hear what big data problems you’ve solved, or interesting ways of working with big data, challenges that you struggle with, or cool hardware tricks that mask the problems in your code.

    Think big, and let us know how you work with Big Data.