Tag: Cloud Computing

  • No Limits

    Google Compute Engine
    No limits for the Google Compute Engine, at least not any practical limits.

    We’ve had Amazon Web Services (AWS) available for some time, and used for some interesting projects that wouldn’t be possible if groups had to purchase their own equipment. From password cracking to cancer research, there are some amazing possibilities. Windows Azure works as well, and there are customers such as banks, using the cloud to perform complex analysis of data. Not to be left out, Google announced recently they were provide their Google Compute Engine to anyone, without any limits on scale. You have to pay for it, but if you want 770,000 cores to solve a problem, they’ll provide them if you can pay for the resources. It’s US$2m/day, but it’s there.

    I don’t know what that means for us as data professionals, but I suspect there will be any number of companies that will consider using these types of resources to work on complex analysis of problems. Running a simulation might be something that costs a few hundred dollars a day, using resources for minutes at a time. Looking over some of the different projects people have used cloud computing engines for, it seems that many businesses might find this to be a cost effective way to perform data mining or BI type workloads.

    If you can get the data to the engine. I still wonder how challenging this is, apart from all the security concerns. Just moving that much data around, refreshing it, removing the stale data, could be very complex. It concerns me that as more people attempt this type of work, we will have more and more poor decisions made because of data quality, age, or accuracy. After all, garbage in, garbage out has been a tenet of data professionals for decades.

    If you’re using cloud resources for computation, I’d love to know about it. I know many of the data professionals out there have reservations, and that’s healthy. It shouldn’t blind you to the possibilities that this is a most cost effective way of actually getting analysis and answers for your users.

    Steve Jones


    The Voice of the DBA Podcasts

    We publish three versions of the podcast each day for you to enjoy.

  • No Limits

    Google Compute Engine
    The Google Compute engine isn’t unlimited, but it’s got 770,000 cores and growing.

    We’ve had Amazon Web Services (AWS) available for some time, and used for some interesting projects that wouldn’t be possible if groups had to purchase their own equipment. From password cracking to cancer research, there are some amazing possibilities. Windows Azure works as well, and there are customers such as banks, using the cloud to perform complex analysis of data. Not to be left out, Google announced recently they were provide their Google Compute Engine to anyone, without any limits on scale. You have to pay for it, but if you want 770,000 cores to solve a problem, they’ll provide them if you can pay for the resources. It’s US$2m/day, but it’s there.

    I don’t know what that means for us as data professionals, but I suspect there will be any number of companies that will consider using these types of resources to work on complex analysis of problems. Running a simulation might be something that costs a few hundred dollars a day, using resources for minutes at a time. Looking over some of the different projects people have used cloud computing engines for, it seems that many businesses might find this to be a cost effective way to perform data mining or BI type workloads.

    If you can get the data to the engine. I still wonder how challenging this is, apart from all the security concerns. Just moving that much data around, refreshing it, removing the stale data, could be very complex. It concerns me that as more people attempt this type of work, we will have more and more poor decisions made because of data quality, age, or accuracy. After all, garbage in, garbage out has been a tenet of data professionals for decades.

    If you’re using cloud resources for computation, I’d love to know about it. I know many of the data professionals out there have reservations, and that’s healthy. It shouldn’t blind you to the possibilities that this is a most cost effective way of actually getting analysis and answers for your users.

    Steve Jones


    The Voice of the DBA Podcasts

    We publish three versions of the podcast each day for you to enjoy.

  • Leveling the Field

    Level Playing Field
    Cloud computing can level the field between large and small businesses

    I like small companies. If I had my choice, I’d prefer to work in a small company rather than a large one. I get to know more people, there’s less friction to getting things done, people can make decisions, and I get to do more cool stuff. My budget is smaller, but creativity is often encouraged when solving problems. As I read about some of the cool stuff that startups are doing, it reminds me of a few places I’ve worked.

    One of the challenges with small companies and their software has always been cost. A lot of companies look to Open Source products to cut down on their investments for this reason. However if there weren’t such a high price to the software, I think many companies would go with the “brands” of software that many of us work with every day.

    I remember working for a small company and being in charge of rewriting their inventory and sales system. As we were preparing to program the system, an SAP sales rep called our company and made a pitch to the owner. He was impressed and we spent a few weeks looking at SAP. We knew we couldn’t afford the full SAP software, much less purchasing the multiple servers it would take to run it, but SAP had just released a cut-down version of their software, running on one server, for small businesses. We didn’t buy it then, and I’m glad because we had a unique business model that really benefited from custom programming.

    These days all sorts of companies are looking to get started in new areas, or trying new ideas. Many of them don’t necessarily want to make large IT investments. It’s not only hardware and software, but also the IT expertise to manage the systems. If I were starting a business, or even working with a small business as a developer, I’d seriously consider cloud services. The breadth of offerings and features, the low investment cost, and lack of administration needed really level the playing field between what a small company and a large one can do with technology.

    There are opportunities here. If you’re looking to work with a small business, or start one of your own, look at cloud offerings. You might be surprised what you can get for very little initial investment.

    Steve Jones


    The Voice of the DBA Podcasts

    We publish three versions of the podcast each day for you to enjoy.

  • Clouds, Costs, and Data Analytics

    cloud computing costs
    The costs of cloud computing should be lower than on-premises computing, if you pay attention.

    There are more and more companies using, or seriously considering, cloud based services. It’s a way to reduce some of the infrastructure costs, especially the initial investment costs, for many applications that have highly variable workloads. There’s also the tremendous amount of media attention being given to the subject of cloud services, which exerts pressure on all decision makers to consider moving to a cloud service.

    However are you really saving money with the cloud? The cost of the hardware and software usually ends up being a small part of the total cost of an application. Renting either hardware or software is an ongoing expense. It can have tax implications, and the calculations can be complex. It is important to analyze the costs and track what is being spent over time, as well as analyzing the amount of resources you use to determine if this is a good business decision.

    Apparently quite a few people realize this as there are a whole slew of companies that are willing to help you track, monitor and even analyze your costs. This article lists a number of them, some that even look to save you money where possible. That’s good because the calculators from some of the cloud vendors are extremely confusing. Not only that, but they’re relatively static calculators, whose values may change over time.

    Getting at your cloud data, and building a calculator of sorts is something most of us could do, but would we want to maintain it? Do you want to enhance it over time to work with the changing nature of the cloud? I’d think these services are worth using if you plan to use the cloud, especially those that analyze usage and suggest places to cut costs. There are lots of good and bad things about the cloud, but one thing is certain: you need to make sure someone is tracking your usage and eliminating unused systems. Otherwise you might not find yourself with any cost savings at all.

    Steve Jones


    The Voice of the DBA Podcasts

    We publish three versions of the podcast each day for you to enjoy.