Daily Coping 20 Oct 2020

Posted on October 20, 2020 by way0utwest

I started to add a daily coping tip to the SQLServerCentral newsletter and to the Community Circle, which is helping me deal with the issues in the world. I’m adding my responses for each day here.

Today’s tip is to make a list of things you are looking forward to.

I look forward to life, but a relatively short term list is here:

  1. November Denver SQL Server User Group talk
  2. A volleyball tournament in Denver in March (fingers crossed)
  3. Hawaii – planning on Jan.
  4. Getting on the slopes this winter
  5. Getting another car when kids grow up and get their own jobs next year.
Posted in Blog | Tagged , , | Comments Off on Daily Coping 20 Oct 2020

Azure DevOps–Reconfiguring an Agent

Posted on October 19, 2020 by way0utwest

This post looks at how to re-configure a local Azure DevOps agent when you need to change to a new pool or organization.

PAT Expired

I got a note that one of my personal access tokens (PAT) had expired, and I wanted to update the agent. I ran config, but saw this, I need to remove the config first.

However, when I ran “config remove”, which is how you can reconfigure an agent, I got this:

2020-10-12 10_04_34-cmd

In the image, the agent config asks for the PAT to allow it to authenticate to be removed. Since the agent doesn’t store this, and I don’t have it anymore, I can’t enter this. I can remove the agent from the portal, but there’s an easier way.

The Local Config

If you show hidden files, and if you are in tech, you always ought to do this, you will see a few in the agent folder. I name mine Agent, and inside, you can see there are .agent, .credentials, and .credentials_rsaparams files.

2020-10-12 10_17_22-agent

If I remove these three files, the agent doesn’t know where or how to connect. I can then run the config and re-set up the agent.

Posted in Blog | Tagged , | 2 Comments

Chopping Off Data

Posted on October 19, 2020 by way0utwest

Do you know the difference between XLS and XLSX? They’re both Excel formats, and many of us might just use one or the other. After all, the latest versions of Excel work with both, and if you’ve been using a spreadsheet for years, perhaps you stick with the older format when exchanging data with others.

As many of you might have seen, Public Health England recently learned there is a difference with large amounts of data. They found data was being chopped off in a spreadsheet because they were using the old XLS format, which only supports 65k rows. The newer XLSX format will support a million rows, but both numbers are far below what SQL Server, MySQL, PostgreSQL, and other platforms support. Those platforms support billions, and most are limited only by the storage available.

I know that pandemic has had many groups scrambling to assemble and analyze data. We have people building dashboards and gathering data together in numerous ways, from paper and pencil to Excel to (hopefully) enterprise databases. An import into a relational store would make more sense than Excel, but I also understand that setting a schema, dealing with ETL and different formats from different sources, and other issues are a pain. There is a reason data professionals get paid a lot of money for these tasks.

To me, this highlights one of the issues of working with SQL Server, MySQL, PostgreSQL, etc., in that they are cumbersome and difficult to get started with. Even if scientists chose Cassandra or MongoDB, there would be issues, because there aren’t easy, simple client tools that facilitate work with data sets coming in disparate text files and formats.

I don’t mean to excuse this, because IT professionals should know better. If you’re using XLS, stop. Data volumes increase and you don’t want to realize you’ve hit the limit after data is lost.

I get the ease and convenience of using Excel, but stop using it for major projects once we realize these are important. Once you realize this is data that needs to be intact, secured, and protected, put it in a real platform. Excel, PowerBI, and most tools can query SQL Server.

Use those tools where you need them and where you can, just don’t use them as your database.

Steve Jones

Listen to the podcast at Libsyn, Stitcher or iTunes.

Posted in Editorial | Tagged , | Comments Off on Chopping Off Data

Daily Coping 19 Oct 2020

Posted on October 19, 2020 by way0utwest

I started to add a daily coping tip to the SQLServerCentral newsletter and to the Community Circle, which is helping me deal with the issues in the world. I’m adding my responses for each day here.

Today’s tip is to share your most important goals with the people you trust.

There are not a lot of people that I really trust and want to share some goals with. It’s a few, and really, this is a time when I’m re-evaluating my life and goals. I have a son out of college, another in his last year, and a daughter in college. I can see the end of financial responsibility outside of my wife and I.

Therefore, I am starting to look at life, goals, and plans in a new way. I get on a plane tomorrow with my wife, taking a vacation to visit some family. While we’re traveling, I’m looking forward to some time with just my wife where we can talk about life, some plans, and start to think about what’s important to us in the next decade.

Posted in Blog | Tagged , , | Comments Off on Daily Coping 19 Oct 2020