Long Term Storage

Posted on June 24, 2022 by way0utwest

Data storage has always been a concern for data professionals. Early on in my career, we dealt with large ESDI, IDE, and SCSI drives, all of which would fail unexpectedly in servers. Sometimes after a few years, sometimes after a few weeks. We learned to use RAID and tape backups to ensure that our data was recoverable.

In many places tape was the long term storage medium used. These days, I know many people have moved to secondary disk storage of some sort, often rotating data across a few disk types that give you recovery for days, weeks, or longer. I don’t know how long term storage work in Azure or AWS, but I assume some sort of combination of technologies are in use. I also know I don’t trust them completely to be readily available and recoverable after a few years.

For most of us, database backups aren’t really relevant after some number of weeks or months. We usually just don’t need to recover things from long term storage. The exception might be for some types of data that do need to archived for legal or financial purposes. I know we used to keep a end of year tape for 7 years after we’d closed the financial records at one company. I don’t know if that would be the case today, especially with so many “digital records” of transactions. Would we really need to recreate a system as it looked on a particular day from 5 years ago?

However, there are types of data that we might want to archive for a long time. An example might be the arts, where we have lots of music and video that can preserved. There might be other records, such as historical government records, which are suitable for WORM (write-once-read-many) systems.

A new type of recording uses glass and may provide archival storage for thousands of years. Obviously we don’t know this is the case as we haven’t been recording digital information for thousands of years, but it’s an interesting medium. It also doesn’t require the algorithms to be maintained as the idea is machine learning systems can read back the data and learn to interpret it.

To me, that might be the most interesting part of this project. Using computers to learn to read the data rather than requiring us to know have an MP3 player, a database system like SQL Server, or any other particular technology. Instead, we can let the computer learn how to read the data and then play back that recording of Prince in the year 3510.

Steve Jones

Listen to the podcast at Libsyn, Stitcher, Spotify, or iTunes.

Posted in Editorial | Tagged | Comments Off on Long Term Storage

Daily Coping 24 Jun 2022

Posted on June 24, 2022 by way0utwest

I started to add a daily coping tip to the SQLServerCentral newsletter and to the Community Circle, which is helping me deal with the issues in the world. I’m adding my responses for each day here. All my coping tips are under this tag.

Today’s tip is to get outside and find joy in being active.

My ankle is doing better. I managed to go this whole week without a cane for assistance, including a work trip to Austin.

I took advantage of this to walk alongside the Colorado River in Austin. enjoying the cool(er) evening air. Since I’ve been limited in my mobility, this was a great chance to enjoy the outdoors in a very neat place, watching people enjoying the city life and the river.

Posted in Blog | Tagged , , | Comments Off on Daily Coping 24 Jun 2022

Daily Coping 23 Jun 2022

Posted on June 23, 2022 by way0utwest

I started to add a daily coping tip to the SQLServerCentral newsletter and to the Community Circle, which is helping me deal with the issues in the world. I’m adding my responses for each day here. All my coping tips are under this tag.

Today’s tip is to look for something good in a difficult situation.

I had ankle surgery a few weeks back. Actually, it’s almost a month and things are going well. However, the first two weeks I was in a boot and supposed to avoid weight bearing where possible. The next week was beginning rehab, but still being careful how much I used the joint.

In that time, I had to travel to Germany, camped in Nebraska, and flew to Austin. Across those trips, I had to maneuver with a cane and wheelchair, navigate planes, steps, ferries, trains, carry bags, and more. It was certainly difficult at times. My ankle ached, My right arm and wrist were sore from using the cane to support myself, and I was slow. I couldn’t do things that I normally do, or if I could, I moved at half speed.

Still, I got to go to Germany and speak at a conference. I got to go camping with my family and enjoy a beautiful view of nature. I got to go to Austin, speak at an event, meet people, and see my cousin.

I had a lot of good, even if it was difficult.

Posted in Blog | Tagged , , | Comments Off on Daily Coping 23 Jun 2022

A Big Year on the Road

Posted on June 22, 2022 by way0utwest

Someone asked me recently about my travels this year, and I listed out the trips I’ve taken. So far, I’ve been to these airports on trips away from home:

  • LHR
  • SYR
  • LAS
  • ORD
  • RNO
  • LAX
  • JAX
  • LHR
  • BRU
  • AMS
  • AUS
  • AUS (2nd trip)

Today I’m in Austin for for the second week in a row, this time visiting the Redgate office space.

Still to come this year, that I know of, are these:

  • EWR
  • SEA
  • LAX
  • HNL
  • LHR
  • SYR
  • YYC
  • MCO
  • MCI
  • SEA

There are a couple other possibilities,. including 1 or 2 more LHR trips. I’ll also likely get another LAX and AUS trip in somewhere to visit Redgate offices.

I don’t know if this will be the biggest year of travel for me. In 2019, I flew 144k miles in the air. My current total from this query of data I keep:

SELECT top 10
  YEAR(u.Transaction_Date) AS FlightYear
  , SUM(u.PQM)
  , SUM(u.miles)
  FROM dbo.United AS u
  WHERE u.Activity_Type = 'Airline'
  GROUP BY YEAR (u.Transaction_Date)

is 118k, but this is with a lot of bonus miles. I’ll need to parse out some of the bonus stuff to figure out how much I fly, but I wouldn’t be surprised if I end up with around 100k miles this year.

Unfortunately, the downloads from the airlines don’t separate out bonus miles, so I think I need a little data modeling adjustment to figure out my trips.

With things reopening, this feels like a big year, and I am looking forward to all of these trips.

Posted in Blog | Tagged | Comments Off on A Big Year on the Road