Voice of the DBA
Writings from Steve Jones, the Voice of the DBA
Skip to content
  • Home
  • About The Voice of the DBA
  • Talks
  • Speaking Schedule
  • Speaking CV
  • Keynote Talks
  • T-SQL Tuesday
← Daily Coping 30 Sep 2020
Running Express Edition in a Container–#SQLNewBlogger →

The Value of Metadata

Posted on September 30, 2020 by way0utwest

A long time ago, nearly two decades ago, I had a manager come ask me about metadata, specifically, what it was. This was a technical manager, who understood software well but wasn’t a data expert. I tried to explain data about data, but at that time, the world primarily dealt with client-server type technologies, with data being something that was primarily about a think. Metadata like types, scales, etc., weren’t seen as that useful. Descriptive items, like we might store in the MS_Description extended property, were rare.

Today, we use metadata quite often, and I think in many ways we’ve “consumer-ized” metadata with tagging and other structures that let the users of our software add descriptive attributes to the data they store in our systems. In some sense, we get metadata at a deeper level, almost the row or cell level from actual users, as if we were tracking column or entity level markers.

There is a lot of value in this metadata, both to the technical staff and to business users. This article talks about the value of having detailed metadata for data scientists and similar roles, where understanding the meaning of the data can be very valuable. The more focused data scientists and analysts can be, and the easier with which they can find data, the more productive they can be.

At Redgate, we work with customers all over the world, but it’s outside the US where we’ve seen the value of metadata grow. Primarily in response to the GDPR, we find many business people want to know about their data, it’s meaning, it’s sensitivity, and really, the risk of data loss. This has expended into our Data Catalog and Data Masker products, which exist to help organizations keep track of their data. It’s a big job, one that isn’t fun, and often has debatable value when starting from the beginning. It can be a large time sink when one person has to track down the meanings of all the data in databases. It’s also not a very interesting job.

Many find, however, that knowing this information can be quite useful when it’s available. Archive plans, decisions on masking data, even choosing technologies for protection become more focused when you know what data you have. We continue to research and work on finding ways to improve the help software gives users in applying this metadata, as do many others. Privacy and compliance have driven a lot of work in this area, but potentially data science, data lineage, security, and more could find ways to use this information in all our organizations.

The one thing I think is important is that we maintain this information as a part of our regular work. Customers might do some metadata work themselves (which can be extremely valuable information), but asking most people to classify and tag lots of information is a mind-numbing job. It’s better if we can tag sections of data as we add features to software, whether as developers, or someone else as a part of the software process. That way, when someone goes looking, most data is already partially tagged.

Steve Jones

Listen to the podcast at Libsyn, Stitcher or iTunes.

Share this:

  • Twitter
  • LinkedIn
  • Reddit
  • Print
  • More
  • Email
  • Facebook
  • Tumblr

Like this:

Like Loading...

Related

About way0utwest

Editor, SQLServerCentral
View all posts by way0utwest →
This entry was posted in Editorial and tagged metadata. Bookmark the permalink.
← Daily Coping 30 Sep 2020
Running Express Edition in a Container–#SQLNewBlogger →
  • Search this blog

  • Data Community Summit Registration
  • The Current Book

  • MVP Award

  • Tags

    • administration
    • AI
    • auditing
    • Azure
    • backup
    • Backup/Recovery
    • blogging
    • business
    • career
    • career2
    • car update
    • Cloud Computing
    • conferences
    • containers
    • continuous delivery
    • continuous integration
    • coping
    • data
    • data analysis
    • database design
    • databases
    • Database Weekly
    • data privacy
    • dbatools
    • DevOps
    • disaster recovery
    • DLM
    • encryption
    • Friday Poll
    • GDPR
    • Git
    • goals
    • hardware
    • high availability
    • Humor
    • life
    • Linux
    • machine learning
    • mcm
    • Microsoft
    • misc
    • monitoring
    • networking
    • NoSQL
    • PASS
    • Performance
    • powershell
    • presentations
    • Redgate
    • republish
    • sabbatical
    • security
    • software development
    • software development
    • speaking
    • SQL Compare
    • SQL in the City
    • SQLNewBlogger
    • SQL Prompt
    • SQL Saturday
    • sql server
    • SQLServerCentral
    • SSMS
    • syndicated
    • T-SQL
    • T-SQL Tuesday
    • Tesla
    • testing
    • travel
    • tsqlt
    • vacation
    • version control
    • webinar
    • windows
    • work
  • Search this blog

  • Steve’s Tweets

    • @bweissman @sqlatspeed @DataGrillen Patch Friday 9 hours ago
    • @sqlatspeed @DataGrillen In a boot 9 hours ago
    • @TheHybridDBA Cheers my friend. It's all good. The ankle has been a mess for years. Finally getting fixed 9 hours ago
    • @DJWhiteSquall That sucks. Hopefully it wasn't too a stressful 11 hours ago
    • @IrishSQL Thanks. Should be a quick fix Friday morning 15 hours ago
    • RT @BrentO: [Blog] Breaking News: SQL 2019 CU16 Changes Backup Formats, Can Break Log Shipping. brentozar.com/archive/2022/0… 16 hours ago
    • Enjoying @TechoramaBE but these baby coffee cups are a bit small. I shouldn't see my fist. https://t.co/ORn9vdzwi1 16 hours ago
    • Negative. Now I get to fly home and get the ankle fixed https://t.co/fbKkNXBn4k 16 hours ago
    • administration
    • AI
    • auditing
    • Azure
    • backup
    • Backup/Recovery
    • blogging
    • business
    • career
    • career2
    • car update
    • Cloud Computing
    • conferences
    • containers
    • continuous delivery
    • continuous integration
    • coping
    • data
    • data analysis
    • database design
    • databases
    • Database Weekly
    • data privacy
    • dbatools
    • DevOps
    • disaster recovery
    • DLM
    • encryption
    • Friday Poll
    • GDPR
    • Git
    • goals
    • hardware
    • high availability
    • Humor
    • life
    • Linux
    • machine learning
    • mcm
    • Microsoft
    • misc
    • monitoring
    • networking
    • NoSQL
    • PASS
    • Performance
    • powershell
    • presentations
    • Redgate
    • republish
    • sabbatical
    • security
    • software development
    • software development
    • speaking
    • SQL Compare
    • SQL in the City
    • SQLNewBlogger
    • SQL Prompt
    • SQL Saturday
    • sql server
    • SQLServerCentral
    • SSMS
    • syndicated
    • T-SQL
    • T-SQL Tuesday
    • Tesla
    • testing
    • travel
    • tsqlt
    • vacation
    • version control
    • webinar
    • windows
    • work
  • Older Posts

  • Meta

    • Register
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.com
  • Recent Posts

    September 2020
    M T W T F S S
     123456
    78910111213
    14151617181920
    21222324252627
    282930  
    « Aug   Oct »
  • Archives

  • Copyright Steve Jones 2018

    All content on this site is copyrighted by Steve Jones. Republication or reproduction is not allowed without permission.

  • Follow Voice of the DBA on WordPress.com
  • Copyright 2016

    All content on this site is copyrighted by Steve Jones. No permission to re-publish or re-produce is given without permissions.
  • Meta

    • Register
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.com
Voice of the DBA
Blog at WordPress.com.
  • Follow Following
    • Voice of the DBA
    • Join 11,954 other followers
    • Already have a WordPress.com account? Log in now.
    • Voice of the DBA
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.
  • Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
    To find out more, including how to control cookies, see here: Our Cookie Policy
  • %d bloggers like this: