Voice of the DBA
Writings from Steve Jones, the Voice of the DBA
Skip to content
  • Home
  • About The Voice of the DBA
  • Talks
  • Speaking Schedule
  • Speaking CV
  • Keynote Talks
  • T-SQL Tuesday
← Daily Coping 30 Sep 2020
Running Express Edition in a Container–#SQLNewBlogger →

The Value of Metadata

Posted on September 30, 2020 by way0utwest

A long time ago, nearly two decades ago, I had a manager come ask me about metadata, specifically, what it was. This was a technical manager, who understood software well but wasn’t a data expert. I tried to explain data about data, but at that time, the world primarily dealt with client-server type technologies, with data being something that was primarily about a think. Metadata like types, scales, etc., weren’t seen as that useful. Descriptive items, like we might store in the MS_Description extended property, were rare.

Today, we use metadata quite often, and I think in many ways we’ve “consumer-ized” metadata with tagging and other structures that let the users of our software add descriptive attributes to the data they store in our systems. In some sense, we get metadata at a deeper level, almost the row or cell level from actual users, as if we were tracking column or entity level markers.

There is a lot of value in this metadata, both to the technical staff and to business users. This article talks about the value of having detailed metadata for data scientists and similar roles, where understanding the meaning of the data can be very valuable. The more focused data scientists and analysts can be, and the easier with which they can find data, the more productive they can be.

At Redgate, we work with customers all over the world, but it’s outside the US where we’ve seen the value of metadata grow. Primarily in response to the GDPR, we find many business people want to know about their data, it’s meaning, it’s sensitivity, and really, the risk of data loss. This has expended into our Data Catalog and Data Masker products, which exist to help organizations keep track of their data. It’s a big job, one that isn’t fun, and often has debatable value when starting from the beginning. It can be a large time sink when one person has to track down the meanings of all the data in databases. It’s also not a very interesting job.

Many find, however, that knowing this information can be quite useful when it’s available. Archive plans, decisions on masking data, even choosing technologies for protection become more focused when you know what data you have. We continue to research and work on finding ways to improve the help software gives users in applying this metadata, as do many others. Privacy and compliance have driven a lot of work in this area, but potentially data science, data lineage, security, and more could find ways to use this information in all our organizations.

The one thing I think is important is that we maintain this information as a part of our regular work. Customers might do some metadata work themselves (which can be extremely valuable information), but asking most people to classify and tag lots of information is a mind-numbing job. It’s better if we can tag sections of data as we add features to software, whether as developers, or someone else as a part of the software process. That way, when someone goes looking, most data is already partially tagged.

Steve Jones

Listen to the podcast at Libsyn, Stitcher or iTunes.

Share this:

  • Twitter
  • LinkedIn
  • Reddit
  • Print
  • More
  • Email
  • Facebook
  • Tumblr

Like this:

Like Loading...

Related

About way0utwest

Editor, SQLServerCentral
View all posts by way0utwest →
This entry was posted in Editorial and tagged metadata. Bookmark the permalink.
← Daily Coping 30 Sep 2020
Running Express Edition in a Container–#SQLNewBlogger →
  • Search this blog

  • The Current Book – Do Hard Things

  • MVP Award

  • Tags

    • administration
    • AI
    • auditing
    • Azure
    • backup
    • Backup/Recovery
    • blogging
    • business
    • career
    • career2
    • car update
    • Cloud Computing
    • conferences
    • containers
    • continuous delivery
    • continuous integration
    • coping
    • data
    • data analysis
    • database design
    • databases
    • Database Weekly
    • data privacy
    • dbatools
    • DevOps
    • disaster recovery
    • DLM
    • encryption
    • Friday Poll
    • GDPR
    • Git
    • goals
    • hardware
    • high availability
    • Humor
    • life
    • Linux
    • machine learning
    • mcm
    • Microsoft
    • misc
    • monitoring
    • networking
    • NoSQL
    • PASS
    • Performance
    • powershell
    • presentations
    • Redgate
    • republish
    • sabbatical
    • security
    • software development
    • software development
    • speaking
    • SQL Compare
    • SQL in the City
    • SQLNewBlogger
    • SQL Prompt
    • SQL Saturday
    • sql server
    • SQLServerCentral
    • SSMS
    • syndicated
    • T-SQL
    • T-SQL Tuesday
    • Tesla
    • testing
    • travel
    • tsqlt
    • vacation
    • version control
    • webinar
    • windows
    • work
  • Search this blog

  • Steve’s Tweets

    • Experimenting with RedisGraph on Docker and Windows voiceofthedba.com/2023/03/23/exp… 21 minutes ago
    • Resources for Adding Graph Structures to Your Database at VS Live voiceofthedba.com/2023/03/23/res… 59 minutes ago
    • Resources for Architecting Zero Downtime Deployments voiceofthedba.com/2023/03/23/res… 6 hours ago
    • Daily Coping 23 Mar 2023 voiceofthedba.com/2023/03/23/dai… 8 hours ago
    • @KoprowskiT Indeed. We aren't looking for only one blog from one person on each topic. Your blog is there to showcase your knowledge 1 day ago
    • #sqlsat South Florida is coming on June 3. The CFS is open and they are looking for speakers. A great place to vaca… twitter.com/i/web/status/1… 1 day ago
    • A packed room for @bobwardms at @VSLive https://t.co/ki4nfVq4qg 1 day ago
    • @jasonhorner Cheers. 1 day ago
    • administration
    • AI
    • auditing
    • Azure
    • backup
    • Backup/Recovery
    • blogging
    • business
    • career
    • career2
    • car update
    • Cloud Computing
    • conferences
    • containers
    • continuous delivery
    • continuous integration
    • coping
    • data
    • data analysis
    • database design
    • databases
    • Database Weekly
    • data privacy
    • dbatools
    • DevOps
    • disaster recovery
    • DLM
    • encryption
    • Friday Poll
    • GDPR
    • Git
    • goals
    • hardware
    • high availability
    • Humor
    • life
    • Linux
    • machine learning
    • mcm
    • Microsoft
    • misc
    • monitoring
    • networking
    • NoSQL
    • PASS
    • Performance
    • powershell
    • presentations
    • Redgate
    • republish
    • sabbatical
    • security
    • software development
    • software development
    • speaking
    • SQL Compare
    • SQL in the City
    • SQLNewBlogger
    • SQL Prompt
    • SQL Saturday
    • sql server
    • SQLServerCentral
    • SSMS
    • syndicated
    • T-SQL
    • T-SQL Tuesday
    • Tesla
    • testing
    • travel
    • tsqlt
    • vacation
    • version control
    • webinar
    • windows
    • work
  • Older Posts

  • Meta

    • Register
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.com
  • Recent Posts

    September 2020
    M T W T F S S
     123456
    78910111213
    14151617181920
    21222324252627
    282930  
    « Aug   Oct »
  • Archives

  • Copyright Steve Jones 2018

    All content on this site is copyrighted by Steve Jones. Republication or reproduction is not allowed without permission.

  • Follow Voice of the DBA on WordPress.com
  • Copyright 2016

    All content on this site is copyrighted by Steve Jones. No permission to re-publish or re-produce is given without permissions.
  • Meta

    • Register
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.com
Voice of the DBA
Blog at WordPress.com.
  • Follow Following
    • Voice of the DBA
    • Join 206 other followers
    • Already have a WordPress.com account? Log in now.
    • Voice of the DBA
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
  • Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
    To find out more, including how to control cookies, see here: Our Cookie Policy
  • %d bloggers like this: