The AI Budget Assistant

I saw this article about AI helping IT leaders plan their budgets, and I had visions of certain departments getting cut, especially data-related ones. My concern is that a lot of what a DBA does can be acting as insurance or supporting others and not necessarily doing things which are easily visible or that might show up in reports, praise in Slack/Teams, or in other places an AI might be prompted to look. If an IT leader has to decide what’s important for the AI to look at, is data included?

Of course, it’s entirely possible the AI would look at all the performance problems and want to spend more budget on the data side. Fingers crossed for that interpretation.

The idea of an AI looking at a large amount of current data in various spreadsheets, reports, goals, requirements, usage, and more to synthesize a budget makes sense. This is the type of thing many AI-type technologies do well, finding patterns and summarizing the data in a way that assists a human in producing a final report of where to spend money.

Just like any report produced by a human, I would hope that someone reviews the results and verifies the analysis makes sense. However, in reality, I suspect a lot of human reports are passed along as-is, with only a cursory glance. The world of AI might make this worse as we can produce larger and more detailed reports.

The funny thing might be that whoever has to approve the budget might let their GenAI model summarize the budget for accuracy. In that case, do we need humans involved? I can see some managers trying to reduce the staff that might have internal knowledge and replacing them with GenAIs. Will we just have AIs producing things other AIs read and summarize?

Most of us know that garbage in/garbage out is a constant problem in the world of data and reports. Judging data quality and ensuring the accurate (and complete) data is fed into any system is something that humans need to be a part of. An AI model might assist, but humans have context and knowledge that can be hard to craft into a prompt. After all, this might be the training data for your model, and I’m not sure general models will learn well without handholding from humans, especially in specialized areas like budgets.

I’ve had to build budgets, and while I don’t think it’s hard, it’s time-consuming. There is a lot of drudgery, and I think an AI can help here. However, I’d want to audit and check the data and ensure that my helper is summarizing the data in a way that makes sense to me. Even then, what I’d most like to do is let the AI give me a few suggestions of future costs and let me fine-tune those before I present them to anyone else. After all, if we make large errors, I suspect I’ll feel the pain of failure more than my AI assistant.

Steve Jones

Listen to the podcast at Libsyn, Spotify, or iTunes.

Note, podcasts are only available for a limited time online.

Posted in Editorial | Tagged | Comments Off on The AI Budget Assistant

Another AI Faux Pax

I was experimenting with a local model (article) and as a part of this, I pulled down a web interface for my model in a container. I ran it and had it in the background. I’ve randomly been asking questions as I need to look up things. I’m mostly curious how well it works.

This week I asked about CDC and got and interesting response.

This is part of a series of experiments with AI systems.

Updating a CDC Schema

I asked this question of my local mistral model: How do I alter a table in SQL SErver that is being tracked by CDC to add a new column?

That might not be the best way to phrase things, but I was on a call with a customer who was going to enable CDC and wanted to discuss how to manage this with schema changes. I’m not a CDC expert, so I was checking some documentation while chatting and decided to put this query in.

I got these results,

2025-01_0153

I thought I’d missed something, as I had never heard of sp_cdc_refresh_schema. Sure enough, I didn’t see it on MS Docs.

2025-01_0155

If I were trying to do this (pretend I’m a copy/paste DBA), I would see this:

2025-01_0156

So, the next step is to call the AI on this. It finds that it hallucinated and give me other ideas.

2025-01_0158

It gets worse. Now I create a proc and insert into the system tables, which isn’t recommended.

2025-01_0160

This won’t work either, but I can see people trying this.

First, if you get advice from the Internet, please always, always use a sandbox to test (what I also recommended to the customer), and second, treat any AI response like it came from a teenager.

Posted in Blog | Tagged , , | Comments Off on Another AI Faux Pax

Monday Monitor Tips: Using the PowerShell API

Redgate Monitor has grown tremendously from its early days and I find many customers using this to monitor lots of servers, like thousands. In those cases, some of tasks you might do to manage your Redgate Monitor server can be cumbersome in the GUI.

This post shows you how to get started with PowerShell to administer your Redgate Monitor Instance.

This is part of a series of posts on Redgate Monitor. Click to see the other posts

The Purpose of the PowerShell API

Redgate Monitor (RGM) has lots of configuration options that you can set. In any size estate, this can be overwhelming when you need to change settings for some servers, but not others. For example, suspending some monitoring for servers being patched or upgraded. While this can be done easily in the web interface, for more than 1 or 2 servers, you might want a programmatic way to do this.

The PowerShell API is designed to help you change your configuration in a programmatic way rather than clicking through the GUI. If you look at the main documentation screen below, it says the same thing.

2025-01_0143

Getting the PowerShell Module

To get the various PoSh modules you need, you need to go to your configuration screen and click the download under the PoSh API section. You can see this below, and it’s also in the docs.

2025-01_0144

While this downloads, you also need an authorization token from your install. This is also on the configuration screen and described in these docs. The PowerShell API section has the Authorization Tokens section. Click that and in this screen you can genernate a new one. Save this, as you can’t see it after generation.

2025-01_0145

From here, test making a basic connection to your server with a script like this one below. One of our solutions specialists wrote it, and it imports the module, sets the URL and token, and then tries a connection. If that works, you are connected. You can run the Get-RedgateMonitorMonitoredObject as well. This gets a list of all objects being monitored.

2024-12_0280

Where to go from there is up to you. What types of things do you find yourself changing in Redgate Monitor? If there are a series of stops, then think about automating them. We have a set of example scripts that might give you some examples. There are things you might do from a list of servers like:

  • add to a group (or move)
  • suspect monitoring
  • annotate them with an event
  • set a tag
  • copy settings from one server to another

With PowerShell, there are so many ways to program a script to do the thing you used to do manually. Give it a try with Redgate Monitor today.

https://youtu.be/eTlg1auKRUA

Redgate Monitor is a world class monitoring solution for your database estate. Download a trial today and see how it can help you manage your estate more efficiently.

Posted in Blog | Tagged , , | Comments Off on Monday Monitor Tips: Using the PowerShell API

Setting up a Local LLM

I wanted to experiment a bit with an LLM and training it, so I decided to try a few things. I looked at a few tutorials (see the references below) and then finally got this working. This post distills down what I got to work.

Getting Started

I like containers, and rather than install something on my machine, I decided to get docker images for ollama. I ran this to get started:

docker pull ollama/ollama

I ran the Docker container with this command:

docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

From there, I pulled a few models into the container with these commands:

docker exec -it ollama ollama pull mistral

I then ran this to start the model and interact with it.

docker exec -it ollama ollama run mistral

Here are a first few things I typed in to test the model.

2025-01_0111

From here, I exited and then ran this to start the model in detached mode.

docker exec -d ollama ollama run mistral

From there, more experiments, but that’s in another article.

References

Here are some places and tutorials I looked at:

Posted in Blog | Tagged , , | Comments Off on Setting up a Local LLM