-
Finely Tuned Models
I have no idea if this is true, but this post on X says that Thomson Reuters used information they’ve collected for decades to fine tune and train a model. They started with one of the qwen models and then spent $40 million to add their knowledge to the model. The post says this model is comparable to the Gpt5.5 and Sonnet 5 models. They have used 10% of their data, which spans over 100 years. I…
-
Local Models Using GPUs with Ollama
Can you use your GPUs when running a local model under Ollama? You can, and it really depends on how you run Ollama and what your hardware is. Ollama supports NVidia and AMD GPUs with some exceptions. You can read about their hardware support here. There are drivers required from the vendors, and configuration, but it can help with performance. Of course, GPUs aren’t cheap. I have an NVidia GeorForce RTX 2060, which is listed as being…
-
Creating a Local Model Chatbot on Windows
After my session at VSLive last week, I had a few questions from the audience. I’m adding some of these into blogs, and this was one: How do I run the docker compose to get a local chatbot? I didn’t include the dockerfile in a a repo, mostly because it’s simple, but just to make it easy, it’s in this zip: ollama-docker-compose.zip. To start this, I’ll assume you have Docker (or equivalent), but no images. Create a…
-
Make It Routine
The first one is hard. The rest are boring. I hear this statement from someone recently, and it sounds like something a technical person would do with a task. It’s often been a goal of mine, or maybe a direction to aim, that I want to make things easier with some script or automation. Sometimes I think it’s more aspirational than actual. I might want to make most things routine and automated, but that doesn’t always work…
-
Your Favorite Quotes
I love seeing thoughtful, pithy, witty quotes. A good saying can often spur me in some way. Maybe I’ll stop and think about what the words mean. Perhaps I’ll get inspired. Sometimes the quotes improve my day by making me smile. In any case, I was visiting Epic Systems a few months ago and they have a screensaver in one of the meeting rooms that displayed a number of quotes, along with some lovely backgrounds. I grabbed…
Currently Reading
administration AI Azure Backup/Recovery career career2 car update Cloud Computing coping database design databases Database Weekly DevOps disaster recovery encryption Friday Poll goals hardware Humor life Microsoft misc PASS powershell Redgate republish sabbatical security software development software development speaking SQL in the City SQLNewBlogger SQL Prompt SQL Saturday sql server syndicated T-SQL T-SQL Tuesday Tesla travel vacation windows words work
