Category: Blog

This post looks at a logic problem asked to an AI, and which is struggles at finding an answer. This is based on an article noting this question stumps most AIs. The article is at: https://futurism.com/logic-question-stumps-ai

This is part of a series of experiments with AI systems.

The Setup

I loaded a Deepseek model to compare with my Mistral model. I did this with the following commands:

docker run ollama
docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
docker exec -it ollama ollama pull deepseek-r1:1.5b
docker exec -d ollama ollama run deepseek-r1:1.5b
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v ollama-webui:/app/backend/data --name ollama-webui --restart always ghcr.io/ollama-webui/ollama-webui:main

From there, I had a website.

The Logic Problem

In the article, we ask a question.  I asked: >Alice has [5] brothers and she also has [3] sisters. How many sisters does Alice’s brother have?

The response was interesting, using the Deepseek-r1:1.5b model. Here it is, with the entire response in Italics.

First, determine the total number of children in the family by adding Alice’s brothers (5) to her sisters (3). This gives a total of 8 children.

Next, since Alice is one of those 8 children and she has 5 brothers, subtracting Alice from the total gives the number of brothers as 4. However, this calculation leads to a discrepancy because it doesn’t align with the original information provided.

Recognizing that there might be an error in the initial assumption, consider that Alice has 3 sisters, meaning there are at least 4 girls (including herself). Adding her 5 brothers results in 9 children, which still does not match the given numbers.

Finally, re-evaluating the problem, it’s clear that without additional context or information, determining the exact number of sisters a brother has is not possible with the provided details.

Solution:

Let’s break down the problem step by step.

1. Total Number of Children in the Family:

   Alice has:

   • 5 brothers
     

   • 3 sisters

   Since Alice herself is one child, the total number of children is:

   [
   \text{Total children} = \text{Number of brothers} + \text{Number of sisters} + 1 = 5 + 3 + 1 = 9
   ]

2. Number of Brothers:

   Alice has 5 brothers in her family.

3. Number of Sisters Alice’s Brother Has:

   Since the total number of children is 9 and there are 5 brothers, we can determine the number of sisters each brother has by subtracting the number of brothers from the total number of children:

   [
   \text{Sisters per brother} = \frac{\text{Total children}}{\text{Number of brothers}} = \frac{9}{5}
   ]

   However, this division does not result in a whole number, which suggests that the problem might be interpreted differently.

4. Alternative Interpretation:

   Considering that Alice has 3 sisters, it implies there are at least:

   • 1 (Alice) + 3 = 4 girls

   Including her own siblings, if each brother has an equal number of sisters, we can find the exact number by dividing the total number of children among all siblings:

   [
   \text{Sisters per brother} = \frac{\text{Total children}}{\text{Number of brothers} + 1} = \frac{9}{5 + 1} = \frac{9}{6} = 1.5
   ]

   This result still doesn’t make sense in the context of having whole sisters.

5. Conclusion:

   Given the information provided, it’s not possible to determine an exact number of sisters that each brother has because:

   • The total number of children is fixed at 9.
     

   • Each brother has a different number of sisters based on their position in the family tree.

   Therefore, with the current details, there isn’t enough information to definitively state how many sisters Alice’s brother has.

\boxed{\text{Cannot determine}}

That’s interesting, but is this a Deepseek problem? Let’s try another.

Mistral

Mistral is the first model I played with locally. Let’s ask it the question. This response was shorter, so I’ll add it as an image:

It seems the AIs don’t quite understand family, and they’re making simple mistakes in putting things together. I could see humans making this mistake, but they’d catch it quickly if someone pointed something out.

Let’s try one more thing.

What’s a Family?

I then ran this prompt: In a family, if I say Alice has 2 brothers and 1 sister, how many children are in the family?

Easy, isn’t it? If I have 3 siblings, whether brothers or sisters, then there are 4 kids. How does the AI do?

I suppose Alice could be male (Alice Cooper), but even in that case, the AI seems to struggle to separate out Alice from the counts. For some reason, even listing the siblings out it counts 5 rather than 4. I guess 2+2=5 (for extremely confused AIs).

Conclusion

This isn’t to imply the AIs aren’t useful or helpful, but rather they aren’t intelligent in a human sense, or even logical in a human sense. They are very well trained search engines that can put things together in a way that we can’t easily program. They can predict the way to approach problems with mimicry of how humans think.

However, they don’t have common sense. They are just working with patterns that are very complex, but aren’t intelligent.

They are useful and can help you solve problems, however, they do make mistakes. Knowing something about the problem you’re asking them to solve is important. These are tools to help us, not tools that replace us.