Skip to content
Back to guides

How does a chatbot actually work?

What happens when you press send? Explore why the same chatbot can answer differently and what its memory really means.

Estimated time
About 8 min

Your goal for this session

Understand why the same chatbot can answer differently and how to give it the background this conversation needs.

Try changing the conversation context

  1. 1

    Open a new conversation

    Choose a harmless topic, such as ideas for a weekend trip.

  2. 2

    Start with a brief question

    Write one general question and notice what the answer assumes.

  3. 3

    Add background

    Explain, for example, that you will travel by train, have a small budget and have one day available.

  4. 4

    Start a new conversation

    Change the topic completely and notice how a new conversation helps keep the request clear.

Try the effect of background information

Suggest a day trip for me. Ask one clarifying question before answering.

Continue in the same conversation and add a detail the AI did not know yet.

Continue the same conversation

I will travel by train, my budget is no more than 30 euros and I have one day available. Update your suggestion using these details.

Give only the background needed

A common request:

I need help writing a message.

Write a friendly, three-sentence message to an imaginary hobby group. The subject is rescheduling next week's meeting.

What happens when you press send?

When you write a message to an AI assistant and press send, the service processes your request and builds a response piece by piece. Speed and the background used vary with the service, settings and task.

Why does the chatbot remember the conversation?

The service supplies the model with conversation context when it generates an answer. Depending on the service, that may include selected messages, summaries or other background, rather than every message in full. This is not human memory. The context window limits how much information the model can use at once, so earlier details may become unavailable in a long conversation. Starting a new conversation can help separate topics; provide the relevant background again and check the service’s memory settings.

Why does the same question produce different answers?

A language model generates text using probabilities for possible continuations. A setting often called “temperature” affects variation: lower values generally produce less varied output and higher values allow more variation. Neither setting guarantees accuracy, and services may control this setting themselves. Context and other service settings can also change the answer.

Same question, different day

Example prompt:

On Monday, you ask the assistant for a good way to start the morning without coffee. On Thursday, you ask exactly the same question in a new conversation.

You will probably get a different answer even though the question is identical word for word. The model does not retrieve its old answer from memory: each time it calculates again which word is the most likely continuation. The temperature setting affects how much variation this sampling allows.

Does the chatbot remember you?

That depends on the service and its settings. Some services keep conversation history by default and others do not. Check the settings to see exactly what is saved on your account.

Once you know the basics

You can ask the assistant to summarise the conversation, turn it into next steps or ask a clarifying question before answering.

Recall the context-window rule from memory

Read the practice material once, hide it and answer in your own words. The hint and checking criteria appear only after your own attempt or after you select “I don't know yet”.

Your written answers stay only in this browser tab. They are not sent to AI Licenses servers or analytics.

Question 1/2

Read the material before your first attempt

Once you have read the material, hide it using the button on the left and answer from memory.

Use the practice activity in your own AI service (optional)

Send the same request twice.

A chatbot does not retrieve an answer from a ready-made list. The easiest way to see this is to ask the same thing again and notice what changes.

Experiment · about 5 min

Where shall we start?

How the request is built

Task
An answer and an assessment of its own variation
Background
Send the same request twice
Format
Five sentences, then an assessment

Suggest one good way to spend a 30-minute break in the middle of a working day. Write no more than five sentences. At the end, separately explain which parts of your answer might differ if I sent exactly the same request again.

Ready to run the experiment?

The experiment works in any assistant, and different services may behave differently. That is part of the lesson too.

Open ChatGPT (opens in a new tab)

In this exercise: The trip details (train, budget, day) are imaginary. They are included only to show how added background changes a suggestion.

Skills and concepts in this guide

Publication details and sources

Published:
July 23, 2026
Sources checked:
September 4, 2026

Related guides