Tutorials Logic, IN info@tutorialslogic.com

LangChain Memory and State: Conversations, Chat History and Workflows

LangChain Memory and State

Memory means carrying useful information from earlier turns or earlier workflow steps. In chat apps, memory may include recent messages. In business workflows, state may include selected documents, user role, tool results, approvals, or partial outputs.

The key is to store the right information in the right place. Do not blindly append the entire conversation forever. Summarize, trim, retrieve, and separate durable user profile data from temporary chat context.

LangChain is expanded here with a practical explanation, multiple examples, and beginner-focused checks so the idea is easier to learn from this page alone.

Read the concept first, then trace the example line by line. The important habit is to connect the rule to visible behavior instead of memorizing only the name.

Mental Model

Memory is not magic. It is state management for LLM applications, and it should be designed like any other stateful system.

Types of Memory

Short-term memory keeps the current conversation coherent. Long-term memory stores durable facts or preferences. Workflow state tracks intermediate steps in a multi-step process.

  • <strong>Message history:</strong> recent conversation turns.
  • <strong>Summary memory:</strong> compressed conversation context.
  • <strong>Profile memory:</strong> durable facts such as user preferences.
  • <strong>Workflow state:</strong> tool results, approvals, and intermediate decisions.

Memory Risks

Memory can leak sensitive information, increase token cost, and preserve incorrect assumptions. Treat memory as data with privacy, retention, and correction rules.

  • Do not store secrets or sensitive data unless the product explicitly requires it.
  • Let users inspect or reset durable memory.
  • Trim or summarize long histories before they exceed context limits.

Detailed Explanation of LangChain

LangChain becomes much easier when you separate the concept from the tool syntax. First identify the problem being solved, then identify the data or resource being changed, and finally identify the proof that the change worked.

In LangChain, this topic should be studied through prompt inputs, model calls, parser behavior, retrieved context, tool boundaries, and validation. Those points explain not only how to use the feature, but also why it fails when the wrong assumption is made.

The previous audit note was: under 650 content words . This expanded section adds a fuller explanation, concrete examples, and practice guidance so the page can stand on its own for beginners.

A good way to learn this page is to read the normal path once, run or trace the example, then intentionally change one input to observe the different result. That one change teaches more than memorizing several definitions.

  • Write the goal of LangChain before touching code or configuration.
  • Identify the normal case, edge case, and failure case.
  • Trace what changes before and after the operation.
  • Use a command, output, compiler message, log, metric, or table to verify the result.
  • Record the mistake that would confuse a beginner and the exact fix.

Beginner-Friendly Walkthrough for LangChain

Start with a tiny project scenario. For example, imagine one user action, one request, one resource, one function call, or one batch of data. Keep the scenario small enough that every step can be explained without skipping details.

Next, describe the movement of information. Where does the input start? Which rule or component handles it? What result should appear? If the result is wrong, where would you inspect first?

Finally, compare two outcomes. The correct outcome proves that you understand the main rule. The incorrect outcome teaches the symptom, which is what you will recognize later during debugging or interviews.

  • Normal path: valid input produces the expected result.
  • Boundary path: the smallest, largest, empty, or unusual input still behaves predictably.
  • Error path: a realistic mistake creates a visible symptom.
  • Fix path: one focused correction removes the symptom without changing unrelated code.

Runnable with Message History

This pattern keeps chat history outside the model and injects it only when invoking the chain.

Runnable with Message History
from langchain_core.chat_history import InMemoryChatMessageHistory
from langchain_core.prompts import ChatPromptTemplate, MessagesPlaceholder
from langchain_core.runnables.history import RunnableWithMessageHistory
from langchain_openai import ChatOpenAI

store = {}

def get_history(session_id: str):
    if session_id not in store:
        store[session_id] = InMemoryChatMessageHistory()
    return store[session_id]

prompt = ChatPromptTemplate.from_messages([
    ("system", "You are a helpful programming mentor."),
    MessagesPlaceholder(variable_name="history"),
    ("human", "{question}"),
])

chain = prompt | ChatOpenAI(model="gpt-4o-mini", temperature=0.2)

chat = RunnableWithMessageHistory(
    chain,
    get_history,
    input_messages_key="question",
    history_messages_key="history",
)

config = {"configurable": {"session_id": "user-123"}}
print(chat.invoke({"question": "What is RAG?"}, config=config).content)
print(chat.invoke({"question": "Give me one use case for it."}, config=config).content)
  • InMemoryChatMessageHistory is for demos, not durable production storage.
  • Session IDs should map to authenticated users or anonymous sessions safely.

LangChain focused LangChain runnable example

LangChain focused LangChain runnable example
from langchain_core.prompts import ChatPromptTemplate
from langchain_core.output_parsers import StrOutputParser

prompt = ChatPromptTemplate.from_template('Explain LangChain with one example and one warning.')
chain = prompt | (lambda message: message.text) | StrOutputParser()

# In a real app, replace the lambda with a chat model and keep the parser step explicit.

LangChain LangChain validation example

LangChain LangChain validation example
def check_answer(answer: str) -> list[str]:
    issues = []
    if 'source' not in answer.lower():
        issues.append('Add sources or retrieved context.')
    if len(answer) < 120:
        issues.append('Add a fuller explanation for LangChain.')
    return issues

print(check_answer('Short answer without source'))
Key Takeaways
  • Design memory intentionally: recent turns, summaries, profile facts, and workflow state are different.
  • Keep sensitive data out of memory unless there is a clear retention policy.
  • Use trimming, summarization, and retrieval instead of unlimited chat history.
  • Explain the purpose of LangChain in your own words.
  • Run or trace a small LangChain example for LangChain.
  • Test a normal case, a boundary case, and a broken case.
  • Verify the result with visible output, logs, metrics, compiler feedback, or a table.
  • Summarize the common mistake and the correction.
Common Mistakes to Avoid
WRONG Append every message forever.
RIGHT Trim, summarize, or retrieve relevant memory.
Unlimited history increases cost and can confuse the model.
WRONG Store user secrets in long-term memory.
RIGHT Store only necessary, user-approved durable facts.
Memory is product data and needs privacy rules.
WRONG Learning LangChain only as a term.
RIGHT Learn it through a working example, a boundary case, and a failure case.
Concept plus behavior is easier to remember than definition alone.
WRONG Skipping verification.
RIGHT Always check output, state, logs, metrics, query results, or compiler feedback.
Verification turns confidence into evidence.
WRONG Changing many things at once while debugging.
RIGHT Change one setting, input, or line, then inspect the result.
Small changes reveal the real cause.

Practice Tasks

  • Implement a chat chain that keeps only the last six messages.
  • Add a user preference memory field and include it in the prompt only when relevant.
  • Write a reset-memory function and test that a session starts cleanly afterward.
  • Create a small demo that shows LangChain clearly.
  • Add one edge case and write the expected result before running it.
  • Break the demo intentionally and document the error symptom.
  • Fix the broken version and explain why the fix works.

Frequently Asked Questions

No. Memory usually stores conversation or user state. RAG retrieves external knowledge from documents or databases.

Yes. Old, irrelevant, or incorrect memory can distract the model and produce poor answers.

Start with one tiny example, trace every step, then compare it with a broken version.

Verify the visible result: output, state, log entry, metric, query result, compiler feedback, or rendered behavior.

It often combines vocabulary with behavior. The confusion drops when you trace the input, rule, result, and failure path.

Ready to Level Up Your Skills?

Explore 500+ free tutorials across 20+ languages and frameworks.