Prompt vs. Context
A Prompt is "what is being asked this time"; Context is "the background information AI should draw on when answering." Conflating the two is often where government AI applications go wrong: a caseworker assumes a clearly written question is enough, forgetting that AI has no idea about internal procedures or case history unless given them.
- Context Engineering sorts information into four categories: Include (put directly into the prompt), Retrieve (pulled dynamically), Remember (kept across turns), and Exclude (explicitly withheld).
- Include: suited to small, always-needed, rarely-changing information, e.g. the complaint text itself.
- Retrieve: suited to large, not-always-needed, updating information, e.g. a full regulation database.
- Remember: suited to information that must carry over across multiple interactions, e.g. the case number and current status.
- Exclude: information explicitly withheld, this does not mean "forgotten," it means "never provided in the first place."
A caseworker believes "if the question is written clearly enough, AI will know the right answer." What does this mainly overlook?