Page 117 - CyberSecurityEssentialsEnglish
P. 117
✕ Common misconception Correction
Results may still differ because of a version
update, a change of context, search tools,
Temperature = 0 means the system has the way a file is processed, or parallel
become a fixed source of truth. execution. A deterministic setting narrows
one source of variation; it does not make
an answer correct.
The Context Window and the Lost-in-the-Middle Problem
The context window is the space the system can process within an interaction, and it includes
the instructions, the conversation, the files, and the retrieved results. A large number does
not mean that every part is used with equal efficiency. The Lost in the Middle study showed
that performance may decline when the decisive information sits in the middle of a long
context, even in models that support large contexts [9].
In practice, do not upload everything you have without organization. Clean the documents,
ask a specific question, use headings and metadata, ask for the page to be cited, and test
questions whose answers lie at the beginning, the middle, and the end. Sometimes retrieving
a few relevant passages is better than sending thousands of pages at once.
Context Engineering and Managing Long Material
Context engineering is broader than writing a prompt. It is the selection of the information
that enters the window, its ordering, its compression, the marking of what is trustworthy,
and the decision about what should be retrieved on demand rather than placed there in
advance. In long tasks, the quality of the context may matter more than an increase in model
size.
Begin by removing repetition and unnecessary pages, then preserve the structure: the title,
the page number, the section, the date, and the issuing body. If the document is large, do
not summarize every part and then summarize the summaries without verification, because
errors accumulate. Use a hierarchical plan: index the sections, extract facts or claims with a
fixed template, tie each point to its page, then build the final synthesis from the structured
record.
The order of the material matters. Place the core instructions and the definition of the task
clearly, then the material or the passages, then the final question if the system benefits from
having the question near the end of the context. There is no single rule for every model, so
test the position of the important information: the beginning, the middle, and the end. If
116

