Page 117 - CyberSecurityEssentialsEnglish
P. 117

✕ Common misconception                                      Correction

                                                              Results may still differ because of a version
                                                              update, a change of context, search tools,

             Temperature = 0 means the system has                the way a file is processed, or parallel
                  become a fixed source of truth.             execution. A deterministic setting narrows

                                                               one source of variation; it does not make
                                                                           an answer correct.


         The Context Window and the Lost-in-the-Middle Problem
         The context window is the space the system can process within an interaction, and it includes

         the instructions, the conversation, the files, and the retrieved results. A large number does
         not mean that every part is used with equal efficiency. The Lost in the Middle study showed
         that performance may decline when the decisive information sits in the middle of a long

         context, even in models that support large contexts [9].

         In practice, do not upload everything you have without organization. Clean the documents,

         ask a specific question, use headings and metadata, ask for the page to be cited, and test
         questions whose answers lie at the beginning, the middle, and the end. Sometimes retrieving
         a few relevant passages is better than sending thousands of pages at once.


         Context Engineering and Managing Long Material
         Context engineering is broader than writing a prompt. It is the selection of the information

         that enters the window, its ordering, its compression, the marking of what is trustworthy,
         and the decision about what should be retrieved on demand rather than placed there in
         advance. In long tasks, the quality of the context may matter more than an increase in model

         size.

         Begin by removing repetition and unnecessary pages, then preserve the structure: the title,

         the page number, the section, the date, and the issuing body. If the document is large, do
         not summarize every part and then summarize the summaries without verification, because
         errors accumulate. Use a hierarchical plan: index the sections, extract facts or claims with a

         fixed template, tie each point to its page, then build the final synthesis from the structured
         record.


         The order of the material matters. Place the core instructions and the definition of the task
         clearly, then the material or the passages, then the final question if the system benefits from
         having the question near the end of the context. There is no single rule for every model, so

         test the position of the important information: the beginning, the middle, and the end. If




        116
   112   113   114   115   116   117   118   119   120   121   122