Page 84 - CyberSecurityEssentialsEnglish
P. 84

instruction to think step by step adds length and cost. State the problem, the data, the
           constraints, and what a finished answer looks like.

           + For the advanced reader: there is no single recipe for every model

           Some models are designed to spend more internal reasoning effort. Current guidance
           encourages a direct, clear request that states the constraints and what completion
           means, rather than filling the prompt with repeated commands of the “think step by
           step” kind. Test the result, and ask for brief justifications that can be inspected [10].


         The instruction “think step by step” has a real research basis. Chain-of-thought prompting
         was shown to improve performance on multi-step reasoning tasks in earlier and smaller
         models, both when examples of reasoning were supplied and when the instruction alone

         was added [16][17]. The recommendation has shifted for a specific reason: models built for
         reasoning already perform that work internally, so repeating the instruction adds length and
         cost without necessarily adding accuracy. The technique is not wrong; it is being absorbed

         into the model.

         When using a reasoning model, begin with the complete problem, the data, the constraints,
         and the shape of the answer. Define the end point: is one solution required, or a comparison,
         or the detection of a contradiction, or a verification plan? Do not make the goal simply “think

         deeply.” Depth is not an output, and it can consume time without changing the decision.
         Do not treat the disclosure of an internal chain of thought as a guarantee of correctness. You

         can ask for a summary of the justifications, the assumptions, the auditable steps, and the
         visible sources or calculations. But real verification comes from testing the result, using an
         appropriate tool, or consulting an expert, not from the length of the narration about how
         the thinking was done.


         In computational or programming tasks, ask for a tool or code to be used where one is
         available, and ask for the result, the assumptions, and the verification tests to be shown. In
         open tasks, ask for alternatives, criteria, and trade-offs. In every case, make the prompt

         specific enough that we know when the task is finished and what must be checked.
         It also helps to set an effort budget when the tool supports one. Does the task deserve
         extended reasoning, or a fast answer? Do not use the highest effort for every request; that

         may increase time and cost without adding value. Tie the effort to the complexity of the task
         and the impact of an error, and test whether the increase actually improves the measure
         you care about.


         In multi-part problems, ask for a short plan of the outputs or a list of sub-questions, but do

         not assume that writing a plan means executing it correctly. You can specify: “Check that all
         items are complete before finishing the answer, then give a summary of the justifications





         83
   79   80   81   82   83   84   85   86   87   88   89