Page 320 - CyberSecurityEssentialsEnglish
P. 320

7.5.1 A Miniature Evidence Matrix: From Three Sources to a Cautious Judgment
         Suppose  the  institutional  question  is:  does  rapid  feedback  reduce  rework  time  in  staff
         training? Three sources are not enough for a categorical judgment, but they are enough to

         train the eye on the difference between a finding, a limitation, and a judgment.

         TABLE 7-17: A MINIATURE EVIDENCE MATRIX

                            Design and                                                         Provisional
            Source                                    Finding               Limitation
                              setting                                                           judgment


                                                                                               Useful as an
                           A small trial in      Rework fell after
                                                                        Small sample, one  initial signal, not
            Study A      customer-service       feedback delivered
                                                                           organization            as a
                              training            within 24 hours
                                                                                              generalization.
                                                                        Does not establish      Supports a
                                               The association was
                         An observational                               causation; active       hypothesis
                                                  stronger when
            Study B      study on a digital    feedback contained a     participants may      about the type
                         learning platform                                   be over-        of feedback, not
                                                 specific example
                                                                          represented.        only its timing.

                                                                                                  Fits the
                                              Completion indicators
                         An organizational                               No comparison           practical
           Report C        report on an         improved after the     group; operational  context, but its
                                                feedback template
                         internal program.                               indicators only.       certainty is
                                                    was revised
                                                                                                 limited.


         A  possible  synthesis  paragraph:  the  limited  evidence  indicates  that  rapid  feedback  may
         reduce rework when it is specific and actionable, but the strength of the conclusion varies
         with the design. The small trial offers an initial causal signal, the observational study helps in

         understanding the characteristics of effective feedback, and the institutional report adds
         contextual relevance that does not compensate for the absence of a comparison. It would
         therefore be reasonable to test a revision of the template internally with a before-and-after

         measure and a comparison group where possible, rather than generalizing a final result.

         Notice that the paragraph does not say that rapid feedback is always effective. It separates
         the general pattern, the limits of the designs, and the next action the evidence permits.

         7.6 From Summarizing to Comparison, Synthesis, and Disciplined Inference
           ◆ Key idea: synthesis is not summary.
           Scientific synthesis does not gather paragraphs from sources. It builds an organized
           explanation of the relationships between them: what recurs, what differs, why it differs,

           how confident we are, and which limits must stay visible. AI can help with organization,
           but the final meaning is the researcher’s responsibility.





        319
   315   316   317   318   319   320   321   322   323   324   325