No Child Left Behind places a strong emphasis on using
programs and methods scientifically proven to be effective. Programs and
practices grounded in scientifically based research are not fads or untested
ideas; they have proven track records of success.
What is scientifically based research? When reviewing
research findings to determine whether they meet the criteria for
scientifically based research, the following questions are important to
consider: Use of rigorous, systematic
and empirical methods.
Adequacy of data to justify the general conclusions
drawn.
Reliance on methods that provide valid data across
multiple measurements and observations.
Use of control groups.
Details allow for replication.
Acceptance by a peer-reviewed journal or approved by a
panel of independent experts. For more
information on quality research, go to the What Works Clearinghouse
site. The preceding
information was taken from No Child Left Behind: A Tool Kit for Teachers.
U.S. Department of Education, Office of the Under Secretary, Washington
D.C., 2003. For copies of this complete document order online at:
www.edpubs.org. Special note: on
request, this publication is available in alternate formats such as Braill,
large print, audiotape, or computer diskette.
Using Scientific Research to Guide Classroom Practices
Does the work have a solid theoretical or research foundation? Was it
carefully designed to avoid biased findings and unwarranted claims of
effectiveness? Does the research clearly delineate how the research was
conducted, by whom it was conducted and on whom it was conducted?
Was the research designed to minimize alternative explanations for observed
effects? Are the observed effects consistent with the overall conclusions
and claims of effectiveness? Does the research present convincing
documentation that the observed results were the result of the intervention?
Does the research make clear what populations were studied (i.e., does it
describe the participants’ ages, as well as their demographic, cognitive,
academic and behavioral characteristics) and does it describe to whom the
findings can be generalized? Does the study provide a full description of
the outcome measures?
Are the data based on a single-investigator, single-classroom study, or did
multiple investigators in numerous locations collect similar data? What
procedures were in place to minimize researcher biases? Do observed results
hold up over time? Are the study interventions described in sufficient
detail to allow for replicability? Does the research explain how
instructional fidelity was ensured and assessed?
Has a randomly assigned control group or some other kind of comparison group
been used?
Does the study clearly explain how the treatment was designed? Is there
enough detail to replicate the study?
Has the review been rigorous and objective? Has the research been carefully
reviewed by unbiased individuals who were not part of the research study?
Have the findings been subjected to external scrutiny and verification?
