Learning objectives
- Evaluate a complete research plan as a skeptical, constructive reviewer.
- Explain reproducibility, validity, uncertainty, ethics, and communication with the formal object.
- Separate evidence, transformation, inference, and limitation.
Terms Developed in Context
These terms form the lecture's reasoning chain from observable through model to a bounded physical conclusion.
- Validity
The degree to which a method and evidence support the intended scientific inference. In this lecture it supports the evidence-to-model chain for reproducibility, validity, uncertainty, ethics, and communication.
Use and relationship: Read it together with Confidence and Peer review. The governing relation \(confidence=validity x reproducibility x transparency\) shows where the concept enters quantitatively; the student should state whether its value is measured, calibrated, adopted, or inferred.
Boundary: The best project is one whose failure modes are informative. This caveat prevents the term from being treated as a unique explanation or a context-free number.
- Peer review
Structured expert evaluation of methods, evidence, clarity, and limitations. In this lecture it supports the evidence-to-model chain for reproducibility, validity, uncertainty, ethics, and communication.
Use and relationship: Read it together with Validity and Reproducibility audit. The governing relation \(confidence=validity x reproducibility x transparency\) shows where the concept enters quantitatively; the student should state whether its value is measured, calibrated, adopted, or inferred.
Boundary: The best project is one whose failure modes are informative. This caveat prevents the term from being treated as a unique explanation or a context-free number.
- Reproducibility audit
A test of whether inputs, code, environment, and outputs can be reconstructed and rerun. In this lecture it supports the evidence-to-model chain for reproducibility, validity, uncertainty, ethics, and communication.
Use and relationship: Read it together with Peer review and Constructive critique. The governing relation \(confidence=validity x reproducibility x transparency\) shows where the concept enters quantitatively; the student should state whether its value is measured, calibrated, adopted, or inferred.
Boundary: The best project is one whose failure modes are informative. This caveat prevents the term from being treated as a unique explanation or a context-free number.
- Constructive critique
Feedback that identifies a consequential defect and specifies an evidence-based revision. In this lecture it supports the evidence-to-model chain for reproducibility, validity, uncertainty, ethics, and communication.
Use and relationship: Read it together with Reproducibility audit and Confidence. The governing relation \(confidence=validity x reproducibility x transparency\) shows where the concept enters quantitatively; the student should state whether its value is measured, calibrated, adopted, or inferred.
Boundary: The best project is one whose failure modes are informative. This caveat prevents the term from being treated as a unique explanation or a context-free number.
- Confidence
A bounded judgment integrating validity, reproducibility, transparency, and remaining uncertainty. In this lecture it supports the evidence-to-model chain for reproducibility, validity, uncertainty, ethics, and communication.
Use and relationship: Read it together with Constructive critique and Validity. The governing relation \(confidence=validity x reproducibility x transparency\) shows where the concept enters quantitatively; the student should state whether its value is measured, calibrated, adopted, or inferred.
Boundary: The best project is one whose failure modes are informative. This caveat prevents the term from being treated as a unique explanation or a context-free number.
Method in context
Research quality is a system property: a beautiful figure cannot rescue an untraceable sample. Ask what a second researcher needs to reproduce the claim: raw input, processing state, software or database version, and inferential step.
Derivation and assumptions
Define every symbol and explain the failure mode. A method becomes scientific when assumptions are visible enough to be tested.
Worked example
A decision matrix makes science, feasibility, access, risk, and reproducibility scores auditable.
The best project is one whose failure modes are informative. Require an independent recomputation and one perturbation.
Misconceptions and study guidance
Do not confuse a data service with a measurement, a catalog identifier with physical identity, a formal error with total uncertainty, or a polished figure with a validated inference. Reconstruct the evidence chain before interpreting.
Verified reading
All course archive and ethics sources; exact URLs and verification status are in reference-log.md.
Use the exact documentation anchor in the reference log and record any access mismatch.