Validity
Definition: The degree to which a method and evidence support the intended scientific inference.
Why it matters here: In Synthesis and Peer Review, Validity is needed to reason about reproducibility, validity, uncertainty, ethics, and communication rather than merely label the phenomenon.
Relationship: It is interpreted alongside Peer review and the lecture relation below; identify which quantities are observed, calibrated, or model-derived.
Limitation or common confusion: The best project is one whose failure modes are informative.
\(confidence=validity x reproducibility x transparency\)
Peer review
Definition: Structured expert evaluation of methods, evidence, clarity, and limitations.
Why it matters here: In Synthesis and Peer Review, Peer review is needed to reason about reproducibility, validity, uncertainty, ethics, and communication rather than merely label the phenomenon.
Relationship: It is interpreted alongside Reproducibility audit and the lecture relation below; identify which quantities are observed, calibrated, or model-derived.
Limitation or common confusion: The best project is one whose failure modes are informative.
Reproducibility audit
Definition: A test of whether inputs, code, environment, and outputs can be reconstructed and rerun.
Why it matters here: In Synthesis and Peer Review, Reproducibility audit is needed to reason about reproducibility, validity, uncertainty, ethics, and communication rather than merely label the phenomenon.
Relationship: It is interpreted alongside Constructive critique and the lecture relation below; identify which quantities are observed, calibrated, or model-derived.
Limitation or common confusion: The best project is one whose failure modes are informative.
Constructive critique
Definition: Feedback that identifies a consequential defect and specifies an evidence-based revision.
Why it matters here: In Synthesis and Peer Review, Constructive critique is needed to reason about reproducibility, validity, uncertainty, ethics, and communication rather than merely label the phenomenon.
Relationship: It is interpreted alongside Confidence and the lecture relation below; identify which quantities are observed, calibrated, or model-derived.
Limitation or common confusion: The best project is one whose failure modes are informative.
Confidence
Definition: A bounded judgment integrating validity, reproducibility, transparency, and remaining uncertainty.
Why it matters here: In Synthesis and Peer Review, Confidence is needed to reason about reproducibility, validity, uncertainty, ethics, and communication rather than merely label the phenomenon.
Relationship: It is interpreted alongside Validity and the lecture relation below; identify which quantities are observed, calibrated, or model-derived.
Limitation or common confusion: The best project is one whose failure modes are informative.