Lecture 14: Computational Astrophysics Research Synthesis
Which checks are decisive enough to support the final scientific conclusion?
14-week course · 3 credits · Week 14
Motivation
Which checks are decisive enough to support the final scientific conclusion?
A research computation needs a model argument, numerical evidence, and a bounded interpretation. The strongest claim is often the one that survives changes in resolution, timestep, seed, and plausible physical assumptions.
Today’s result must be interpretable as a physical statement with declared data, algorithm, uncertainty, and a check that could fail.
Learning objectives
After this lecture, you can
Which checks are decisive enough to support the final scientific conclusion?
State the scientific question
Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Core language
Terms for This Lecture
Validation dossier
Definition: A compact record of analytic checks, convergence evidence, uncertainty, provenance, and limitations supporting a result.
Why it matters here: It helps answer Which checks are decisive enough to support the final scientific conclusion? within the numerical model described here.
Relationships: Connect it to Discretization error, the governing expression \(\epsilon_{\rm total}\not\equiv\epsilon_{\rm solver};\quad \epsilon_{\rm total}\sim(\epsilon_{\rm discretization},\epsilon_{\rm sampling},\epsilon_{\rm parameter},\epsilon_{\rm model})\), and the computed diagnostic developed later in the lecture.
Boundary or common confusion: Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Discretization error
Definition: Error caused by representing continuous equations on finite timesteps, grids, or basis sets.
Why it matters here: It helps answer Which checks are decisive enough to support the final scientific conclusion? within the numerical model described here.
Relationships: Connect it to Sampling error, the governing expression \(\epsilon_{\rm total}\not\equiv\epsilon_{\rm solver};\quad \epsilon_{\rm total}\sim(\epsilon_{\rm discretization},\epsilon_{\rm sampling},\epsilon_{\rm parameter},\epsilon_{\rm model})\), and the computed diagnostic developed later in the lecture.
Boundary or common confusion: Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Sampling error
Definition: Random variation caused by estimating a quantity from a finite stochastic sample.
Why it matters here: It helps answer Which checks are decisive enough to support the final scientific conclusion? within the numerical model described here.
Relationships: Connect it to Parameter uncertainty, the governing expression \(\epsilon_{\rm total}\not\equiv\epsilon_{\rm solver};\quad \epsilon_{\rm total}\sim(\epsilon_{\rm discretization},\epsilon_{\rm sampling},\epsilon_{\rm parameter},\epsilon_{\rm model})\), and the computed diagnostic developed later in the lecture.
Boundary or common confusion: Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Parameter uncertainty
Definition: Uncertainty propagated from incompletely known model inputs or fitted parameters.
Why it matters here: It helps answer Which checks are decisive enough to support the final scientific conclusion? within the numerical model described here.
Relationships: Connect it to Model discrepancy, the governing expression \(\epsilon_{\rm total}\not\equiv\epsilon_{\rm solver};\quad \epsilon_{\rm total}\sim(\epsilon_{\rm discretization},\epsilon_{\rm sampling},\epsilon_{\rm parameter},\epsilon_{\rm model})\), and the computed diagnostic developed later in the lecture.
Boundary or common confusion: Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Model discrepancy
Definition: Systematic difference between the adopted mathematical model and the physical system it approximates.
Why it matters here: It helps answer Which checks are decisive enough to support the final scientific conclusion? within the numerical model described here.
Relationships: Connect it to Validation dossier, the governing expression \(\epsilon_{\rm total}\not\equiv\epsilon_{\rm solver};\quad \epsilon_{\rm total}\sim(\epsilon_{\rm discretization},\epsilon_{\rm sampling},\epsilon_{\rm parameter},\epsilon_{\rm model})\), and the computed diagnostic developed later in the lecture.
Boundary or common confusion: Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Physical and mathematical model
State what is being evolved
A research computation needs a model argument, numerical evidence, and a bounded interpretation. The strongest claim is often the one that survives changes in resolution, timestep, seed, and plausible physical assumptions.
Define the state, coordinates, units, initial/boundary conditions, and domain before interpreting solver output.
Numerical method
Algorithm choice is a modeling decision
State the scientific question; identify inputs and provenance; choose a domain solver; design a convergence and uncertainty plan before running; compare an independent method or analytic limit; archive code, environment, data, and validation report.
Write the model and its assumptions.
Choose a solver and identify its stability, accuracy, and conservation properties.
Record configuration, tolerances or timestep, and output sampling.
Compare against an analytic limit, independent method, or controlled refinement.
Visual reasoning
Integrated numerical-validation dossier
Four distinct verification families are summarized with computed results; this is not a single aggregate error bar.
Computed example
One result, with a check
The final validation dossier retains four distinct measures: three-body energy drift 5.33e-13, shock L1 error 0.00521, transmission standard error 0.00244, and fitted residual RMS 3.0897 m/s.
Inputs and method are generated by src/astr474_computations.py; the machine-readable values are in data/generated/computed_results.json.
Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Verification
What would falsify this result?
Repeat with a smaller timestep, tighter tolerance, or finer spatial grid.
Track conservation or residual structure in addition to visual agreement.
Check units, coordinate frame, boundary conditions, and invariants independently.
Change a random seed when the method is stochastic; report the resulting sampling uncertainty.
Do not report a smoother curve as proof of convergence.
Failure modes
Numerical agreement has a domain
Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.
Solver error, discretization error, stochastic error, parameter uncertainty, and model discrepancy are different quantities. Diagnose and report them separately.
Active reasoning
Make a prediction before rerunning
Which checks are decisive enough to support the final scientific conclusion?
State a measurable outcome, a competing explanation, and the smallest computation that distinguishes them. Include an expected direction or scaling, then test it.
Workflow
From parameters to auditable output
State the scientific question; identify inputs and provenance; choose a domain solver; design a convergence and uncertainty plan before running; compare an independent method or analytic limit; archive code, environment, data, and validation report.
Record the exact command, package versions, data path, random seed if applicable, and output checksum. Keep raw inputs unchanged and generated files separate.
Transfer
Lab and problem-set connection
Lab 07 and PS07 deliver a compact, independently audited computational research record.
Submit plots with labeled axes/units, a concise uncertainty argument, and enough code or intermediate values for a peer to reproduce the claim.
Synthesis
Three durable checks
Does the implemented equation match the intended physical model?
Does the numerical result converge under a controlled method change?
Does the interpretation stay inside the validity and provenance limits?
Do not collapse distinct errors into one unlabeled percentage. Solver convergence does not reduce parameter uncertainty or model inadequacy.