Lecture 13: Uncertainty, Reporting, and Scientific Claims

ASTR 210 Observational Astronomy and Data Reduction

Context and Why This Matters

A number without an uncertainty is not a scientific claim — it is an assertion. Every measurement discussed this term (a calibrated flux, a zero point, a radial velocity, a distance) carries an uncertainty budget, and combining those budgets correctly is what lets a reader judge whether a claimed result is credible.

Learning Goals

  1. Combine independent random uncertainties in quadrature.
  2. Separate a random uncertainty from a systematic one in a worked example.
  3. Write a one-paragraph result statement that meets a professional reporting standard.

Opening Phenomenon

A calibrated magnitude depends on both the photometric zero point (uncertain by 0.02 mag, from Lecture 5’s calibration) and the instrumental measurement itself (uncertain by 0.015 mag from photon statistics). Neither uncertainty alone tells the whole story.

Terms Developed in Context

These terms form the measurement chain for Uncertainty, Reporting, and Scientific Claims: each connects an observable to a model choice, and each has a boundary that must be respected when making a scientific claim.

random uncertainty

Scatter that changes unpredictably among repeated measurements and is described statistically. It determines how repeated measurements average and enters the quadrature error budget.

Independent random variances add, and the uncertainty of a mean often falls as \(1/\sqrt N\). Random-looking residuals can still conceal an unmodeled correlated systematic.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

systematic uncertainty

Uncertainty associated with a shared calibration, model, or instrumental effect that shifts measurements coherently. It limits claim accuracy even when repeatability and formal random errors are excellent.

Zero-point error propagates to every calibrated magnitude and generally does not average away by repeating the same setup. A systematic is not necessarily a known correction; its magnitude may itself be uncertain.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

quadrature sum

The square root of the sum of squared independent uncertainty components. It gives the combined random uncertainty without incorrectly adding independent one-sigma errors linearly.

\(\sigma_{tot}=\sqrt{\sum_i\sigma_i^2}\) follows from adding independent variances. Correlated uncertainties require covariance terms and cannot be combined by simple quadrature.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

error budget

An organized accounting of uncertainty sources, their sizes, assumptions, and contribution to a final result. It shows which measurement or calibration limits the claim and where improved observations would matter most.

The budget connects photon statistics, calibration uncertainty, model terms, and systematic caveats to the reported error bar. Listing only readily computed random errors while omitting dominant systematics produces a falsely precise result.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

claim strength

The degree of confidence and specificity justified by the quality, uncertainty, and scope of the evidence. It governs whether the report should state a detection, a tentative indication, an upper limit, or no conclusion.

Claim strength depends on effect size relative to uncertainty, replication, systematic checks, and model alternatives. More decimal places or confident wording do not increase evidential strength.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

provenance

The documented origin and processing history of a datum, including instrument settings, calibration inputs, software steps, and versions. Provenance lets another observer determine how a displayed number was produced and whether it can be reproduced.

It connects raw files to calibrated products, uncertainty estimates, archive queries, and the final scientific claim. A filename or citation alone is not complete provenance when decisive processing choices remain undocumented.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

reproducibility

The ability of an independent analyst to apply the documented inputs and procedures and obtain a consistent result. It is the operational test of whether a reported measurement is more than an undocumented one-off outcome.

Reproducibility depends on provenance, calibration files, query text, code/version information, and stated decisions. Reproducibility does not guarantee that the shared method is scientifically correct; it makes the method inspectable.

Developed in this lecture: The term helps interpret this evidence: Repeating the same measurement many times under identical conditions produces a scatter consistent with the random (statistical) uncertainty alone. It also constrains the working model: Independent random uncertainties combine in quadrature: σ_total = √(σ₁² + σ₂² + …).

Evidence

Model

Working Equation

\[ \sigma_{\rm total} = \sqrt{\sigma_{\rm ZP}^2 + \sigma_{m}^2} \]

Worked Example

  1. Zero-point uncertainty: σ_ZP = 0.02 mag.
  2. Instrumental measurement uncertainty: σ_m = 0.015 mag.
  3. Combined uncertainty: σ_total = √(0.02² + 0.015²) = √(0.0004 + 0.0002) = √0.0006 = 0.025 mag.
  4. A magnitude of, say, 13.42 should be reported as 13.42 ± 0.03, not as a bare number.

Common Misconception

Reporting a high-precision instrumental scatter (small σ_m) as though it were the total uncertainty, while ignoring a larger systematic uncertainty (like an uncertain zero point) that dominates the real error budget.

Active-Learning Guidance

Given a new pair of uncertainties (a calibration uncertainty and a measurement uncertainty), compute the combined uncertainty and write one sentence stating the final result correctly.

Lab / Observing Connection

Every lab this term has required an explicit uncertainty column; this lecture formalizes the rule used to combine those numbers into a single reported value.

Synthesis Questions

References