Blog

A table is an endpoint in a reproducible chain

A table is an endpoint in a reproducible chain

Tables, listings, and figures are often reviewed as finished documents. Yet a polished display is the visible end of a longer chain: analysis intent, input data, selection rules, calculations, formatting, and review. Reproducibility depends on preserving that chain, not simply saving the final PDF.

The CDISC Analysis Results Standard addresses structured results information. A practical implementation can start with a handful of high-value outputs rather than attempting to rebuild an entire reporting system at once.

1. Give each result a stable identity

A display number is useful, but numbers can change as a report evolves. Maintain a stable output identifier alongside the current title, reporting purpose, analysis population, and relevant plan section. If the title changes, reviewers should still be able to identify the same underlying result.

For a hypothetical adverse-event summary, record whether counts represent participants or events, which treatment period applies, and which coding version was used. These details determine meaning. They should not disappear when the table is copied into a presentation.

2. Separate calculation from presentation

A rounded percentage is not the underlying result. Retain the numerator, denominator, unrounded estimate, and associated metadata separately from display formatting. This makes it easier to review arithmetic, change presentation conventions, and reuse a result without scraping a document.

The ARS output model is a useful reference when considering how analyses and their presentation relate. Our recommendation is to make the calculation layer testable without requiring visual comparison of every page.

3. Review information loss

Formatting can conceal an important distinction. A zero count and a missing result are different. A suppressed value and an unavailable estimate are different. A confidence interval that cannot be estimated should not be replaced by an empty cell whose meaning is left to the reader.

Create conventions for these cases and test them deliberately. Examine very small denominators, long labels, empty treatment groups, and unexpected category combinations. These are often more revealing than a table produced from an ordinary data cut.

4. Keep a release manifest

A reporting release should identify the approved data cut, dataset versions, program versions, execution environment, and review state. The manifest should distinguish an exploratory rerun from an approved deliverable. It should also identify outputs excluded from the release and the reason for exclusion.

CDISC ADaM supplies an important upstream reference for the analysis data layer. Linking that layer to results allows reviewers to investigate a number without manually searching multiple directories.

A useful acceptance exercise is to ask a second programmer to reproduce one released display using only the manifest and controlled materials. Record missing dependencies rather than relying on informal assistance to complete the exercise.

The objective is not to create more administrative work. It is to make the meaning and origin of a result survive movement between programming, statistics, clinical review, and submission preparation.

Sources and further reading