Checks on the published model

Model Checks

Both checks run the published model for the selected outcome — the same reference specification the simulator pages use — and interrogate it from different angles. One asks whether a scenario estimate depends heavily on that fitted logit; the other maps the conditional dependency structure among its predictors. Use either on its own, or both together. Narrow to a subgroup and the network instead discovers that subgroup’s own model, which is the more useful question there; to see the published specification refit on a subgroup, build it on the Build page and run the check from there.

One fitted explanation, examined from two additional angles. The published logit remains the reference for the estimates shown elsewhere, and neither check replaces it or becomes a second reference model: the Triangulation Check re-estimates a stated scenario through a different observational route, while the Bayesian network examines how the same predictors are conditionally organized under a different model structure.

Triangulation Check

How dependent is the estimate on model form?

Model: propensity-score subclassification

Take a scenario — set one or more factors — and the check estimates the same scenario a structurally different observational way: through propensity-score subclassification built from the same measured predictors rather than the active fitted outcome model. The two routes differ in form, but they share the sample, measured controls, and important observational limitations.

  • When they agree, one concern narrows: the result appears less dependent on the active fitted logit model.
  • When they diverge, read it cautiously — small sample, weak overlap, residual imbalance, or model dependence.

Bayesian Network Analysis

BETA

How are the selected factors conditionally related?

Model: constrained Bayesian network

Take the same predictors as the published model and examine how they are conditionally connected under a constrained Bayesian network. The network provides a different structural representation of the measured variables, and its what-if view shows model-implied changes under stated settings. Those outputs are exploratory properties of the fitted network, not identified intervention effects.

It adds information that ranked predictor lists do not show. It displays which of those variables are connected to the outcome in the fitted network and whether those connections are represented as direct or indirect paths through other measured variables. That direction belongs to the fitted network structure; it does not establish temporal or causal direction.

  • Connected factors show stronger model-implied relationships with the outcome under the fitted network.
  • Factors without a modeled path may still add information in the logit; the two structures can place the same measured factor differently.

How they work together

One tests the number; the other tests the interpretation.

Triangulation probes model-form dependence

Does a specific predicted change survive a second route that does not use the fitted outcome equation? Agreement narrows the concern that the number is an artifact of the model’s form.

The network probes conditional structure

Maps the conditional dependency structure among the published model's predictors, and whether each is represented as reaching the outcome directly or indirectly. That direction belongs to the fitted network; it does not establish causal direction.

Predictive importance is not network placement. A factor can add substantial information in the logit yet have no modeled path to the outcome in the fitted network. A large logit contrast beside little or no network-implied change therefore reflects the two representations answering different questions rather than a contradiction.

A model that looks similar under both has survived two additional forms of scrutiny, but neither check is a pass/fail test and agreement is not proof. Neither resolves omitted measurement, nonresponse, or other vulnerabilities shared by the underlying data.