Daily Wind Speed

Analysis

The report opens with the Headline and the Concerns, followed by the Discovered Relations when the analysis has targets and by Questions & Answers when questions were asked. Three sections carry the detail: Data describes the table as supplied, Model presents one model per target, and Implications states where the models hold and what to weigh before relying on them.

Generated 2026-09-20 14:38 UTC, analysis 97c87d70-48b7-11f1-8087-d378640fe787, 1 target, computation time 1 h 0 min, compute budget 500 credits, 6,574 rows. The Provenance & Audit chapter holds the full record.

Headline

The model predicts target from 14 columns, using only 1. It explains 64% of target, leaves 36% unexplained, and relies entirely on clo.

• One target was modeled; 1315 rows were held out for checking.
• A straight line through the same columns already explained 75%; the model did not beat this reference, trailing by 11 points.
• Critical: Ufinq model loses to baseline on target.

Best R²

0.63982

Best quality

63.89 %

Best target

target

Targets

1

Concerns

Data-quality, model-quality, and deployment-risk issues detected during the analysis appear below, ordered by severity. Critical concerns are listed first; Warning and Info entries follow.

• Critical | Model: Ufinq model loses to baseline on target. R² lift over Linear regression = -0.111 (Ufinq R² 0.64 vs baseline R² 0.751). The cheap baseline is the better deployment choice unless interpretability dominates. Cohen's-d magnitude on |residuals|: small.
• Critical | Implications: Most held-out rows are outside the training distribution. 54% of held-out rows are out of distribution (715 of 1,315). The held-out evaluation measures extrapolation rather than quality on rows like the training rows, so a deployment decision needs a fresh held-out set drawn from the same distribution as the training rows.
• Warning | Model: Highly correlated pair: bir and cla. Pearson r = 0.888; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: bir and clo. Pearson r = 0.874; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: bir and kil. Pearson r = 0.871; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: bir and mul. Pearson r = 0.895; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: bir and sha. Pearson r = 0.905; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: cla and clo. Pearson r = 0.879; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: cla and sha. Pearson r = 0.873; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: clo and mul. Pearson r = 0.877; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: dub and mul. Pearson r = 0.88; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Warning | Model: Highly correlated pair: kil and rpt. Pearson r = 0.866; consider dropping one or combining them. Tightly correlated regressors inflate coefficient variance.
• Info | Model: 5 more high-correlation pairs. The dataset has many highly correlated variable pairs; only the strongest 10 are listed individually. Inspect the Correlation chapter for the full matrix.

The first 10 rows of 13. The other 3 are in the notebook.

Discovered Relations

One model per target, each a formula with its quality, complexity and error. Higher quality at lower complexity describes the data most clearly. The findings below read the models together; the per-target chapters in the Model section carry each formula, its predictions and its diagnostics.

• The target model explains 64% of the variation in target and relies entirely on the feature clo.
• Compared to always fitting a linear regression, which explained 75% of the variation, the model explained 11 points less.

Data

The Data section describes the table as supplied, before any modeling: the Column Profiles overview of every column and its role, one chapter per column with its distribution and correlations, a closer look at columns with notable characteristics, Duplicate Rows, Leakage Suspicion, a map for paired coordinate columns, and the General chapter with descriptive statistics, correlations, missing values, outlier ranges, clusters and segments across all columns.

Bir and sha move together with a correlation of 0.905, indicating very strong alignment between these features, and bir shows similarly high correlations with mul and cla. No data duplicates or leakage were found, supporting data quality.

Most notable in the Data section:

• bir and sha move together (correlation 0.905)
• bir and mul move together (correlation 0.895)
• bir and cla move together (correlation 0.888)

Column Profiles

One row per column of the analyzed table: its role in the analysis (the target being predicted, a feature it is predicted from, or the segment column), its type, value count and missing count, and for numeric columns the mean, standard deviation, minimum, quartiles, maximum and interquartile range. A column with 25% or more missing values is flagged; its mean and quartiles describe only the rows that have a value.

These are the columns as supplied, before any modeling: the reference against which every later chapter reads.

Profiled 15 columns across 6,574 rows (15 numeric, 0 non-numeric): every column is at least 75% populated. Distributional statistics on numeric columns can be read at face value.

The first 10 rows of 15. The other 5 are in the notebook.

N columns

15

N high missing

0

N rows

6574

BEL

This chapter profiles bel: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize bel in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for bel reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs bel with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against bel, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of bel and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

BIR

This chapter profiles bir: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize bir in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for bir reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs bir with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against bir, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of bir and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

CLA

This chapter profiles cla: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize cla in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for cla reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs cla with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against cla, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of cla and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

CLO

This chapter profiles clo: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize clo in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for clo reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs clo with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against clo, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of clo and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

Day

This chapter profiles day: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures, every other column summarized for each of its values and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize day in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for day reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

The first 10 rows of 31. The other 21 are in the notebook.

By Value

The rows are grouped by the value of day, and every other column is summarized within each group with the same descriptive statistics. A statistic that shifts from group to group marks a column that moves with day; one that stays level marks a column that does not. Groups with few rows produce unstable figures, so the row count of each group is the first thing to read.

The first 10 rows of 31. The other 21 are in the notebook.

Correlation

Each row pairs day with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against day, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of day and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

DUB

This chapter profiles dub: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize dub in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for dub reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs dub with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against dub, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of dub and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

KIL

This chapter profiles kil: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize kil in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for kil reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs kil with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against kil, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of kil and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

Month

This chapter profiles month: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures, every other column summarized for each of its values and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize month in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for month reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

The first 10 rows of 12. The other 2 are in the notebook.

By Value

The rows are grouped by the value of month, and every other column is summarized within each group with the same descriptive statistics. A statistic that shifts from group to group marks a column that moves with month; one that stays level marks a column that does not. Groups with few rows produce unstable figures, so the row count of each group is the first thing to read.

The first 10 rows of 12. The other 2 are in the notebook.

Correlation

Each row pairs month with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against month, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of month and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

MUL

This chapter profiles mul: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize mul in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for mul reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs mul with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against mul, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of mul and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

ROS

This chapter profiles ros: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize ros in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for ros reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs ros with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against ros, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of ros and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

RPT

This chapter profiles rpt: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize rpt in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for rpt reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs rpt with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against rpt, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of rpt and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

SHA

This chapter profiles sha: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize sha in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for sha reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs sha with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against sha, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of sha and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

Target

This chapter profiles target: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize target in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for target reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs target with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against target, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of target and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

VAL

This chapter profiles val: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize val in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for val reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

Correlation

Each row pairs val with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against val, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of val and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

Year

This chapter profiles year: its distribution in figures and charts, and how it relates to the other columns. The Description chapter carries its figures, every other column summarized for each of its values and its correlation with every other numeric column. The Visualization chapter carries its charts.

Description

The figures below summarize year in numbers: where its values center (mean, median, mode), how far they spread (range, variance, standard deviation, interquartile range) and how they are distributed across percentiles. They are the reference for every chart in the Visualization chapter and for the correlation measures further down.

The row for year reads from left to right: location first, then spread, then shape. The symbols in the header row (x̅, σ, σ², IQR, {x}, |X|, and the percentile and decile columns) are defined in the Descriptive Statistics chapter under General in the Data section.

The first 10 rows of 17. The other 7 are in the notebook.

The first 10 rows of 18. The other 8 are in the notebook.

By Value

The rows are grouped by the value of year, and every other column is summarized within each group with the same descriptive statistics. A statistic that shifts from group to group marks a column that moves with year; one that stays level marks a column that does not. Groups with few rows produce unstable figures, so the row count of each group is the first thing to read.

The first 10 rows of 18. The other 8 are in the notebook.

Correlation

Each row pairs year with one other numeric column and reports how strongly the two move together, in which direction, and whether the association could be chance. Pearson's coefficient measures a straight-line relationship. Spearman's rho and Kendall's tau measure a monotonic relationship on ranks, which makes them resistant to outliers and lets them see a curved but consistently rising or falling pattern. A strong coefficient is an association, not an explanation: two columns can move together because a third one moves both.

The table lists every other numeric column against year, with three correlation coefficients, the significance of the Pearson coefficient and its confidence interval.

Visualization

The charts in this chapter were chosen from the type of year and of the columns it is compared with: a numeric column gets a histogram, a box plot and a value sequence, a categorical column gets a frequency chart, and each comparison with another column gets the chart that suits the pair. The charts complement the figures in the Description chapter; the shape of a distribution and the position of its outliers are easier to see than to read.

Duplicate Rows

This chapter counts rows that repeat another row exactly, value for value: how many rows take part in a duplicate group, how many groups exist, and how large the largest group is.

Duplicate rows inflate the apparent row count and can place identical rows on both sides of the training and held-out split, which flatters every quality figure in this report. Only exact repeats are detected here; rows that differ by a rounding digit or a whitespace variant count as distinct.

Across 6,574 rows the table has no exact duplicates: every row's value vector is unique across all columns, so the row count reflects distinct rows.

Largest group size

0

N exact duplicates

0

N exact groups

0

N rows

6574

N unique

6574

Pct exact duplicates

0

Verdict

Clean

Leakage Suspicion

For every numeric column that is not a target, this chapter reports the Pearson correlation with each target and flags any pair with an absolute coefficient of 0.95 or more as a suspected leak. A pair at 0.99 or more is Critical: at that level the column amounts to a renamed copy of the target, and a model trained on it looks perfect on the training rows and means nothing on new data.

A flagged pair is worth resolving before trusting any quality number in this report: either the column genuinely encodes the target and should be dropped, or it is a legitimate strong predictor and the quality is real. The correlation alone cannot tell the two apart; that judgment needs someone who knows where the column came from.

No leakage detected. No non-target column correlates with any target above the |ρ| ≥ 0.95 threshold. Predictive features appear genuinely predictive rather than encoded copies of the target.

Critical threshold

0.99

N critical

0

N suspects

0

Threshold

0.95

Verdict

Clean

General

The General chapter covers what holds across all columns together: descriptive statistics, correlations, missing values and outlier ranges under Description, the Clusters found among the rows, and, when a segment column was chosen, the Segments.

Description

This chapter summarizes every column at once: the descriptive statistics table below, then Correlation, Missing Values and Outlier Ranges. For a numeric column the table reports its center (mean, median, mode), its spread (standard deviation, variance, interquartile range, percentiles) and its shape (skewness, kurtosis); for a categorical column it reports the count and share of each category.

Each row of the table describes one column. The header symbols read as follows.

The first 10 rows of 34. The other 24 are in the notebook.

The first 10 rows of 15. The other 5 are in the notebook.

The first 10 rows of 15. The other 5 are in the notebook.

The first 10 rows of 15. The other 5 are in the notebook.

The first 10 rows of 15. The other 5 are in the notebook.

The first 10 rows of 61. The other 51 are in the notebook.

Missing Values

The table pairs each column's count of present values, in the Values column, with the row count of the processed table, in the Rows column. The difference is the number of missing values, and the larger it is, the less any statistic or model built on the column can be trusted.

• Below 5% missing: safe to use as it is.
• 5% to 25% missing: usable; filling the gaps or excluding those rows is worth considering.
• 25% or more missing: the column is flagged and receives its own chapter in the Data section. Verify why so much is missing before trusting any result that depends on it.

Outlier Ranges

The table is the five-number summary for every numeric column: Min, Q1, Median, Q3 and Max. Q1 and Q3 are the values below which 25% and 75% of the values fall, and the interquartile range is Q3 minus Q1. By the Tukey rule, a value more than 1.5 times the interquartile range below Q1 or above Q3 is a possible outlier. A Min far below that lower bound means extreme values in the lower tail; a Max far above the upper bound means extreme values in the upper tail.

Extreme values can be real (rare but legitimate rows) or errors (measurement mistakes, data-entry slips). Which case applies decides whether to keep, clip or drop them before trusting a model that uses the column.

Correlation

This chapter measures how pairs of numeric columns move together: the Correlation Measures table below, the Strongest Correlations, the Correlation Heatmap and, when the analysis has targets, the Potential Data Leaks. A correlation states association, not causation.

The table lists every pair of numeric columns once, with three correlation coefficients, the significance of the Pearson coefficient and its 95% confidence interval.

105 column pairs analyzed across 6,574 rows; 85 (81%) clear the q < 0.05 significance bar after BH-FDR. Significant pairs are flagged in the matrix below; non-significant cells may still show large coefficients but they are not distinguishable from chance at this row count.

N pairs

105

N samples

6574

N significant

85

The first 10 rows of 24. The other 14 are in the notebook.

Strongest Correlations

The 20 pairs of columns with the smallest q-values: the correlations that remain significant after the Benjamini-Hochberg adjustment for the number of pairs tested. Among all pairs reported with q below 0.05, about 5% or fewer are expected to be false discoveries; a pair above 0.05 may be coincidence even when its Pearson coefficient looks strong.

A pair with an absolute Pearson coefficient above 0.9 often signals a duplicate or derived column. Moderately strong pairs with a low q-value are the relationships most worth investigating.

Correlation Heatmap

Every pair of numeric columns colored by its Pearson correlation coefficient. The color scale is fixed: blue at -1, pale yellow near 0 and red at +1, so a color means the same strength in every analysis, and a table whose coefficients are all positive shows no blue. The diagonal is each column correlated with itself and always sits at +1. Off-diagonal blocks of one color point to groups of columns that carry the same information.

Potential Data Leaks

The table lists the correlation between every column and each target, with the p-value and the q-value. A Pearson coefficient close to +1 or -1 with a target, together with a q-value near zero, is one of two things: a genuinely strong relationship, or a data leak, a column derived from the target after the fact, such as a tax amount computed from the price being predicted. A leaked column trains a model that looks perfect and fails on new data, because the leak is not available at prediction time.

The Leakage Suspicion chapter in the Data section applies the 0.95 and 0.99 thresholds to these pairs and issues the verdict; a flagged pair is resolved there before any quality figure is relied on.

Clusters

Rows are grouped into three clusters by k-means over the numeric columns, and the table shows each cluster's descriptive statistics side by side. Differences in mean, median and spread between clusters point to row-level structure that no single column states, such as two kinds of customer or two kinds of transaction.

Cluster labels are arbitrary integers; only the composition matters. Rows without usable numeric values are placed in cluster -1.

Model

The Model section presents one model per target: its formula, its predictions on held-out rows, the features it relies on, the baselines it is measured against, and diagnostics of how it behaves. With more than one target, the Composite Model, Multi-Output and Leaderboard chapters read the models as a set.

Clo carries most of the model, accounting for all of its reliance on features, while the model on target loses to the Linear regression baseline by 11 points of variance explained, signaling a need for model improvement. Several concerns and high-correlation pairs were flagged in the Concerns chapter.

Most notable in the Model section:

• clo carries most of the model (100% of its reliance on features)
• The model on target loses to the Linear regression baseline by 11 points of variance explained

The concerns raised about this section are listed in the Concerns chapter.

Target

The Model section builds one model for target: a formula that expresses it through the other columns. Diafunc searches the space of mathematical expressions for the formula that balances accuracy against simplicity, so the result is not a black box but an expression that can be read, evaluated and questioned. The chapters that follow show the formula, score it on rows it never saw during training, and take it apart term by term.

Target Model

The three gauges score the model the search settled on. All three are measured on the rows the model trained on.

Quality is a training figure and is not the held-out R². The held-out R² measures the model on rows it never saw during training and is the figure to quote for how the model generalizes; it is reported in the Generalization chapter beside the training R², and in the Baselines chapter beside the reference predictors. The time and budget gauges account for the computation that produced the model, not for the model itself.

The model relies entirely on clo, with target rising as clo rises.

target = fma(1.16, clo, 5.5)

Held out R²

0.63982 (95 % CI 0.6052 – 0.67346)

Held-out rows

1315

N inputs

1

N terms

1

Prediction

The model predicts target for any row that supplies the other columns. This chapter applies it to the held-out rows, the rows set aside before training, so that the predictions can be compared with values the model never saw. The feature table, the prediction function and its output below are the raw material for the Prediction Chart and the distribution chapter that follow.

The function below selects the held-out rows from the processed data and keeps the columns the model takes as inputs.

One row per held-out row and one column per input feature, in the form the model reads. This table feeds the prediction function below.

The function below evaluates the model for every row of the feature table and returns the predicted target for each.

The predictions of target for the held-out rows, one value per row of the feature table.

Prediction Chart

Actual target on the horizontal axis against the model's predicted value on the vertical axis, for the held-out rows the model never saw during training. Points on the diagonal are perfect predictions; systematic vertical offsets reveal bias, vertical spread reveals noise, and points far from the diagonal are rows the model handles poorly.

R² of 0.64: moderate. The model explains a meaningful share of the variance but a substantial residual remains; the Worst Predictions chapter shows where it fails. Mean absolute error is 3.04 on the target's scale.

Error

36.02 % (95 % CI 32.65 % – 39.48 %)

MAE

3.042 (95 % CI 2.913 – 3.171)

N

1315

N fit

5259

Quality

63.89 % (95 % CI 60.42 % – 67.26 %)

R²

0.63982 (95 % CI 0.6052 – 0.67346)

Target

target

Residual Distribution

How the held-out residuals (actual target minus predicted) are distributed. Bias is their mean: a value away from zero means the model is systematically high or low rather than merely imprecise. The standard deviation and the percentiles describe the spread, and the tail percentiles say how large the worst misses get. Every figure carries a bootstrap 95% confidence interval; with a small held-out set those intervals are wide, and that width is itself the finding.

Bias

-0.12994 (95 % CI -0.34291 – 0.08313)

N

1315

P50

-0.21 (95 % CI -0.53 – 0.11)

P90

4.769 (95 % CI 4.462 – 5.08)

P95

6.303 (95 % CI 5.74 – 6.931)

P99

10.14 (95 % CI 8.5 – 10.61)

Std

3.903 (95 % CI 3.728 – 4.094)

Which inputs matter most

The chart ranks the features of the target model by permutation importance: how much the model's error rises when that feature's values are shuffled across rows so that it carries no information. A longer bar means the model relies on the feature more. The order says which columns the model reads most, and those are the columns where measurement quality and data collection matter most. A short bar marks a feature the model barely uses, which is a fact about this model and not a verdict on the column. Importance describes the model's reliance and nothing more: a feature can rank high because it stands in for something the data does not contain.

Baselines

The table scores the model for target against three reference predictors on the same held-out rows. The mean baseline always predicts the training average and is the floor: a model below it is worse than a constant. The median baseline always predicts the training median and holds up better when the target is skewed. The linear regression baseline is a straight-line model over all numeric features and appears when the data has at least one; it captures everything a linear relationship can. The Ufinq model is the last row.

Read the R² and MAE columns from top to bottom. When the model clears every baseline by a wide margin, its structure earns its place. When it is level with the linear regression baseline, the relationship is linear and the extra structure adds nothing. When it is level with the mean baseline, the features carry no usable signal for target. R² reaches 1 for perfect prediction and falls below 0 when a predictor is worse than the mean; MAE is the average absolute miss in the units of target.

The model does not beat a naive baseline (R² lift -0.111). At least one of the mean, median or linear regression baselines predicts the held-out target better; the model's complexity is not buying anything yet. Either the target does not depend on the features, or more data or different features are needed.

Best baseline R²

0.75096

Effect size d

-0.28761 (95 % CI -0.34033 – -0.23593)

Effect size d magnitude

small

Model MAE

3.042 (95 % CI 2.913 – 3.171)

Model R²

0.63982 (95 % CI 0.6052 – 0.67346)

Held-out rows

1315

Target

target

Generalization

The chart sets the R² of the target model on the rows it trained on beside its R² on the held-out rows it never saw, and the gap between the two bars is the finding. The held-out bar carries a bootstrap 95% confidence interval, which says how far that figure could move with a different held-out draw; the training bar has none, because it is measured on the rows that shaped the model.

The verdict reads from the two figures. Generalizing: the held-out R² is strong, or training and held-out agree closely; the structure the formula encodes carries to new rows. Overfit: training is far ahead of held-out and the held-out R² is not strong on its own; the formula has absorbed noise from the training rows, and the training figure overstates what to expect on new data. Underfit or noisy: held-out is far ahead of training; this is not strength, it usually means an outlier or a flat region in the training rows that the held-out rows happen to avoid. Insufficient: fewer than 30 held-out rows and no strong held-out R², too little evidence for a negative verdict. In every case the width of the held-out interval says how much weight the gap can bear.

The model explains held-out rows about as well as training rows (held-out R² 0.64, gap between training and held-out R² 0.0233): it generalizes. The structure the formula encodes carries from the training rows to the held-out rows.

Generalization gap

0.0233

N test

1315

Target

target

Test error

3.042 (95 % CI 2.913 – 3.171)

Test R²

0.63982 (95 % CI 0.6052 – 0.67346)

Train error

0.32124

Train R²

0.66312

Verdict

Generalizing

Per-Term Partial Dependence

The formula for target is split into its additive terms, and each term is traced as one of its inputs moves across the training range while the other inputs stay at their medians. Each curve is therefore a profile of the term at the typical row, not an average over the data: it shows what the term contributes at every value of that input when everything else is ordinary.

A term that depends on several inputs gets one curve per input; a constant term gets none. Terms the formula subtracts are drawn with their sign, so a curve below zero pulls the prediction down. At any fixed row, the terms add up to the model's prediction. The notebook lets the reader trim each range to the central 95% of the input. When the formula has no additive structure, the chapter traces the whole formula as a single term along each of its inputs, and the Sensitivity chapter is the better read for how the inputs combine.

The formula is not additively decomposable: the prediction comes from a single non-separable expression. The curve below shows the whole-formula response.

Additive

No

N terms

1

Notation

fma(1.16, clo, 5.5)

Target

target

Symbolic Behavior and Extrapolation

The formula for target is read as a mathematical object, without data, to state how it behaves beyond the range it was trained on. A black box cannot answer that question; a formula can. For each input the chapter reports the limit as the input grows without bound in either direction (whether the formula diverges, settles to a finite value or oscillates, with the sign tracked exactly, so that a term like minus two times the cube of the input is reported as diverging downward on the right and upward on the left), whether the formula stays finite in every direction, and any singularity with its solved location: a division whose denominator reaches zero, a logarithm or square root whose argument leaves its domain, or a periodic pole.

The inputs along which the formula diverges or meets a singularity are listed as the risky ones; along them the formula's shape gives no support for extrapolation. A formula that stays finite everywhere with no singularity carries no structural hazard when extrapolated; the data still ends where it ends, and a prediction outside the training range remains unsupported by evidence. The plain-language summary at the end states the same facts in one paragraph.

How the model behaves beyond the observed range of clo could not be determined from the formula, so extrapolation there is not assessed. Extrapolate with caution.

Bounded at infinity

No

N inputs

1

N singularities

0

Target

target

Per-Row Contribution Waterfall

For up to five representative held-out rows, the chapter draws one bar chart showing how each additive term of the formula builds that row's prediction of target. The five rows are the worst prediction (largest absolute residual), the best (smallest), the median miss, the row with the smallest prediction and the row with the largest. When two roles fall on the same row, which is common with few held-out rows, the earlier role keeps it and fewer than five charts appear.

In each chart the bars stack the terms' contributions at the row's feature values, terms the formula subtracts sit below zero, and the bars sum to the prediction. The dashed line marks the actual value; the distance between it and the top of the stack is the residual. The bars are evaluated at the same precision as the predictions, so they agree with the Prediction Chart. When the formula has no additive structure, each chart holds one bar for the whole formula, and the Sensitivity chapter is the better read for how individual inputs move it.

Additive

No

N rows

5

The notebook draws this chapter's figure from each held-out row; the row-by-row detail is there.

Term Ablation

For each additive term of the formula for target, the chart shows how much the held-out R² drops when that term is replaced by its mean contribution, so that it no longer varies from row to row. The bars are sorted from the largest drop down, and the dashed line marks the R² of the full model.

A large drop means the term carries real predictive work; the complexity it adds is paid for. A small drop means the term adds little beyond its average value: it may refine a stronger term, or its curve in the Per-Term Partial Dependence chapter may be nearly flat. A negative drop means the held-out R² rises without the term, which is a sign that the term tracks noise in the training rows. Each figure describes what a term contributes inside the model as discovered; the chart diagnoses the model, it is not a guide to removing terms. When the formula has no additive structure, the chart shows one bar for the whole formula.

Full-formula R² is 0.64. The formula is non-decomposable, so ablation collapses to a single bar; the Per-Term Partial Dependence chapter is the better surface in this case.

Additive

No

Baseline R²

0.63982

Held-out rows

1315

The notebook draws this chapter's figure from each held-out row; the row-by-row detail is there.

What-If

The chapter shows the model's prediction for target at one input combination, with the contribution of each term stacked beneath it. The inputs start at their training medians, so the first view is the prediction for a typical row, and each input can move within the range the training rows cover; the notebook lets the reader change the inputs and watch the prediction and the stack update.

In the stack, a long bar marks the term that dominates at this input combination, often the one whose removal costs most in the Term Ablation chapter. A short bar marks a term that makes a small adjustment here; the Per-Term Partial Dependence chapter shows whether it stays small everywhere or grows toward the edges of the range. A negative bar marks a term that pulls the prediction down at this point, either because the formula subtracts it or because it evaluates below zero.

The inputs stay inside the training range for a reason: the formula computes a value anywhere, but outside that range no training row supports it. When the formula has no additive structure, the stack holds a single bar for the whole formula and the inputs move the prediction directly.

Additive

No

Held-out rows for the interval

1315

N terms

1

Residual P5

-6.148

Residual P95

6.303

Residual std

3.903

Sensitivity

For each input feature, the chart traces the rate at which the predicted target changes as that feature moves across its training range, with the other inputs held at their medians. The rate is the local slope of the prediction with respect to the feature, measured by a small finite difference at each point. A table summarizes each feature with the mean, minimum and maximum of the absolute slope, which ranks the inputs by how strongly the prediction responds to them.

A flat curve means the model is close to linear in that feature: the prediction responds at the same rate everywhere in the observed range, which is easy to state and says nothing about values beyond that range. A curve that grows or shrinks marks diminishing or accelerating returns, and whether that is plausible is a question for the domain. A curve that crosses zero means the prediction rises with the feature in one part of the range and falls in another, which is either a real optimum or a sign that the formula bends around a few rows. A curve with a large magnitude marks a feature to which the prediction is highly responsive; the Term Ablation chapter says whether the term behind it also carries predictive work.

In the table, the mean absolute slope ranks the features by typical responsiveness. A minimum close to the maximum means the responsiveness is nearly constant; a wide gap means it varies strongly across the range. The chapter reads the whole formula, so it applies whether or not the formula splits into terms.

No numeric input statistics are available, so sensitivity curves cannot be plotted. The training table provides no numeric ranges for the formula's free features.

Additive

No

N terms

1

2-Feature Interactions

When a single term of the formula combines two or more inputs, the prediction's response to one of them depends on the value of the other. This chapter draws one surface for each such pair: the predicted target across the plane of the two features, with every other input held at its training median. Pairs that never share a term have no interaction by construction, and the Per-Term Partial Dependence curves already say everything about them.

Parallel stripes mean the two features act almost independently, so the surface is close to a sum of two one-feature curves. Curved contours mean a real interaction, where the slope along one feature changes with the other; the location of the peak or trough matters. A saddle, rising along one axis and falling along the other, marks a trade-off between the two. A sharp edge or cliff means the formula encodes a change of regime, and the Per-Term Partial Dependence curve for the same feature shows whether the bend appears there too.

The grid is deliberately coarse, and the color scale runs from low to high predictions. When the formula has no additive structure, the single whole-formula term holds every input, so every pair appears; the number of surfaces is capped for models with many features.

The formula is non-decomposable: every pair of features potentially interacts. The heatmaps show the full-formula response across each pair's plane.

Additive

No

N terms

1

Worst Predictions

The held-out rows on which the model misses target by the most, sorted by absolute residual with the largest first and capped at ten. Each card shows the row's actual value, the prediction, the residual, the contribution of every additive term at that row and the row's feature values. R² and MAE say how good the model is on average; these cards say where it fails and let each failure be read feature by feature and term by term.

A large residual with one dominant term means that term produced the wrong value at this row; the row's value for that feature, read against the Per-Term Partial Dependence curve, shows whether it fell in a region the formula models poorly. A large residual with balanced contributions means every term was a little off and the sum still missed, which points to a shape the formula cannot represent in that region. Residuals that change sign from card to card mean the misses are not a consistent bias but scattered errors on particular rows. When the formula has no additive structure, each card shows a single whole-formula contribution.

The worst held-out row was missed by 23.1 (target's scale). The 10 rows with the largest absolute residuals out of 1,315 held-out rows are shown. Each card breaks the failure down into per-term contributions and feature values, so the failure mode is inspectable. A large residual with one concentrated term contribution means one term got this row wrong; a large residual with balanced contributions means a structural mismatch.

Additive

No

N extrapolated

0

Held-out rows

1315

Held-out rows for the interval

1315

Residual P5

-6.148

Residual P95

6.303

Residual std

3.903

Prediction Interval Coverage

Each held-out prediction of target carries a prediction interval, and this chapter checks whether that interval covers the actual value as often as it claims. The interval reported with each prediction is built from the held-out residuals themselves: its bounds are the 2.5th and 97.5th percentiles of the residuals added to the prediction, so it is asymmetric when the residuals are skewed and assumes no particular error distribution.

The coverage table checks a second, simpler band: the symmetric interval that a normal error distribution with the residuals' standard deviation would give. At four nominal levels (50%, 80%, 90% and 95%) it lists the half-width of that normal band and the share of held-out rows whose actual value falls inside it. Empirical coverage close to nominal means the residuals are close enough to normal that the two bands agree and the interval can be taken at face value. Empirical coverage below nominal means the normal band is too narrow, the residuals have heavier tails than a normal distribution, and the percentile-based interval is the one to trust. Empirical coverage above nominal means the normal band is wider than the data needs, usually because a few large residuals inflate the standard deviation. Every figure comes from the same held-out residuals the intervals are built from.

Across 1,315 held-out rows, the 95% prediction interval actually covers 95% of the rows, within 2.24 percentage points of the promise across every level reported. The per-row prediction interval can be trusted at face value.

Largest miss (percentage points)

2.243

Held-out rows

1315

Residual P2.5

-7.491

Residual P97.5

7.76

Verdict

well-calibrated

Regression Diagnostics

Four residual diagnostics for target, all computed from the held-out residuals. Each asks in its own way whether the model's errors look like noise, which is what remains when a model has captured all the structure the data holds.

Residuals against predicted values: Each held-out row is plotted with the model's prediction on the horizontal axis and its residual on the vertical axis, around a zero line. A symmetric cloud around zero means errors of similar size across the predicted range and no systematic bias. A funnel or fan means the size of the errors depends on the predicted value: the model is more uncertain in some regions than in others, and its prediction interval is not equally trustworthy everywhere. A curved pattern, a smile or a frown, means the model misses a structural component; the Per-Term Partial Dependence and 2-Feature Interactions chapters show the shapes the formula does capture.

Normal Q-Q plot: The sorted residuals are plotted against the quantiles of a normal distribution, with the diagonal marking a perfectly normal set of residuals. Points that hug the line mean approximately normal residuals, so the normal band in the Prediction Interval Coverage chapter will hold. An S-shape means heavier or lighter tails than normal; heavier tails (below the line at the left, above it at the right) mean the model occasionally produces large errors. A banana or arc means skewed residuals: the model is systematically high or low in part of the range.

Histogram: The residuals binned into equal-width intervals. A bell centered on zero means symmetric errors with no bias. An off-center bell means the model is biased, with a mean error away from zero. A long tail or two peaks mean outliers or two regimes inside the prediction range.

Autocorrelation: For each lag, the correlation of the residual sequence with itself shifted by that many rows, with the band that pure noise would stay inside at plus or minus 1.96 divided by the square root of the row count. Bars inside the band mean uncorrelated residuals with no order-dependent structure left. A bar at lag 1 outside the band means adjacent residuals correlate, usually a time component when the rows are time-ordered. A wave across the lags means periodic structure remains, and the Time Series chapter in the Data section is where to look for its period.

Autocorrelation carries meaning only when the row order itself does, as in a time series or a sequence. For an unordered table it looks like noise even when the other three diagnostics find fault, so it is read alongside them, never alone.

1,315 held-out residuals, with a spread up to 23.1 in absolute terms. Mean residual is -0.13, close to zero. The model is approximately unbiased on these held-out rows (a small held-out set makes this less reliable; the Prediction Chart chapter carries the 95% confidence interval). The four charts below check whether the errors look like noise: a pattern in residuals-vs-fitted or a curving Q-Q means a structural miss; a spike at ACF lag 1 means structure tied to row order leaked through.

Abs residual vs predicted r

0.15306

Autocorrelation lag 1

-0.02951

Autocorrelation noise band

0.05405

Bias

-0.12994

Bias over residual sd

-0.0333

Held-out rows

1315

Residual sd

3.903

Share within normal band

0.95209

The notebook draws this chapter's figure from each held-out row; the row-by-row detail is there.

Search Progress

The line traces the best quality the search for the target model had reached at each generation, from the first generation to the last. Quality is the technology's combined score on the training rows, the figure the Model Metrics chapter defines. A curve that flattens well before the last generation means the search converged: the budget was more than enough, and the model is the one the search settled on. A curve still rising at the last generation means the budget ended before the search settled, and the model is the best the search reached within it. The chart describes the search, not the data: it says whether the search had time to settle, not whether more rows would help.

The search ran for 13 generations, ending at quality 0.677 (gain +0.0233 from generation 0). The curve climbs modestly: most of the lift happened early, so the search has largely converged. A small increase in computation time may extract a few more points.

First generation

2

First quality

65.35 %

Last generation

14

Last quality

67.68 %

Max quality

67.68 %

N points

13

N total generations

13

Model Constraints

Sanity checks on the target formula, run against the held-out rows. Three checks: every prediction is a finite number (output coherent), predictions stay within the range of the training target widened by two standard deviations on each side (within domain), and no single prediction runs away more than ten standard deviations from the training mean (bounded predictions).

These are pass or fail guards, not quality measures: a formula can clear all three and still predict poorly. A failure is the stronger signal. It means the expression misbehaves numerically somewhere in the data it was shown, and any downstream use of it should wait until that is understood.

Across 1,315 held-out predictions, the formula is mathematically well-behaved: every output is finite, stays inside the training-target ±2σ band, and no prediction runs away beyond the bounded-prediction limit. It is safe to consume downstream at face value.

Held-out rows

1315

N non finite

0

N outside domain

0

N runaway

0

Verdict

Clean

Modeling

The function below trains the model for target on the processed data. Its output is the model that every other chapter of this section scores and dissects.

Measured during the search, on the rows the model was fitted on

Error

32.12 %

N train

5259

Quality

67.67 %

Findings

12 findings from the model diagnostics (1 Critical, 10 Warning, 1 Info) are listed in the Concerns chapter at the top of the analysis.

Implications

The Implications section states how to act on the models: the Stakeholder Summary and the Recommended Next Data, where the models hold and where they weaken (Per-Segment Quality, Out-of-Distribution, Per-Segment Predictions, Fairness), what to weigh before relying on them (Causal Honesty, Deployment Readiness), and the Provenance & Audit trail a reviewer needs to retrace the analysis.

Fifty-four percent of the held-out rows lie outside the range the model was trained on, raising critical deployment concerns highlighted in the Concerns chapter.

Most notable in the Implications section:

• 54% of the held-out rows lie outside the range the model was trained on

The concerns raised about this section are listed in the Concerns chapter.

Stakeholder Summary

The model explains 64% of the variation in target and relies entirely on the feature clo. For comparison, always predicting a straight line through the data explained 75%, so the model added no value over this reference.

The model did not beat always predicting a straight line through the data and should not be relied on for decisions. The check also flagged a high number of held-out rows outside the range the model was trained on. Validate on a fresh sample before deciding whether to trust this model.

Recommended Next Data

• Collect more rows that expand the range of the data, especially for the target, as 54% of held-out rows are outside the training range. Reason: the model generalizes poorly when predicting outside its training boundaries, as flagged by oodPercent at 54%.
• Add predictive columns beyond clo. Reason: the model uses only 1 of 14 columns, suggesting that relevant predictors are missing or underused, and quality stands at 64%.
• Inspect how the target is defined and measured. Reason: the model explains 64% of the variation but loses to a basic linear regression baseline by 11 points, flagged as a critical concern.
• Examine and address the highly correlated columns, especially those involving bir, cla, clo, kil, mul, and sha. Reason: the diagnostics flagged multiple pairs with high correlation, which can limit model interpretability and effectiveness.

Quality by Input Range

Per-Segment Quality splits the held-out rows by every usable feature and compares each segment's R² with the overall held-out R². A numeric feature is split into quartiles; a categorical feature with at most ten values is split by value. A segment with fewer than three held-out rows is left out, because its gap would be noise.

The chart is sorted from the worst gap to the best. Each bar is the segment's R² minus the overall R².

• Negative bars: the model is weaker on these rows than its headline R² implies. A segment 0.25 or more below the overall value reads much weaker; a segment 0.10 to 0.25 below reads weaker. These are the segments to treat with caution.
• Positive bars: the model is stronger on these rows than overall. A strong segment can mask weakness elsewhere, so the negative segments come first.

Target by Input Range

Segment year = q3 performs in line with the aggregate (293 held-out rows): segment R² 0.724 against aggregate R² 0.64 (gap 0.0837). No quality drift detected.

Column

year

Gap vs aggregate

0.0837

MAE

2.638

N

293

R²

0.72352

Residual mean

0.84842

Value

q3

Verdict

Consistent

Out-of-Distribution

Out-of-distribution detection finds held-out rows that lie far from the rows the model was trained on. For each numeric feature, a row's value is standardized against the training mean and standard deviation; the combined standardized distance across all features is compared with a fixed line at 3.0. Rows beyond that line are flagged as out of distribution: the headline quality is unlikely to apply to them. The more features the model uses, the more rows cross this fixed line, so the flagged share reads against the feature count rather than as an alarm rate.

The chart shows one bar per held-out row in row order; the flagged rows are the bars at or above the line.

The check treats features independently, so it will not notice a rare combination of values that are each ordinary on their own, such as a large height with a small weight. It is a first screen. A decision that depends on catching unusual inputs needs a dedicated check.

715 of 1,315 held-out rows (54%) exceed the diagonal-Mahalanobis z = 3.00 bracket: far from the training-row distribution on at least one feature axis. That is most of the held-out set: the evaluation is largely testing extrapolation, not in-range behavior. The headline R² and MAE reflect the model's extrapolating behavior rather than its in-range quality; a deployment verdict needs additional in-range held-out rows.

Held-out rows out of distribution

715

Held-out rows measured

1315

Share out of distribution (%)

54.37

Distance line

3

Causal Honesty

Diafunc fitted a formula that captures the structure in the training data. That structure is correlative: it states what predicts what in this data. It does not establish that any feature causes the target.

A correlative model is the right tool for predicting future outcomes from similar inputs, for exploring which features carry information about the target, and for an early-stage diagnostic or screening tool.

A correlative model is not the right tool for claiming that intervening on a feature will change the outcome, for attributing outcomes to specific causes for accountability, or for choosing between policies that act on the inputs.

To upgrade to causal claims

• Controlled experiment: Randomize the feature to be acted on, then analyze again. Randomization breaks confounding, so any change in the target is attributable to the feature.
• Natural experiment: Find a setting where the feature varied for reasons unrelated to the target, an instrumental variable. Variation of that kind supports causal inference.
• Causal graph: Write out what plausibly causes what, then check whether the model's terms are consistent with the conditional independences the graph implies.
• Control for confounders: If a third variable plausibly moves both the feature and the target, stratify by it or condition on it before fitting again. Gaps in the Per-Segment Quality chapter are a clue.

The Per-Segment Quality, Fairness and Concerns chapters show the most common confounding patterns in the data.

The model is correlative: it captures which columns predict the target in the training data, not whether changing one would change the other. Predictions are reliable for inputs that look like the training distribution; they are not evidence that intervening on a feature will change the target. The 4 upgrade pathways below show what evidence would support a causal claim.

Deployment Readiness

The analysis ran with the configuration below. The computed checks and the verdict follow once the diagnostics have run.

• Targets: 1 target: target
• Rows: 6,574 rows
• Per-Segment Predictions: not produced, because no segment column was chosen
• Fairness: not assessed, because the data has no categorical column other than the target
• Out-of-Distribution: held-out rows are scored against the training rows; predictions made outside this report are not scored
• Provenance & Audit: recorded in the chapter of that name

Across 5 checks (3 pass, 0 warn, 2 fail, 2 critical concerns), at least one check fails or a critical concern is open: Not ready. The failing checks need addressing first; they typically indicate data leakage, severe miscalibration, or a model that loses to a trivial baseline.

N critical concerns

2

N fail

2

N pass

3

N warn

0

Overall verdict

Not ready

Provenance & Audit

This record captures the inputs and configuration that produced the report, so the analysis can be reproduced or the result defended in an audit.

Findings

1 finding from the implications diagnostics (1 Critical) is listed in the Concerns chapter at the top of the analysis.