Ridge
Overview
Ridge sensitivity fits a linear model with L2 regularization to numerical parameters only. The Importance Chart ranks |β|; the Sensitivity Heatmap shows signed coefficients. Signs describe increasing/decreasing linear contributions, not causality. Strong nonlinearity and interactions are not represented by this model.
Supported inputs and model scope
- Optuna Int/Float parameters are supported. Optuna categorical choices are nominal, including numeric-looking labels.
- Categorical parameters are excluded from the fit and displayed separately as Unsupported (categorical) in charts, heatmaps and CSV. They have no coefficient, score, bar, colored score cell or ranking, not zero importance.
- On mixed input, R² (numerical-only) assesses the numerical-only model. It does not assess the excluded categorical effects or a full mixed model.
- All-categorical input shows No supported numerical parameters. No Ridge model is fitted, so no coefficients or Ridge R² are reported.
- Numerical missingness handling filters rows non-finite in any included numerical feature or the objective before sampling/splitting. Missing numerical values do not turn a parameter into categorical unsupported.
Calculation and fit quality
Using training-set column means and standard deviations, standardize the numerical input matrix X, center y, and solve:
Importance is |β_j|. R² is evaluated on a seeded 80/20 holdout split using training statistics; very small datasets use all data for both training and evaluation. Negative R² values are clipped at zero; signed coefficients are not. Permuting numerical rows can change the seeded holdout assignment, so Ridge results can depend on row order.
A low numerical-only R² can reflect excluded categorical effects as well as nonlinear effects. Do not interpret it as evidence that categories are irrelevant.
For derivations and numerical examples, see the detailed numerical theory. The numerical-only input restriction applies to Ridge sensitivity, not to Ridge surrogate fitting in PDP, Sobol or other workflows. See the method guide for the encoding limitations of other methods.