4 docs tagged with "Generalization"

The empty space phenomenon, distance concentration, and overcoming high dimensionality via feature selection and PCA projection.

Memorizing noise versus learning generalizable structure, the bias-variance tradeoff, and L1, L2, and Elastic Net regularization.

Tuning hyperparameter lambda and C via grid search, warm-start path algorithms, and understanding scikit-learn solver-penalty compatibility.

The train-test split lottery, understanding why multiple splits estimate generalization reliably, and the sealed test set protocol.