Marcell T. Kurbucz, Nikolaos Tzivanakis, Nilufer Sari Aslam, Adam M. Sykulski
arXiv 21 May 2025 · Machine Learning
arXiv:2505.15423 · PDF · DOI · OpenAlex · Extracted main text
Capturing nonlinear relationships without sacrificing interpretability remains a persistent challenge in regression modeling. We introduce SplitWise, a novel framework that enhances stepwise regression. It adaptively transforms numeric predictors into threshold-based binary features using shallow decision trees, but only when such transformations improve model fit, as assessed by the Akaike Information Criterion (AIC) or Bayesian Information Criterion (BIC). This approach preserves the transparency of linear models while flexibly capturing nonlinear effects. Implemented as a user-friendly R package, SplitWise is evaluated on both synthetic and real-world datasets. The results show that it consistently produces more parsimonious and generalizable models than traditional stepwise and penalized regression techniques.
appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.
The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.
| Reference | Intensity | Mentions | Sections | Main text | |
|---|---|---|---|---|---|
| 1 | Raymaekers J, Rousseeuw PJ, Verdonck T, et al (2024) Fast linear model trees by pilot | 0.644 | 2 | 2 | 100% |
| 2 | Henderson HV, Velleman PF (1981) Building multiple regression models interactively | 0.511 | 2 | 1 | 100% |
| 3 | Therneau T, Atkinson B, Ripley B (2025) Recursive Partitioning and Regression Trees | 0.511 | 2 | 1 | 100% |
| 4 | Akaike H (1974) A new look at the statistical model identification | 0.405 | 1 | 1 | 100% |
| 5 | Breiman L, Friedman JH, Olshen RA, et al (1984) Classification and Regression Trees | 0.405 | 1 | 1 | 100% |
| 6 | Breiman L (2001) Statistical modeling: The two cultures | 0.405 | 1 | 1 | 100% |
| 7 | Caruana R, Lou Y, Gehrke J, et al (2015) Intelligible models for healthcare: Predicting pneumonia risk and hospital 30-day readmission | 0.405 | 1 | 1 | 100% |
| 8 | Doshi-Velez F, Kim B (2017) Towards a rigorous science of interpretable machine learning | 0.405 | 1 | 1 | 100% |
| 9 | Efroymson MA (1960) Multiple regression analysis | 0.405 | 1 | 1 | 100% |
| 10 | Fong Y, et al (2017) chngpt: threshold regression model estimation and inference | 0.405 | 1 | 1 | 100% |
Showing the top 10 of 33 scored citations.