Research / BFI Working PaperMar 05, 2024

Can Machines Learn Weak Signals?

Zhouyu Shen, Dacheng Xiu

In high-dimensional regression scenarios with low signal-to-noise ratios, we assess the predictive performance of several machine learning algorithms. Theoretical insights show Ridge regression’s superiority in exploiting weak signals, surpassing a zero benchmark. In contrast, Lasso fails to exceed this baseline, indicating its learning limitations. Simulations reveal that Random Forest generally outperforms Gradient Boosted Regression Trees when signals are weak. Moreover, Neural Networks with ℓ2-regularization excel in capturing nonlinear functions of weak signals. Our empirical analysis across six economic datasets suggests that the weakness of signals, not necessarily the absence of sparsity, may be Lasso’s major limitation in economic predictions.

More Research From These Scholars

BFI Working Paper May 14, 2019

Predicting Returns with Text Data

Dacheng Xiu, Zheng Tracy Ke, Bryan Kelly
Topics:  Financial Markets
BFI Working Paper Jul 7, 2021

Test Assets and Weak Factors

Stefano Giglio, Dacheng Xiu, Dake Zhang
Topics:  Financial Markets
BFI Working Paper Jul 24, 2023

Financial Machine Learning

Bryan T. Kelly, Dacheng Xiu
Topics:  Technology & Innovation, Financial Markets