cs.CCcs.CGcs.LG

Two $\operatorname{ReLU}$ Layers is All You Need

📅 👥 5 authors arXiv:2610.28587v1

Authors

Abstract

We prove that every $\operatorname{ReLU}$ network can be exactly simulated by a $\operatorname{ReLU}$ network with two hidden layers. We present two proofs: one that is based on fillings in homological algebra and a direct combinatorial proof.

Paper Information

arXiv ID:
2610.28587v1
Published:

Related Categories

cs.CCcs.CGcs.LG