Integral representations of shallow neural network with Rectified Power Unit activation function

Abstract

In this effort, we derive a formula for the integral representation of a shallow neural network with the Rectified Power Unit activation function. Mainly, our first result deals with the univariate case of representation capability of RePU shallow networks. The multidimensional result in this paper characterizes the set of function that can be represented with bounded norm and possibly unbounded width.