Rounding Error Analysis of Artificial Neural Networks in Floating-Point Arithmetic
The increasing size and computational cost of modern artificial neural networks have led to a massive use of low precision floating-point arithmetic to improve computation performance and reduce memory requirements. However, the use of reduce precision introduces rounding errors whose influence on the accuracy and stability of neural network computations is not yet fully understood....