relu

Can ReLU Cause Exploding Gradients if Applied to Solve Vanishing Gradients?

The exploding and disappearing gradient problems are the issues that arise when using gradient-based learning methods and backpropagation to train artificial neural networks.