The Sigmoid function is a mathematical function having a characteristic "S"-shaped curve or sigmoid curve.
When the sigmoid function is used in
AI Neural networks to calculate
bias within the layers of a Neural network this function is repeated and calculated for each neuron. The function must be simplified (or squished) to result in a usable function that can be used to program an
AI software program.
In order to simplify the use of these functions, sigmoid function weights and activations are organized into columns into vectors resulting in a matrix
vector product which will be the
bias vector, as a final step the sigmoid is wrapped around the
vector function. The results of these vectors can be symbolically represented in a simplified function, which then can be used to communicate the full transition of activations from one layer of the neural network to the next in a Squishified Sigmoid function.