The Sigmoid function is a mathematical function having a characteristic "S"-shaped curve or sigmoid curve.
When the sigmoid function is used in AI Neural networks to calculate bias within the layers of a Neural network this function is repeated and calculated for each neuron. The function must be simplified (or squished) to result in a usable function that can be used to program an AI
software program.
In order to simplify the use of these functions, sigmoid function weights and activations are organized into columns into vectors resulting in a
matrix vector
product which will be the bias vector, as a final
step the sigmoid is wrapped around the vector function. The results of these vectors can be symbolically represented in a simplified function, which then can be used to communicate the full transition of activations from
one layer of the neural network to the
next in a Squishified Sigmoid function.