When you have the balls, you are brave enough to do
something the average joe wouldn't be brave enough to do. Usually, males challenge other males to do
something by asking If they have the balls to do it.
Balls can also mean
something spherical commonly used in sports.