1. The prefered outburst of the people of the ancient or fictional civilisations before the gods affiliated under one name for business and political reasons. Then decided using God's name in vain was a heinous sin, for authoritarian reasons.
2. A subtle double blasphemy to be exclaimed when surrounded by devout christians.
Roland of Gilead: "By the gods!"