What is Sorry, Sally?

If you use swear words on the Chris Gethard's Beautiful Anonymous show, you must say "Sorry, Sally". Sally is the name of Chris Gethard's mom who abhors swear words. However, the phrase has gone far outside of its original realm, and now widely used by many people as the modern version of "pardon my French".