Suppressing sexual urges can build up frustration and also aggravate anxiety or irritability,” one expert said.