The agency's leader had to answer to his boss: President Obama.
The head of the Secret Service was called to the oval office for the first face-to-face meeting with the President since the scandal exploded.
Mark Sullivan briefed President Obama Friday, and came away with his job, but three more Secret Service agents were forced out Friday, for a total of 6 so far.
Five others remain under investigation, another has been cleared of the most serious allegations, and the military is investigating 11 of their own as well.
A toxic brew of prostitutes, alcohol and unpaid money boiled over into scandal.
"The Secret Service demands integrity unconditionally. It has been a very, very serious situation. And it has done irreparable harm to the Secret Service reputation," said Barbara Riggs, former Deputy Director of the Secret Service.
Officials say one of the agents implicated in the Colombian scandal may have more to answer for.
When David Chaney was assigned to protect Vice-Presidential candidate Sarah Palin, he confided to his Facebook page: "I was really checking her out, if you know what I mean."
This is one kind of "going rogue" that Governor Palin does not approve of.
"Check this out, bodyguard, you're fired," said Palin.
"It actually violates the sacrosanct trust that we have between the Secret Service and a protected," said Riggs.
"It bothers me that it was posted," said Rep. Peter King. "I don't know if we can expect Director Sullivan is on everything that is posted on every website or every facebook page."
As the investigation expands, sources say a 24 year old single mother is the woman at the center of the Cartegena crisis, who while fighting to get her full fee, inadvertently laid bare a hidden secret of some of the Secret Service.
