Still, Frank said Congress will continue to do everything in its power to rescind the bonuses, including bringing lawsuits against the company.
"It is time for us to assert our ownership rights under this arrangement ... and bring lawsuits," Frank said. "As owners, we should say these people performed so poorly, the company should rescind the bonuses."
Frank said the government cannot legally cancel the contracts, but can sue AIG as majority shareholder, arguing that the money went to people who did not deserve it.
"These are not the people you want to retain -- you need to get people who understand the mistakes and undo them," he added.
Most of the committee members, including subcommittee chairman Paul Kanjorski, D-Pa., used their opening statements to unleash anger about the bonus payments.
Despite the furor, Kanjorski urged the committee to "focus on the bigger picture too."