NEW YORKFergie has been lying low since the Black Eyed Peas announced they were going on an indefinite hiatus back in November. Yet on Wednesday, the Internet was abuzz with rumors that she might fill Paula Abdul or Nicole Scherzinger's "X Factor" judging seats.

But that's all news to Fergie herself.

"I have no idea how this keeps coming back, it's crazy!" she told MTV News on Thursday (March 22) at the Voli Light Vodka Brunch in New York. "I know that my managers and agents have been in touch with the 'X Factor' both last season and this season, but both times it's not the right time."

In April 2010, Fergie was mentioned as a potential judge, but much like this time around, she felt she couldn't give the contestants the commitment they would need from a mentor.

"I can't commit all the energy that these contestants deserve," Fergie said. "This is their career, and right now, I've got different plants in my garden that are going on, and that's a really big tree that would take a lot of nurturing and energy. It's just not the right time right now."

It might not be the right time for Fergie, but it could be the right time for Britney Spears. The pop star was reportedly offered $10 million to join Simon Cowell and L.A Reid on the judging panel. So does Fergie think Spears would be a good fit?

"I think whatever they do ... Simon's a genius and he'll make the right decision," Fergie said. "And it will all work out."

Even though Fergie won't be mentoring this season's "X Factor" contestants, that doesn't mean she won't be tuning in. "I love Simon and I'll be watching the show," Fergie said. "I'm excited to watch — but at home in my pajamas."

Do you think Fergie would make a good "X Factor" mentor? Let us know in the comments!