Hours before Justin Bieber arrived at New York's Lucky Strike Lanes for his bowling-themed My World 2.0 release party, the 16-year-old pop star stopped by "The Late Show With David Letterman" to bust out the album's first single, "Baby."

After guest appearances by Ben Stiller and celebrity chef Jamie Oliver, Bieber came out dressed in a black leather motorcycle jacket and black jeans. Flanked by four backup dancers, Bieber shimmied across the stage as he sang.

"It was very exciting to be here with Bieber," Stiller told Letterman earlier in the show. "I'm not being facetious. People [outside] are screaming constantly. I felt great when I got out of my car, because I didn't know Justin was on the show."

The 44-year-old actor and comedian eventually got the chance to say hello to the teen star. "Met Justin Bieber tonight on Letterman," Stiller wrote on his Twitter account. "Told him to hang in there, things will happen for him eventually."

Bieber gave Stiller a shout-out on his own Twitter feed, writing, "I'm on LETTERMAN 2nite... Things got a little crazy with Ben Stiller. We took the bulls by the horns."

After the performance, Letterman said to Bieber, "Hey, how ya doing, buddy? Come on up here. Nice job!"

Then, it was on to the bowling party, where fans had been lined up for hours to catch a glimpse of the singer. Going up against Nick Cannon in a head-to-head bowl-off, Bieber ended up coming away the champion. But there wasn't much time to celebrate. Just hours later, the teen was up and ready to hit the next leg of his promotional tour.

"Wow. It's early ... headed to the airport," he tweeted Wednesday morning (March 24). "Chicago bound."

What do you think of My World 2.0? Share your reviews in the comments!

MTV News will be rolling out previews from "The Diary of Justin Bieber" all week — don't miss the full show, airing on MTV, Sunday at 7:30 p.m. ET!