Late Show With Stephen Colbert
"The Late Show With Stephen Colbert" debuts Sept. 8 on CBS. It will be broadcast from the Ed Sullivan Theater in New York City. Getty Images

All late-night hosts have a first episode and Stephen Colbert is about to have his. "The Late Show With Stephen Colbert" debuts Tuesday with George Clooney, Republican presidential candidate Jeb Bush and musician Jon Batiste as the first guests. While we wait to find out how different Colbert -- and the show -- will be from "The Colbert Report," let's see how other hosts fared in their debut.

"Late Night With David Letterman" (Feb. 1, 1982)

Colbert is taking over "The Late Show" from David Letterman, but the legendary host started his late-night career in 1982 with this unconventional talk show on NBC. "Late Night With David Letterman" had very little managerial oversight, which led to a rather strange show that would become a massive hit. There were absurdist segments (Bill Murray performing jumping jacks to Olivia Newton-John's "Physical"), awkward interviews and obscure references (comedian Steve Fessler reciting the script of the Bela Lugosi thriller "Bowery at Midnight") that would define Letterman's comedic style over his 33 years on late-night television.

"The Tonight Show With Jay Leno" (May 25, 1992)

Johnny Carson retired from "The Tonight Show" and Jay Leno was named his successor, a move that was mired in controversy. (Letterman wanted the job and when he didn't get it, he left NBC and started "Late Show" at CBS.) Leno's first guests included Billy Crystal, broadcast journalist and science correspondent Robert Krulwich and musical act Shanice. Leno had a more mainstream style than Letterman and featured a monologue, comedy segments and interviews.

"The Tonight Show Starring Johnny Carson" (Oct. 1, 1962)

Johnny Carson perfected the late-night format way back in 1962. The monologue, comedy segments, celebrity interviews and musical acts were all part of Carson's "Tonight Show" format. His first episode featured Groucho Marx, Joan Crawford, Mel Brooks, Tony Bennett and musical act the Phoenix Singers.

"Jimmy Kimmel Live!" (Jan. 26, 2003)

ABC does not have the legacy of NBC or CBS, but it does have the longest-running late-night host currently on television. "Jimmy Kimmel Live!" launched at midnight in 2003 before moving to the 11:30 p.m. EDT slot in 2012. George Clooney, Snoop Dogg and musical act Coldplay were the first guests on "Jimmy Kimmel Live!" in its original midnight time slot.

"Conan" (Nov. 8, 2010)

Conan O'Brien replaced Leno on "The Tonight Show" in 2009, but that didn't last long and O'Brien left the late-night franchise after just 146 episodes. O'Brien could not host a new show until Sept. 1, 2010 -- as part of his settlement with NBC -- and went on a 30-city comedy tour. Before the start of the tour, O'Brien announced "Conan" would air on TBS. Seth Rogen, Lea Michele, Jack White and Leavenworth Nutcracker Museum curator Arlene Wagner were the first "Conan" guests.