Mike Pence became the vice president of the United States Friday, but he and his family won’t be moving into the White House. Instead, Pence will move not too far from President Donald Trump’s new digs to the grounds of the United States Naval Observatory, located at Number One Observatory Circle.

The house, which was initially built in 1893, was originally intended for the superintendent of the USNO to live in. However, in 1923, the chief of naval operations booted the superintendent out of the home and claimed it for himself, according to the White House.

It wasn’t until 1974 when Congress decided to restore the home located at the Naval Observatory and use it as a designated residence for the vice president and his family. Walter Mondale, vice president under President Jimmy Carter, was the first person to move into the home three years after it was refurbished in 1977.

Since Mondale’s residency, Vice Presidents George H.W. Bush, Dan Quayle, Al Gore and Dick Cheney have lived in the house. Vice President Joe Biden was the most recent person to occupy the space, but he has now handed over the keys to Pence.

Although Pence won’t live in the White House, he will still have a space to call his own inside the famous mansion. Pence will work out of the Vice President’s Ceremonial Office, located in the West Wing of the White House. His staff will also have an area inside the Eisenhower Executive Office Building (EEOB), which sits next the White House. Initially, the vice president’s office in the EEOB was where the Navy Secretary worked back with the EEOB was the designated facility for the State, Navy and War Departments.

Pence’s wife, Karen Pence had been inside of One Observatory Circle a few times before moving in. She told Indiana’s Journal Gazette that the 33-room white brick house “was amazing.”

Before moving into One Observatory Circle, Mike Pence and his family lived in Indiana's Governor's Residence located in Indianapolis.