He hasn't yet scored higher than 22 points on any of his "Dancing With the Stars" routines, and former 98 Degrees front man Nick Lachey admits that he wouldn't be too upset if he wound up eliminated from the competition.

Following Disney night on the ABC show, which saw "Pretty Little Liars" star Sasha Pieterse and Gleb Savchenko eliminated, Lachey spoke to Access Hollywood about the season so far, admitting that he'd be "okay" with being eliminated, because he never expected to win the competition in the first place.

"I'm a competitive guy—I certainly don't want to go home, but I didn't do this show because I was dying to win or even thought I could win," he said. "I just wanted to kind of challenge myself in a new way that I had never been challenged before."

He also admitted that both he and his wife, Vanessa, who is also competing on the season, have been putting a lot of time in the show, and it's been difficult for their kids. He also indicated that their eldest son, Camden, 5, wanted him out of the show so he could be home more.

"It's a lot of time. It's a lot of rehearsals every day and then it's all the packages and the interviews and the things you have to shoot outside of rehearsal. So to have both parents fully engaged in this whole thing, it's been tough," he said. "My son said to me the other day, he's like, 'Daddy, I don't want you to dance anymore.' It broke my heart because you wish you could spend more time with your kids, obviously."

Of course, Lachey has been having a great time dancing with pro partner Peta Murgatroyd, even though the two have been struggling with judge's scores. They have landed at the bottom of the leaderboard the last two weeks, scoring 22 points for both their Contemporary Routine during 'Most Memorable Year" week and their Disney themed Quickstep. They were also revealed to be in jeopardy for a second time at the end of "Most Memorable Year" night, though that position does not necessarily mean they were in the bottom two when the viewer votes were added to their scores.

However, even though he has struggled to get ahead of the remaining competitors, he is enjoying spending the time on the show, especially with his wife right by his side and going through the same experience.

"It is also very helpful to have a partner who's going through the same kind of experience," he said. "At the end of the day, I can come home and talk about my sore feet or my sore back and emotionally how drained I am, and she totally gets it because she's in the same spot."

Vanessa's own experience on the show was previously interrupted by drama with her and partner Maksim Chmerkovskiy. The two reportedly argued ahead of Week 3's "Guilty Pleasures" night, and Maks did not perform with her as a result. Their alleged argument was later revealed, though after their return together in Week 4, Maks cleared up the reports that they had feuded, praising his partner in a post on Instagram.

"Dancing With the Stars" airs Mondays at 8 p.m. EDT on ABC.