Jennifer Garner and Ben Affleck went to Hawaii after their separation to present a picture of a couple that is breaking up amicably, but sources say the reality could be completely different. According to new reports, Affleck admitted cheating on his wife of 10 years.

Garner was not very happy with Affleck's “partying and gambling” habits, and was unhappy that he flirted with other women, Us Weekly reports. Garner also reportedly told her close friends that Affleck had “admitted to cheating” with an unnamed female, the magazine writes. At one point, Garner kicked Affleck out of their home in Los Angeles but later “decided to forgive him,” an insider told the magazine.

However, other sources claim the “Gone Girl” actor did not cheat on his wife, and the recent reports are just unconfirmed rumors.

Other sources claim the couple has had a rocky relationship, and that Garner “tried to leave him a few times, but he would beg her to stay.” Garner reportedly decided to keep the relationship going because of their three kids: Violet, 9; Seraphina, 6; and Samuel, 3. The couple has been “on the brink of splitting up” many times, but Garner always wanted to give the kids a happy family environment.

“She always fought against the urge to throw her hands up in the air and walk away,” an insider tells the magazine. Garner's biggest desire "has always been to keep the family together.” Meanwhile, the couple plans to stay on the same property in Los Angeles' Brentwood section for the sake of their kids. Affleck is building a new house in the same neighborhood so that he can be near his children.