Five women, now in their 40s and 50s, have come forward saying that a Colorado based gymnastics coach sexually assaulted them when they were children and teenagers in Southern California.

I'll never forget the words he whispered in my ear at that time: 'This is what you want. This is what all girls want,' Anne Malver, then 11, told CNN.

Doug Boger, now 63, trained gymnasts in Southern California for the National teams. He was acquitted by a jury in 1982 on child abuse and battery charges after two young gymnasts accused him of assault.

I was not abusive and did not do anything wrong, Boger told CBS. The sexual thing is absolutely fabricated. These kids all got together and fabricated this.

According to CNN, the parents of two of the former gymnasts who are now alleging abuse helped finance his defense during that trial, including the parents of Julie Whitman.

Whitman was on USA Gymnastics' Junior National Team 1983-1984. She told CNN that time at the gym with Boger could be a living hell at times.

Whitman began to contact her former teammates to speak up against Boger about six years ago after she found out that he was still coaching, according to CNN.

Several of Boger's former gymnasts wrote letters detailing abuse that spurred an official investigation with USA Gymnastics in 2009.

The biggest challenge with this particular case was that it happened 30 years ago and, not only that, he had been acquitted, USA Gymnastics President Steve Penny told CNN.

The investigation concluded in 2010 by placing Boger on its permanently ineligible coaches list, meaning that he cannot coach at a USA Gymnastics member gym, but he can at any non-affiliated gym.

This prompted Boger to begin coaching at a Colorado Springs gym owned by a coach once convicted of a sexual offense.

One former gymnast, who Boger coached at the World Championships in 2005, 2007 and 2009, still supports him.

I obviously don't want to believe it, but all I can share is the good experience I had, Aubree Balkan told CNN.

Balkan says Boger has stopped coaching, adding that she's not sure what his critics are trying to accomplish.

This is about a group of women who want no more harm coming to any children for the sake of becoming a competitive athlete, Malver told CNN.

Whitman said via e-mail that the reason they are still fighting is to get USA Gymnastics to not allow gyms that aren't affiliated with USA Gymnastics and can have sex offenders on staff to send athletes to USA Gymnastics' sanctioned events without being a member club.

She has been fighting for this for nearly four years and will continue to do so until there is no fight left in her.