The majority of people wouldn’t be thrilled about being demoted, but Phil Coulson isn’t the most normal guy. “Marvel’s Agents of S.H.I.E.L.D.” star Clark Gregg revealed that despite a few issues with the new director in Season 4, Coulson never really loved being the man in charge.

“I always felt like Coulson was happiest in the field,” Gregg revealed to the Hollywood Reporter. Of course, the actor mentioned that he is happy about the shakeup on the ABC drama as well.

“Neither I nor Coulson loved playing and listening while his agents went into dangerous situations. And there are more dramatic possibilities when you have a boss that you have to deal with,” he explained.

Coulson revealed in the Season 3 finale that he was no longer director. In “Agents of S.H.I.E.L.D.” Season 4, Jason O’Mara will play the new boss. His character, who has a long history in Marvel comics, has not been revealed yet. While Coulson might be excited to be in the field again, he isn’t going to be pleased about an outsider being in charge.

“I think Coulson is going to be a little wary, and try to protect everyone in S.H.I.E.L.D.,” Gregg said.

O’Mara has already teased the tense relationship between the two. As previously reported, he noted that Coulson would have trouble letting the new director lead. “Obviously, the relationship between my character and Coulson [Clark Gregg] is going to be huge,” O’Mara told THR last month. “It’s a power struggle kind of dynamic there. It's going to be huge and important.”

While much of the team will stick with Coulson, it’ll be tough for goody two-shoes Simmons (Elizabeth Henstridge) to dismiss her new boss. “This new director may come with new policy changes, new rules,” executive producer Maurissa Tancharoen warned Entertainment Weekly. “Simmons being someone who’s good at following the rules may cause some tension with the rest of our team.”

“Marvel’s Agents of S.H.I.E.L.D” Season 4 premieres Tuesday, Sept. 20, at 10 p.m. EDT on ABC.