Mark Wahlberg Explains Why He Was 'Pissed About a Couple Things' Filming Martin Scorsese's The Departed

Mark Wahlberg is detailing why he wasn't entirely thrilled with certain aspects of filming Martin Scorsese's 2006 blockbuster The Departed.

During his appearance on the March 14 episode of Josh Horowitz's Happy Sad Confused podcast, the 52-year-old Academy Award nominee revealed that he was "a little pissed about a couple things" while filming the acclaimed Boston-set thriller, which also starred Leonardo DiCaprio, Vera Farmiga, Jack Nicholson, Matt Damon, Alec Baldwin and other big names.

"But look, it all worked out in the end. Originally, I was supposed to play another part. Originally, I was supposed to get paid," Wahlberg said, before adding that he "had another movie" lined up for after The Departed, which he also needed to focus on.

"I was going into Invincible after. I was trying to grow my hair out, which is why I had that weird hair," he added. "... But I completely understand where Marty was coming from. He had to deal with Jack, he had to deal with Matt and Leo and Alex and everything, the studio and everybody else who was in the cast. And then I was supposed to be in and out in five weeks."

"And so I went off to shoot Invincible, got my hair extensions, came back and they're like, 'Oh, you gotta take out the extensions.' "

As Wahlberg recalled, he didn't want to remove the extensions, which he said took eight hours to put in for his other role. "So we had a couple issues," Wahlberg said.

"But, you know, ultimately, I think when I read that particular role, I was like, 'OK, this is a good role. This is an opportunity for me to really go off and have some fun,' " he added.

Wahlberg earned his first and only best supporting actor Oscar nomination for his portrayal of Sergeant Dignam in The Departed, but lost the trophy to Alan Arkin for his role in Little Miss Sunshine.

Opening up on the podcast about his history with the Academy Awards, where his 2011 film The Fighter also earned a best picture nod four years later, Wahlberg said he cares "to a certain extent."

"You want the movie to be recognized, you want to be recognized, it helps the ultimate success of the film, I think it enhances the box office quite a bit," he told Horowitz. "Especially if you have a movie coming out that time of year. But it's not as high on the priority list as it used to be, let's just say that."

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

When asked if he'd rather have a film gross $1 billion or win an Oscar, Wahlberg responded: "If I have a nice backend, I would rather take the money."

"Look, I'm a competitive guy," he continued. "I work really hard and I try to make the best movies possible. I always want to be the best. I approach it very much as an athlete, as a fighter, all those things. So I only want to win. I'm gonna be one of the few guys that's not gonna lie to you right now."