© Max Mumby/Indigo/Getty ImagesPrince Harry and Prince William
Prince Harry and Prince William could have been a "brilliant" team.
The brothers - along with Harry's wife Meghan Markle and William's wife Kate Middleton - were thought to be the "Fab Four" until a rift between them led to a separation of their royal offices and Harry and Meghan's eventual exit from the royal family.
"It's a sad state of affairs because William and Harry could have been so brilliant" as a team, says a close insider in this week's issue of PEOPLE. "To think of what they could have achieved together is almost heartbreaking."
Prince Harry Says Prince William 'Can't Leave the System:' 'My Father and Brother Are Trapped'
© Provided by PeoplePaul Grover - WPA Pool/Getty Images Queen Elizabeth, Meghan Markle, Prince Harry, Prince William and Kate Middleton
While William, 38, and Harry, 36, were always on "different paths" due to Prince William's future role as king, they grew up close - especially after the death of their mother Princess Diana when they were young.
Can't get enough of PEOPLE's Royals coverage? Sign up for our free Royals newsletter to get the latest updates on Kate Middleton, Meghan Markle and more!
© Provided by PeopleMax Mumby/Indigo/Getty Images Prince Harry and Prince William
On July 1, the brothers are set to come together for the unveiling of a statue in honor of their mother at Kensington Palace. While both William and Harry (who relocated to California last year) are determined to keep that appointment, they will have to talk things over first.
Prince Harry Has Spoken to William and Charles, but 'Conversations Were Not Productive,' Says Gayle King
![UP NEXT]()
UP NEXT
"Neither of them have good poker faces," a palace source says.
© Provided by PeopleGetty Prince William, Princess Diana and Prince Harry
During Harry and Meghan's interview with Oprah Winfrey on March 7, the Duke of Sussex said that other members of his family can't leave the "system" the way he did.
"It's been really hard," Harry explained. "I am part of the system with them, I always have been, but I guess - and I'm very aware of this - my brother can't leave that system, but I have."
© Provided by PeopleTim Graham Photo Library via Getty Prince William and Prince Harry in 2002
RELATED: Prince William Doesn't Feel 'Trapped' by Royal Life, Found Prince Harry's Comments 'Off the Mark'
In a new report from The Sunday Times, a source close to both brothers claims that William, who is second in line to the throne behind their father, found those comments "way off the mark."
"He has a path set for him and he's completely accepting of his role. He is very much his grandmother's grandson in that respect of duty and service," the source told the outlet.
© Provided by PeopleJoe Pugliese/Harpo Productions Prince Harry, Meghan Markle and Oprah Winfrey
Get the premiere issue of PEOPLE Royals for glamorous new photos and inside stories royals fans haven't seen or read elsewhere! Subscribe at peopleroyals.com/launch
Prince Harry also described his relationship with his older sibling at the moment as "space."
"I love William to bits. He's my brother. We've been through hell together," Harry explained. "But we are on different paths."