Prince Charles under attack over Chelsea Barracks

The architect, whose proposal was withdrawn last Friday by its Qatari developers, claimed the Prince had "single-handedly destroyed the project" by writing a private letter to the Qatari prime minister in early March.

He now wants an inquiry to investigate whether Charles has a constitutional right to become involved in matters which have economic, political and social ramifications.

The 76-year-old Labour peer claimed Prince Charles had broken "a bond of trust" with the British public.

He also questioned the Qataris' decision to involve the Prince's Foundation for the Built Environment - a charity of which Charles is president - in the future of the site.

"Bringing in the foundation, his own boys if you like, is unbelievably questionable," Lord Rogers said.

"I absolutely don't think this is acceptable. It is directly self-serving and is unconstitutional."

He called for the creation of a committee of independent constitutional experts to vet Prince Charles's involvement not just in architecture, but in other areas where he expresses an opinion including medicine, agriculture and the environment.

He added: "The Prince always goes round the back to wield his influence. It is an abuse of power because he is not willing to debate.

"Someone who is unelected, will not debate but will use the power bestowed by his birthright must be questioned.

"This sort of situation is totally unconstitutional and should never happen again."

The award-winning architect revealed he was only told his team had been sacked from the project on Friday morning - just as the Evening Standard was preparing to publish the story.

Lord Rogers said: "We had hoped that Prince Charles had retreated from his position on modern architecture but he single-handedly destroyed this project."

Clarence House said: "We don't want to get into a debate with Richard Rogers."

But Belgravia residents today backed the Prince.

One resident in Bloomfield Terrace, which risked being overshadowed by the nine-storey tower blocks, said: "We never supported the Rogers plans, which were presented to us as a done deal after no more than the most perfunctory consultation.

"It consisted of a handful of brief public exhibitions during which we were patronised by members of Lord Rogers's firm and made to feel we should have no say anyway."