Energy systems are highly complex entities that are inextricably linked to society and the environment. Today, our energy industry is fragmented and failing to work towards our common goals. This may not be a problem during benign economic periods, but is not fit for purpose as we face unprecedented challenges around energy sustainability, security and affordability.
The energy problems we face are long term and require a "systems thinking" approach that is immune to the commercial or political pressures of the day. This is particularly important because the impact of any decision to invest in energy infrastructure can take decades to be realised and is locked in – good or bad – for 50 years or more.
This is where an overall system architect has the potential to offer much-needed leadership by taking independent, transparent decisions on how to move towards a low-carbon economy. This overall architect would not own any assets, protecting its independence. But what would it actually do?
First, it could set out long-term, transparent plans for new energy infrastructure. This would provide clarity about where the country is going and the principles used in making decisions about energy, giving much-needed certainty to investors and avoiding piecemeal, short-term projects.
It could also make decisions about capacity margins (the difference between generating capacity and maximum demand), our desired energy mix, roadmaps and timescales for achieving that mix, and pricing models that help to encourage energy efficiency.
The system architect could decide when, where and how to integrate new technologies such as energy storage, real time ratings and demand response. And, crucially, it could think about the energy system as a whole, building plans that consider how heat, power, water and transport systems are all linked together.
What we need is a separation of the design from the operation and asset management of our energy systems. This would reduce the conflict of interest which arises when these important roles both reside within the same private company. This has been discussed before during a review of the National Grid, when the creation of an Independent Design Authority was considered, and is similar to Labour's proposal to establish an Energy Security Board with responsibility for identifying energy needs and taking action to meet them.
Appointing an independent architect of our energy system is a challenging ask of both the industry and politicians – but it could be the only way to help us find our way through the trilemma of energy security, sustainability and affordability.
Professor Phil Taylor is director of the Institute for Sustainability at Newcastle University
This article is part of the Guardian's #bigenergydebate series. Click here to find out more about this project and our partners.