Monday, October 27, 2014

Met Office supercomputer confirmed

Funding has been confirmed for a £97m supercomputer to improve the Met Office's weather forecasting and climate modelling.

The facility will work 13 times faster than the current system, enabling detailed, UK-wide forecast models with a resolution of 1.5km to be run every single hour, rather than every three.

It will be built in Exeter during 2015 and become operational next September.

The Met Office said it would deliver a 'step change' in forecast accuracy.

As well as running UK-wide and global forecasting models more frequently, the new technology will allow particularly important areas to receive much more detailed assessment.

For examples, forecasts of wind speeds, fog and snow showers could be delivered for major airports, with a spatial resolution of 300m.

The extra capacity will also be useful for climate scientists, who need massive amounts of computing power to run detailed models over much longer time scales.

Met Office chief executive Rob Varley said he was 'absolutely delighted' that the government had confirmed its investment, which was first promised by the chancellor in the 2013 Autumn Statement. He described it as 'news that we've been waiting for for some time'.

Analysis by David Shukman, BBC Science Editor

For an island nation that sits at a turbulent cross-roads between Atlantic moisture, Arctic cold and continental extremes, our weather is notoriously hard to forecast. Fickle winds, complicated topography and innumerable local influences add to the challenge.

But because the weather matters so much - to everything from whether to leave home with a brolly to preparing for closed runways at an airport - all eyes are on the Met Office, and the glances are often hostile.

The biggest failures have now entered the national vocabulary: Michael Fish's denial of an approaching hurricane in 1987 and the infamous suggestion of a 'barbecue summer' in 2009 when the reality proved relentlessly soggy.

The Met Office asserts that people never notice everyday successes, a gradual increase in reliability that has seen each decade allow the forecasts to reach another day into the future.

The new supercomputer should accelerate that process, crunching bigger numbers at a finer scale and more frequently than ever before.

But it may also raise expectations about accuracy. And, in a country obsessed with the weather, that brings its own risks.

The new system will be housed partly at the Met Office headquarters in Exeter and partly at a new facility in the Exeter Science Park, and will reach its full capacity in 2017.

At that point, its processing power will be 16 teraflops - meaning it can perform 16 quadrillion calculations every second.

The 'Cray XC40' machine will have 480,000 central processing units or CPUs, which is 12 times as many as the current Met Office supercomputer, made by IBM. At 140 tonnes, it will also be three times heavier.

It marks the biggest contract the Cray supercomputing firm has secured outside the US.

'It will be one of the best high-performance computers in the world,' Science Minister Greg Clark told journalists at the announcement, adding that it would 'transform the analytical capacity of the Met Office'.

The improved forecasts, according to the Met Office, could deliver an estimated £2bn in socio-economic benefits, including more advance warning of floods, less air travel disruption, more secure decision-making for renewable energy investments, and efficient planning for the impacts of climate change.

Mr Varley said this type of technology was 'fundamental' to modern forecasting.

'Computing power is right at the heart of what we do,' he said. 'It gives us the fuel in the tank to make real progress in all of these areas.'

Prof Tim Palmer, a climate physicist at the University of Oxford, also said the announcement was 'very exciting news' and emphasised the necessity for more and more powerful computers.

'Unlike other areas of science, you can't really do lab experiments,' he told the BBC. 'We can only do two things: wait and see what happens, or try and simulate it inside a computer.'

This means, Prof Palmer explained, 'fantastically complex machines' like the XC40 - and whatever comes next.

'This is the start of an important investment, but it's by no means the endpoint.'

The most detailed climate simulations currently being proposed, Prof Palmer said, will need exabytes of storage: another vast increase on the capacity of the Cray XC40, which will have storage capacity of 17 petabytes (a petabyte is one million gigabytes; an exabyte is 1,000 petabytes).

Piers Forster, a professor of climate change at the University of Leeds, said the increased power should 'massively improve understanding of extreme weather and climate change', but added: 'We also need to support brain power.

'When the Met Office opened some of its computers to work with UK university academics it benefited everyone.

'These problems are too big for one computer or organisation to solve, but as long as our fruitful collaborations continue, we can realise the promised benefits.'

Follow Jonathan on Twitter