With the demise of Denard scaling, it is well known that we cannot go faster for greater throughput, rather we have to go wider.
However, with the imminent demise of Moore's Law, there lies continued challenges in reaching and exceeding the Exascale.
We discuss how and why GPU computing provides a solution to take computational science to this next level.
We consider some of the software and algorithm challenges that the Exascale will bring.
Lastly, we take a dive into the newly-launched Volta GPU architecture, the architecture that will drive the next-generation CORAL Supercomputers.
