Tuesday, September 16, 2008

The laws of supercomputing

Its about time I wrote some of these down:
  1. It's all about the memory.
  2. Latency is next to Godliness
  3. Any asshole can build a fast floating point unit.
  4. Cache is King.
  5. Storage is memory
  6. Parallel programming isn't complicated, but it is hard.
  7. Data drives computation.
  8. You can hide latency, but you can't make it run.
  9. Go for capability or capacity, but not both.
  10. One process, then two, then many.
  11. Explicit parallelism beats implicit parallelism.
  12. Don't call, compile.
  13. No non-trivial application will run faster than the Linpack benchmark.
  14. Innovation in HPC in the last 10 years has consisted almost solely of the bending of sheet metal.
  15. 95% of all supercomputing is capacity oriented.
  16. All meaningful HPC programming is done in Fortran or C

No comments: