​​Brilliant article on different float types used in DL

FP64, FP32, FP16, BFLOAT16, TF32, and other members of the ZOO by Grigory Sapunov

Link: https://medium.com/@moocaholic/fp64-fp32-fp16-bfloat16-tf32-and-other-members-of-the-zoo-a1ca7897d407

#dl #engineering #cs #floatingpoint