Tag Archives: fp16

What Is Bfloat16 Arithmetic?

Posted on June 2, 2020 by

Bfloat16 is a floating-point number format proposed by Google. The name stands for “Brain Floating Point Format” and it originates from the Google Brain artificial intelligence research group at Google. Bfloat16 is a 16-bit, base 2 storage format that allocates … Continue reading →

Posted in what-is | Tagged , , | Leave a comment

Half Precision Arithmetic: fp16 Versus bfloat16

Posted on December 3, 2018 by

The 2008 revision of the IEEE Standard for Floating-Point Arithmetic introduced a half precision 16-bit floating point format, known as fp16, as a storage format. Various manufacturers have adopted fp16 for computation, using the obvious extension of the rules for … Continue reading →

Posted in research | Tagged , , | 12 Comments