Tag Archives: bfloat16

What Is Bfloat16 Arithmetic?

Bfloat16 is a floating-point number format proposed by Google. The name stands for “Brain Floating Point Format” and it originates from the Google Brain artificial intelligence research group at Google. Bfloat16 is a 16-bit, base 2 storage format that allocates … Continue reading

Posted in what-is | Tagged , , | Leave a comment

Half Precision Arithmetic: fp16 Versus bfloat16

The 2008 revision of the IEEE Standard for Floating-Point Arithmetic introduced a half precision 16-bit floating point format, known as fp16, as a storage format. Various manufacturers have adopted fp16 for computation, using the obvious extension of the rules for … Continue reading

Posted in research | Tagged , , | 12 Comments