4/24/2025 at 8:18:34 AM
I wonder where the label ‘mini/micro’ batch came from (‘Training at bfloat16 numeric precision enabled them to use large micro-batch sizes of 256...’), given that batches were never that big to begin with.by macleginn
4/24/2025 at 6:02:31 AM
by simplesort
4/24/2025 at 8:18:34 AM
I wonder where the label ‘mini/micro’ batch came from (‘Training at bfloat16 numeric precision enabled them to use large micro-batch sizes of 256...’), given that batches were never that big to begin with.by macleginn