Introduction to INT8 quantization in JAX
Introduction In this blog post, we will provide an intuitive introduction to a technique called quantization. The topic has always seemed a bit mysterious to...
Posts by Tag
TPU
Attention module in JAX
The attention module is the key ingredient of what makes up a transformer layer. In this blogpost we will show how to implement it from scratch in JAX alongs...
Multi chip performance in JAX
The larger the models we use get the more it becomes necessary to be able to perform training of machine learning models over multiple chips. In this blog po...
Jax
Introduction to INT8 quantization in JAX
Introduction In this blog post, we will provide an intuitive introduction to a technique called quantization. The topic has always seemed a bit mysterious to...
Attention module in JAX
The attention module is the key ingredient of what makes up a transformer layer. In this blogpost we will show how to implement it from scratch in JAX alongs...
Multi chip performance in JAX
The larger the models we use get the more it becomes necessary to be able to perform training of machine learning models over multiple chips. In this blog po...
Googlecloud
Back to Top ↑Probability
Permutations and Combinations.
An ordered set of elements in [n]={1,2,...,n} is called a permutation.
Probability with Python
Introduction to basic probability.
Let us start with the notion of a sample space. A sample space describes the set of all possible outcomes when performing an experiment.