Code

A replication of AlphaFold2 architecture (very accurate protein structure prediction model) with an open license.

Contrastive learning for story critiques.

A CLIP-like model for amino acid sequence prediction.

An implementation of model & data-parallel autoregressive language models with Mesh TensorFlow for distributed TPUs.

An implementation of 3D-parallel autoregressive language models for distributed GPUs.

An implementation of model & data-parallel autoregressive language models with JAX and Haiku for distributed TPUs.