Activities Our LayerNorm Scaling has already become a winning technique in OpenAI’s Parameter Golf challenge.