optax-shampoo

Distributed Shampoo (Second order Optimizer for Deep Learning) Optax Optimizer


Keywords
optax, distributed, shampoo, ai, machine-learning, research
License
Apache-2.0
Install
pip install optax-shampoo==0.0.4

Documentation

Google Research

This repository contains code released by Google Research.

All datasets in this repository are released under the CC BY 4.0 International license, which can be found here: https://creativecommons.org/licenses/by/4.0/legalcode. All source files in this repository are released under the Apache 2.0 license, the text of which can be found in the LICENSE file.


Because the repo is large, we recommend you download only the subdirectory of interest:

  • Use GitHub editor to open the project. To open the editor change the url from github.com to github.dev in the address bar.
  • In the left navigation panel, right-click on the folder of interest and select download.

If you'd like to submit a pull request, you'll need to clone the repository; we recommend making a shallow clone (without history).

git clone git@github.com:google-research/google-research.git --depth=1

Disclaimer: This is not an official Google product.

Updated in 2023.