ignitevision

Source code on GitHub.

README

CIFAR10 Example with Ignite

In this example, we show how to use _Ignite_ to train a neural network:

• on 1 or more GPUs or TPUs
• compute training/validation metrics
• log learning rate, metrics etc
• save the best model weights

Configurations:

• [x] single GPU
• [x] multi GPUs on a single node
• [x] multi GPUs on multiple nodes
• [x] TPUs on Colab

Requirements:

• pytorch-ignite: pip install pytorch-ignite
• torchvision: pip install torchvision
• tqdm: pip install tqdm
• tensorboardx: pip install tensorboardX
• python-fire: pip install fire
• Optional: clearml: pip install clearml

Alternatively, install the all requirements using pip install -r requirements.txt.

Usage:

Run the example on a single GPU:

``bash python main.py run `

For details on accepted arguments:

`bash python main.py run -- --help `

If user would like to provide already downloaded dataset, the path can be setup in parameters as

`bash --data_path="/path/to/cifar10/" `

Distributed training

#### Single node, multiple GPUs

Let's start training on a single node with 2 gpus:

`bash

using torch.distributed.launch

`bash

using function spawn inside the code

`bash

horovodrun

`bash

using function spawn inside the code