Iterations are the number of steps through batches of the training data needed to complete one epoch.
For better understanding, consider the following example:
  • The total training set of images = 5000
  • Batch Size = 64
From the above values, 64 samples will be taken each time through the neural network forward and backward. This constitutes one iteration.
Therefore, if you are loading 64 images at a time (in one batch), to go through all 5000 images, you will need 5000 / 64 = about 78 iterations.
Copy link