Skip to content

Commit d2ede36

Browse files
Curt TiggesCurt Tigges
authored andcommitted
corrected total tokens calculation
1 parent 41e1262 commit d2ede36

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

clt/training/metric_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ def log_training_step(
4949
self.metrics["train_losses"].append({"step": step, **loss_dict})
5050

5151
if not self.distributed or self.rank == 0:
52-
total_tokens_processed = self.training_config.train_batch_size_tokens * self.world_size * (step + 1)
52+
total_tokens_processed = self.training_config.train_batch_size_tokens * (step + 1)
5353

5454
self.wandb_logger.log_step(
5555
step,

0 commit comments

Comments
 (0)