Skip to content

Conversation

@rockerBOO
Copy link
Contributor

I am working with some processes that use VAE as part of the gradient flow, so need forwards/backwards support for decoding specifically. But this causes the gradient to build up significantly inside the AutoEncoder. This PR works to add fp8 scaling to the AutoEncoder and gradient checkpointing to help reduce how much VRAM this uses.

  • Add fp8 scaling to Flux AutoEncoder
  • Add gradient checkpointing to Flux AutoEncoder for encode/decode

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant