Mentions légales du service

Skip to content
Snippets Groups Projects
Verified Commit 4de359e9 authored by ANDREY Paul's avatar ANDREY Paul
Browse files

Drop 'functorch.compile' use.

- The use of 'functorch.compile' over a function that takes variable-size
  batch inputs proves impossible, as the tracing on first call creates a
  computation graph with fixed dimensions.
- As a result, the tentative compilation of per-sample clipped gradients
  computation prevents the proper use of DP-SGD with the functorch backend.
- An alternative attempt was to compile the sample-wise function and vmap
  it afterwards, but this is currently unsupported (and unlikely to be as
  part of functorch, as development efforts have moved to 'torch.func').
- This commit therefore drops the use of 'functorch.compile'.
parent c65d0b4c
No related branches found
No related tags found
Loading
Pipeline #852811 passed
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment