Skip to content

Update functional.scaled_dot_product_attention signature/arguments#1473

Open
DillionLowry wants to merge 2 commits intodotnet:mainfrom
DillionLowry:scaled-dot-product
Open

Update functional.scaled_dot_product_attention signature/arguments#1473
DillionLowry wants to merge 2 commits intodotnet:mainfrom
DillionLowry:scaled-dot-product

Conversation

@DillionLowry
Copy link

  • Add optional scale and enable_gqa arguments to torch.nn.functional.scaled_dot_product_attention. Default values scale = null and enable_gqa = false match pytorch.

Breaking Change:

  • torch.nn.functional.scaled_dot_product_attention's function signature has been changed. The is_casual argument has been renamed to is_causal to match pytorch.

@DillionLowry
Copy link
Author

@dotnet-policy-service agree

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant