From 9579593d6a4cf44095088ff998f6cf3740f1fc07 Mon Sep 17 00:00:00 2001 From: pintaoz Date: Mon, 17 Feb 2025 17:02:37 -0800 Subject: [PATCH 1/2] Add warning about not supporting --- doc/frameworks/pytorch/using_pytorch.rst | 2 ++ 1 file changed, 2 insertions(+) diff --git a/doc/frameworks/pytorch/using_pytorch.rst b/doc/frameworks/pytorch/using_pytorch.rst index d415f38c27..c29f29d372 100644 --- a/doc/frameworks/pytorch/using_pytorch.rst +++ b/doc/frameworks/pytorch/using_pytorch.rst @@ -375,6 +375,8 @@ To initialize distributed training in your script, call `torch.distributed.init_process_group `_ with the desired backend and the rank of the current host. +Warning: ``torch.nn.SyncBatchNorm`` is not supported and its existence in +``init_process_group`` will cause an exception during distributed training. .. code:: python From e17131e6d3493a3133e5851f32590fb94de7c659 Mon Sep 17 00:00:00 2001 From: pintaoz Date: Tue, 18 Feb 2025 11:37:25 -0800 Subject: [PATCH 2/2] update wording --- doc/frameworks/pytorch/using_pytorch.rst | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/doc/frameworks/pytorch/using_pytorch.rst b/doc/frameworks/pytorch/using_pytorch.rst index c29f29d372..c50376920e 100644 --- a/doc/frameworks/pytorch/using_pytorch.rst +++ b/doc/frameworks/pytorch/using_pytorch.rst @@ -375,8 +375,9 @@ To initialize distributed training in your script, call `torch.distributed.init_process_group `_ with the desired backend and the rank of the current host. -Warning: ``torch.nn.SyncBatchNorm`` is not supported and its existence in -``init_process_group`` will cause an exception during distributed training. +Warning: Some torch features, such as (and likely not limited to) ``torch.nn.SyncBatchNorm`` +is not supported and its existence in ``init_process_group`` will cause an exception during +distributed training. .. code:: python