Distributed Collective Traces

To include XCCL host calls and collective communication activity in Kineto traces, set these variables before launching the profiled process:

export TORCH_PROFILER_ENABLE_COLLECTIVE_PROFILING=1
export INTEL_LIBITTNOTIFY64="$VIRTUAL_ENV/lib/libpti_view.so"  # until PTI 1.2.0
  • TORCH_PROFILER_ENABLE_COLLECTIVE_PROFILING=1 enables Kineto’s collective communication activity. Only the exact value 1 enables it. Values such as true, yes, or ON are ignored.

  • INTEL_LIBITTNOTIFY64 (until PTI 1.2.0) points the Intel ITT loader to PTI’s libpti_view.so, which collects the XCCL host calls. Starting with PTI 1.2.0, libpti_view.so sets the variable to itself when it is unset, so setting it is no longer required.