dokucama

User Tools

Site Tools

Trace: • networking
network_stuff:machine_learning:networking

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
network_stuff:machine_learning:networking [2025/07/15 19:38] – jotasandokunetwork_stuff:machine_learning:networking [2025/07/15 21:08] (current) – jotasandoku
Line 52: Line 52:
 ==== LAN PROTOCOLS IN AI NETWORKING ==== ==== LAN PROTOCOLS IN AI NETWORKING ====
  
-=== NVIDIA InfiniBand ===+=== InfiniBand ===
 **InfiniBand** is a key technology for AI workloads, widely used in high-performance computing (HPC) and AI clusters for its **ultra-low latency**, **high throughput**, and **lossless performance**. It plays a crucial role in enabling efficient communication between nodes, especially for distributed machine learning tasks where large amounts of data need to be shared rapidly across many devices. **InfiniBand** is a key technology for AI workloads, widely used in high-performance computing (HPC) and AI clusters for its **ultra-low latency**, **high throughput**, and **lossless performance**. It plays a crucial role in enabling efficient communication between nodes, especially for distributed machine learning tasks where large amounts of data need to be shared rapidly across many devices.
  
Line 93: Line 93:
     * Packet Sequence Number (PSN), QP Number, and acknowledgment request bits.     * Packet Sequence Number (PSN), QP Number, and acknowledgment request bits.
 \\ \\
 +Packet structure:
 +  Ethernet Header → IP Header → UDP Header → RoCE Packet (BTH + Payload)
 +The Base Transport Header (BTH) is a key component of the InfiniBand transport layer. It contains essential information for delivering messages in InfiniBand or RDMA over Converged Ethernet (RoCE).
 +
 +\\
 +Specifies the operation type (e.g., RDMA read, write, send, atomic).
 +  * Solicited Event Indicator (SE): Indicates if a completion event is required.
 +  * Migration State (M): Manages Queue Pair (QP) state transitions.
 +  * P_Key: Identifies the partition the packet belongs to.
 +  * Destination QP: Specifies the target Queue Pair for the message.
 +  * Packet Sequence Number (PSN): Ensures ordered delivery and detects packet loss.
 +  * Acknowledgment Request (A): Signals if an acknowledgment is needed for reliable transport.
 +  * Resync Request (R): Handles retransmissions in reliable modes.
 +
 +
 == RDMA VERBS == == RDMA VERBS ==
 They are the **same** for both infiniband and rocev2 They are the **same** for both infiniband and rocev2
network_stuff/machine_learning/networking.1752608287.txt.gz · Last modified: by jotasandoku

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
CC Attribution-Share Alike 4.0 International Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki