Network-faithful simulation of LLM serving and training deployments
-
Updated
Oct 8, 2026 - Python
Network-faithful simulation of LLM serving and training deployments
RDMA fork version of Strix Halo inference engine. Qwen Flash Next Q4_K_XL: >2100pp …
Early-warning bottleneck profiler for GPU training nodes: GPU + RDMA fabric telemetry with job-level classification
KAI Data Center Builder
NCCL over a switchless 4-node DGX Spark / GB10 ring using both PCIe halves of every QSFP cable: ~193 Gb/s per cable instead of ~112, up to +34% vLLM prefill. One patch on top of switchless-nccl.
Performance metrics for AI / ML cluster
A distributed hardware-software co-design fabric for MoE models (DeepSeek-V3, Mixtral) that eradicates NCCL All-to-All communication stalls via distributed RoCEv2 RDMA virtual address MUX and JAX/XLA SPMD sharding.
Line-rate out-of-band network packet classification & RoCEv2 isolation engine offloaded to SmartNIC/DPU cores.
Packet-level simulator (ns-3 + RoCEv2/DCQCN/PFC/ECN) comparing fat-tree vs rail-optimized topologies for AI training fabrics. Validated against NCCL on real GPUs.
Visual, exam-focused study guide for Cisco 300-640 DCAI v1.0
Production-grade High-Frequency Streaming Telemetry Ingestion (TIG Stack: Telegraf, InfluxDB v2, Grafana) & Sub-Second Buffer Incast Inspection for AI Data Center Fabrics (Cisco Nexus Streaming Telemetry aligned).
A simple experiment applying compressible flow principles to soften distributed gradient communication stalls.
Ultra-Ethernet compliance test architecture eliminating expensive HBM memory buffers. Design utilizes FPGAs, PRBS payloads, state hash tables, and virtual RDMA.
Emulated 2-Tier Spine-Leaf AI Lossless Fabric with FRR BGP EVPN, Linux tc multi-queue PRIO/RED/ECN scheduling, Scapy synthetic RoCEv2 (UDP 4791), and ASIC hardware buffer boundary analysis.
Lossless-Ethernet benchmark harness for RoCEv2 fabrics: sweeps queue thresholds, ECN marking, and oversubscription to locate throughput collapse and PFC pressure.
Hands-on code, configurations, and visual labs for Cisco 300-640 DCAI v1.0
PowerShell-based toolkit for Storage Spaces Direct strict bundle deployment, validation, and operational checks in Windows Server 2025 environments.
To associate your repository with the rocev2 topic, visit your repo's landing page and select "manage topics."