draft-xu-idr-fare
Fully Adaptive Routing Ethernet using BGP
Large language models (LLMs) like ChatGPT have become increasingly
popular in recent years due to their impressive performance in
various natural language processing tasks. These models are built by
training deep neural networks on massive amounts of text data, as
well as visual and video data, and often consist of billions or even
trillions of parameters. However, the training process for these
models can be extremely resource-intensive, requiring the deployment
of thousands or even tens of thousands of GPUs in a single AI
training cluster. Therefore, three-stage or even five-stage CLOS
networks are commonly adopted for AI networks. The non-blocking
nature of the network becomes increasingly critical for large-scale
AI model training. Therefore, adaptive routing is necessary to
dynamically distribute traffic to the same destination across
multiple equal-cost paths, based on network capacity and even
congestion information along those paths.