Longterm Wiki

Large-Scale Training Infrastructure

xAIResearch Areaslarge-scale-training-infrastructure

Record Metadata

Record Keylarge-scale-training-infrastructure
EntityxAI
CollectionResearch Areas(3 records total)
SchemaMajor research initiatives and focus areas.
YAML Filepackages/kb/data/things/GLXKjYAEKw.yaml

Fields

NameLarge-Scale Training Infrastructure
DescriptionBuilding and operating massive GPU clusters for frontier model training
StartedJul 2023
NotesColossus cluster in Memphis with 200K H100 GPUs; one of the largest single training clusters globally

Other Records in Research Areas (2)

KeyNameDescriptionStarted
reasoning-and-problem-solvingReasoning and Problem SolvingImproving AI reasoning capabilities in mathematics, coding, and scientific domainsJul 2023
real-time-information-integrationReal-Time Information IntegrationIntegrating live data from X platform and web into AI responsesNov 2023
Record: large-scale-training-infrastructure | Longterm Wiki