Here are details of the Cerebras Andromeda, which integrates 16 wafer-scale engines with a total of 13,500,000 AI training cores. The company shows benchmarks that indicate near-linear scaling in performance from 1 to 16 engines. The architecture supports up to 192 engines.
Andromeda will be available in the cloud, or they’ll be happy to sell you one or more of your own.