Nvidia Kicks Off the Next Generation of AI with Rubin – Six New Chips

Nvidia Kicks Off the Next Generation of AI with Rubin – Six New Chips(nvidianews.nvidia.com)

15 points by ashvardanian 132 days ago | 4 comments

Every founder probably dreams of a press release like this — complete with testimonials from the CEOs of OpenAI, Anthropic, Meta, xAI, Microsoft, CoreWeave, AWS, Google, Oracle, Dell, HPE, and Lenovo.

There aren’t many technical details about the new GPUs yet, but the notes on the Vera CPU caught my eye. NVIDIA Spatial Multithreading sounds like their take on SMT — something you don’t usually see on Arm-based designs. Native FP8 support is also notable, though it’s still unclear how it will be exposed to developers in practice.

Overall it looks like an interesting CPU, but it doesn’t feel like it’s in the same league as the rumored Apple M5 Ultra.

fooker 132 days ago | |

> though it’s still unclear how it will be exposed to developers in practice.

PTX instructions, and compiler intrinsics, depending on which level of abstraction you’re targeting.

ashvardanian 132 days ago | | |

PTX is on the GPU side and is already supported on available models. On the CPU side, it must be some form of an Arm ISA extension, I believe, like NEON-FHM or SVE-AES… I'm just not sure what the scope of those extensions would be and how they will coexist with ARM’s other extensions.

ChrisArchitect 132 days ago |

Large blog post: https://developer.nvidia.com/blog/inside-the-nvidia-rubin-pl... (https://news.ycombinator.com/item?id=46506850)