AI is a particularly well-suited tech trajectory for India: Cerebras' Feldman

livemint.com:

BENGALURU : Andrew Feldman, co-founder and CEO of US-based Cerebras Systems, which last month released what it touts as the world's largest and fastest artificial intelligence (AI) ‘chip’ with 4 trillion transistors, insists that while AI is not a silver bullet, it can certainly solve many of the world’s problems. In a video interview from his US office, Feldman spoke about areas where his company’s third-generation wafer-scale AI accelerator—the CS-3—scores over Nvidia's graphics processing units (GPUs). He also shared his thoughts on how India can leverage AI and Generative AI (GenAI) tools, and whether GenAI is being oversold, among other things.

Edited excerpts: One of the fundamental challenges in AI right now is to distribute a single model over hundreds or thousands of GPUs. You can’t fit the big matrix multipliers (matrix multiplication is a big part of the math done in deep learning models, which requires significant computing power) on a single GPU. But we can fit this on a single wafer, and so we can bring to the enterprise and the academician, the power of tens of thousands of GPUs but the programming simplicity of a single GPU, helping them do work that they wouldn't otherwise be able to do.

We are able to tie together dozens or hundreds of these (chips) into supercomputers and make it easy to train big models. GPT-4 cited in its paper that it had 240 contributors, of which 35 are mostly doing distributed computing. Which enterprise company has 35 supercomputer jockeys, whose job it is to do distributed computing? The answer is, very few.

That means it’s very difficult for them (most companies) to do big AI work. We eliminate that need (with this big chip). Companies like GlaxoSmithKline Pharmaceuticals are