Posts

Showing posts from September, 2025

Beyond Compliance

Image
  Copyright: Sanjay Basu The Future of Trustworthy AI in a Post-Regulation World Compliance “Once everyone’s compliant, what’s next? The future of trustworthy AI isn’t about passing audits, it’s about reimagining responsibility.” The Compliance Cliff Here’s the uncomfortable truth no one wants to say out loud:  compliance is the floor, not the ceiling. Right now, across boardrooms and policy panels, there’s a palpable sense of relief as regulatory frameworks like the  EU AI Act  or  ISO/IEC 42001  gain traction. Companies are drafting ethical AI guidelines, spinning up internal audit teams, and shopping for “bias detection” software like it’s the new cybersecurity. And that’s all… fine. Necessary, even. But here’s what’s happening behind closed doors: organizations are spending millions on compliance infrastructure while their actual AI practices remain fundamentally unchanged. They’re hiring “AI ethicists” who report three levels down from decision-makers....

NVIDIA Dynamo vs HW-NAS: Part Two

Image
  Copyright: Sanjay Basu My NVIDIA Dynamo article from few months back —  Two Roads to Faster AI, One at Compile Time, One at Design Time “If HW-NAS is the architect, Dynamo is the interior designer with a power drill and a tape measure.” We’re in an era where “faster inference” isn’t just a nice-to-have. It’s survival. Whether you’re squeezing LLMs into GPUs with 40 GB memory or pushing them onto edge devices with one good core and a dream, the question is always the same: How can we make these models run faster, cheaper, and more efficiently without losing accuracy? Two major technologies tackle this, but from very different layers of the stack. HW-NAS : Hardware-Aware Neural Architecture Search ← Discussed in Part One —  https://medium.com/my-aiml/transformers-chips-and-the-ai-architects-dilemma-3b058c2c633d NVIDIA Dynamo : Dynamic shape optimization via PyTorch compiler stack (part of TorchDynamo + TorchInductor) ← This week’s take Let’s break them down, compare their goa...