Posts

The Dawn of a new breed of Hyperscale Datacenters

Image
 This is a New Era of Connectivity and Efficiency In the ever-evolving landscape of technology, the demand for faster, more reliable, and efficient data processing has never been more critical. The introduction of hyperscale datacenters represents a seismic shift in how we handle vast amounts of information. Central to this revolution is the use of advanced networking protocols and architectures, such as Border Gateway Protocol (BGP), Virtual Routing and Forwarding (VRFs), and Remote Direct Memory Access (RDMA). Together, they are reshaping the foundations of datacenter design and operation. BGP at the Core of Hyperscale Networking BGP, a staple in the internet's routing architecture, has found a new role within the datacenter. By leveraging BGP for internal routing between compute nodes, top of rack (ToR) switches, and leaf and spine switches, hyperscale datacenters can achieve unprecedented scalability and flexibility. The use of BGP facilitates efficient route advertisement and ...

The Curious Case of vCloud Director and the Perils of Over-Engineering

Back in December 2011 , I wrote what many considered a borderline heretical blog post: a prediction that VMware vCloud Director,  that shining paragon of private cloud orchestration, would not thrive in the following five years. At the time, I was accused of being overly skeptical, anti-vCloud, and even of being secretly on AWS’s payroll. (Spoiler: I wasn’t. Though I wouldn’t have minded the stock options.) Now that it’s August 2016 , I figured it’s only fair to revisit that time capsule of cynicism and ask: Was I right?  Well, grab your favorite performance dashboard, because the data doesn’t lie. Let’s tally up the results. What I Warned in 2011 Just to refresh your memory (and my ego), here’s the TL;DR of what I said five years ago: vCloud Director was too complex for most enterprises. It was designed more for telcos and service providers , not your average enterprise IT shop. It introduced too many layers of abstraction , distancing users from the physical in...

Do Neural Networks Dream of Strictly Convex Sheep?

Image
  A parting thought before leaving Herndon, written on a flight to Dallas after a week at Amazon Machine Learning University. About what we wanted from optimization landscapes and what we got instead. Courtesy: Amazon MLU There is a moment in training a deep network on a g2.2xlarge when the loss does something I can only call insolent. It drops for a few epochs, plateaus for what feels like forever, jitters sideways, then drops again into a region where the gradient is essentially noise around a slow downward drift. My textbooks call this descending. My eyes call it wandering. The optimizer is moving through a country we do not have good language for, because the language we have was built for a country that does not exist. That country is convex. I am writing this somewhere over Tennessee after a week in a windowless room learning what Amazon thinks its engineers should know about machine learning. The instructors were good. The math was rigorous. But there was a recurring tension...

The Age Old Debate continues - Can you get an Ought from an Is?

The question of whether you can derive an "ought" from an "is" is a classic philosophical challenge famously articulated by David Hume in the 18th century, often called "Hume's Guillotine." Hume argued that there's a logical gap between descriptive statements (what is ) and prescriptive or normative statements (what ought to be). In other words, just because we can observe the way things are, it doesn't logically follow that they should be that way or that we have an obligation to act accordingly. This gap raises questions about whether moral or ethical prescriptions can be grounded purely in empirical facts. For example, observing that people help others (an " is ") doesn’t directly tell us that they ought to do so. Bridging the gap would require additional premises—like the value that helping others is good—which aren’t purely factual but normative. However, some philosophers have argued it’s possible to derive “ oughts ” by grou...

Why VMware vCloud Director Won’t Rule the Cloud

Image
 A highly opinionated "Thought Piece" from the Front Lines of Virtualization Disclaimer: I work for Dell Services and am the chief architect for the Dell vCloud, a public cloud offering for customers of PerotSystems (which was recently acquired by Dell). I co-architected it with two others while reporting to CTO David Crofford some time ago. After the acquisition, we retrofitted VMware vCloud on top of our ESX-based platform. In this blog, I present my personal opinion and my opinion is not affiliated with Dell's official position. Ah, 2011. This is the year of Spotify. Steve Jobs stepped down from Apple. Everyone and their CIO are talking about “cloud” like it was some new deity descending from the heavens to solve all infrastructure sins. In boardrooms, in cafés, in airless conference rooms at VMworld, one name kept coming up.  VMware vCloud Director . The chosen one. The future of private clouds. The piece de resistance of VMware’s virtualized vision. And yet, here I...

In Memory of Dennis MacAlistair Ritchie (1941-2011)

Image
Dennis MacAlistair Ritchie passed away  on October 12, 2011, at the age of 70.  He was found dead at his home in Berkeley Heights, New Jersey, where he lived alone.  Ritchie had been in frail health for several years prior to his death, following treatment for prostate cancer and heart disease. His passing came just a week after the death of Apple co-founder Steve Jobs, which overshadowed the news of Ritchie's death in the media.  I shared the below eulogy during our C/C++ Meetup in Dallas, Texas, yesterday evening! ------------------------------>>> We gather today to honor a true pioneer, a quiet revolutionary whose work fundamentally shaped the digital world we inhabit. Dennis Ritchie - dmr, as he was known to many - was not just a programmer or a computer scientist; he was an architect of the modern technological age, a creator whose vision continues to ripple through every keystroke, every compilation, every system call we make today. When I first held...