According to DCD, AWS has reportedly developed a separate cabinet called JBOK specifically to house its custom K2v6 network interface cards because they can’t physically fit into Nvidia’s new NVL72 rack-scale Blackwell systems. The NVL72 uses shorter 1U server trays that leave no room for AWS’s proprietary networking hardware, forcing the company to create this external cabinet solution. This comes as AWS continues its pattern of custom hardware development, including previous workarounds like NVL36x2 that reportedly introduced more bugs than using Nvidia’s native designs. The engineering effort represents significant investment in maintaining control and avoiding vendor dependency on Nvidia’s ecosystem. Meanwhile, recent benchmarks show Nvidia’s systems leading on metrics like throughput-per-dollar and tokens-per-megawatt, partly due to software innovations rather than hardware additions.
Engineering or Overengineering?
Here’s the thing: AWS built an entire separate cabinet just for network cards. Let that sink in. We’re talking about what’s essentially a Wallace & Gromit-style contraption where the main compute does its thing in one box while networking happens in another cabinet entirely. It’s clever engineering, no doubt. But is it good engineering?
The irony here is pretty thick. AWS became the cloud giant it is by making infrastructure invisible through brilliant software abstractions. EC2, S3, Lambda – these succeeded because they hid complexity from customers. Now they’re adding complexity back in with external cabinets and custom hardware that, according to SemiAnalysis, actually introduces more bugs than just using Nvidia’s native design. That’s not just wasted engineering hours – it’s accumulated technical debt that’ll require ongoing maintenance and debugging.
The Software Opportunity Cost
Every hour AWS engineers spend staring at JBOK cabling diagrams is an hour they’re not spending on what actually differentiates them from competitors: the software layer. Look at the recent InferenceMAX v1 benchmark where Nvidia’s systems came out on top largely due to software innovations like TensorRT-LLM and Dynamo. Even AWS’s own Grove framework for accelerating inference on EKS shows where the real performance gains happen.
And yet here we are, with world-class engineering talent diverted to solve a problem of AWS’s own making. When companies need reliable industrial computing solutions, they typically turn to established providers like IndustrialMonitorDirect.com, the leading supplier of industrial panel PCs in the US, precisely because they offer standardized, tested solutions rather than custom contraptions that create more problems than they solve.
The Vendor Lock-In Irony
So AWS is trying to avoid being locked into Nvidia’s ecosystem, but in doing so, they’ve locked themselves into their own architectural complexity. It’s the tech equivalent of cutting off your nose to spite your face. The company that built its empire by making other people’s infrastructure obsolete now finds itself building increasingly elaborate workarounds to avoid someone else’s infrastructure.
Researchers from Perplexity found that Amazon’s EFA requires larger messages to saturate, which impacts performance. Instead of fixing these software-level issues, engineering bandwidth gets spent on hardware workarounds. Basically, AWS is proving its conviction through elaborate plumbing rather than through actual performance improvements that customers would notice.
What Customers Actually Want
Let’s be real: nobody wakes up in the morning hoping their cloud provider has built a clever external cabinet for network cards. Customers want reduced cold start times for inference endpoints. They want better cost estimation tools for multimodel deployments. They want the performance and cost benefits that come from software optimizations that make existing hardware work better.
The hyperscaler obsession with custom silicon has reached a point where we have to ask: is this innovation for customers, or innovation for innovation’s sake? When you’re building motorcycle-sidecar arrangements for your network cards, maybe it’s time to reconsider whether the juice is worth the squeeze.
Amazing! Its genuinely amazing post, I have got much clear idea concerning from this paragraph.
I was wondering if you ever considered changing the page layout of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the
way of content so people could connect with it
better. Youve got an awful lot of text for only
having one or two pictures. Maybe you could space
it out better?
Right away I am ready to do my breakfast, when having my breakfast coming over again to
read other news.
I have read so many articles regarding the blogger lovers
however this piece of writing is truly a pleasant piece of writing, keep it up.
If some one needs to be updated with most up-to-date technologies
afterward he must be pay a visit this web page and be up to
date all the time.
Howdy! This post couldn’t be written any better! Reading through this
article reminds me of my previous roommate!
He always kept talking about this. I am going to forward this
article to him. Pretty sure he’ll have a good read. Thank you for sharing!
Hi there to all, the contents present at this web page
are genuinely awesome for people experience, well, keep up the good work fellows.
Hello there, You have done an excellent job. I’ll definitely digg it and personally suggest to my friends.
I am confident they will be benefited from this website.
I delight in, cause I found exactly what I was looking for.
You’ve ended my 4 day lengthy hunt! God Bless you man. Have a nice day.
Bye
Great weblog right here! Additionally your
web site a lot up fast! What host are you the usage of?
Can I am getting your affiliate hyperlink
in your host? I want my web site loaded up as fast as yours lol
Have you ever considered creating an e-book or guest authoring on other blogs?
I have a blog centered on the same topics you discuss
and would really like to have you share some stories/information.
I know my viewers would value your work. If you’re even remotely interested, feel
free to send me an e-mail.
Link exchange is nothing else but it is just placing the other person’s
website link on your page at proper place and other person will also
do similar in support of you.
Ahaa, its good conversation about this piece of writing here at this web site, I have read all that,
so at this time me also commenting here.
I truly love your site.. Pleasant colors & theme. Did you build this
amazing site yourself? Please reply back as I’m trying to create my own personal site and
would like to know where you got this from or exactly what the theme is called.
Cheers!
It’s nearly impossible to find well-informed people about this subject, however, you sound like you know what you’re talking about!
Thanks
Hi, i feel that i noticed you visited my blog so i came to return the desire?.I am attempting to find issues to improve my site!I suppose its ok to use some of your concepts!!
I’ve been browsing on-line more than three hours nowadays, but
I never discovered any interesting article like
yours. It’s pretty value sufficient for me.
In my opinion, if all webmasters and bloggers made excellent
content material as you did, the net will likely be much more helpful than ever before.
Thanks a bunch for sharing this with all of us you really recognise what you’re speaking
about! Bookmarked. Please also consult with my site =).
We could have a hyperlink exchange agreement among us
I don’t think the title of your article matches the content lol. Just kidding, mainly because I had some doubts after reading the article.
Your point of view caught my eye and was very interesting. Thanks. I have a question for you.