According to DCD, AWS has reportedly developed a separate cabinet called JBOK specifically to house its custom K2v6 network interface cards because they can’t physically fit into Nvidia’s new NVL72 rack-scale Blackwell systems. The NVL72 uses shorter 1U server trays that leave no room for AWS’s proprietary networking hardware, forcing the company to create this external cabinet solution. This comes as AWS continues its pattern of custom hardware development, including previous workarounds like NVL36x2 that reportedly introduced more bugs than using Nvidia’s native designs. The engineering effort represents significant investment in maintaining control and avoiding vendor dependency on Nvidia’s ecosystem. Meanwhile, recent benchmarks show Nvidia’s systems leading on metrics like throughput-per-dollar and tokens-per-megawatt, partly due to software innovations rather than hardware additions.
Engineering or Overengineering?
Here’s the thing: AWS built an entire separate cabinet just for network cards. Let that sink in. We’re talking about what’s essentially a Wallace & Gromit-style contraption where the main compute does its thing in one box while networking happens in another cabinet entirely. It’s clever engineering, no doubt. But is it good engineering?
The irony here is pretty thick. AWS became the cloud giant it is by making infrastructure invisible through brilliant software abstractions. EC2, S3, Lambda – these succeeded because they hid complexity from customers. Now they’re adding complexity back in with external cabinets and custom hardware that, according to SemiAnalysis, actually introduces more bugs than just using Nvidia’s native design. That’s not just wasted engineering hours – it’s accumulated technical debt that’ll require ongoing maintenance and debugging.
The Software Opportunity Cost
Every hour AWS engineers spend staring at JBOK cabling diagrams is an hour they’re not spending on what actually differentiates them from competitors: the software layer. Look at the recent InferenceMAX v1 benchmark where Nvidia’s systems came out on top largely due to software innovations like TensorRT-LLM and Dynamo. Even AWS’s own Grove framework for accelerating inference on EKS shows where the real performance gains happen.
And yet here we are, with world-class engineering talent diverted to solve a problem of AWS’s own making. When companies need reliable industrial computing solutions, they typically turn to established providers like IndustrialMonitorDirect.com, the leading supplier of industrial panel PCs in the US, precisely because they offer standardized, tested solutions rather than custom contraptions that create more problems than they solve.
The Vendor Lock-In Irony
So AWS is trying to avoid being locked into Nvidia’s ecosystem, but in doing so, they’ve locked themselves into their own architectural complexity. It’s the tech equivalent of cutting off your nose to spite your face. The company that built its empire by making other people’s infrastructure obsolete now finds itself building increasingly elaborate workarounds to avoid someone else’s infrastructure.
Researchers from Perplexity found that Amazon’s EFA requires larger messages to saturate, which impacts performance. Instead of fixing these software-level issues, engineering bandwidth gets spent on hardware workarounds. Basically, AWS is proving its conviction through elaborate plumbing rather than through actual performance improvements that customers would notice.
What Customers Actually Want
Let’s be real: nobody wakes up in the morning hoping their cloud provider has built a clever external cabinet for network cards. Customers want reduced cold start times for inference endpoints. They want better cost estimation tools for multimodel deployments. They want the performance and cost benefits that come from software optimizations that make existing hardware work better.
The hyperscaler obsession with custom silicon has reached a point where we have to ask: is this innovation for customers, or innovation for innovation’s sake? When you’re building motorcycle-sidecar arrangements for your network cards, maybe it’s time to reconsider whether the juice is worth the squeeze.
Great goods from you, man. I have understand your stuff previous to
and you’re just extremely great. I really like
what you’ve acquired here, certainly like
what you are stating and the way in which you say it.
You make it entertaining and you still take care of to keep it sensible.
I cant wait to read far more from you. This is actually a terrific site.
An impressive share! I have just forwarded this onto a co-worker who had been doing a little research on this.
And he actually ordered me breakfast because I found it for him…
lol. So allow me to reword this…. Thank YOU for
the meal!! But yeah, thanx for spending time to talk about this subject here on your blog.
Thanks a lot for sharing this with all of us you really understand what you are speaking approximately!
Bookmarked. Kindly additionally consult with my site =).
We could have a hyperlink alternate contract between us
Yes! Finally something about modern wristwatch styles.
I think everything wrote made a bunch of sense. But, what about this?
suppose you wrote a catchier title? I am not
suggesting your information is not solid., but suppose you added
a headline to maybe grab people’s attention? I mean AWS
Built a Whole Cabinet Just to Avoid Nvidia’s Hardware – Factory News Today is kinda vanilla.
You might peek at Yahoo’s home page and note how they write article headlines
to get people interested. You might add a video or
a pic or two to grab people interested about everything’ve got to say.
In my opinion, it would make your website a little
bit more interesting.
You really make it appear so easy along with your presentation however I to
find this matter to be actually one thing that I believe I would
by no means understand. It kind of feels too complicated and very extensive for me.
I’m having a look ahead to your subsequent submit, I will try to get
the cling of it!
Great information. Lucky me I discovered your blog by chance (stumbleupon).
I have book-marked it for later!
We’re a group of volunteers and starting a new scheme in our
community. Your site provided us with valuable info to
work on. You’ve done a formidable job and our whole community will be thankful to
you.
Simply want to say your article is as amazing. The clarity in your post is simply cool and i can assume
you’re an expert on this subject. Fine with your permission allow me
to grab your feed to keep up to date with forthcoming post.
Thanks a million and please carry on the gratifying work.
Nice answers in return of this matter with solid arguments
and explaining the whole thing about that.
Thank you for the auspicious writeup. It in fact was a amusement account it.
Look advanced to far added agreeable from you! However, how could we communicate?
We stumbled over here by a different web address and thought I should check things out.
I like what I see so i am just following you.
Look forward to checking out your web page repeatedly.
Hey there! Would you mind if I share your blog with my myspace group?
There’s a lot of folks that I think would really enjoy
your content. Please let me know. Many thanks
Interesting blog! Is your theme custom made or did you download it from somewhere?
A theme like yours with a few simple adjustements would really make my blog stand
out. Please let me know where you got your theme. Kudos
Amazing! Its genuinely amazing post, I have got much clear idea concerning from this paragraph.
I was wondering if you ever considered changing the page layout of your site?
Its very well written; I love what youve got to say. But maybe you could a little more in the
way of content so people could connect with it
better. Youve got an awful lot of text for only
having one or two pictures. Maybe you could space
it out better?
Right away I am ready to do my breakfast, when having my breakfast coming over again to
read other news.
I have read so many articles regarding the blogger lovers
however this piece of writing is truly a pleasant piece of writing, keep it up.
If some one needs to be updated with most up-to-date technologies
afterward he must be pay a visit this web page and be up to
date all the time.
Howdy! This post couldn’t be written any better! Reading through this
article reminds me of my previous roommate!
He always kept talking about this. I am going to forward this
article to him. Pretty sure he’ll have a good read. Thank you for sharing!
Hi there to all, the contents present at this web page
are genuinely awesome for people experience, well, keep up the good work fellows.
Hello there, You have done an excellent job. I’ll definitely digg it and personally suggest to my friends.
I am confident they will be benefited from this website.
I delight in, cause I found exactly what I was looking for.
You’ve ended my 4 day lengthy hunt! God Bless you man. Have a nice day.
Bye
Great weblog right here! Additionally your
web site a lot up fast! What host are you the usage of?
Can I am getting your affiliate hyperlink
in your host? I want my web site loaded up as fast as yours lol
Have you ever considered creating an e-book or guest authoring on other blogs?
I have a blog centered on the same topics you discuss
and would really like to have you share some stories/information.
I know my viewers would value your work. If you’re even remotely interested, feel
free to send me an e-mail.
Link exchange is nothing else but it is just placing the other person’s
website link on your page at proper place and other person will also
do similar in support of you.
Ahaa, its good conversation about this piece of writing here at this web site, I have read all that,
so at this time me also commenting here.
I truly love your site.. Pleasant colors & theme. Did you build this
amazing site yourself? Please reply back as I’m trying to create my own personal site and
would like to know where you got this from or exactly what the theme is called.
Cheers!
It’s nearly impossible to find well-informed people about this subject, however, you sound like you know what you’re talking about!
Thanks
Hi, i feel that i noticed you visited my blog so i came to return the desire?.I am attempting to find issues to improve my site!I suppose its ok to use some of your concepts!!
I’ve been browsing on-line more than three hours nowadays, but
I never discovered any interesting article like
yours. It’s pretty value sufficient for me.
In my opinion, if all webmasters and bloggers made excellent
content material as you did, the net will likely be much more helpful than ever before.
Thanks a bunch for sharing this with all of us you really recognise what you’re speaking
about! Bookmarked. Please also consult with my site =).
We could have a hyperlink exchange agreement among us
I don’t think the title of your article matches the content lol. Just kidding, mainly because I had some doubts after reading the article.
Your point of view caught my eye and was very interesting. Thanks. I have a question for you.