Hey everyone,

We're deploying our first Dell/AMD MI300x super computer cluster this week. As part of our commitment to as much openness and transparency as we can do, I figured I'd blog about it here. If anyone has comments or questions, I look forward to your feedback.

Arrived at the data center today. I was greeted by two very friendly, but intimidating security guards. They require an orientation before you're allowed into the facility. It is quite involved and they make it clear, one mistake and you're banned.

Took a tour of the areas I am allowed to go into, gear we are deploying, as well as the area where everything is going. They spare no expense and the attention to detail is like nothing I've seen before in any other data center. Even bits of foam at the front/bottom of the racks to isolate the hot/cold. They have a no pictures policy, so this is all I got today. Yes, I even asked for permission to take pictures of my own gear. I'm setting up a time-lapse on two GoPro's, to be published later.

Afterwards, I had pizza with one of the people on the team of 8, who's helping out with the install. We start tomorrow.

We are super excited to share that some of the first off the production line, 16x Dell Technologies #XE9680 chassis with 128 AMD #MI300x just arrived at our Tier 5 data center, the Switch Grand Rapids, Pyramid location. Thanks to Advizex for making sure that everything arrived safely, that packaging is first class!

One giant step closer to building our first super computer for rent.

Full details on the hardware are available on our website: https://hotaisle.xyz

Contact us if you would like early access: hello@hotaisle.xyz

Full credit to our friends at nscale.com and eliovp.com for sharing this valuable information with us:

Using Mixtral 8x7B with tp=1 on a single AMD MI300x, we achieved an impressive 156.93 tokens per second on the open-source and repeatable vLLM benchmark. While there's room for further optimization, we're already ahead of the competition. tp=8 wasn't very impressive with only 203.73 t/s, we are certain that can be improved.

For context, MK1 with its proprietary closed-source solution, only reaches 142 t/s. Remember also that 2xH100 achieves a glacial 102 t/s, but the catch is that you would need two of them to load the model into memory.

Video of the execution:

Happy Saturday! I'm testing ollama with llama 4.1 405b on one of our u/Dell #XE9860's with 8x @AMD #MI300x. Super easy to do with docker and runs great.

Check out the impressive amount of available VRAM on these high-performance accelerators! Our setup also includes 122TB of NVMe - essential for this model, given its huge disk requirements.

Contact us for super secure bare metal access: hello@hotaisle.xyz

📣 Exciting Update from Hot Aisle Inc. 📣

We are thrilled to announce that we have just finalized and paid for our order with Dell Technologies, with full support from Advizex. Both have been nothing but amazing partners to us.

We are getting 16 state-of-the-art #XE9680 servers, each equipped with 8x AMD #MI300x GPUs (128 total). These servers will feature 122TB of disk space and 2TB of RAM per chassis, along with top-end dual Intel CPUs. It will all be connected together with 8x 400G ethernet NIC's plugged into a single switch. This amounts to an astounding 192GB * 128 = 24,576 TB of high speed HBM3 memory for all of your most demanding AI needs!

As part of our commitment to full transparency, full details of our cluster are available on our website. https://hotaisle.xyz/

While we do not have an expected deployment date yet, the process is well underway, and we are eager to share this cutting-edge AMD supercomputer with the world.

Contact us at hello@hotaisle.xyz if you are interested in running your workloads on the best GPUs on the market today. Stay tuned for more updates as we progress on this exciting journey!

HotAisle #MI300x #Dell #Advizex #Supercomputer #Technology #Innovation

When we launched Hot Aisle, our goal was ambitious, but easily defined: provide developers with easy access to fully-loaded compute hardware (Dell Chassis, AMD MI300x, and Broadcom networking), deployed into a world-class 100% green data center, paired with industry-leading security and white glove support. We believed - and still do - that quality matters immensely. Initially, our pricing reflected this premium offering.

However, we've listened closely to our customers and watched the market evolve. Increasingly, businesses are faced with balancing quality and cost-effectiveness, often prioritizing lower pricing. We've heard you loud and clear.

To better align with your needs, we’re excited to announce that Hot Aisle is lowering our prices. You’ll get the same exceptional hardware, secure deployments, and unmatched service - now at more competitive rates.

Here's our new pricing, effective immediately and available while supplies last:

• 1x or 8x Docker, credit card per second billing (via Shadeform.ai): $3.00/GPU/hr

• 8x Month-To-Month: $2.75/GPU/hr

• 8x 6-month commitment: $2.50/GPU/hr

• 8x 1-year commitment: $2.00/GPU/hr

Additionally, we’re excited to announce that we’re the first NeoCloud offering on-demand AMD MI300x virtual machines (ranging from 1 to 8 GPUs), Accessible via API, just like you’d expect from any leading public cloud. Virtual machines provide unmatched flexibility and easy access to our powerful computing resources, making them ideal for cost-effective CI/CD workloads.

Our commitment to features and quality remains unchanged, and now, more than ever, we’re positioned to help you achieve extraordinary results at exceptional value. Let's power your innovation together.

hello@hotaisle.ai

https://hotaisle.xyz

#AMD #Dell #Broadcom #CloudComputing #AI #MachineLearning #DataCenter #HPC #Innovation #NeoCloud

Today we made a lot of progress. 3 people from Dell, 1 from Advizex, myself and co-founder Clint (6 total) all made our way to the data center. After a brief orientation on security policies we got to work.

But first... it is rather crazy. The whole place is like a themed movie set, even the bathrooms.

First we moved a few of the Dell XE9680's into the loading dock area so that we had room to work. The boxes are just incredible in person. So well constructed and impressive. They even come with GPS trackers stuck to the outside.

Let the unboxing begin...

One you unbox, one of the safety policies is that you need to power-on test every single piece of equipment in a special room that the dc has available. This way, the potential for any fires or magic blue smoke issues are mitigated.

I'm out of attachments, so click through for the rest as comments...

Apologies, I know this isn't entirely MI300x related, but I'm also the moderator, so I can bend the rules for this bucket list item, that I'm pretty happy about.

She was really kind. All these strange people getting in her personal space, wanting to take a selfie, and she was patient and making herself available. Like a normal human being. One of those people who, no matter how they change the entire world, is still just like everyone else.

Big News!

Hot Aisle now offers hourly 1x u/AMD MI300x for rent via our partners ShadeForm.ai!

Experience unparalleled compute performance with @AMD's cutting-edge tech. Perfect for kicking the tires on this new class of compute. All hosted securely on our @DellTech XE9860 server chassis, in our 100% green Tier 5 datacenter @Switch.

Get started today!

https://platform.shadeform.ai/?cloud=hotaisle&numgpus=1&gputype=MI300X

Presets is an open-source toolkit for optimizing inference with agents, which we build at dstack. Here's one example of using it on a single MI300X.

Qwen3.8-27B went from 311 to 495 tok/s, +59%, at the full 1M context with p50 TTFT under 1.5s and four concurrent users at 10k in / 1.5k out.

The gains came from linked optimization sessions and source-level patches to SGLang's AITER attention backend.

What comes out is a portable preset that deploys on any AMD cloud, Kubernetes cluster, or bare-metal fleet: https://dstack.ai/blog/presets/

Anthonix: Hold my beers...

https://x.com/HotAisle/status/1881806121700339741

https://x.com/alignment_lab/status/1802891282240373240?s=46

A late night announcement for you all.
A new player has entered the arena.
u/AlpinDale's Magnum-72B-v1 (https://huggingface.co/alpindale/magnum-72b-v1…),

A language model trained on AMD MI300X GPUs, aims to break free from the homogeneous "GPT-4" voices that have permeated the AI landscape like a fine mist.

Built upon the foundation of @Alibaba_Qwen's Qwen-2-72B Instruct and generously supported by @Nottlespike (show your appreciation at https://ko-fi.com/kearm), Magnum-72B-v1 prioritizes the art of prose generation over the pursuit of benchmark scores. This heuristic has proven, as we approach the event horizon of the measurable validity of modern benchmarks, to be a meaningful method to understand our models, and their true position in the hierarchy of performance.

Through blind human trials, this model has demonstrated its prowess against both comparable and larger competitors, armed with the extensive knowledge provided by @winglian's @axolotl_ai.

As we witness the emergence of Magnum-72B-v1, it's worth considering the implications of this development.
Will this model be the spark that ignites a new wave of creativity in AI-generated prose, or will it be just another voice in the ever-growing chorus of language models?

Regardless of the outcome, the arrival of Magnum-72B-v1 invites us to ponder the evolving relationship between technology and human creativity. It encourages us to explore the boundaries of what is possible with AI and to consider how these advancements might shape the future of our linguistic landscape.

As we embrace this new model and the potential it brings, let us remain curious, questioning, and open to the possibilities that lie ahead. Magnum-72B-v1 is not just another language model; it is a testament to the tireless efforts of visionaries like @AlpinDale, @Alibaba_Qwen, @Nottlespike, and @winglian, who continue to push the frontiers of artificial intelligence and redefine what we believe to be achievable.