Hi, this is Wayne again with a topic “YOU Get a Supercomputer!”.
We’Re at the super micro booth at cs2023, and this bad girl right here is the sys751 g-e-t-n-r-t, an 80 000 AI supercomputer designed to go in your house no seriously. People are asking for this and trust me. I have the same reaction, but hear me out. The world is changing for perspective. Every workstation that super micro now sells is actually purpose built to support Ai and machine learning and bundle that with a global shift to working from home, and you end up with demand for top tier AI Hardware like this, the type of stuff that draws thousands of Watts of power – that’s somehow quiet enough to be under your desk at home, like seriously where’s the power button. Oh I missed it. It’S on! That’S how loud it is – and this is how a radiator, quite literally, almost the size of an Xbox series X holy, but not as holy or as as this segue to our sponsor. Thanks to Acer for sponsoring this video Acer’s pushing the limits of 3D gaming with their new 3D Ultra mode and spatial Labs, true game, so stay to the end of the video to find out more, I can’t get over how big this radiator is seriously when we Got that press email about this – I was like, ah just a workstation, but look at this radiator and I can’t wait to show you the rest of the water clean, but for now let’s make this back into a complete system. Of course, since this system is meant to go, you know at someone’s house or in a lab under the desk.
The form factor is a talent. Now it is still rack mountable. You can pull off the top here and the feet at the bottom and rack mount it, but the intended purpose is a tower so up front you’re, going to see things that are like a workstation. We got headphone jack microphone, Jack kind of standard things. I don’t know if you would, you know, have Windows on this and do your Microsoft team calls on a on an AI super computer like this, but you could, if you wanted to there’s also two USB ports and one of the stars of the show, the eight Gen 5 nvme slots – all of them are full speed. You can see our boot drive right here. What is this? Nothing exciting? It’S just a two terabyte boot drive, but you could put up to theoretically. If you put 30 terabyte drives 240 terabytes of storage in this system and that’s before we even get to any of the other cool Hardware. Now, of course, the best thing up front is the power button, because you turn this thing on and it’s like, it barely makes noise. This computer has two 2 000 watt power supplies in it.
That’S the type of heat we’re dealing with and it barely makes noise now some of you are probably saying: well, you know it’s not doing anything yet, but they had it when we walked in here loaded with, I think, a 1500 watt load, or so still the Exact same noise level – oh there’s peels in here they haven’t even peeled foreign film before use, nobody read that it never gets old, peeling plastic off ten thousand dollar graphics cards, let alone four of them. Now we’ll talk about those later, I think the star of the show here is actually the CPUs. Now this isn’t an AMD based system. This is Intel, despite AMD having really really awesome server stuff.
It’S still only about 30 of the market share, so 70 of the systems they’re selling are still Intel based. This is sapphire Rapids, it’s actually just come out. After God, it’s been like two years of DeLay, So this system, fully specked out, could be up to 256 core processors or 350 watts per socket serious amount of power for memory.
There’S eight sticks per socket and, while Sapphire Rapids can do up to 16 or two dims per channel, it’s kind of hard to fit it. In a configuration like this well you’ll see in a lot of dual socket servers is the CPUs kind of in the front or they’ll be in a configuration where they’re staggered slightly now. This is important primarily for airflow.
Now, if you were to have both of the sockets like this in an air cooled system, the second CPU here is just going to be getting a straight hot air, which you don’t really want, since this is water, cooled it doesn’t matter now. It’S also weird I’ve. Never seen a system like this, where the sockets are in between the graphics cards, especially in this configuration now there is an important reason for this, because the system is pcie Gen 5. The actual Lane length the physical traces on the motherboard. The length of those is very important. The longer you go the harder it is to run that sort of frequency as pcie Generations get faster and faster. It’S just going to keep getting harder and harder. A lot of boards from other manufacturers will use something called a retimer which is basically just like a a signal booster, but super micro doesn’t use that and because they position the sockets like this, they can make those physical traces on the board from the pcie slot.
To the CPU super short, which makes it a lot easier to run, speeds like that, and you don’t have to use retimers now, since the CPUs and the gpus are water cooled. Naturally, the next thing you’re wondering is: what else are they going to water, cool and apparently on the next version of the system, they’re gon na water cool the dims? I mean it’s not doing anything right now, but they don’t feel particularly hot and there is a good amount of airflow but um. I guess the more dense the dims get. You can use up to 256 gig dimms, which, in the full configuration, is two terabytes per socket um. It’S probably a bit more heat than this. Do you think they get mad? If I took one of the graphics cards out, yes, they like us. I think I’m just gon na do it what’s the worst that could happen going to jail. You took a graphics card out.
Oh there’s actually locks on these whoa weird. I guess because this is a workstation um. There is PCI e-locks. If you look on servers.
Most of the time they don’t have it. Oh, I think that might be about as far as I can get it to come out. Oh wait! Look! Oh more! Oh wow, there’s more whoa! Weird! I didn’t even realize he’s actually used the new 12 pin connectors. I wonder if they’ve had any that have caught on fire well, regardless of taking it out or not.
These gpus are nvidia’s a100 80 gig cards, which aren’t the latest generation. What you probably get with a system like this are h100s the new architecture, but they don’t really have a stock yet so this is just for show a100s. They look very similar. The idea is the same now: they’re pcie based so they’re, not the crazy sxm cards, but they are water cooled which is crazy. Look at the end. Each of them has quick disconnects.
I wonder if I can get one of them off. I don’t know I don’t know how these quick disconnects disconnect. Oh wow, that’s so easy look at that. These quick disconnects are super nice and so easy to use, and they don’t leak at all some of the ones I’ve seen you pop it out and like a couple drops come out. Nothing came out of this one at all. I guess which matters in a server now the reason they’d be on quick disconnects is so you can take a GP out to swap or if you wanted, to upgrade the system down. The road it’ll be a lot easier than trying to drain the whole Loop change. The cards nobody wants to do that, not all RAM sticks are made equally these ones so satisfying just listen.
Oh, that is wonderful. The power distribution in this system is very weird, we’ll see more of it on the other side, but each of the graphics cards and I think CPU don’t see how it connects to the CPU. Do you see the power connector anyway? Oh it’s down there. Oh interesting. Okay, I get it now, there’s a PCB inside of here with big Power contacts. There’S a big connector, that’s plugging into the motherboard in the bottom corner, and then each of the gpus comes off of this part of that board up and over.
So it’s all directly connected to here and then just little cables to each of the components, but only the graphics cards. I guess it’s very like kind of elegant solution, I’m kind of surprised, cool, there’s, also more pcie slots, there’s one extra one here and another two down here and all seven of them total run at pcie, Gen 5 16x, which is an obnoxious amount of pcie throughput. So you could run a 400 gig Nic 200 gig mix whatever you want a cxl module.
It is a lot an absolutely Monumental amount of i o, especially considering you’re gon na put this at your house. The only other really cool things on this side. Of course, the radiator which we talked about before it’s absolutely massive and, of course, to feed a radiator like that they have some pretty thick fans as well.
They’Re, not crazy, like you would expect. I mean, given that it’s quiet it makes sense, but they’re only 12. Volt 0.96 amp fans, they’re 12 watt fans, usually systems like this they’re, like I got.
My 120 watt fan sounds like a jet taking off this. This is not that, but the craziest thing is this looks so cool on this side. The other side of this system looks pretty much just as cool.
I don’t know if I can move it myself, but it’s apparently 98 pounds or something like that. Oh, my God, there’s the lines from the rad up to the reservoir up here, um and then it goes from Reservoir to pumps, pumps to this big manifold and off to everything. Now the manifold’s super cool. You got quick disconnects here as well, so you can pop tubes off just like that.
Some of them are hard lined like this is. This is like a soldered connection. I imagine that’s probably for the CPU. They don’t expect people to be taking CPU blocks off. Like you would a graphics card, but if you want to pull the graphics card out, it’s a little like so easy. Look at that.
Look at that just gon na put it back on. Oh you hear that click. The crazy thing is look at these pumps. They look like something you would buy on like Alibaba for for two dollars like this is a a wish: water, cooling episode, but apparently they’re really strong, really durable pumps, and I guess if we turn it on when I turned it on they’re, not super loud either, Which is nice um? I don’t even know if they’re Peter, no, they are pwm, they got, they got four pins each they’re, just they don’t look like they belong in this system. There is two of them, of course, so that’s going to give you redundant flow and also more flow if one of the pumps were to die, you’d still have the one pump going, of course, the system’s ipmi would let you know that the pumps aren’t running. It’S just it’s really nice.
I love the manifold too. I think we saw a similar thing in like the the EK fluid work system, it’s nice that it’s mounted behind and kind of out of the way it keeps it very clean and easily serviceable. The other cool thing down here, look at this. You never get to see this stuff.
Usually the power supply is in a server, are plugged directly into the motherboard and all of the Power kind of comes off there, there’s a bunch of cables in the way. So you don’t really get to see it. This is just the like bare contacts. That’S that’s! 4.
000 watts of 12 volt power right there. That’S why it’s so freaking thick! Look at the bars on here! This is crazy. You can also see where the contacts are to pass through to that board.
On the other side, we were talking about, there’s, probably sort of like a socketed connection and they go together. So it’s easily serviceable. This system completely specked out dual 56 cores four terabytes of Ram quad gpus is around eighty thousand dollars the dgx that it’s going to compare to is 200 000 and they charge you like ten thousand dollars a year just for for service contracts, crazy and that system. Only has a single power supply: it’s not even redundant power. This one is redundant power.
If you have 240 volt power, it’ll do 2200 Watts. If you only have 220 volt it’ll do 2100 Watts, so pretty serious power supplies and they’re. So quiet, usually power supplies like this are crazy, but since super micro manufactures them in-house, they can control. You know this is the chassis it’s going to be in.
We know exactly how much cooling it’s going to need and they can make it quiet. I guess we should take a look at the back. I haven’t really looked at it too much. They did tell me that the reservoir, despite these being like quick, disconnect fittings they’re not for hooking up to like a central water supply. It’S just for filling and draining. You can actually see the coolant in there. It’S like red, it looks like rusty water, I’m sure it’s just like some sort of you know, anti-corrosion inhibitor, sort of thing, there’s two little sights. You can see the coolant level and there is a cap there, I’m not going to open it, because I don’t want to make a huge mess.
The i o, I believe this board is dual 10 gig at the back one port for management, there’s actually type c. That’S kind of cool three USB type, A ports VGA and serial, and, of course, since these graphics cards are like AI accelerators, there’s no display output on them. That’S pretty much it I mean if you wanted to add more. I o, if this was actually a workstation you’re going to run Windows on this thing. You could put a USB card or like a sound card back here. If you really wanted, I don’t know if anyone’s making a Gen 5 USB card, but it would be kind of silly if they did. We got the system booted up now in Ubuntu and we’re running a GPU load. It’S like a python AI script and all the gpus are loaded which is going to put it at about a thousand watt load right now.
Does it sound any louder than it did before? I feel the heat, but it sounds literally exactly the same as before. How quiet this thing is, I mean it’s large, but still, oh the fans, it’s it’s on a little bit more now. Overall, this is seriously just kind of a mind-boggling computer. I just I can’t wrap my head around the fact that people are actually asking them for this.
They told me this is like one of the one of the larger requests that companies have been asking them, for they want a dgx clone, that’s way cheaper and one that people could have at their house. I guess there’s Engineers that are important enough to have a hundred thousand dollar computer at their house. I mean, I guess, there’s equipment, that’s hundreds of thousands of dollars that people use all the time. So maybe it’s not that crazy.
But you know what’s not crazy. Just segue to our sponsor Acer they’re, bringing a much welcome, update to 3D gaming with their stereoscopic 3D technology on their spatial Labs. True game. This feature is best enjoyed with Acer’s Predator Helios 300 spatial Labs Edition gaming laptop. It features a new 3D Ultra mode, Amplified stereo 3D, rendering and newly launched game profiles to be enjoyed. This allows you to immerse yourself deeper into the world of 3D gaming.
With the addition of 3D plus gaming mode, you can customize the stereo 3D effects based on Visual and performance preferences, with its 3D sense feature, enjoy impressive performance on The Predator Helios 300, with its built-in 12th gen core I9 processor and GeForce RTX 3080 GPU with features Such as Wi-Fi 6 fan, control and overclocking, the Predator Helios will make sure you’re set up for success in every gaming session, so check out the links in the description to find out more. Do it CES. So thanks for watching, I hope you folks have been enjoying our CES 2023 coverage.
I have been having a hell of a lot of fun if you did like this video, maybe check out how about the Epic Genoa holy. That was a pretty awesome. Video.
Those CPUs are seriously fast and they did tell me they can make an AMD version of this. If there’s people that are asking for it, it only took them three months to design the system from the ground up. That’S because super micro, you know super modular, .