Discussion
Automated bot check in progress
genpfault: 600 GB/s of memory bandwidth isn't anything to sneeze at.~$1000 for the Pro B70, if Microcenter is to be believed:https://www.microcenter.com/product/709007/intel-arc-pro-b70...https://www.microcenter.com/product/708790/asrock-intel-arc-...
qingcharles: I think the B65 is priced at $650. Both supported by llamacpp I believe. With that power draw you could run two of them.
whalesalad: Anyone running an ARC card for desktop Linux who can comment on the experience? I've had smooth sailing with AMD GPU's but have never tried Intel.
wyre: There was the video a little while back where LTT built a computer for Linus Torvalds and they put an Intel Arc card inside, so I'd imagine Linux support is at the very least, acceptable.[1] https://www.youtube.com/watch?v=mfv0V1SxbNA
WarmWash: Wake me when they wake up and release a middling card with 128GB memory.
Weryj: Buy 4?
vessenes: Not sure why you'd want this over an apple setup. M4 max is 545GB/s of memory bandwidth - $2k for an entire Mac Studio with 48GB of RAM vs 32 for the B70.
wyre: one can upgrade and swap parts with a computer running an Intel GPU. Linux is very well supported compared to Mac hardware.
electronsoup: Which mainboards are cheap and have 4 pcie16x (electrical) slots, that don't need weird risers to fit 4 GPUs
2OEH8eoCRo0: Funny, I not sure why anyone would use Apple over Linux.
hedgehog: Being able to keep infrastructure on Linux is a big advantage.
RestartKernel: How many compatibility issues is MacOS realistically expected to spur? Windows DX felt unusable to me without a Linux VM (and later WSL), but on MacOS most tooling just kinda seems to work the same.
einr: It’s not the tooling for me, macOS is just bad as a server OS for many reasons. Weird collisions with desktop security features, root not being allowed to do root stuff, no sane package management, no OOB management, ultra slow OS updates, and generally but most importantly: the UNIX underbelly of macOS has clearly not been a priority for a long time and is rotting with weird inconsistent and undocumented behaviour all over the place.
fvv: with those $2k you can have 2xB70, with 1.2Tb/sec and 64G Vram, on linux ( and you can scale further while mac prices increase are not linear 0
Reubend: You're absolutely right. And these Intel GPUs will also be much faster in terms of actual math than the M series GPUs that the Apple setup would have.
DiabloD3: Since they fired the entire Arc team and a lot of the senior engineers already updated their Linkedins to reflect their new positions at AMD, Nvidia, and others, as well as laying off most of their Linux driver team (GPU and non-GPU), uh...WTF?
bigyabai: For server usage? macOS is the least-supported OS in terms of filesystems, hardware and software. It uses multiple gigabytes of memory to load unnecessary user runtime dependencies, wastes hard drive space on statically-linked binaries, and regularly breaks package management on system upgrades.At a certain point, even WSL becomes a more viable deployment platform.
