EILITDC AI and cool stuff you can do with it

[Deebs]

Give me £4k (for the hardware...) and a full dump of the FH posts database and I'll publish a dashboard for it all

What kit do you need to provide that if asking for £4k?

 

[Overdriven]

What kit do you need to provide that if asking for £4k?

Couple of routes, I threw £4k as a "Probably covers at least some of these" but as always price go up as reqs and tokens/sec go up.

Easy version: 2 M4 Macs with with 128gb memory each in a cluster.
Long version: A cluster of these: Minisforum MS-S1 MAX max the RAM out. <- Even one of these fully kitted out would do well, but more is better.
Longer version: A Ryzen AI Max+ PRO 495, supporting mobo, enough system RAM and maybe a GPU for offloading.

E: Put the right Minisforum in, I had the lower level AI Max one in which was like £1k atm. The above one a guy I know uses (Just 1) who got it before the spike and it does him very well.

 

[Raven]

I had a right rant at my phone the other day, and it got pissy about it, something about "not responding to that". It was just refusing to play a Spotify playlist.

PS, I usually thank it for setting an alarm, so it was probably in shock or whatever.

 

[Deebs]

Couple of routes, I threw £4k as a "Probably covers at least some of these" but as always price go up as reqs and tokens/sec go up.

Easy version: 2 M4 Macs with with 128gb memory each in a cluster.
Long version: A cluster of these: Minisforum MS-S1 MAX max the RAM out. <- Even one of these fully kitted out would do well, but more is better.
Longer version: A Ryzen AI Max+ PRO 495, supporting mobo, enough system RAM and maybe a GPU for offloading.

E: Put the right Minisforum in, I had the lower level AI Max one in which was like £1k atm. The above one a guy I know uses (Just 1) who got it before the spike and it does him very well.

Ah nice, I have several MS-01 and a couple of MS-A1, not had an issue with any of them, the only downside is that the MS-A1 I had to buy an additional card for remote management unlike the MS-01 which come with Intel vPRO.