Ram Prices Projected To Plummet

BloodOmen

I am a FH squatter
Joined
Jan 27, 2004
Messages
18,597
Is this the light at the end of the tunnel?

660438545_1263919739190215_1314037436905718926_n.jpg
 

Deebs

Chief Arsewipe
Staff member
Moderator
FH Subscriber
Joined
Dec 11, 1997
Messages
9,077,587
As much as I want this to happen surely it will require software companies to adopt this new code to make use of the algorithm? Or is it some form of hypervisor memory management process which can also compress memory (has been done before).
 

BloodOmen

I am a FH squatter
Joined
Jan 27, 2004
Messages
18,597
As much as I want this to happen surely it will require software companies to adopt this new code to make use of the algorithm? Or is it some form of hypervisor memory management process which can also compress memory (has been done before).

The magic AI crystal ball says this about it

What TurboQuant is​

  • A new AI memory compression algorithm from Google
  • Designed to reduce how much RAM / VRAM AI models need
  • Focuses on something called the “key-value cache” (basically the short-term memory AI uses when generating responses)

What it actually does​

  • Cuts memory usage by ~6× (six times less RAM needed)
  • Maintains accuracy (no noticeable loss in performance)
  • Can even speed things up in some cases
In simple terms:
👉 Same AI capability, but with way less memory required.
 

Gwadien

Uneducated Northern Cretin
Joined
Jul 15, 2006
Messages
20,530
Six times less RAM needed, or is AI going to be six times better?

I think I'll wait for the bubble to burst then there will be lots of very cheap RAM.
 

BloodOmen

I am a FH squatter
Joined
Jan 27, 2004
Messages
18,597
Six times less RAM needed, or is AI going to be six times better?

I think I'll wait for the bubble to burst then there will be lots of very cheap RAM.

If only, the bubble isn't far off bursting I reckon. Even Disney can see the bubble's about to go, they pulled $1,000,000,000 of investment from Sora/ChatGPT - other big investors have also pulled out or reduced their investment by a lot. I think investors are starting to realise that they won't see returns for a long time yet because datacentres haven't even been built yet and are likely still 5+ years from being built (if at all due to regulations and pushback)
 

Deebs

Chief Arsewipe
Staff member
Moderator
FH Subscriber
Joined
Dec 11, 1997
Messages
9,077,587
The magic AI crystal ball says this about it

What TurboQuant is​

  • A new AI memory compression algorithm from Google
  • Designed to reduce how much RAM / VRAM AI models need
  • Focuses on something called the “key-value cache” (basically the short-term memory AI uses when generating responses)

What it actually does​

  • Cuts memory usage by ~6× (six times less RAM needed)
  • Maintains accuracy (no noticeable loss in performance)
  • Can even speed things up in some cases
In simple terms:
👉 Same AI capability, but with way less memory required.
Key-Value caches have been around for years, FreddysHouse runs one and has done for a very long time. That is not new tech, go check Redis - The Real-time Data Platform
 

Users who are viewing this thread

Top Bottom