blog.ratterobert.com

prologic (twtxt.net)

There are other tasks LLM(s) are far better suited for, which are also its downsides, and gawd so expensive and unrealistic to run yourself 🤦‍♂️ Do you know what one of these NVIDIA H100's cost? 💲 That's right! 🤣 > $50k USD 😱 And many of the models out there require 8 of these suckers 🤣 Each one consumes around ~400W of power each (not including the machine that houses them!)

In reply to: #pdp7oxq 1 month ago
Reply via email