Read RE's blog at Global Collapse 

Main Menu

The big AI revolution

Started by monsta666, Feb 20, 2024, 01:50 PM

Previous topic - Next topic

K-Dog

#60
The 'opencode' tool I am using is normally set up to use an LLM from a data-center.  I modified it to use a particular LLM that is modified to be a code jockey and nothing else.  When it is running it fills most of the video cards.  The Diner dreams of a 5090 but the price is now 70% over MSRP.

Because the tool is made to be used over the web and not use my video card, there is a counter in the interface that keeps track of how much you are spending to use the tool.  Ours is stuck at $0.00.  We don't even have an API key to log onto a data center.  We do not want one.

Chatbots can generate a lot of tokens.  Good I do not have the problem of paying for them.

* If you watch You-Tube videos on how to do anything AI the first half of the video wastes your time telling you how to sign up for an account.  You need a credit card they say, but don't worry you won't use enough tokens for what we are about to do to cost anything.  And they are telling the truth.  It appears to be a rite of passage, no corporate sponsorship without pushing the borg solution.

Their tutorials are examples.  Put software to real work in a loop and tokens matter.  But what can I say, I doubt it is possible to have a You-Tube channel without being a rabid ass kissing capitalist.


As far as cheap memory cards go, until there is an economic crash the shortage will continue.  Nvidia is all about making money, and if that makes everyone else poor.  Their attitude is too fucking bad.  I regret not getting a 5090 last November now it is too much.  But Nvidia will say too much for you, but not for somebody else.  They love the shortage.