Hacker Newsnew | past | comments | ask | show | jobs | submit | Hamuko's commentslogin

I’m not that interested in models that I can’t run on my desktop for ~0€, which is my AI budget.

Electricity cost seems to be about $30/month for a 32B model on a GPU. It's probably better on Apple hardware.

https://github.com/QuantiusBenignus/Zshelf/discussions/2

Not accounting for hardware, of course :)


The price, processed tokens, and output can be anything, it just depends on what GPU it is.

Nvidia GPUs are much more efficient than Apple hardware for inference(and training).


My Mac Studio uses about 60–80 watts whenever I’m running a model (as measured by the system metrics), so it’s less than 2 kWh/day at full blast. Electricity is like 0.125 €/kWh, so that 24-hour period would be <0.25 €.

Not accounting hardware in my costs, since I didn’t buy my hardware for running models. Running models is just something it can do in addition to what I got it for.


Cool beans. You're not the target audience then.

Did I claim I was? I just said why I and people like me are not talking about it.

and he said its cool

This movement stems from Ubisoft’s The Crew, and judging by how Ubisoft is doing financially, maybe they have already.

>Ubisoft has released its financial results for the full 25-26 fiscal year, reporting a sharp decline in revenue and net bookings, down 21.8% and 17.4% year-over-year (YoY), respectively, due to the "softer new release schedule" and new operating model.


The daylight saving time shit is such a fucking fumble from the EU. We have an instance of direct democracy, we have EU politicians parading around saying “we’re gonna end it” and then absolutely nothing happens. Council points fingers at Commission, Commission points fingers at Council. “It’s their job.” How am I as an EU citizen supposed to be proud of being part of this dysfunctional mess?

It's easy talking points during elections but requires lengthy legal procedures and thus gets chopped immediately. Politicians gonna be politicians. Better to be talking about the time of day than some other dog whisle.

It's also been "abolished" many times around the world, then quickly reinstated when kids start dying.

Good thing there's actual data so we can find out how many countries observe DST: <https://en.wikipedia.org/wiki/Daylight_saving_time_by_countr...>.

Not everywhere.

Western Australia has had four referenda on the topic since 1975, each time preceded by a trial period where daylight saving was observed, and every time it has been rejected and the state has switched back to no DST.


Does your member state - as an EU citizen - block the process perhaps? The daylight savings process has stopped because your countries can't agree on which timezone they'd like to be in.

I'm Finnish, so my guess is "no". Gallup polling gave a >85% in favour of abolishing DST. 52% also voted in favour of winter time.

Vibed?

I imagine the stupid enterprise business software I make is way less bad than "our algo is making teenage girls kill themselves".

yeah except that isn't how it's presented.

social media boards don't go creating slides and mission statements that mentions those second order effects.

most go something like: "Connecting people and souls through the technologies that empower every day life."

rather than

"Let's get Susie to jump off a bridge for yuks."


>“Thirty-two percent of teen girls said that when they felt bad about their bodies, Instagram made them feel worse,” the researchers said in a March 2020 slide presentation posted to Facebook’s internal message board, reviewed by The Wall Street Journal. “Comparisons on Instagram can change how young women view and describe themselves.”

>“We make body image issues worse for one in three teen girls,” said one slide from 2019, summarizing research about teen girls who experience the issues.

>Among teens who reported suicidal thoughts, 13% of British users and 6% of American users traced the desire to kill themselves to Instagram, one presentation showed.

I don’t know, seems like they do go around creating slides that mention them.


The current pricing isn't sustainable, and if you try to wring out the maximum amount of profit, you're gonna have competition spring up. The Chinese are probably salivating at this opportunity. Previously they would've had to sell memory at discount rates to get anyone to switch over to them, but now they'd have customers lined up for years if they were selling at the prices Samsung/Micron/SK Hynix were selling a year ago.

Meet the new memory cartel, it's just like the old memory cartel but with CXMT being priced a tiny tad below.

Safe to say they're not in it out of sheer altruism.


> The current pricing isn't sustainable, and if you try to wring out the maximum amount of profit, you're gonna have competition spring up.

I don't understand what you mean by "sustainable". The whole industry tripled their process AND is maxing out their production lines. They are cashing out as expected.

It matters nothing if this trend can't be kept up for years, because by then their output still meets demand AND they will be sitting on a huge bag of cash.

I think you are confusing "I don't want to pay this much" with "this isn't sustainable". The sellers are cleaning up stock at a huge markup and buyers are still buying like crazy.


It's not sustainable because it'll basically ruin all of the industries connected to memory. OpenAI, Anthropic etc. all need a massive amount of compute to train and serve models, and increases in memory price will all drive up their already massive costs. And then on the other end, the people they need to use their AI services cannot either afford the devices they need to access the devices, or the device costs go up so much that they cannot afford to buy the services. If for example budget phones disappear completely because of memory prices, those consumers disappear from the customer pool and then the budget phone manufacturers disappear and stop buying memory, AI companies spend even more to build models for fewer people, etc.

Will there be a budget phone market with these prices? What about budget laptops? Can there exist a gaming console market when memory costs are so high? And what happens to the companies that sell goods and services to the users of those devices?

And obviously, if people see that you're extracting an exorbitant amount of profit, you're gonna have a lot more people eyeing your industry as ripe for competition, since some company would probably not mind eating some of your pie. I'd say that the current memory cartel has a very real risk from China right now. And if you get competition during the boom period, you're also gonna be competing with them during the bust period too.


OpenAI/Anthropic are in the business of "replacing workers with AIs", not in the business of "selling AIs to workers"

that is a 20T market

they dont need you to afford a subscription, they need your boss to replace you with their service


I wonder about that. At the moment, it feels like OpenAI and Anthropic are in the “racing to IPO” business. I’m also not sure who is going to be buying all of this AI output when nobody’s employed.

Isn't this just a "I'm paying for a sub vs. others are paying for tokens" situation?

I don't understand how the tap trust improves security at all. If I'm installing something from a third-party tap, instead of running tap + install, I now run tap + trust + install? How does this protect me against compromised taps?

You can now trust individual files inside taps. It was not clear to all users before now that some commands (before —-eval-all, a mess this replaces) would evaluate all packages Ruby code from all taps). This cleans that up and some other security degrading edge cases I won’t bore you with here.

Trust is also user specific now.

It’s not a silver bullet but it does help address some potential attacks and gives us a foundation to improve on over time.


Exactly - so far seems like a windows vista “are you sure?” Modal. Are we missing something here?

Is that even the plan, or is the plan to make a huge IPO while there's still hype and run off with the money?

Running off with money to be burned by your infra is a pretty terrible plan

It's wild!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: