The difference in complexity between my go and my Python docker image is actually hilarious. 100s of files and package managers and npm and whatever else.. vs 1 file.

Where does NPM play in to the build?

Beats me but somehow we do!

Every day I drop 1k lines of Python code and replace with go. Will be fully go soon!

Npm always finds its way in, usually for building web artifacts.

Ditto. Nothing I want to play doesn’t work on Linux / bazzite.

In fact Atlas and their push to be a C-Corp is a bad play for us small timers

A C corporation can still make a lot of sense for a small business depending on the nature of the business and the interests and needs of the owners.

C corps can offer a lot of advantages in terms of shareholder and employee benefits, particularly around healthcare, and QSBS is a huge benefit for qualified businesses and owners who might one day sell the business.

...unless you're based in a jurisdiction like the UK, where an LLC may not get the same tax treatment as a C-corp (Ltd companies being the norm here).

The memory bandwidth and size seems to be there, but what is the tokens per sec on like a qwen model? And you can basically do 3x opus 4.5 on the $100 a month claude plan. Your payback will be near infinity years after electricity.

you are assuming the idea, the data, the code being touched by opus worths nothing.

how about measuring returns in the sense that I no longer need to share my flagship idea with some random 3rd party just because it hosts the LLM I am using?

At the price points they are hitting, can’t afford over 32 GB on the cheaper model.

256 memory gets you to like 11k. So like 15-20k.

The storage is pretty silly. Bring that down and the max isn’t nearly as bad, more like 12k

But is it? If it’s cheap enough latency doesn’t matter. Unlike say cloud gaming, where latency does matter. I’ll take my games local and my text bots cloud

Of course. People are valuing privacy now, and it's almost inevitable that humans will seek to have more agency over a social contact, even if it's an artificial one.

History has shown me people value convenience and cheapness and maybe safety. Privacy is far down the list for 99% of the world

The first three are starting to get more closely associated with privacy.

Convenience: if I want information from a chatbot, I don't want to have to hear how I can save on my car insurance by switching to another insurance company. That's basically what websites have become. Go to any American local news station's site. It's just wallpapered with ads and you'll inevitably get a popup asking to subscribe. I don't want that from my chatbot.

Cheapness: this doesn't matter over the long run because inevitably, both straight-up monetary payment and revenue generated by invading privacy become part of the service providers' revenue streams, if they don't start out that way. Cable TV used to be ad-free, as did streaming services. Then there was a need to fund the coke habits of some finance guys in Lower Manhattan, so ads were introduced as a "free" tier. Now there's only "reduced" ads on the paid tier, and you still fork over your data to let service providers give advertising clients a better profile of you.

Safety: identity thieves, stalkers, and even government agents acting against the law use commercial data sources to do things they otherwise couldn't. Imagine what they could glean from chatbot or other AI sources.

If you're your own LLM service provider, none of this is a problem.

Wouldn’t you need to bump opus reasoning a few levels to be apples to apples?

I think it’s gut biome problems. So you just trade one problem for another, while tasting bad? Pass.

Well not all artificial sweetener is the same. Some people get gut stuff from sugar alcohols, but I don’t believe that’s been observed in Aspartame. I drink a good amount of Diet Coke, because it’s delicious, and I never get any stomach pain or digestive issues from it. I get more digestive troubles from coffee.

Statistically a fire is more likely to burn your 1 copy than the data center I bet. Ideally you have both, that survives almost anything outside thermonuclear war