It's less about performance and more about ecosystem lockin. It's a bit like imperial vs metric units. Why would you ever chose to learn imperial if you had the option to only ever use metric to begin with?
That's exactly why I am reluctant to do anything with Polars. They are actively running a company and trying to sell a product. At any point they could be acquired and change the license for new releases. Sure you could fork it, or stay on an older version, but if what they offer isn't compelling enough for you then why take the risk?
Pandas on the other hand has been open source for almost two decades, and is supported by many companies. They have a governance board, and an active community. The risk of it going off the rails into corporate nonsense is much lower.
- Pandas is interwoven into downstream projects. So it will be here to stay for a long time. This is good for maintenance and stability. Advantage: Pandas.
- OTOH, the Pandas experience is awful; this was obvious to many from the outset, and yet it persisted. I haven't tracked the history. But my guess would be the competition from Polars was a key pressure for improvement. Edge: Polars.
- Lots of Python projects are moving to Rust-backed tooling: uv, Polars, etc. Front-end users get the convenience of Python and tool-developers get the confidence & capabilities of Rust. Edge: Polars.
- Pandas has a governance structure not tied to one company. Polars does not. (comment above said this) Advantage: Pandas.
But this could change. Polars users could (and may already be?) pressing for company-independent governance.
For short scripts and interactive research work, pandas is still much better than polars. Polars works well when you know what you want.
When you are still figuring out things step by step, pandas does a lot of heavy lifting for you so you don't have to think about it.
E.g. I don't have to think about timeseries alignment, pandas handles that for me implicitly because dataframes can be indexed by timestamps. Polars has timeseries support, but I need to write a paragraph of extra code to deal with it.
Because these are silly personal scripts. I'm not going to make sensible architectural decisions on something I run every now and then on my laptop. That's optimising too early.
That would be great if journals bothered publishing replication studies. But since they don't, researchers can't get adequate funding to perform them, and since they can't perform them, they don't exist.
We can't look for failed replication experiments if none exist.
I am reminded by the perhaps revisionist history but still applicable belief that slavery was really ended by industrialization making abolition economically advantageous and not actually a socially driven movement. (In reality it was certainly a convoluted mixture of the two I'm sure.)
I hope we are in a similar era with regards to climate change. Surely there's a lot of money to be made in harnessing effectively unlimited renewable energy that literally falls from the sky like manna. With a bit of social pressure we should be able to extinct the fossil fuel industry in my opinion.
> I am reminded by the perhaps revisionist history but still applicable belief that slavery was really ended by industrialization making abolition economically advantageous and not actually a socially driven movement. (In reality it was certainly a convoluted mixture of the two I'm sure.)
More or less.
Adam Smith famously wrote that slavery was economically detrimental way back in 1776. It still took nearly 100 years to abolish slavery, and even to this day, people still equate slavery with prosperity (as implied by that controversial 1612 Project article, for example).
Another way to think about it, the South did not embrace slavery because it made them richer; the South embraced slavery because they opposed industrialization. Southerners would regularly complain about the hustle and bustle of the North, the size of the cities, and how hard regular (white) people had to work. The "Southern way of life" was a thing - a leisurely, agrarian society based on forced labor and land instead of capital.
In this regard it's a doubly fitting metaphor because much of the opposition to abolishing slavery was cultural and not economic.
> Adam Smith famously wrote that slavery was economically detrimental way back in 1776. It still took nearly 100 years to abolish slavery...
Slavery had basically been a thing for all of human history up to that point, and based on my discussions on HN many smart people don't believe a lot of what Adam Smith said. There are still a lot of basic economic ideas that would make people much wealthier that struggle to get out into the wild. With that perspective the near-total abolition of slavery in a century seems pretty quick. And it can't really be a social thing because it is clear from history that societies tolerate slavery if it makes sense.
And we see what happened to the people who tried to maintain slavery over that century - they ended up poor then economically, socially and historically humiliated.
Slavery was already being abolished in the West when Adam Smith wrote the Wealth of Nations. But what was notable was that Adam Smith was really the first to make a strong case and prediction that it was not just the moral thing to do, but would lead to prosperity.
Adam Smith also differentiated between different levels of slavery - that Roman slavery was different than Serfdom was different from chattel slavery in the US.
It's worth noting that Adam Smith did not think total abolition was possible. One of his concerns about free markets was that people deeply desired control of other people, and slavery would increase as a byproduct of wealth.
And effectively it did: many people are kept in their place by the combined pressure points of debt and employment to stay (barely) afloat.
This is of course nothing compared to the cruelty of real slavery but the effect is much the same, a lot of people are working their asses of for an upper class that can ruin their lives at the drop of a hat. That there are no whips involved is nice but it also clearly delineated who was the exploiter and who were the exploited. That's a bit harder to see today.
Rental versus outright purchase is a weird transition. I have this idea for a faction in a post apocalyptic setting that started out as a libertarian community that idealized a society with zero slavery but found it constantly hiding in arrangements like the one you describe, so they made it very explicit and transactional instead: every member of the community is a central bank, and the currency takes the form of small clay discs with a number and a thumbprint. Anyone can mint their own money, but anyone can redeem money for hours of slave labor with the issuing party. And of course there are rules limiting what slaves can be compelled to do, like no minting more hours and no demanding a specific slave.
For some reason this concept is very sticky to me. I actually think it could work as a low tech monetary regime in a grid down scenario.
True, but if your point is that most slavery regimes throughout history were less awful for the slaves, it's also worth remembering that most accounts of those regimes weren't written by the victors of a war that saw the other sides slavery practices as justification for said war.
> if your point is that most slavery regimes throughout history were less awful for the slaves
Not at all. The fact that we have practically zero first-hand accounts from the slaves of antiquity speaks volumes to their treatment. My point is on scale (and with that, the institution's effect on the societies that hosted it).
That’s partly true, but it’s also the case that medieval Europe didn’t have any convenient sources of slaves. Conquests had dried up, Europe was effectively surrounded by stronger neighbors, and instead of being able to take their neighbors as slaves many of their neighbors were taking Europeans as slaves.
That didn’t change until the Age of Sail opened up new frontiers and the wheel turned again.
> Slavery had basically been a thing for all of human history up to that point,
Except that of course it wasn't.
> and based on my discussions on HN many smart people don't believe a lot of what Adam Smith said.
And many smart people do.
> There are still a lot of basic economic ideas that would make people much wealthier that struggle to get out into the wild.
Yes, such as the one that wealth is not very good as a context free metric for societal success.
> With that perspective the near-total abolition of slavery in a century seems pretty quick.
You missed that bit about the war. If not for that who knows where we'd be today.
> And we see what happened to the people who tried to maintain slavery over that century - they ended up poor then economically, socially and historically humiliated.
Yes, they relied on the misery of others to drive their former wealth, but they are not the important people in that story. The important people are the ones that were no longer slaves.
And never mind that many of those former slave owners did just fine economically afterwards, after all, they already were fantastically wealthy so they just switched 'business models' and still made money hand over fist.
It really comes down to granularity at the end, and whether you attempt to look as closely as possible or you accept a certain lack of fidelity because it makes the abstraction work for you.
In this case, I frequently hear people talk about how "the greeks and romans had slaves! and they were white! See, it's fine!" but that fails to take into account that there's a gigantic difference between slavery-as-a-legal-status like they had (entered into by contract or as legal punishment, exit conditions, no real social meaning), and chattel slavery based on race (the 'fuck you got mine' of ethos). I think the idea is that if you squint real, real hard; you can make it look like "not being racist" and "human rights" are somehow newfangled, 'woke' ideals, which is the kind of hilariously wrong misunderstanding we once saw embodied by cletus the slackjawed yokel.
I can call my ma from up here. Hey, ma! Get off the dang roof!
Slavery as we talk about it has been around since roughly the 1600s, and even then didn't peak until the 1800s. Everything prior to that was a totally different beast.
and a quick sidebar - wth is supposed to be wrong with being alert to your surroundings? Do we really value being asleep that much?
I don't see much difference when you consider the condition of farming and mining slaves in Roman society.
Slaves were spoils of war since before the Republic.
Even if a slave had valuable skills, and were treated better, they had no legal recourse against a Roman citizen. Their owner could sell them like chattel, break up families (slave marriage had no legal basis) and kill them outright.
The highly skilled could enter into a kind of indentured servitude. That's a separate category.
You hear romantic stories about household servants gaining high esteem and a few being granted or buying their freedom. These were the exception, against the backdrop of menial labor.
> You missed that bit about the war. If not for that who knows where we'd be today.
It's not just a war. The British Empire declared for moral reasons slavery illegal, and slavers could be hunted for bounty like pirates. The only place that remained in the Empire with slavery was India, because the British felt that the Indian culture could not be disentangled from slavery.
"“Our position is thoroughly identified with the institution of slavery — the greatest material interest of the world....Its labor supplies the product which constitutes by far the largest and most important portions of commerce of the earth.”
Georgia
"“The prohibition of slavery in the Territories… is destructive of our rights and interests.”
The full preamble of the Mississippi declaration is fascinating, and further shuts down doubters that the civil war wasn't about slavery and racism:
> Our position is thoroughly identified with the institution of slavery-- the greatest material interest of the world. Its labor supplies the product which constitutes by far the largest and most important portions of commerce of the earth. These products are peculiar to the climate verging on the tropical regions, and by an imperious law of nature, none but the black race can bear exposure to the tropical sun. These products have become necessities of the world, and a blow at slavery is a blow at commerce and civilization. That blow has been long aimed at the institution, and was at the point of reaching its consummation. There was no choice left us but submission to the mandates of abolition, or a dissolution of the Union, whose principles had been subverted to work out our ruin
Also, they clearly make the case that cotton was the most important good in the world, perhaps imploring the intercession of foreign powers.
I think it's worth pointing out though that these people were not being honest with themselves - nothing in their argument about the importance of cotton suggests it couldn't have been done with wage labor. They are dancing around the fact that only a very few benefit from slavery.
Capital was actually a big part of it. The plantation owner didn't just need to capitalize the cost of the land, but the labor as well. When someone purchased a slave, they were paying up front for the remaining labor that could come from that body. This was often pretty expensive when the body was young. Before the Civil War, New Orleans was one of the biggest banking centers of the US because of all of the borrowing.
People often make the mistake that the labor was "free". It wasn't to the people who bought slaves. It wasn't even really free to the slave traders because of the cost of transport.
It was a horrible system in many ways, but it was also a outrageously expensive because of all of the banking and loans involved.
I highly recommend the book Accounting For Slavery to anyone even remotely interested in this topic.
You talked about the costs of buying a human being, which is already horrible. But once an enslaved person was owned outright, they were used as collateral in loans to expand operations.
Reading this post made me wonder if there were "temp agency" type businesses for slaves. Having to own the labor would make your it very difficult to expand and contract your workforce.
Morality aside, it really doesn't seem like a great system.
This was incredibly common here in Washington DC. Think about construction. Building the Capitol required a ton of temporary labor, for example, so Congress contracted for both free and enslaved labor for its construction.
The south wasn't really situated for industrialization at the time. They didn't have enough rivers that could turn a water wheel effectively. (That's what I've heard anyway)
It's true the first mills were in the north because they had some good sites, but there are good mill sites throughout the South as well. More tellingly, when the first steam engines in the US were imported from Europe - they could have been just as easily installed in the South.
I think more importantly, steam mills solved for a problem the south did not have. If one was to tell a southerner, I have a technology that will save on labor costs, the southerner's response would have been "what are labor costs?"
You still have to wonder why the south never built factories to compete with the north. They exported most of their cotton to the north just to buy it back again the the form of textiles, so slavery working by hand wasn't able to compete with factories on that level.
I'd venture that the north's earlier industrialization built up experience and supporting infrastructure which made it a dubious business prospect for any southerner that might have considered building a factory, along with the fact that making textiles by manpower alone made less money than picking cotton and exporting it.
> They exported most of their cotton to the north just to buy it back again the the form of textiles, so slavery working by hand wasn't able to compete with factories on that level.
My impression was that there was a lack of fast moving rivers which were suitable for water wheels. You could make some elevation, or build a larger wheel, but that can become prohibitive for the volume needed for a real factory.
It looks like the south does have some suitable rivers, but you wonder why they exported their crops to the north just to buy them back again in their more processed form...that just doesn't make much sense from an economic standpoint. Clearly slavery wasn't a suitable replacement for the type of production work done in the north. It must have been a mix of social factors, combined with the fact that the north specialized in industry early on and you couldn't compete very well with the lack of expertise and lack of industry which supported the local industry in the south.
Anyway this is all just wild speculation. Take it for what you will.
> It still took nearly 100 years to abolish slavery, and even to this day, people still equate slavery with prosperity (as implied by that controversial 1612 Project article, for example).
The enslaved people sure as fuck aren't prospering in that situation, so the only way one could possibly equate slavery with economic prosperity is by simply not counting them as people at all.
> Another way to think about it, the South did not embrace slavery because it made them richer; the South embraced slavery because they opposed industrialization... and how hard regular (white) people had to work.
One way to think of slavery is that it's a far point on the continuum between equality and inequality. What they really hated was equality because that necessarily involves taking something away from them, the people who have the most.
- The difference between Ben Franklin writing about farming in the 1770s and the civil war was that industrialization didn't hit the US until the 1810s/1820s when the first steel mills and steam engines were set up.
- "These people categorically did not want to start a farm; otherwise they would not have been facing famine." The vast majority of immigrants to the US at this time WERE farmers who were not allowed to own land in Europe. The reason they came to the North instead of the South is because they were largely not allowed to settle anywhere East of the Appalachians in the South. The South was staunchly anti-immigrant and barely had any cities at the time.
- At the outbreak of war, the Union army was almost entirely made up of American born volunteers. Later, immigrant brigades were enlisted, but most were highly regarded and commended and still made up less than half of the army.
- Your explanation cutely ignores the fact that Southern troops fired first in the Civil War
These people categorically did not want to start a farm; otherwise they would not have been facing famine.
Please tell me more on your theories regarding these immigrants.
The only ones I'm aware of were Irish immigrants. Most of them were urban dwellers, not farmers. The Irish who were farmers were generally working on farms owned by the English.
What makes you think the newspapers of the day are all telling the truth? Does the media today tell the truth? Did newspapers disclose when the equivalent of a billionaire bought them out and drastically changed the editorial bias?
I'm not saying we shouldn't read historical documents. I'm saying to not apply the same skepticism you would apply to modern media to old media is a mistake.
Maybe - a lot of the material wealth of the South was having a lot of land divided amongst fewer people. Enjoying more leisure has a nasty habit of not making people richer in the end.
Here's specifically what Adam Smith had to say in the Wealth of Nations:
> But if great improvements are seldom to be expected from great proprietors, they are least of all to be expected when they employ slaves for their workmen. The experience of all ages and nations, I believe, demonstrates that the work done by slaves, though it appears to cost only their maintenance, is in the end the dearest of any. A person who can acquire no property, can have no other interest but to eat as much, and to labour as little as possible. Whatever work he does beyond what is sufficient to purchase his own maintenance can be squeezed out of him by violence only, and not by any interest of his own.
Later, to explain this trap of why people insist on owning slaves even if paying workers would be more productive in the long run:
> "The pride of man makes him love to domineer, and nothing mortifies him so much as to be obliged to condescend to persuade his inferiors. Wherever the law allows it, and the nature of the work can afford it, therefore, he will generally prefer the service of slaves to that of freemen."
> Enjoying more leisure has a nasty habit of not making people richer in the end.
Human slavery might be one of the few exceptions to this. People can reproduce and create more people provided they are given the bare necessities of life. As long as you could keep the enslaved under control, you would have new slaves you could constantly sell and they mostly took care of themselves.
Honestly it sounds like a great life for an unambitious, lazy person. Maybe we’ll all be able to experience something similar when humanoid robots are commonplace in the future. Find an isolated piece of land with a few robots. Make them grow food and commercial crops. Raise some animals. Live a life of relative self sufficiency and leisure.
The issue (for the masters, and besides any ethical issues) is being a slave master is a very tenuous position, and prone to revolts.
Too capable (but also valuable!) slaves tend to be self sufficient and strong enough to throw you off.
Too weak (and therefore non-valuable!) slaves tend to be easy to control - but are a huge drain on the system, including ‘master’ management, which is often the most constrained resource anyway in any hierarchical system.
Yeah roving bands of murdering robots would be a problem in that scenario. We should be able to keep/maintain our current security and rule of law though.
> if you exclude the enslaved, the south had a higher GDP per capita than the north.
In other words, if you remove the people that earned the least (close to nothing) the overall income per capita goes up? If you exclude the non nobles I am sure the middle ages had a very high GDP too
Prior to the steam engine, what sources of energy you have?
The wind and the water, both rather limited to specific activities (milling, sailing). And the power of human and animal muscle. Where the animals are stronger, but also much dumber, so most of the actual hard work has to be done by human hands.
Basically all the settled civilizations used some sort of non-free or at best semi-free labour. Villeiny, serfdom, prisoners of war, slavery of all sorts, or having low castes do the worst work.
And given that humans are very good at rationalizing away their conditions, the cultures adapted to being comfortable with it, even considering the societal inequality as something ordained by the gods or karma.
> Prior to the steam engine, what sources of energy you have?
Oxen? Paid laborers? It's not like the American South was unique in needing farm workers.
> Basically all the settled civilizations used some sort of non-free or at best semi-free labour.
The South was notable in clinging to slavery long after it had been abolished elsewhere.
> And given that humans are very good at rationalizing away their conditions, the cultures adapted to being comfortable with it, even considering the societal inequality as something ordained by the gods or karma.
Good, then we agree; it was at least in part cultural.
In other words, animal and human muscle, we agree on that.
I didn't claim that all human labour was non-free, far from that. Every classical civilization had paid artisans and employees as well.
But the paid professions tended to be the skilled ones, and the non-free ones tended to be the arduous, backbreaking ones.
"The South was notable in clinging to slavery long after it had been abolished elsewhere."
Elsewhere where? If I look at the timeline of slavery abolition on Wikipedia, it seems that the South was not even the last holdout in the Americas, much less worldwide.
They were about as delayed as Russia. (Serfdom in Russia was not quite slavery, but brutal and backward nonetheless.)
And the timeline of slavery abolition seems to dovetail with the expansion of the Industrial Revolution across the globe quite tightly, or not?
"it was at least in part cultural."
Chicken, egg. This is a system stretching over millennia with endless feedback loops. Runaway slaves may become the masters (such as the Aztecs) and vice versa, developing their own justifications why it happened.
> In other words, animal and human muscle, we agree on that.
Sure. My objection is to the slavery bit, not the "humans doing work" bit.
> But the paid professions tended to be the skilled ones, and the non-free ones tended to be the arduous, backbreaking ones.
There were plenty of non-slave manual laborers throughout history. Doubly so for chattel slavery of the sort practiced in the South.
> Elsewhere where? If I look at the timeline of slavery abolition on Wikipedia, it seems that the South was not even the last holdout in the Americas, much less worldwide.
What we'd now call the developed world.
That article lists many restrictions and abolitions of the practices hundreds of years prior to the 1860s. The Russians you mention managed it in 1723; Massachusets deems it unconstitional in 1783. By the 1860s still having it as a properous nation was pretty weird.
The developed world of now is much more extensive than the developed world of the 1860s, and the South was very backward until the 1950s or so. In the 1850s, it was seriously lagging behind the North in industrial power, which is one of the reasons why they lost the war. This would point to a yet another chicken-and-egg problem. Nonfree labour tends to cement premodern societal and economic structures, which perpetuate existence of non-free labour, unless disrupted from the outside. The Islamic world didn't give up slavery voluntarily either.
I am not sure if we can call the South of the 1860s "developed", even relatively to the rest of the Western civ. By what criteria?
"The Russians you mention managed it in 1723"
Serfdom in Russia was abolished after the Crimean War, and the Tsar used the money gained by the Alaska Purchase to pay off part of the due compensations to the nobles.
Yes, these institutions were not equal. Different cultural and historical development. Still, a Russian serf of the 1850s was a very non-free person, tied to the land and dependent on whims of his lord or lady. Few would care if a drunk noble whipped him to death, even though theoretically he should not be doing that. A rough equivalent in category.
Serfs were essentially slaves. They could be traded without any real limits and could be punished at will. The families could be split, and serfs were officially prohibited from making lawsuits against their owners.
And it was one of the reasons for Russia's "misadventures" during the 20-th century. The serfdom abolishment came when other countries were already in the midst of the industrial revolution.
Slave labor is most efficient when it comes to non-skilled, hard work. Mining, agriculture, sex (where it still survives even in the Western world), where the output is easily checked and counted.
When it comes to anything sophisticated done by qualified people, like "making advanced tools for the Führer", the options for subtle sabotage are there and pissed-off people will use them.
In general, German occupation authorities had better results when they actually paid the workers and gave them vacation vouchers. But of course the racial theories got in the way, as it was unthinkable to treat, say, Jews as normal employees.
Sure you can stuff smart people into penal colonies, but what is their productivity?
I am not aware of anyone like Kapica or Kolmogorov producing their best results in a penal camp.
OTOH we have a notorious railway tunnel in Prague from the 1950s, designed by imprisoned engineers. Guess what, it is half a foot too narrow to put two tracks into. Someone got the last laugh.
Does it matter what their productivity is as long as it's above 0 of whatever? Leon Theremin invented the "Buran eavesdropping system" while "working" at the sharashka, used to spy on embassies in Moscow via their windows.
Another fun anecdote related to Theremin:
> Theremin invented another listening device called The Thing, hidden in a replica of the Great Seal of the United States carved in wood. In 1945, Soviet school children presented the concealed bug to the U.S. Ambassador as a "gesture of friendship" to the USSR's World War II ally. It hung in the ambassador’s residential office in Moscow and intercepted confidential conversations there during the first seven years of the Cold War, until it was accidentally discovered in 1952.
> The invention of the cotton gin increased the use of slaves; it didn’t decrease it.
Because the efficiency increase in that part of the process meant we could grow so much more cotton to be processed. It wasn't very profitable before that, because slave labor wasn't very efficient at the process.
(This led, eventually, to more automation of the planting/harvesting process.)
> if you exclude the enslaved, the south had a higher GDP per capita than the north.
That doesn't tell the whole story though. If you own 100 slaves, you need to spend nonzero resources maintaining them, or else they will starve and then you have zero slaves. So the owner has less wealth than the equivalent person in the North that has the same income but zero slaves. You can't directly compare GDP per capita excluding enslaved people.
I do agree with your broader point about usage of labor and how being able to have leisure via slavery is economic.
Except that slaves also make new slaves that can be sold.
I really dislike this idea that slavery was just a cultural aberration and not economic. For one thing, that lightens the moral stain of slavery adjacent activity, most notably colonialism and the exploitation of the colonies. This never went away. Economic colonialism exists to this day. We just call it “outsourcing”, “offshoring” and “subcontracting”.
It's worse than that because it takes something that should beg the question what modern things we peddle today because they make $$ are in fact morally wrong into a trite "hurr durr past people bad we smart now" that nobody learns anything from.
Offshoring generally improves the lives of the people who get the offshored jobs. Usually foreign companies pay more and have better working conditions than the local companies.
Consider as just one example the lawsuit over child slavery against Nestle, etc [1]. The Supreme Court ultimately ruled that Nestle can't be held responsible for the child slavery even though they have full knowledge of it happening. Go figure. In fact, that's what they pay for.
The whole shipbreaking industry in Bangladesh is incredibly dangerous for those involved and couldn't possibly be done in any developed nation.
There is certainly a cultural component. A very good book named Albion’s Seed traces the waves of early American immigration. The North was mostly settled by dissidents pre-ECW. The South was mostly divided up into estates and settled by post-ECW lords that mirrored the social structure and power dynamics they liked.
> if you exclude the enslaved, the south had a higher GDP per capita
Yeah because your "capita" is severely undercounted.
If I exclude every who dont live in New York, USA has astonishing GDP per capita ... because I am assigning each person production of many. Same thing.
If you own a lot of slaves your life is better than the freemen who own less/none, much less slaves. However society overall could be muca better even if for you personally it is worse
I am quite hopeful. One benchmark that was passed only very recently was Levelized Full System Cost parity in Texas. That is, the total cost of generating electricity via renewables, importantly, including storage and infrastructure costs became equivalent to other options.
I don't think this gets talked about enough because its truly a milestone.
It's still more expensive in colder places, but the math is changing very fast.
> With a bit of social pressure we should be able to extinct the fossil fuel industry
Taking Europe versus China, California versus Texas, it seems like social pressure is less effective than markets. Let markets build the power source they want to build and lo and behold you get lots of solar and wind and batteries.
Solar is just one technology. Decarbonizing successfully requires still further huge investments in batteries, modular nuclear reactors, CO2 removal, zero-carbon steel production, aviation e-fuels, non-fossil plastics, etc. But yes, hopefully we've unlocked enough economic advantage with just that one technology to get us 90% of the way there just on the basis of economics. (If the current administration doesn't find some way to sabotage it.)
It's just a shame that they didn't end up enjoying the spoils very long. They had very good panels that were researched and produced in Germany but they got completely wiped out by cheap Chinese products
It's a cute ideal, but you can't disentangle government from the energy sector. It's too big.
How do markets build infrastructure as large as an LNG terminal without the government tipping the scales with various guarantees? How do you build a literal coastline of refineries without government clearing the way with permissive regulations? How can you say "let markets figure it out" when the US military is the acquisition department of Halliburton's Iraqi joint venture?
Pretending "markets can figure it out if we just remove government subsidies" is hopelessly naiive. Geopolitics is mostly energy policy.
> you can't disentangle government from the energy sector
Nobody argued as much. My point is the net effect of social pressure on the energy transformation has been costly—financially and politically—for relatively little bang.
Because the opponents of it have the deepest pockets of literally anybody in the world.
A whole class of parasites who have made their lives as highwaymen on the densest energy source (outside of uranium) -- that literally comes out of the ground -- have spent at least the last 20 years actively suppressing alternatives.
In some places (see Alberta, Canada), they have literally outlawed renewable developments.
In this context political advocacy, education, and subsidy remain absolutely imperative.
There is no "free market" way out of the current situation regardless of how economically viable solar is. In the real world markets and power are intrinsically linked.
> Because the opponents of it have the deepest pockets of literally anybody in the world
Yet somehow these opponents have been ham fisted when it comes to opposing the projects which make commercial sense?
> In this context political advocacy, education, and subsidy remain absolutely imperative
Agree. But the bans were counterproductive.
> There is no "free market"
You're the only one in this thread who's brought up free markets.
> It's also actually also an emergency
In a sense. I'd underscore, again, that the breathless activism did approximately nothing–the actual gains came from China pursuing national-security interests and market forces driving the deployment and development of solar, wind and batteries.
> the breathless activism did approximately nothing
The subsidies for solar in places like Germany in the 2000's were crucial for the insane solar cost curve we have today. Those subsidies primarily came from "breathless activism" IMO.
If we let the markets have their way, Earth becomes unhabitable. Coal and oil plants aren't being shut down. In fact, we have more than ever with additional ones on the way.
It's because "free market" is and always has been a misnomer. Free to ignore externalities, yes. But our shared ecosystem is not seen as a market participant, so it can't charge the true cost of burning hydrocarbons.
We'd also still have industry dumping raw waste directly into our waterways. I'm not so sure that this wouldn't have killed more people faster than unregulated coal/oil plants.
Markets are constructed. It's possible to engineer toward the outcome you want by designing the market in a way that brings it about. Unfortunately, this is considered a socialist (which, in the US, is largely synonymous with "demonic") idea unless you want to change a market in ways that benefit entrenched elites.
Making it illegal (or expensive, via outsized taxes) to burn fossil fuels would ultimately just be another change in the rules of the market -- players will optimize within that space and find the best way to deliver energy and other services within those constraints (assuming enforcement is such that they can't just skirt the laws -- enforcement is also part of the market design).
One can frame this as "incorporating externalities" in order to help marketist ideologues swallow it, but the audience for that is almost entirely composed of people with second homes on islands with tax-cheating-based economies. Normal people are fine with the explanation of "this would have horrible and unpredictable consequences for the world your children are inheriting, so we're making it illegal".
Wait, which part is China and which is Europe? Solar didn't win in China because of social pressure, but also not because of market forces. It did win because the CCP made energy independence a political goal.
We are at the tail end of 30+ years of successful social awareness efforts, and government regulation and incentivization.
Social awareness and pressure produced the government action necessary to incubate the early markets and seed research. It helped to spur the armies of young researches set about improving solar generation, wind generation, power storage, electric motors, and even LEDs.
Yeah, it's "obvious" now the economics make sense for producers to build wind and solar farms. Or yeah, purchasing LEDs is a no-brainer now why on earth would anyone want to incandescent bulbs; that's boomer tech.
I operate incandescent bulbs because I consider them healthier than LED bulbs, especially the incandescents with neodymium glass that transmits UV light.
(Unlike my LED bulbs though, I will turn an incandescent off every time I step away from it.)
Your revisionist history isn't on point for US slavery.
Industrialization actually increased slavery in the South. Demand for cheap cotton came from English and then American industrialization. A machine, a product of industrialization, the cotton gin, shackled the chains of slavery ever tighter in the South, as it increased the processing speed of raw cotton. Combine that with acquisition of huge swathes of Mexican territory via unjust conquest, and you had industry demanding cotton and lots of new territory for slavery to potentially move into.
What ended slavery in the USA was the military necessity to free the slaves to save the Union in 1863. Lincoln would've ended slavery earlier or later if it could've saved the Union, he explicitly writes this in a public letter.
The government needed to destroy the rebellion, and slavery was the backwards un-economic stultifying institution enforced by a different culture, a different people: Southern Aristocrats. They used the psychology of emergency and fear to propagandize Southern nationhood and militarism, motivated their anti-democratic notions of "freedom" and "property rights".
This system needed to be torn down militarily and culturally, economically and politically it was probably stuck in place, because it was held in place by corrupt aristocracy.
Does the US have a corrupt aristocracy now holding other things in place that ought to be abolished?
In the US the invention of the cotton gin reinvigorated slavery, which prior to that point had been declining. In the Antebellum south, slavery was profitable, with average return on slaves of about 8 to 10%. Even after slavery was legally abolished, extremely similar social institutions remained for decades (share cropping + institutionalized racism). It wasn't until the 1940s that cotton picking was mechanized.
The North steamrolled the South economically because manufacturing steamrolls agriculture in terms of productivity, but an apples to apples comparison between farmers shows slave owning plantations were economically more productive than free farmers. After abolition, the South's per capita productivity dropped substantially, and remained 20% lower per capita in 1880 than it had been in 1860.
Obviously slaves were individually much worse off than if they were free, and society as a whole suffered from the suppression of human capital. Had all those people been free for all that time, imagine what could have been accomplished besides growing more cotton. But for the slave-owner, there was never a point where abolition became economically advantageous, hence why slavery was ended at gunpoint.
> After abolition, the South's per capita productivity dropped substantially, and remained 20% lower per capita in 1880 than it had been in 1860.
I wonder how much of that was because of economies of scale (Even if it's forced scale). Plantations are large and have many workers, and can scale without having to worry (to a degree) about retaining workers, since workers are for most intents just machines you invest in and pay to keep up in that system, which allows for easier scaling.
We've seen increasing consolidation of farms into large entities over the centuries, so perhaps this was just a system that made that much, much easier to do.
I've read somewhere how the English people industrialized because they had problems that could not be fixed by human or animal power. Mines became too deep, pumping too hard. The ancient greek knew about steam engines, but had no use for them. The English did, in their mines. Necessity as mother of invention. Then machines freed us from hard labour and gave us free time.
This perfectly demonstrates the point: Before James Watt came along, neither had the English. Steam was unreliable, broke down a lot, killed people, and was only tolerated because it was the only game in town. This bothered society, so money became available so smart people could sit down and give it a solid theoretical basis.
The greek had plenty of smart people, but nobody bothered to assign them the unreliable steam problem. There are secondary problems like metallurgy, but smart people can work on them or find away around them, too.
England started experimenting with steam because it _could_. Newcomen's atmospheric engine required metalworking that was flat-out impossible before the advent of modern(ish) iron-making processes.
Greeks would have needed to perfect large-scale iron-making. And in England's case, it was itself driven by the need to manufacture things like cannons, anchors, chains, etc.
If you somehow got transported into Greece with a perfect knowledge of steam engines, you first would need to spend several lifetimes researching the iron metallurgy. You would be able to build a toy steam engine out of bronze, maybe, but good quality bulk bronze was expensive enough to be used as currency.
My impression is that slavery was economically disadvantageous the whole time, but persisted in the South because of the relative power of the slaveholders.
Exactly. As distasteful as it is to put it in these terms, some slaveholders had massive "balance sheets" consisting of thousands of human "assets". Outlawing slavery meant reducing the value of these assets to zero.
Which is identical to all the balance sheets today will oil and gas infrastructure and the billions dumped into ICE R&D they were hoping to amortize over the next 30 years.
Identical might be a bit strong. It's only identical if we signed a law that made oil and gas illegal tomorrow. There are definitely parallels, but this is much more of a normal market situation where most things are handled through incentives, not regulation to such an extreme degree we make the common immediately illegal.
Perhaps most importantly, it not being an immediate change allows the entrenched interests time to shift their strategies and portfolios over time to take advantage of the more economically advantageous option. Many people aren't happy with the time frames that generally requires, but they also seem to be very happy with reliable energy and and economy that doesn't collapse overnight and having invested a year or two ago in a car which would become worthless tomorrow.
What will come with the approaching boom of guilt-free energy is public support for doing more things with more energy, and instead of stagnated per-capita energy use a return to more-than-linear energy usage growth.
With that you get flying cars, space tourism, AI, cities in deserts with free water through desalination, better indoor climates with freer ventilation with the outside, cities skies free of ICE smog and probably a whole lot of things which are hard to imagine.
I hope you are right. My fear is that it could allow unrestricted limits to tear down the rest of nature.
Alternatively, it could mean that we would no longer need to do that as a lot of materials that are restricted by energy costs become viable. If energy is almost free you can extract a lot of trace materials from almost anywhere.
> belief that slavery was really ended by industrialization making abolition economically advantageous
On the contrary, historians broadly agree that industrialization (particularly the advent of the cotton gin) actually turbocharged the human trafficking industry in the US. The cotton gin moved the bottleneck for textile production onto enslaved people, since there was no automation available for planting, cultivating, or harvesting the cotton.
Not only that, but slavery in the south didn't "end" anywhere near as fast as people think it did. Even when plantations stopped using chains and shooting people for leaving the plantation, they just switched to slightly more subtle ways. Sharecropping, barring them from owning property, running lynch mobs to kill anyone who stepped afoul of the unspoken rules, and not allowing black people into most public spaces.
To this day southern conservatives talk about "state's rights" as being the reason for the civil war. Yeaaaaaah no
Re: slavery: I've wondered before if the arrow of causation might go both ways. Slavery has existed throughout history. With slaves, what's the incentive to industrialize? You have "free" and captive human labor. But take that away, and suddenly the idea of machines doing stuff for you seems a lot more compelling.
Slavery also displaces industry in the economy. Slave-driven industries compete with industrial development for investment funds and production driven by slave labor can compete with mechanized production. But if labor is suddenly expensive, mechanized production has an advantage, and if former slaves are now getting paid there are also more customers for the output of that production.
So industrialization may have played some role in abolition, but did abolition also drive industrialization? Slavery was abolished in Britain in the early 19th century and Britain was also the cradle of the industrial revolution, which started to hit very shortly after. America did not explode industrially until after it abolished slavery.
If we'd abolished slavery in Roman times we might have terraformed Mars by now.
Salved are free in neither up front nor ongoing cost, just as industrial equipment is not. It comes down to costs. Industrial equipment that is most costly than slaves seems unlikely to supplant them based on monetary incentives alone, while once it is less costly it's just the social economic momentum which needs to be overcome, which is likely a matter of time.
Importantly, I think there's only so much advancement you can get out of people by investing in economies of scale and iterating on process (and people, as icky as that idea is), while there's a huge amount of advancement to get out of machinery, including moving to whole new categories of machinery (which depending on how far you want to take the "slaved are machines" metaphor is waht a shift away from slaves was in the first place). In that respect maybe what you're noting is just that the shift from slaves to machines was the first in an iterative process which is speeding up over time.
> If we'd abolished slavery in Roman times we might have terraformed Mars by now.
I think maybe the right was to look at it is if we were able to abolish slavery and keep the same output (which might have required an economic or social system that incentivized farm consolidation for economies of scale that plantations were able to more easily achieve), then yes, we would have terraformed mars by now, but probably just because we happened to be along the tech tree earlier in the timeline.
I have consistently held that solar will replace oil once solar becomes cheap. Literally you cannot beat the market. This is not revisionist. It's simply true. The same thing holds America back from barbarism. Our material wealth is what allows our society. That's why it's important to maintain both
> Surely there's a lot of money to be made in harnessing effectively unlimited renewable energy that literally falls from the sky like manna
China has solar panel production on lock. Nobody is going to make money there.
So from a western point of view, there is only a LOT of money to be lost by going solar. Anyone that invested in oil and gas, coal and even to a lesser degree nuclear is NOT going to go quietly.
Hence all the climate change denial and anti-renewable rhetoric from the current US regime
(To be clear I personally have my roof covered in panels and also hope like mad we can get everyone on board)
Even if global greenhouse gas emissions immediately and permanently stop, climate change won’t. We have many years of further warming ahead of us due to the greenhouse gases already dumped into the atmosphere.
Not diamonds, but olivine. And Dubai isn’t the only one who’d have an interest, anywhere with coastal property that likes to maintain it against erosion is a target for this, admittedly experimental, technique.
> I am reminded by the perhaps revisionist history but still applicable belief that slavery was really ended by industrialization making abolition economically advantageous and not actually a socially driven movement. (In reality it was certainly a convoluted mixture of the two I'm sure.)
I also never found the economic argument entirely convincing. If slavery were so economically disadvantageous in an industrialized society, why are there still slave labor in industrialized countries around the world today?
I read a piece that calculated the economic value of the slaves just before the civil war and compared it with investments in fossil fuels.
It made a convincing case that people would rather start catastrophic wars than just transition to a better economic system, if a few rich people had a lot to lose.
Why though? For a business owner I can’t imagine a better situation than his workers working for free and having to do 16 hours a day under pain of death. This probably wouldn’t work with 80% of the populace enslaved but would work very well with 10-15% enslaved.
It's not quite as straightforward as that though. You're also required to pay a large sum up front to get the worker, have to pay for room and board and health for the worker, including children of workers which while they are investments that may eventually pay off, are mostly cost sinks until at least a few years have passed. There's more of a trade-off that might be immediately obvious when you dig into the reality of what it took.
You still need to feed them, clothe them, and house them.
You need to do basic medical care.
And now you have the problem that most of them would happily murder you in your sleep/if your back is turned, or run away never to be found. So the tend to be a pretty big security risk.
Oh, and also they’re slaves so good luck getting them to care about their work - way worse than a typical new hire retail employee even. So you need to do heavier supervision.
Oh, and you had to pay to acquire them - instead of give them an offer and pay them after they’ve worked for you successfully. So add that to the ‘risk’ pile.
It was a socially-driven movement, but economics made it feasible for social concerns to win. The lesson is that you need both, and this is especially true when time is short.
There’s an effort to whitewash the horrors of chattel slavery that is really disgusting.
Estimated on the economics of slavery (that I’ve read anyway) seemingly ignore that slaves can make new slaves.
This is the dark side of slavery that seems to be rarely discussed. That is, the mass rape of slaves over centuries by their owners.
There was even an economic incentive for this because lighter skinned slaves were more desirable for domestic labor. By the 19th century this had gotten so absurd that some slaves were almost indistinguishable from white people due to generations of repeated rape, basically.
There was a book whose name escapes me that analyzed the records of one of the largest slave markets and it found that the price of girl slaves went way once they started menstruating. This was advertised. Why do you think that was?
We would line in a very different country if, after the civil war, every slave owner was strung up from a tree and their estates were redistributed to the formerly enclaved.
> We would line in a very different country if, after the civil war, every slave owner was strung up from a tree and their estates were redistributed to the formerly enclaved.
Yeah, but not for the reasons you think. A country that would just kill a significant share of its citizens for something that used to be legal very recently is not going to end up just fine. Moreover, due to normal distribution of human traits the next generation would have the same percentage of 'evil' with or without your well-intentioned genocide.. go figure.
0%? Extremely unlikely. [0] Is your plan as an evil overlord to implement the stack ranking killing the evilest 10% generation after generation for the good of humanity?:)
Also hope you’re going global since other populations will quickly outcompete the docile sub-population if given chance.
Which is funny because we've had an environmentally and economically optimal source of power since the 50s (nuclear) which we deliberately phased out due to panic cycles.
> I am reminded by the perhaps revisionist history but still applicable belief that slavery was really ended by industrialization making abolition economically advantageous and not actually a socially driven movement.
I really don't understand why you're bringing slavery in a discussion about hydro. Why not bring Gaza? And Iran? This is a tech site after all: so, sure, bringing slavery in a talk about solar energy makes sense.
Note that the abolition of slavery is unrelated to industrialization: the islamic republic of Mauritania was the last country to officially abolish slavery and they did it in the 1980s. And it's very well known that slavery still persisted long after that and there are still people owning slaves today (not too sure why the other comment mentioning it was downvoted).
At this point I think people are just insane: they'll use any excuse, on any unrelated subject, to bring it the issues of slavery, patriarchy, Gaza (but not Iran), etc. But as soon as you point out actual patriarchal societies operating today or actual slavery still happening today or people having actual sex slaves in western countries (e.g. several members of the UK parliament are now running an enquiry into a gigantic gang-rapes operation with thousands of victims and an attempted cover-up by the authorities and the findings are beyond belief).
"Won't hear, won't see, won't speak -- shall only mention slavery, the patriarchy, Gaza and shall downvote".
> I hope we are in a similar era with regards to climate change.
I'm struggling to understand the level of completely irrational rejection of reality in all these comments.
Emissions continue rise every year, we are already locked into extreme climate change, multiple nations are engaged in military conflicts to capture oil, we globally use more fossil fuels every year.
Companies are starting to convert jet engines into natural gas powered generator for AI data centers [0]
So far we've continually used 'green' energy to supplement the use of non-renewable fossil fuels. We have far more EVs on the road than we did a few years ago and are using more oil than before in the US (and producing more than we ever have).
We are already out of the standard IPC scenarios and potentially on track for a 'hot house earth' future [1].
It is quite clear that we are ramping up for global war over natural resources (largely fossil fuels) and we will burn the planet to the ground chasing the last drop of oil.
Animated SVGs are one of the example in the press release. Which is fine, I just think the weird SVG benchmark is now dead. Gemini has beat the benchmark and now differences are just coming down to taste.
I don't know if it got these abilities through generalization or if google gave it a dedicated animated SVG RL suite that got it to improve so much between models.
Regardless we need a new vibe check benchmark ala bicycle pelican.
What benchmark, though? There is very clearly a lot of room for improvement in its SVG making capabilities. The fact that it can now, finally, make a pelican on a bike that isn’t completely wrong is not an indicator that SVG generation is now a solved problem.
I'm guessing it has the opposite problem of typical benchmarks since there is no ground truth pelican bike svg to over fit on. Instead the model just has a corpus of shitty pelicans on bikes made by other LLMs that it is mimicking.
Most people seem to have this reflexive belief that "AI training" is "copy+paste data from the internet onto a massive bank of hard drives"
So if there is a single good "pelican on a bike" image on the internet or even just created by the lab and thrown on The Model Hard Drive, the model will make a perfect pelican bike svg.
The reality of course, is that the high water mark has risen as the models improve, and that has naturally lifted the boat of "SVG Generation" along with it.
Healthy grandparents that are around to support their children and take care of grandchildren increase the fitness of the entire lineage by helping their children have more children and those grandchildren to be healthier/safer.
If you are interacting with a carrier of your genes at all while they still might reproduce, you are having an impact on their fitness and thus evolutionary pressure exists.
Stoicism has always struck me as cognitive behavioural therapy (specifically the cognitive triangle) but for boys who think therapy is for women and is rife for misuse from people who don't understand it.
I understand stoicism is deeply entwined with modern CBT and the roots can be traced back basically, but why misuse the ancient form when we have decades of evolution and study on CBT?
I am not a physician, but I expect that decades hence we will see the health effects of repeated Covid infections. I'm guessing specifically around cardio health and dementia risk.
Seems like the problem should be pretty easy to figure out. Just need to wait ~5 gigayears and see which model is right. I'm personally hoping for deceleration so that we have more total visitable volume.
I'll set a reminder to check back at that time to see who was right.
With 5 gigayears to work with I'm going to move a few star systems over, break down all the matter orbiting the star into a Dyson sphere made of computronium, and simulate visiting any world I could possibly ever want to.
reply