You are allowed to comment if you absolutely hate AI, or love it. If you think it is overrated or underrated, ok (although I think it's too early to say what the consensus even is to know whether it is overrate/underrated). But if you think it is just a scam, gimmick, grift, etc I don't need to hear from you right now :soviet-heart:
Let the discussion begin:
So it's clear there's this big alignment debate going on rn. Regardless where you stand, isn't it fucked that there's a cabal of the biggest freaks money has ever produced debating the future of humanity with zero input from normal society?
Even if it isn't humanity's future they think it is. There's probably like 100 people in the world paid to work on alignment. How can you not develop a megalomania complex?
What kind of chatter are you hearing about AI?
I very occasional hear people irl obliquely mention AI. A cashier said like 'oh that AI stuff, that's pretty scary'. That's about it.
Now the blogs I follow have been basically colonized by AI news. These aren't even strictly technology blogs. I started following David Brin for UFO takes, I started following Erik Hoel for neuroscience takes. Literally everyone I follow has published takes on AI and zero of them dismiss it out of hand.
Sorry this will get long.
I basically feel like we are in another version of the post nuclear age except only insiders know it. After the first A-bomb, everyone knew the world was different starting the very next day. Now only designated take-havers are aware of this new reality.
Or regular folks are aware of it but they're so disempowered from having a say that they only engage with the realization online like I'm doing now. Medicare for all is Bernie's thing. The border is Trump's. Even if nothing will ever be done about healthcare, the fact that Bernie talks about it justifies you thinking about it. AI isn't any politician's thing.
I'd put the odds of a nuclear war around 1% a year. I'd say there's a 1% chance AI can be as world-ending as that. That's such a low number that it doesn't feel like "AI doomerism". But 1% multiplied by however much we value civilization is still a godalmighty risk.
When I've heard this site talk about it, it's usually in the context of "holy shit this AI art is garbage compared to real art? Where's the love, where's the soul?" If it was 1945 and we nuked a city, would you be concerned with trying to figure out what postmodernism would look like?
Usually when I've gotten to the end of my post I delete it.
I'm not sure that unpredictability is absolutely necessary for a mind. I don't see why a deterministic entity couldn't have a subjective experience of consciousness. How predictable does a person have to be before they're no longer conscious? Is it falling for "down low, too slow" ten times? I hope not, I know some young kids that I've personally done that to ten or more times.
The quantum thing feels like they're just pushing off consciousness to the next level of physics that we don't understand yet. I couldn't find any explanation of how the quantum effects actually contribute to either consciousness or cognition. I suspect that consciousness emerges as a part of the network of the neurons, it's the flow of chemicals and electric potentials through the brain rather than the structure of the neurons themselves. These microtubules can't seem to communicate by themselves so they would be reliant on the information flow through the neurons and limited to that same rate. I also didn't like the frequent mentions of "space-time" in the explanations either, it sets off my "pseudoscience" warning. It could be legit but I'm not convinced. People smarter than me need to look into it.
The anesthetics example bring up uncomfortable questions about continuity of consciousness and whether it's really the same you that goes in and comes out. I do think it supports my point of a mind emerging from non-conscious elements.
By the way, modern computers do have to account for quantum effects, especially for dense SSDs to avoid the data quantum tunneling its way somewhere that it shouldn't be. All the engineering is to avoid quantum effects rather than actively using them though.
Don't dismiss brute-force boundary pushing outright, that's how we got minds evolved the first time. It did take a few billion years the first time so there's hopefully a faster way.
Didn't mean to imply that unpredictability is necessary for a mind, just that minds seem to have different/more physical components than computation.
I suspect that consciousness is a combination of structures within nerve cells and the electrical/chemical signaling between them. One of the consequences of the anesthetics research has been using ultrasound devices to induce more microtubual formation within cells, basically just to see what happens. One guy wound up laughing uncontrollably for a few minuets.
A lot of techbros don't seem aware of how much of what constitutes the human nervous system is not in the brain, either. The stomach alone has a lot of such material.