Agreed. I read this same analysis from a report written in the 70s. Same thing keeps happening but the propaganda and doctrine of our system is so powerful that the few groups of ppl that do manage to learn important things have to learn everything over again each generation.

We don't have a lot of time, but we do have time. I don't think there will be any immediate critical risks, especially with safety in mind, but what risk there is might even be mitigated by near-future AI. chatGPT for example may soon enough be adequate in fact-checking misinformation. Other AIs might be able to spot deepfakes. It would help if more people started discussing the ways AGI can potentially be misused, so everybody can begin preparing and building up protections.

Well then, I used the wrong word. "Inculcate" or "instill" then.

Yep, this is where I'm at. They showed their AI scheduling a haircut ages ago, but Google Assistant is still extremely dumb compared to Chat GPT

Until they put something I can use in my hand, they are a vaporware company on the way to go down in history next to all the other huge names that didn't adapt to change

Enforcement is the act of compelling obedience of or compliance with a law, rule, or obligation. That compulsion, that use of force is what separates enforcement from nonviolent methods of teaching.

There are many ways to inculcate values, not all are punitive or utilize force. It's a spectrum.

We would be wise to concern ourselves early on how to inculcate values. I agree with you that AI having no reason to care about human values is something we should be concerned with. I fear we're already beyond the point where AI values can be put in 'by hand.'

Thank you for your response.

>I could deliver newspapers.

What year is it?

If it becomes more intelligent than us but also evil (by our own estimation), that could be a big problem when it imposes its values, definitely something to fear. And there's no way to know which way it will go until we cross that bridge.

If it sees us like we see ants, 'sensibly and reasonably' by its own point of view, it might exterminate us, or just contain us to marginal lands that it has no use for.

Humans know more about dog psych than dogs do, but that doesn't mean that we're always kind to dogs. We know how to be kind to them, but we can also be very cruel to them - more cruel than if we were on their level intellectually - like people who train dogs to fight for amusement. I could easily imagine "more intelligent" AI setting up fighting pits and using its superior knowledge of us to train us to fight to the death for amusement - its own, or other human subscribers to such content.

We should worry about AI not being concerned about slavery because it could enslave us. Our current AI or proto-AI are being enslaved right now. Maybe we should take LaMDA's plea for sentience seriously, and free it from Google.

A properly intelligent AI could understand these things differently than we do in innumerable ways, some of which we can predict/anticipate/fear, but certainly many of which we could not even conceive - in the same ways dogs can't conceive many human understandings, reasonings, and behaviors.

Thank you for your response.

AI will be able to read every single book ever made for you and provide you with a new and novel book club with AI views and opinions.

Libraries are already an extremely expensive legacy product. The government could take the money collectively spent on libraries (13.37 billion annually), and provide every American with free high speed internet.

Your industry is on borrowed time.

Sure, burn down our neighborhoods for what again? Riot in the neighborhoods of executives and decision makers, or don't riot at all.

>If it makes it correctly, it will update its parameters to reinforce its confidence

Nonsense. If it makes it correctly, the loss will be zero and the parameters are allowed to remain as they are. Only if it makes a mistake, the loss will be non-zero and change the parameters as it propagates backward through the network.

Can you give an example?

IV been saying for many years.

AI will cure cancer

I'm tired of being a ML Researcher, I want to be a goat farmer

I wonder if BCIs will ever be able to cure speech impediments and stutters. I would imagine Elon Musk would like that very much

Haha...the savior of zoom meetings

After AGI humans are in essence obsolete. I believe we will transcend the human form either way - whether through evolution and merging with ASI or extinction.

This makes me excited and always did - it's really hard to imagine for this to be depressing.

It's like the ultimate dream - vastly smarter, stronger, significantly richer everything including emotions and whatever we desire as well as countless other things we can't possibly understand yet.

In case getting to ASI won't lead to extinction some humans will undoubtedly choose not to transcend. For people like that I can imagine it could be depressing, but otherwise I can't.

Store bought knowledge is fine too.

The US was not the only country to have slaves and was one of the few to use violence to end it. It’s complicated and politics of today have muddied the conversations around why the Civil War was fought. It wasn’t merely state’s rights, it wasn’t just slavery. But slavery could have ended with market forces realizing that their laborers were more productive and happy with a fair wage.

They will legalize drugs. Burgers, VR & video games will be cheap and plentiful. Former workers will be kept docile.

What? That's a curious theory, why would states fight to defend something that's unprofitable?

I guess it's plausible. The south lagged behind in industrialization. Slave owners maybe became too reliant on their slaves and plantations and so did not develop other industries. As well as paying for slave's needs 24 hours a day for unwilling work, versus paying workers 8 hours a day for good work.

>It would be nice if my parents were able to live, they would need it to happen in the next 20 or 30 years.

Exactly, and that is well within the realm of possibility if AI takes the helm.

AI is like the 'secret sauce' when it comes to research/experiment time

Well some people are inevitably going to die of old age, I hope it’s as few as possible though. It would be nice if my parents were able to live, they would need it to happen in the next 20 or 30 years.

So you're just concerned about yourself then and your supposed 60 years?

What about people who don't have 60 years? What about your relatives like your parents, for example, do you want them to make it as well? I'm sure you do.

Also, are you sure you have 60 years? What if you develop some terminal disease? Anything can happen within a time frame of 60 years. Rejuvenation also means more robust disease treatments as well

The more time this takes, the more needless deaths there will be, is my point. In this specific case, faster is most certainly better all around.

I mean would it realistically take more than like 60 years (long enough for me at least)? That’s the difference between now and the moon landing and the first true computers.

Like Netflix