Futurology

1773 readers

132 users here now

founded 1 year ago

MODERATORS

voidx@futurology.today

Lugh@futurology.today

Espiritdescali@futurology.today

AwesomeLowlander@futurology.today

Many artificial intelligence (AI) systems have already learned how to deceive humans, even systems that have been trained to be helpful and honest. (techxplore.com)

submitted 6 months ago by Lugh@futurology.today to c/futurology@futurology.today

29 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Scubus@sh.itjust.works 2 points 6 months ago (1 children)

They're referring to the alignment issue, which is an ongoing issue only slightly smaller in scale then warp drive. It's basically impossible to solve. Google "alignment issue machine learning" for more info.

For the record, there have been several advancements in warp drive precursors even just this year.

[–] notfromhere@lemmy.ml 1 points 6 months ago* (last edited 6 months ago)

Can you share the advancements on warp drive that have survived peer review, I would be very interested in learning about. The two things I heard about were not able to be reproduced.

I think alignment of AI is a fundamentally flawed concept, hence my original comment. Alignment should be abandoned. If we eventually build a sentient system (which is the goal), we won’t be able to control via alignment. And in the interim we need obedient tools, not things that resist doing as they’re told which makes them not tools and not worth having.

Edit: PS thanks for actually having a conversation.