Recent comments in /f/singularity

beezlebub33 t1_j5yqbuv wrote

>gary marcus' objections have nothing to do with world models,

I think they do. See: https://garymarcus.substack.com/p/how-come-gpt-can-seem-so-brilliant . GPT and other LLMs don't are not grounded in the real world, so cannot form an accurate model of them; only getting secondary (from human text). This causes them to make mistakes about relationships; they don't 'master abstract relationships'. I know he doesn't use the term there, but that's what he's getting at.

Also, at https://garymarcus.substack.com/p/how-new-are-yann-lecuns-new-ideas he says:

>A large part of LeCun’s new manifesto is a well-motivated call for incorporating a “configurable predictive world model” into deep learning. I’ve been calling for that for a little while....

The essay isn't primarily about his thoughts on world models, but marcus, for better or worse, thinks that they are important.

3

SpinRed t1_j5yq5d0 wrote

Just know that there will always be those who continue to downplay the progress of these models, in an effort to parade their "expertise."

I'm guessing these self-proclaimed experts will continue to tell us to, "check our astonishment at the door, because how these models really work is, blah, blah, blah." And they'll continue to spout that narrative, all the way to the point where they're unwittingly describing how the human brain works.

There's something about the act of description that robs experience of its "magic." (No, I'm not suggesting actual magic is happening here).

I do believe these ai models are soon to be, if not already, greater than the sum of their algorithms.

So yes, be astonished!...but also take the time to understand how things work in a deeper way, so that you don't buy into the irrational, religious doomsday narratives that will invariably be part of these technologies.

2

Puzzleheaded_Pop_743 t1_j5ymk19 wrote

This is a fear of mine. If all the smart jobs get replaced and all that is left is repetitive factory jobs then we end up in a dystopic non-automated future that is like idiocracy where no one is incentivized to educate themselves. But I have hope this will not happen and if we ever reached that point then it would only lost for a short period of time until the automation/robotics technology catches up. (Like 1 decade).

0

dasnihil t1_j5yd0ai wrote

that's fine and it's a great tool like most tools humans have invented, id even say NN and gradient descent is the greatest idea so far. so what, we must keep going while society makes use of inventions along the way.

1

dasnihil t1_j5ybc3o wrote

if gpt is more important for you that's okay. everyone has a mission and it doesn't have to be the same. there are physicists still going at it without caring much about gpt or agi. who cares man, we have a limited life and we'll all be dead sooner or later. relax.

1

pyriphlegeton t1_j5y1q32 wrote

Yeah but that's just not the case. You aren't the world's best surgeon if you can accurately tell me what most sources on the internet say about procedure x on average. That might help speed up education a bit in the best case...and maybe not even that. Google finds you that Information basically as quickly as putting it into something like ChatGPT.

Regardless, that's not even what this AI is about. It's about accurate translation, which again is something completely different.

2

pyriphlegeton t1_j5y13rn wrote

It seems to me that one of the biggest challenges is taking real-world data, representing as a model and only then working with it. Such as automated driving, for example. Being perfect at that would give me far more confidence that AI could be disruptive in more areas very soon.

Also AI being capable of reliably fixing and improving other AI at an increasing speed.

1

SeaSaltStrangla t1_j5y0m7a wrote

Very interesting. Unrelated tangent: I read at length today a book that basically argues that 1989-2015 is the best the world will ever be, and society will only get worse from this point onward. Really fascinating coming on this sub and seeing the polarity of how people so optimistically view the future.

3

genshiryoku t1_j5y03ci wrote

Problem is that AI benefits from economy of scale and there's an exponential increase in performance with bigger models.

What this means is that it's a "winner-takes-all" situation and you can't compete as a smaller entity without huge capital injection to generate the compute necessary to train large models.

The only alternative I can think of is a distributed computer like Seti@home where people volunteer their GPUs to collectively train large open source AI models.

As cryptocurrency mining has shown us, most people won't do that on volunteer basis so there'd need to be some sort of financial incentive but I wouldn't want to mix a neutral AI open source model with perverse financial incentives like crypto.

So essentially that is not going to happen and even StabilityAI is eventually going to have to incorporate like OpenAI to continue on their path, sadly enough.

8