Recent comments in /f/singularity

MustacheEmperor t1_jcc5crl wrote

Reply to comment by Lawjarp2 in GPT4 makes functional Flappy Bird AND an AI that learns how to play it. by gantork

Our CTO and I tried getting it to write some relatively challenging Swift as a benchmark example and it just repeatedly botched it. It would produce something close to working code, but kept insisting on using libraries that didn't have support for what it was trying to do with them, which was also an issue with 3.5.

3

MustacheEmperor t1_jcc5851 wrote

Reply to comment by Nanaki_TV in GPT4 makes functional Flappy Bird AND an AI that learns how to play it. by gantork

>Preliminary assessments of GPT-4’s abilities, conducted with no task-specific finetuning, found it ineffective at autonomously replicating, acquiring resources, and avoiding being shut down “in the wild.”

>ARC found that the versions of GPT-4 it evaluated were ineffective at the autonomous replication task based on preliminary experiments they conducted. These experiments were conducted on a model without any additional task-specific fine-tuning, and fine-tuning for task-specific behavior could lead to a difference in performance. As a next step, ARC will need to conduct experiments that (a) involve the final version of the deployed model (b) involve ARC doing its own fine-tuning, before a reliable judgement of the risky emergent capabilities of GPT-4-launch can be made

So, don't start collecting canned food yet.

3

Unfocusedbrain t1_jcbz5p3 wrote

Reply to On the future growth and the Redditification of our subreddit. by Desi___Gigachad

I must say that it might be challenging, if not impossible, to prevent the Redditification of this subreddit. I have been on Reddit for a decade and was part of r/Futurology when it first started. The moment r/Futurology became a default subreddit, it was flooded with individuals who lacked self-awareness, were overconfident, and often confidently incorrect.

Futurology is about looking towards the future with wonder and excitement, but many an average person does not share this perspective. Most people are preoccupied with their own lives, focused on immediate survival, and most times lack broader aspirations or views. When people joined r/Futurology post-default, they often didn't come to discuss but instead to force their perspectives and opinions onto the community, frequently acting in bad faith.

Singularity, futurology, optimism, and forward-thinking are not mutually exclusive; in fact, they are synergistic. Accelerating returns suggest we are moving toward progress, but the human element does not always keep pace. Society, sociology, ethics, philosophy, reason, politics, and many other 'human' domains tend to progress linearly, much like the human mind.

There is often a lag time for culture and other factors to catch up with exponential growth in any area. A population increase leads to a lag time in food production to sustain that population. Similarly, an exponential increase in technology can result in a lag time in cultural adaptation.

No matter what, the average person may struggle to grasp singularitarian concepts. If the floodgates open on this subreddit, those who do not understand these ideas will bring their biases and fears, potentially causing permanent disruption to the community.

While I'm optimistic about the future and technological progress, I have always been cautious about people's reactions to it. I don't know what the solution is or how to be proactive in preventing this subreddit from ending up like r/Futurology—but it is essential to be aware of these challenges and strive to foster a supportive and forward-thinking environment, even in the face of insurmountable odds.

52

qrayons t1_jcbi3sk wrote

Reply to GPT4 makes functional Flappy Bird AND an AI that learns how to play it. by gantork

I mean, Karpathy was kind of right. This is from his original post.

> I’ve seen some arguments that all we need is lots more data from images, video, maybe text and run some clever learning algorithm: maybe a better objective function, run SGD, maybe anneal the step size, use adagrad, or slap an L1 here and there and everything will just pop out. If we only had a few more tricks up our sleeves! But to me, examples like this illustrate that we are missing many crucial pieces of the puzzle and that a central problem will be as much about obtaining the right training data in the right form to support these inferences as it will be about making them.

One of the crucial pieces we were missing was attention. So much of the advancement we are seeing now is because of transformers.

13