Recent comments in /f/MachineLearning

MysteryInc152 t1_j4l8fwz wrote

Reply to comment by [deleted] in [D] Can ChatGPT flag it's own writings? by MrSpotgold

Yeah well, that's not really how these models work. There's no pulling from a database and there's no external searching. The model was trained and frozen.

While it is possible to have the model access some external database in the future, yeah...that's not going to happen in relation to previous chat entries you have no right or access to. That's a privacy can of worms no corporation with any sense will get into as well as being prohibitively expensive for no real gain at all.

2

FreddieM007 t1_j4l58y4 wrote

Reply to [P] I built arxiv-summary.com, a list of GPT-3 generated paper summaries by niclas_wue

Great idea! There is a lot of potential! The biggest challenge for me is not just reading the most important papers but finding them. You already did the heavy lifting by downloading papers and computing the gpt3 embedding. With that you can build an index and add searching. You could cluster papers into categories to let the user browse. You could umap the papers etc. In the long term I would want it to be comprehensive and include all papers. In terms of costs, perhaps you can partner with arxiv directly. They should be interested to use your project...

4

TiredMoose69 t1_j4l525j wrote

Reply to comment by ephemeral_happiness_ in [D] Simple Questions Thread by AutoModerator

no :( But i did train a GPT-2 355M model on chatbot like data. The output of it was fun but not that great hahaha

I am now looking into something like this:

https://github.com/daveshap/LongtermChatExternalSources

I think i will use the API from openai to load messages like this so that it can "remember" them every time i prompt to it. If you're interested in working on something similar PM me we can share ideas.

1

TrueBirch t1_j4kv71p wrote

Reply to comment by eldenrim in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan

I think "AGI" is a silly concept overall and never really happening. Computers are good at doing things in different ways from humans. Rather than chasing AGI, you can make a lot more of an impact by leveraging a computer's strengths and avoiding its weaknesses.

For my example, I picked an occupation with an average salary south of $30,000/year (source). I'm not saying everybody can do it, but the market puts a price on this kind of labor that suggests many people can do it. A true AGI system could replicate how a low-salary human does a job. In reality, a computerized system would use a few wireless sensors that call home instead of physically driving around looking at fields.

Similarly, consider meter readers, another low-wage job. Imagine what it would take to create a robot that could drive from house to house, get out of the car, find the power meter, gently move anything blocking it, and take a reading. Instead, utilities use smart meters that call home. It's cheaper, more reliable, and simpler.

It's beyond hard to create a true AGI system, and there are plenty of ways to make tons of money with application-specific systems.

1