Recent comments in /f/MachineLearning
Mikatron3000 t1_j3l71ns wrote
Reply to [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
Not sure if this is already there but it might be worth adding some license information here since sending closed source code over an open sourced API / model might become a no no in the future legally. I guess that would be the problem of making this an Intellij / vscode plugin
Mental-Swordfish7129 t1_j3l6yqj wrote
Reply to [N] What's next for AI? by vsmolyakov
I think the field may eventually move in the direction of online unsupervised generative models implementing something akin to the free energy principle and active inference. These are the kinds of models I am developing and they seem to circumvent many of the issues with modern SOTA ML. I figure it will be a while before this happens because it seems that there isn't a lot of interest yet from the typical sources.
Melodic-Bluejay1999 t1_j3l6vu5 wrote
wikipedia seems to be the best resource
Datafuse_Analytics t1_j3l6uck wrote
Reply to [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
This is awesome..
fredlafrite OP t1_j3l6b40 wrote
Reply to comment by madmax_br5 in [D] Have you ever used Knowledge Distillation in practice? by fredlafrite
Nice! There are 20MB versions of BERT, super interesting thank you!
fredlafrite OP t1_j3l65ju wrote
Reply to comment by nmfisher in [D] Have you ever used Knowledge Distillation in practice? by fredlafrite
Interesting! Echoing this, do you know which kind of companies one could work on this in an applied setting?
LahmacunBear OP t1_j3l5ub2 wrote
Reply to comment by resented_ape in [R] Learning Learning-Rates: SteDy Optimizer by LahmacunBear
Oh damn, that paper almost does exactly what I do. Huh. Oh well. Slightly different implementation though. I in contrast, use both grads from the same timestep and have an accumulated Ct.
nmfisher t1_j3l4ipq wrote
Reply to comment by suflaj in [D] Have you ever used Knowledge Distillation in practice? by fredlafrite
Echoing this, KD is also very useful for taking a heavyweight GPU model and training a student model that's light enough to run on mobile. Small sacrifice in quality for huge performance gains.
learningmoreandmore OP t1_j3l4cu0 wrote
Reply to comment by LetterRip in [D] I want to use GPT-J-6B for my story-writing project but I have a few questions about it. by learningmoreandmore
Thanks! Would this be able to scale and handle more computations or is this only for personal use? I wonder why most people wouldn't be using this version if it's so efficient computation-wise
[deleted] t1_j3l47br wrote
Reply to comment by jsonathan in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
[deleted]
LetterRip t1_j3l42en wrote
Reply to comment by learningmoreandmore in [D] I want to use GPT-J-6B for my story-writing project but I have a few questions about it. by learningmoreandmore
You can use the GPT-J-6B 8bit, and can do finetuning on a single GPU with 11 GB of VRAM.
https://huggingface.co/hivemind/gpt-j-6B-8bit
You could probably do a fine tune and test fairly cheaply using google colaboratory or colaboratory pro (9.99$/month).
jsonathan OP t1_j3l41za wrote
Reply to comment by Eastern_Incident4922 in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
Yep! Try it out here: https://useadrenaline.com/
jsonathan OP t1_j3l3xm5 wrote
Reply to comment by [deleted] in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
I haven’t used this yet, but my understanding is it can explain code and generate unit tests. It can’t explain and fix errors.
What_The_Hex OP t1_j3l3fe5 wrote
Reply to comment by Bart-o-Man in Is there an AI tool that can specifically isolate sentences or chunks of text, from larger bodies of text, that meet a certain narrow criteria -- then output those as the result? - [D] by What_The_Hex
Dude it is just such a valuable tool. Sky's the fucking limit, truly. Computer programming + AI = like The PROMISED Land of just, massive, massive leverage and automation. Like, click one button, run one program, and you can move fucking mountains with what those two working in tandem are capable of.
[deleted] t1_j3l3f45 wrote
Reply to comment by jsonathan in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
[deleted]
[deleted] t1_j3l3a9f wrote
Reply to [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
[deleted]
ml-research t1_j3l36cj wrote
Reply to [P] searchthearxiv.com: Semantic search across more than 250,000 ML papers on arXiv by universal_explainer
Does it omit some papers if it fails to parse them? Because I cannot find some arXiv papers.
GoofAckYoorsElf t1_j3l2sls wrote
Reply to comment by --algo in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
A cloud hosted GitLab with customer managed keys. We have a very detailed IP and security agreement with our cloud provider.
Eastern_Incident4922 t1_j3l2own wrote
Reply to [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
Can i try this
2Punx2Furious t1_j3l29nx wrote
Reply to comment by satireplusplus in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
And it's not even AGI yet. The singularity is closer than a lot of people think.
2Punx2Furious t1_j3l26ui wrote
Reply to comment by jsonathan in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
Even fine-tuning the prompt could get much better results. Prompt engineering is important.
_Arsenie_Boca_ t1_j3l1x1y wrote
Reply to comment by learningmoreandmore in [D] I want to use GPT-J-6B for my story-writing project but I have a few questions about it. by learningmoreandmore
Pretty much, yes. I believe other APIs might use slightly worse models than OpenAI but definitely better than GPT-J.
danielswrath t1_j3l1fkb wrote
Reply to comment by kelkulus in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan
GPT-3 has the same problem though. ChatGPT is a successor of GPT-3, so it's not the same but it's not extremely different either.
ml-research t1_j3l1fg3 wrote
Probably look for something Jürgen Schmidhuber wrote or presented.
mr_birrd t1_j3l7rjf wrote
Reply to comment by learningmoreandmore in [D] I want to use GPT-J-6B for my story-writing project but I have a few questions about it. by learningmoreandmore
Cause it is worse metric wise.