Recent comments in /f/MachineLearning
znihilist t1_j704b3j wrote
Reply to comment by maxToTheJ in [R] Extracting Training Data from Diffusion Models by pm_me_your_pay_slips
>> That's beside the point,
> It does for the comment thread which was about copyright
It doesn't, as this is issue has not been decided by courts or laws yet, and opinion seems to be evenly divided. So this is circular logic.
>> my point is that the MP3 compression comparison doesn't work,
> It does for the part that is actually the point (copyright law).
You mentioned MP3 (compressed versions) as comparable in functionality, and my argument is about how they are not similar in functionality, so the conclusion doesn't follow as they are not comparable in that analysis. Compression not absolving copyright infringement doesn't lead to the same thing being concluded for diffusion models. As you asserted that, you need to show show compression and diffusion follow the same functionality for that comparison to work. That's like if I say that it isn't illegal that I can look at a painting and then go home and have vivid images of that painting therefore diffusion models are not doing any infringement, that would be fallacious and wrong, functionality doesn't follow, the same for MP3 example.
dack42 t1_j702e2p wrote
Reply to comment by paypaytr in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
It's almost like people are avoiding using it because of the huge amount of bugs and missing features...
dack42 t1_j7027nz wrote
Reply to comment by Imonfire1 in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
https://github.com/IsmaelMartinez/teams-for-linux
This 3rd party implementation is better than any version Microsoft has ever released.
CowardlyVelociraptor t1_j7025ho wrote
Reply to comment by 2blazen in [N] OpenAI starts selling subscriptions to its ChatGPT bot by bikeskata
You're paying a premium for the nice UI
puppet_pals t1_j701uqt wrote
Reply to comment by netw0rkf10w in [D] ImageNet normalization vs [-1, 1] normalization by netw0rkf10w
>I think normalization will be here to stay (maybe not the ImageNet one though), as it usually speeds up training.
the reality is you are tied to the normalization scheme of whatever you are transfer learning from. (assuming you are transfer learning). Framework authors and people publishing weights should make normalization as easy as possible; typically via a 1/255.0 rescaling operation (or x/127.5 - 1, I'm indifferent though I opt for 1/255 personally)
scraper01 t1_j6zyvzc wrote
Reply to [D] I'm at a crossroads: Bayesian methods VS Reinforcement Learning, which to choose? by fuscarili
Bayesian. Not even close.
scraper01 t1_j6zyjd7 wrote
Reply to [D] Why do LLMs like InstructGPT and LLM use RL to instead of supervised learning to learn from the user-ranked examples? by alpha-meta
The RL loss landscape is richer.
maxToTheJ t1_j6zy5z8 wrote
Reply to comment by znihilist in [R] Extracting Training Data from Diffusion Models by pm_me_your_pay_slips
>That's beside the point,
It does for the comment thread which was about copyright
> my point is that the MP3 compression comparison doesn't work,
It does for the part that is actually the point (copyright law).
TrevorIRL t1_j6zvy53 wrote
Reply to comment by 2blazen in [N] OpenAI starts selling subscriptions to its ChatGPT bot by bikeskata
Sure, but until recently, OpenAI has been a not for profit researching platform.
That means, the R and D would have been written off as a cost of production for this product.
As far as publicly known info, $3 million a year is our best guess at what it costs to run.
Considering the excitement at future utility, I don’t imagine capital will be the constraint for future development.
ojdajuiceman25 t1_j6zvjpr wrote
Reply to [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
My job got a demo a couple months back and some of the capabilities are incredible. The live translation might really be a game changer
Assistance_Useful t1_j6zvd0p wrote
Reply to comment by bumbo-pa in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
Create an electron app and use
the320x200 t1_j6zv69g wrote
Reply to comment by JQuilty in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
We're blocked due to key stakeholders needing to get alignment on deliverables. Let's schedule a deep-dive.
nraw t1_j6zusm5 wrote
Reply to comment by Necessary_Ad_9800 in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
But that's part of the Microsoft branding.
Professional_Poet489 t1_j6zsleg wrote
Reply to comment by fuscarili in [D] I'm at a crossroads: Bayesian methods VS Reinforcement Learning, which to choose? by fuscarili
There are smarter people than me out there, so maybe I’m missing something, but the market doesn’t change trajectories because of any move you make. All finance wants to do is guess what the movement will be (up, down, how much). This is a classification or regression problem, not RL.
bumbo-pa t1_j6zsg6a wrote
Reply to comment by AnotherEuroWanker in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
Yeah in fact I did reinstall a chrome based browser for that
wardellinthehouse t1_j6zrsvp wrote
Reply to [D] Why do LLMs like InstructGPT and LLM use RL to instead of supervised learning to learn from the user-ranked examples? by alpha-meta
I asked this same question: https://www.reddit.com/r/reinforcementlearning/comments/zqfw7r/why_cant_we_do_supervised_learning_in_step_3_of/?utm_source=share&utm_medium=android_app&utm_name=androidcss&utm_term=1&utm_content=share_button
I believe the answer is due to the fact that sampling from the policy network is a non-differentiable operation.
fuscarili OP t1_j6zrmld wrote
Reply to comment by YOLOBOT666 in [D] I'm at a crossroads: Bayesian methods VS Reinforcement Learning, which to choose? by fuscarili
You're right in that, it depends a lot on the teacher and also if the student does his part of the job by self-studying and then use the teacher to clarify all the doubts that he may have come up with.
fuscarili OP t1_j6zr70d wrote
Reply to comment by Professional_Poet489 in [D] I'm at a crossroads: Bayesian methods VS Reinforcement Learning, which to choose? by fuscarili
Interesting! And do you know btw if RL is a useful tool in finance? I have heard really polarized opinions about its effectiveness for algorithmic trading/trading bots. Some say it's awful and other people that it's the most promising technology for it.
Geneocrat t1_j6zpkyn wrote
Reply to comment by bumbo-pa in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
Also just around the time I bought a System76 to WFH. I was bitterly disappointed
paypaytr t1_j6zo88c wrote
Reply to comment by Imonfire1 in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
i work at teams and i can tell you usage in Linux is getting so low it makes no sense business wise to invest anything on it tbh
cachemonet0x0cf6619 t1_j6zkpdk wrote
Reply to comment by bojohnsonyadig in [N] OpenAI starts selling subscriptions to its ChatGPT bot by bikeskata
correct. nothing specific. I’ve given it a bit of code and asked it to add doc strings to it. it was meh.
I’ve asked it to help me set up a new environment. it gave me old set up instructions but was able to make my way through by changing old versions. a lot like google.
it will write a lot of boiler tests. I’ve asked it to write a script and then write a unit test for the script. that was also meh but it was a good scaffold
mtocrat t1_j6zk1ka wrote
Reply to [D] Why do LLMs like InstructGPT and LLM use RL to instead of supervised learning to learn from the user-ranked examples? by alpha-meta
Let's say your initial model is quite racist and outputs only extremely or moderately racist choices. If you rank those against each other and do supervised training on that dataset you train it to mimic the moderately racist style. You might however plausibly train a model from this that can judge what racism is and extrapolate to judge answers free of it to be even better. Then you optimize with respect to that model to get that style
I_draw_boxes t1_j6zjxbt wrote
Reply to [D] Normalizing Flows in 2023? by wellfriedbeans
Human Pose Regression with Residual Log-likelihood Estimation learns an error distribution using normalizing flows. The technique filled a large performance gap between regression and heat map methods.
frequenttimetraveler t1_j6zjmza wrote
Reply to comment by gyanster in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
It looks like you 're trying to get censored
EnzoTrent t1_j704ban wrote
Reply to [D] I'm at a crossroads: Bayesian methods VS Reinforcement Learning, which to choose? by fuscarili
I'm not trying to temper your dreams or anything but I think Data Science as an industry is going to completely change over the next 5-10 years. I'm not saying humans won't work in Data Science in 5-10. I'm saying, the Data Science industry is going to evolve a lot as it incorporates AI. I don't know what that will look like - do your professors?
If you go to an Ivy and are taught by the smartest person in this old world, learn all the best old world stuff, it will do you little good in the new world.
If data is interesting to you - maybe, at least as a hobby, be sure that you learn everything you need to completely setup and deploy a native GPT-AI (s) and can train for years on specific tasks/functions/intent, all tailored to whatever services you want to offer a business owner - this should be obvious as this gets closer.
Eventually, most of this AI generative tech will be locked behind corporate walled gardens and anything accessible to consumers will be lightyears behind - prices will skyrocket for basic stuff that people just no longer really do. This will be super cheap until it isn't.
That is when you come in with your own generative AI - still lightyears behind Microsoft, but won't be nerfed like the consumer AI that will be available.
Haha, of course Microsoft doesn't really lose anything by undercutting your company at that point... I'm really just trying to get you thinking.
Don't expect anything about the world today to stay the way it is today. Assume everything will be updated and changed. Try to see the world that will follow the transition - where do you fit?
tl;dr: I think everyone with the ability to run/train a limited native AI - should totally do that.