Recent comments in /f/MachineLearning

katadh t1_j7s73hw wrote

SNN - ANN conversion and surrogate gradient methods can both get good results these days, so training has become a lot more comparable to ANNs than it was in the past. I would agree though that there is a disconnect between the hardware and software still which is preventing SNNs from reaching the dream of super low power models.

1

katadh t1_j7s68c6 wrote

There has been a lot of progress in the last 2 - 3 years. They're still not quite at the level of ANNs in general but have been gaining ground quickly and do outperform ANNs on some specific tasks -- usually things with a temporal component but low data dimensionality per time-step. Another area with comparable results to ANNs would be object detection.

1

dancingnightly t1_j7s355b wrote

In a sense, you can communicate between semantic text embeddings and LM models through this method(would operate differently to multi modal embeddings): https://www.lesswrong.com/posts/mkbGjzxD8d8XqKHzA/the-singular-value-decompositions-of-transformer-weight

This method, which is only practical for toy problems really right now, would allow you to use semantic embeddings to find what to look for when doing SVD on an (autoregressive) LM. You could depend this on the input, for example, transforming your embedding into the keys to apply the abduction with in that process, and impacting the generation of logits. I'm not sure this would behave much differently to altering the logit_bias of tokens, but it would be interesting to hear if it was.

2

MisterBadger t1_j7rj1bf wrote

Machine learning algorithms are not even "intelligent" enough to filter out Getty watermarks.

They do not have minds or experiences, any more than zbrush or cinema4D or any other complicated software do.

Furthermore, they do not produce outputs like humans do - the speed and scale are more akin to automated car factories than human tinkers.

Fair use laws were not designed with them in mind.

1

like_a_tensor t1_j7rbdno wrote

Sounds like you want something like a logical representation of sentences. Reducing sentences to first order logic might be what you're looking for. There's also AMRs (Abstract Meaning Representations). The problem with AMRs is that they need to be built, which is non-trivial for machines and time-consuming for humans.

1

mjaltthrowaway t1_j7r9zon wrote

No it's real human. For some reason it didn't take in my first paragraph. What I was saying was that I own a high value domain related to vaccines and I was also thinking something along the similar lines of what OP posted.

And then the rest of my post was about starting from first principles and asking the simple question what problem does this machine learning website or app solve.

1

mr_house7 t1_j7qpnc4 wrote

Reply to comment by sonofmath in [D] List of RL Papers by C_l3b

Thank you so much for your reply.

I did take a look at your suggestions. The Sergey Levine course seems really awesome, It is definitely on the list to do. But I'm a little bit conflicted regarding the David Silver course. I have a few follow-up questions, if you don't mind:

I'm currently doing Hugging Face Deep RL course. It is free and at the end I get a certification of completion, not that I care much about the certification, but it is always nice to get a certificate.

Also, isn't the David Silver course a little outdated? It seems that the video lectures were made 7 years ago. I guess the basics don't change, but I was wondering what is the best course to take. I think they are around the same lvl of difficulty. What would you choose?

5

ksblur t1_j7qozkl wrote

> you.com

First time hearing about that search engine. I gave it a go, and man is it bad. I don’t understand how they think people will be loyal users of their “AI” search engine when nothing is intelligent about it.

I asked a simple query: “should I wear a jacket tomorrow?”, expecting it to interpret my query as “will it rain/be cold tomorrow” and this was the answer:

> It depends on the weather and the occasion. If it is mild or warm outside, then wearing a jacket may not be necessary. Ultimately, it is up to you to decide what to wear based on the weather, the occasion, and your personal style.

2