Recent comments in /f/MachineLearning

Affectionate-Echo289 t1_j40lky4 wrote

I seriously implore people to pay attention to what microsoft is doing, what they're saying on conference calls, and most of all, how much cash on hand they have.

It seems whoever mentioned on the conference call a few weeks back about investing an additional 100BB into OpenAi got what they wanted because MS isn't stopping anytime soon and I don't think this is going to be 'the end' to the relationship by any means.

Also, OpenAi have a reason to be confident, we're looking at the early-stages of the next trillion dollar company.

5

chatterbox272 t1_j40jame wrote

Not publishing the dataset is becoming less common as we start inching our way slowly to reproducible science. Public code with public data is the simplest form of reproducible research, where we can re-run your experiments with the same code and should get the same result (modulo some extremely low-level randomness or hardware differences that we may not be able to control).

That alone isn't enough to kill a paper, but it doesn't help. As another commenter said, showing your approach on public datasets and other approaches on your dataset will help, as it gives the rest of the community something that is reproducable.

It's more common in medical venues because of a few reasons:

  1. Difficulties around safely releasing medical data. Proper anonymisation and informed consent.
  2. It is more common in medical science to go for a higher level of reproducibility, where the same or a similar study will be done on a different population (i.e. same method, different data). This is pretty uncommon in ML, it's hard to get papers accepted in this format.
10

trnka t1_j40i4fa wrote

Fine-tuning is when you take a pretrained network, change the output layer only, and run the optimizer a little more.

Transfer learning is when you take any sort of pretraining. Fine-tuning is one example of transfer learning. Using pretrained word embeddings is another example of transfer learning.

You can do deep learning without either. It's just that existing pretrained models and components are so good that it's tough to build a competitive model without either.

2

CuriousCesarr OP t1_j40hegs wrote

No, I'm European so I have no idea about the Zillow debacle sadly.

The outputs would probably be used as a price evaluator for the living space (my friend works as a registrar of new/ bought homes). Honestly I think the Zillow usecase might be desired ultimately.

Would you be interested? :)

1

Anjum48 t1_j40gm5q wrote

Ah ok. On the first point I guess whoever you are looking for will need to spend a considerable amount of time building/finding a dataset to train a model.

On the second point, I might have incorrectly assumed you were familiar with the Zillow controversy around price prediction.

The TL;DR is that the ML team used a model to forecast prices using a tool made by Facebook called Prophet. The model was probably accurate enough for displaying a rough prediction on a website. Another team in Zillow started using these price predictions to flip houses and lost a whole bunch of money since the model was not designed to do this.

A lot of armchair data scientists quickly pointed the finger at Prophet for being a "bad" model. The reality is all models are bad if they are used for the wrong reason. In this case, the team flipping houses likely didn't listen to the data science team when they said the model shouldn't be used for that purpose.

This is why it's a good idea to know how the model outputs are going to be used. The obvious answer is always "as accurate as possible" but sometimes that might not be accurate enough...

Hope this helps!

4

42gether t1_j40fxyg wrote

> Why were OpenAI the first to make a model as good as ChatGPT then?

Here's a controversial take: luck

They didn't invent the wheel or faster than light travel, it was something that was going to happen sooner or later and they were just the first to do it publicly, meanwhile Google fired a guy that mass mailed people saying their own ai was sentient.

4

Malignant-Koala t1_j40fflp wrote

This is an "idea guy" post, isn't it. ;)

Like, one of those "I have no idea how incredibly hard it would be to even gather the necessary data for this" ideas? A, "I need a quote to give to my guy in two days despite being unable to provide you with any more guidance than a vaguely worded pseudo-concept" proposal?

Best of luck dude.

9

CuriousCesarr OP t1_j40f0i1 wrote

1). Not really. Data would have to be processed, but probably it can be introduced via a well structured form:

  • Nr. of rooms/ bathrooms/ etc.
  • Living space (square meters)
  • pictures (probably another ML to gauge how furnished and well maintained/ dilapidated the whole place is)
  • etc.

2). A great question! Zillow seems like a great example. As accurate as possible I guess. But a good starting point would be a price range.

1