Recent comments in /f/MachineLearning

TiredMoose69 t1_j3w9j4x wrote

I would like to start a project (possibly) using openai's API to make a GPT-3 based bot finetuned on Messenger/Whatsapp chatlogs of mine. Any suggestions on which model to use?

From what i see i have around 100M tokens for it to learn, I am currently working on changing the format of the json file and the txt file of the exported data but i am confused regarding which model to use. I think the davinci003 is an overkill for something like that.

(My data is in Greek, i used a GPT-2-Small-125M model trained for many hours on a colab notebook, and the results were not that great :D that's why i wanted to try a bigger model)

The format i want to use it for is idealy a chat bot that you ask something and replies as the other person would (my friend).

Do you think it's possible to train it on my local PC (RTX3060ti) for privacy reasons?

Any help/suggestions would be highly appreciated!

1

Fultonardo t1_j3vn1zm wrote

Greetings!

My background is in evolutionary genetics and bioinformatics and I totally agree!

I’ve been working as a bioinformatics consultant for almost two years now and I absolute love it. As a consultant I have several projects, and am constantly checking in with clients to do requirements gathering and present my work. While there is a fair bit of alone time/coding work of course, but it’s more like 60/40% or 40/60% depending on the project.

I never would have thought of consultant until I found this specific job posting that matched my background and in interviews got super positive vibes from the folks there. Now it’s my dream job!

2

LaravelWorkflow OP t1_j3vmjar wrote

Right now yes it's just a fun idea but once we take it to the logical conclusion, it will become a lot more powerful. If you don't like any of the search results you can edit them and then generate the website you wish existed. You can embed fake images and audio from other AI models. It can already write code to make things interactive as well.

−9

LaravelWorkflow OP t1_j3vmb9w wrote

Yes, you are seeing the key first feature. This is essentially a prompt generator. You put in your keywords or phrase and then it extends that to different examples. But it presents it in a familiar format. The average person doesn't understand prompts or prompt generation yet but they do know how to search for stuff.

1

LaravelWorkflow OP t1_j3vm4xq wrote

The search results are free. Search for whatever you want. It's definitely mostly a novelty at this point but I'm sure someone can find a productive use for it too. The VC is needed for generating fake websites for these fake results.

As for what makes it different. It's a lot more open than most other ideas. There are AI search engines and AI website builders, etc. This is more like a portal into all of that and the ability to make it social as well. As AI improves so too will this service.

Midjourney makes fake pictures. Latent Web makes fake Internet.

It's up to the users to figure out how to make these tools productive. We will listen to their feedback and add the most useful features in order to achieve PMF.

−3