Recent comments in /f/MachineLearning
nildeea t1_j3betb4 wrote
Reply to Is there an AI tool that can specifically isolate sentences or chunks of text, from larger bodies of text, that meet a certain narrow criteria -- then output those as the result? - [D] by What_The_Hex
“Summarize this text using only excerpts from the text itself” into chat gpt along with your text.
juhotuho10 t1_j3beqhj wrote
Reply to [D] Which ML model should I use to analyse and detect dip in time series sequence? by C0R0NA_CHAN
The pain of building a ml model that isn't even as accurate as calculating portions below average
Idk, you can do ml but I would just recommend a simple function
bernhard-lehner t1_j3bddsb wrote
Reply to [D] I recently quit my job to start a ML company. Would really appreciate feedback on what we're working on. by jrmylee
You might want to consider a different name, as there is a library already there with a highly similar name: https://pypi.org/project/rubberband/
_Arsenie_Boca_ t1_j3bbl7h wrote
Reply to [D] I recently quit my job to start a ML company. Would really appreciate feedback on what we're working on. by jrmylee
For me personally, it would be very important that I am not tied to Jupyter Notebooks. Ideally integrate vscode and automatically load settings from .vscode directory in the repo
brucebay t1_j3bb7t2 wrote
Reply to [D] I recently quit my job to start a ML company. Would really appreciate feedback on what we're working on. by jrmylee
This seems to be a very ambitious project, as there are several ML projects that have very obscure dependencies that dont't work out of the box. This is especially true for older repos. I would personally be very interested at a reasonable price level (compatible to vast ai or runpod) to check out some repos without hassling with setup.
​
But I'm just a hobbyist. In a professional environment, I don't know if I would be interested in an automated ML setup for a long term development/production solution. My company uses H2O, DataRobot, some IBM solution, (and another one but forget the name). They have some attractive features for everyday data analysts, but mostly limits the advanced users. In a corporate environment, your solution seems to fit between an expert developer who does all work, and an AutoML solution that makes most of the work.
​
I think it is great idea for rapid experimentation for middle-high end development . So I suspect your target audience for those features are going to be either educational institutions, or any kind of research centers, be it military or commercial. I hope it will have enough interest to support you financially. Good luck with your company.
​
ps: if you can find a way to let users download the environment where the target repo runs (or provide a tool to mirror) for local development (may be at an extra cost) it would be very useful feature for most people. I would even pay for such a stand-alone software.
tareumlaneuchie t1_j3ba1km wrote
Reply to comment by C0R0NA_CHAN in [D] Which ML model should I use to analyse and detect dip in time series sequence? by C0R0NA_CHAN
If you want a model, you will need to think about input variables... This where it gets complicated.
As it minima detection, there are many ways this can be achieved, for example: look at a sign change in viewers per unit of time? Or if your data is evenly sampled, compute the difference between viewers at t[n+1] and t[n], and see whether the sign change is stable (no flip-flop) over say 5 or 10 samples?
To get a robust detection you will need to play with your data. A lot.
C0R0NA_CHAN OP t1_j3b5hum wrote
Reply to comment by marr75 in [D] Which ML model should I use to analyse and detect dip in time series sequence? by C0R0NA_CHAN
Agreed, i thought of this too. But say, i want to scale up and detect an ad in video based on intrest drop then it will be difficult to achieve that through local minima right? Interest at a particular second might drop due to boring content right? What if I want model to detect intrest drop only when ad occurs?
Normally there'll be a max drop in intrest during an ad for sure. But we can't use global minima technique here because normally people skip off end parts of video so that might actually be the biggest drop and we don't want that.
marr75 t1_j3b4xso wrote
Reply to [D] Which ML model should I use to analyse and detect dip in time series sequence? by C0R0NA_CHAN
I don't know why you would need ML to do this. Detecting local minima is a Calc I homework question. Scipy (and many other libraries) do it in a single function call.
idonthaveenoughchara t1_j3b4q6p wrote
Reply to [D] Simple Questions Thread by AutoModerator
Does anyone here happen to have a trained GANILLA model and would you be able to translate a few images for me into stylised images? I’m making a book for my niece’s 5th birthday and would love to have the images of our holiday as if an illustrator drew them. I would do this myself but my laptop has unfortunately given up on me - any help or advice would also be appreciated :)
Atom_101 OP t1_j3b2vmr wrote
Reply to comment by mkthabet in [D] Best way to package Pytorch models as a standalone application by Atom_101
From what I read it doesn't package cuda, only python dependencies. Were you able to get cuda inside your pyinstaller executable? Also is it even possible to package cuda inside an executable? Cuda needs to go into a specific folder right? And it needs to be added to the path variable for pytorch or other libraries to see it. For example in Linux it goes inside /usr/local/cuda
Atom_101 OP t1_j3b2hnc wrote
Reply to comment by nins_ in [D] Best way to package Pytorch models as a standalone application by Atom_101
Thanks. This might be more useful for someone doing mobile or edge deployment since ncnn seems to be cpu only. I need my model to run on GPUs.
Atom_101 OP t1_j3b291o wrote
Reply to comment by dr-pork in [D] Best way to package Pytorch models as a standalone application by Atom_101
It seems you can't lock a container. If the end user has root access they will be able to ssh into the container and see your source code. The solution seems to be to obfuscate your code using something like pyarmor, so that even if the user accesses the docker image, they won't easily figure out your source code.
Atom_101 OP t1_j3b20ok wrote
Reply to comment by CyberDainz in [D] Best way to package Pytorch models as a standalone application by Atom_101
So you are manually setting up cuda and windows environment variables in that script? I'll see if I can get it to work like that. Thanks!
[deleted] t1_j3b0qiy wrote
[deleted] t1_j3ayrdy wrote
[removed]
CyberDainz t1_j3ayd88 wrote
Reply to comment by IndieAIResearcher in [D] Best way to package Pytorch models as a standalone application by Atom_101
Because each project has its own configuration.
If you make a framework out of this, you get a horror like Bazel. And you will spend time learning how to work with Bazel. But what for? Building a project is a simple operation: create folders, some files, download, unzip, call Popen with a certain env, clean up the __ pycache __ folder at the end, and archive it - that's it! The project is ready.
All you need to do is spend 20 minutes and figure out how WindowsBuilder.py works and adapt it to your project.
WindowsBuilder.py is standalone and requires only python 3.
IndieAIResearcher t1_j3axf09 wrote
Reply to comment by CyberDainz in [D] Best way to package Pytorch models as a standalone application by Atom_101
Windows builder as pypi
CyberDainz t1_j3ax5f5 wrote
Reply to comment by IndieAIResearcher in [D] Best way to package Pytorch models as a standalone application by Atom_101
what do you mean
IndieAIResearcher t1_j3ax10h wrote
Reply to comment by CyberDainz in [D] Best way to package Pytorch models as a standalone application by Atom_101
Why don't you create it as a standalone framework?
CyberDainz t1_j3awj2p wrote
look at my project https://github.com/iperov/DeepFaceLive
I made a builder to create an all-in-one standalone folder for Windows that contains everything to run a python application containing cuda runtime. Release folder also contains portable VSCode that has already configured project to modify only folder's code. No conda, no docker and other redundant shit.
Builder located here https://github.com/iperov/DeepFaceLive/blob/master/build/windows/WindowsBuilder.py and can be expanded to suit your needs.
psychorameses t1_j3av5f9 wrote
Reply to comment by dr-pork in [D] Best way to package Pytorch models as a standalone application by Atom_101
Through a web API, sure. Locally, no.
Python fundamentally is a scripting language. It isn't pre-compiled into binary. It literally needs the source code to run.
It's ok, a whole lot of people including my boss have made the exact same mistake and asked the exact same question.
BurgooButthead t1_j3augjm wrote
Reply to comment by clavalle in [Discussion] If ML is based on data generated by humans, can it truly outperform humans? by groman434
I wonder this about too. Like if there was some alien technology that we cant understand even if we were taught.
psychorameses t1_j3aufn8 wrote
OpenAI just went for-profit with a $29 billion valuation so I say good luck and godspeed.
Baturinsky OP t1_j3bh9kb wrote
Reply to comment by LanchestersLaw in [D] Is it a time to seriously regulate and restrict AI research? by Baturinsky
Thanks.
I think people vastly underestimate the possibilities of use of ChatGPT-like model. If it has learned from the entire(-ish) interned scrapped, it's not just language model, it's the model of entire human kowledge avaialbe on the internet, neatly documented and cross-referenced for very easy use by algorithms. Currently it's used by quite simple algorithms, but what if it will be algorithms that try to use that data to write itself, btw? Or something else we don't forese yet.
And I don't even know how it's possible to contain the danger now, as algorithm for "pickling" internet like that is already widely known, so it could be easily done by anyone with budget and internet access. So, one of necessary measures could be switching off the internet...