Yeah that’s pretty frightening.

Given your reply I’m unsure of why you would want be able to follow the proofs then?

Some of the proofs in optimization are particularly rough so if you want to understand them the only way to is to wade through a book or the very least online lecture videos + slides.

[removed]

Imagine someone writes one that's explicitly aimed around manipulating your thoughts and actions.

An AI could likely come up with some insane tactics for this. Could feed off of your twitter page, find an online resume of you or scrape other social media or in microsoft's case or google's, potentially scrape your emails you have with them, profile you in an instant, and then come up with a tailor made advertisement or argument that it knows would land on you.

Scary thought.

How should we control the exposure for people with low cognitive capabilities that might not understand what they are interacting with.

I guarantee you a state space model will beat out any fancy named transformer for most “forecastable” problems. Even MDFA - signal extraction + exp integration for forecasting - will beat out these big ML models

You generally won't have any value for an ICML submission even if you are the 1st author, however, being a co author for an accepted ICML paper always counts. It should also improve your LOR. Regarding EMNLP, 3rd author would add some value if it's a long paper. For short a paper it's of little value IMHO. Again the paper should be accepted, 0 value for submitted and rejected papars.

Maybe a little easier:

import sys
probably_colab = 'google.colab' in sys.modules

Corporations scraping all kinds of copyrighted materials and then profiting off the models while the people doing all the labor are getting either nothing (for content generation) or poverty wages (for content labellers).

Their current push to promote LLMs as some sort of pinnacle of technology, when they barely have any legitimate use-cases and struggle with the most basic of logic, will probably lead to a recession in the tech industry.

I use Colab because of its easy integration to Google Drive. What do you use for storage on Paperspace? I don’t want to pay another service (S3) for storage.

I'm neither a mathematician nor a computer scientist by trade. I don't have the need nor the time to go through the nitty gritty details of optimization theory. All I need is an overview of the main ideas in this field. Think of it like knowing how to use a limit without the need to go through the epsilon-delta definition. Hope my reply didn't offend your ego.

Lol dude you wanna learn optimization, the details and length are what make the subject. If you want a high level overview look at a blog post. At the very least find an online offering of an optimization course with lecture videos and watch those and read the slides if you can’t be bothered to open a textbook.

All these low effort posts in this sub about people just looking to cut corners are depressing.

I have been using colab for ML training big models. It is a good product. Would love a more straightforward integration with my proper python modules. I end up having to update my libraries on my local, pushing to gh, then refresh/restart the colab kernel. Would love a better way to run my python module in -e mode. Thanks.

Take a look at Hebbian and adaptive resonance models. No backprop, no distinct training/inference phases.

Depends on what models you are using but for most transformers, running on GPUs may be much more efficient than CPUs when you consider $ / M inferences (or inf/$).

Are there specific EC2 instances you have to use or can you deploy on any EC2 instance?

Recently, we started evaluating Time Series Transformers. TSTs showed good performance in comparison to other TS DL methods.

Okay thank you. May I ask you a couple of questions if they arise ?

State space models (S4, H3, etc) are also competitive with 2B param transformer language models and have an effectively infinite context window https://hazyresearch.stanford.edu/blog/2023-01-20-h3

Thanks! Though a lot of thanks to my buddy in Google Brain who saw this thread and pinged me this morning :)

I was so close to getting this and then our partner team got hit by layoffs which set us back. Hoping before next school year to have something (not perfect), but we'll see.

👍🏻 thanks

hey now no need to be snarky

[edit] I give up on formatting

We've never really worked on a foilproof way to detect if you're using Colab, but this might work a little better for you:

import sys probably_colab = False

if 'google.colab' in sys.modules: probably_colab = True

[deleted]

Ah yes, several EU countries started sending warning shots about it. Makes sense. Good luck for the production fix on friday evening!