Geeze. What a bunch of nonsense. ChatGPT would NOT even be possible without Google.

Google has made most of the major AI fundemental breakthroughs in the last decade+. Google leads in every layer of the AI stack without exception.

A big one is silicon. They started 8 years ago and now on their fifth generation. Their fourth was settting all kinds of records.

https://blog.bitvore.com/googles-tpu-pods-are-breaking-benchmark-records

This app works on all pdf files. It converts pdfs with pymupdf in python, like if you were copy pasting all the text from the pdf with some pdf formatting into chatgpt.

tbh I don't think we are going to get much out of Meta until they get close to a holodeck VR experience, or a mainstream-ready AR experience. I'm sure they could drop a chatbot in the next six months, but being able to compete with google/microsoft is going to be hard.

Apple is going to update siri in two years with an LLM and act like they are the saviors of the universe

Amazon is someone that I see get left out of this a lot. They have the resources and funding to make Alexa a search/chat bot as well, and it's right up their ally.

> OpenAI is overwhelmingly a net consumer of AI research

Exactly. Not sure why people do not get this? Google has made many of the major fundamental AI breakthroughs from the last decade+.

So many fundamental things. GANs for example.

Learn python, it is all you need!

I've run it thru GPT for your reading pleasure: "I like to tell people that GPT-3 is more like writing an essay for English class (or the SAT) than a research paper for a history class. It cares about grammatical correctness -- in other words, readability -- rather than accuracy or truth. For the SAT, they used to say "you can make up quotes", because they're grading your writing, not your content."

ChatGPT can work on PDF files? How does that work? Does it just parse and interpret the raw PDF file? I'd like to parse some PDF files with many (thousands) of repeated table structures and convert them to JSON, is that something ChatGPT might be able to help with?

Autodiff in Swift is still in active development: https://github.com/apple/swift/pulls?q=is%3Apr+%5BAutoDiff%5D

What got killed is Tensorflow for Swift. (As it was Google project, it wasn't a big surprise.)

You probably want both, if you want robotics or biomedical. Most experiments and model training will usually remain in Python, but inference and final product may use a large amount of existing C++ code, where running the model is just one small piece, and nobody wants to ship python just for inference, if they can help it.

Some shops also use Rust for inference/integration, but good luck finding these blessed jobs.

But but what about programming language :( no seriously I bought an o’reilly subscription, and I want to read books on a specific topic in programming while i m in train, bus , before bed, I can’t do maths all time! I searching more of a strategy which programming language will benefit me first, should I become advanced at one before I move to next or juggle both?

The point about python is that all the machine learning libraries are just wrappers around c++ libraries so, the speed of the language is largely irrelevant

And stats

Focus on math...

If Xi Jing Ping, Putin and Trump have taught you anything, being correct is absolutely useless. Just having some sort of a plan, coming up with a good story and some fact sounding arguments is a lot more valuable that what the average person thinks. Nothing more is required to be one of the the most influential person alive.

As an ML engineer, I second this.

> [D] Should I focus on python or C++?

Yes.

Uh, I'm sorry the English classes wherever you went to school sucked!

Is English a second language for you?

Mentally (adverb) - in a manner relating to the mind.

Thanks for the answer, but Im afraid the idea there is quite different. They take embeddings from LMs and finetune them, rather than aligning and injecting external embeddings.

I can understand their (the Meta/Google engineers) frustration when perspectives like yours proliferate everywhere.

Transformers were invented at Google. OpenAI is overwhelmingly a net consumer of AI research, and incredibly closed off on the few innovations they have actually made. There is a graph somewhere for research output of the various research labs that shows that despite OpenAI 300-400 or so employees, their publicly released open access research is a ridiculously tiny fraction of that of other research labs. Consider the damage this might do if their success convinces management at other tech labs to be more closed off with their AI research, further concentrating the ownership of AI into the hands of a single, or select few corporations. In this sense OpenAI is actively harming the democratisation of AI, which given the previously unseen productivity generating effects AI will have seems like a dangerous place to be in.

I think there's a lot more work to be done on that front. I tried to use ChatGPT and perplexity.ai instead of Google Search. It works for common knowledge, but once you get into more complex and niche queries it just falls apart. They're both very happy to lie to you and make up stuff, which is a huge time waste when you're trying to get work done.

Here are some paper referenced by much smarter people than me. You're free to waste your time however you want, though!

They mention it as an alternative to prompt engineering

For the GRE our teacher said one of the easiest ways to get a high score was to have a strong ideology. Just be a Nazi, he said.

I did not end up using that advice but maybe if I did I would’ve done even better.

Maybe this can help https://www.youtube.com/live/FKsARHV3ZTI they mention the SeFit method which seems similar to what you are looking for.