> But yes, anyone reading please don't use ChatGPT instead of google search unless you don't care about the responses being made up.

Most people honestly don't care. They just want to get an answer quick, whether it's made up or not. This is true whether in real life or online.

They should be scared of both. OpenAI is capable of scaling ChatGPT and packaging a good consumer app themselves. Bing gets them faster distribution but it isn't like OpenAI is a paper tiger. Google wouldn't be able to compete with either of them in the long term if it continued to refuse to ship its own LLMs.

I was really interested in how this could summarize primary sources, so I ran it on the database of Hillary Clinton's emails.

A Storyteller Summarizes Hillary Clinton’s Emails

Input: Raw PDF of 2016 Democratic National Committee email leak

------------------------

Prompt: I want you to act as a storyteller. You will come up with entertaining stories that are engaging, imaginative and captivating for the audience based on the summary text provided. It can be fairy tales, educational stories or any other type of stories which has the potential to capture people's attention and imagination. You have been given a section of a large set of emails to summarize and come up with an entertaining story.

------------------------

Output: Once upon a time, there was a group of diplomats working hard to make the world a better place. They had been discussing how to gain leverage over the Pakistanis to move them to more aggressively pursue Al-Qaeda. After much deliberation, they decided to use a combination of incentives and coercive measures to try to get the Pakistanis to cooperate. They offered incentives such as increased control over how Kerry-Lugar money was used and increased support for counterinsurgency capabilities. They also used coercive measures such as targeting military leaders who gave support to Al-Qaeda and its allies, and attempting to reduce Pakistani anxieties about the Indian front. In the end, their efforts paid off and the Pakistanis began to cooperate more with their mission. The diplomats had succeeded in making the world a better place.

The story follows Hillary as she juggles her busy schedule, responding to requests from her colleagues and friends. She is always willing to help, and her dedication to her work is evident. Despite her busy schedule, she is still able to find time to help those around her. A powerful leader was tasked with finding out whether a senator supported the surge in Iraq and obtaining a copy of his recent speech about troops to Afghanistan. The leader reached out to her team for help, and they worked together to draft a memo outlining four strategic interests, three of which overlapped with the leader's goals. With the help of her team, the leader was able to obtain the information she needed and use it to make a positive impact.

President Obama was faced with the challenge of how to win the war in Afghanistan without causing too much destruction and civilian casualties. He decided to increase the size of the Afghan army and police force, and to pay them better wages so they could live comfortably. He also decided to send more US Special Forces and tens of thousands of troops to the region. Despite these efforts, the Taliban continued to gain strength and support from the Pashtun community. Obama realized that he needed to find a better solution. He decided to focus on carefully thought out measures such as providing better pay for the Afghan army and police, and using diplomacy to negotiate with the Taliban. In the end, Obama was able to find a peaceful solution that allowed the US to win the war without causing too much destruction.

A Prime Minister of a country had a fear of losing his sight due to a childhood rugby injury. He had his eyes checked and it was found that he had two minor tears in his retina. He visited the world-renowned Moorfields Hospital for further examinations and the doctors decided against any further operations. The Prime Minister was grateful to the doctors and staff of the NHS, especially Moorfields Hospital. Meanwhile, the US Secretary of State was in contact with the Foreign Minister of Honduras to discuss the situation in the country. She asked her staff to call the US Congressman Payne to update him on the situation. Through her diplomatic efforts, she was able to make a positive impact on the lives of many.

A small island nation called Haiti faced many challenges, but the people of Haiti were determined to build a stable, prosperous and democratic future. The United Nations appointed President Clinton as a special envoy to Haiti, and he appointed Dr. Paul Farmer as the Deputy U.N. Special Envoy. Dr. Farmer had dedicated his life to helping the people of Haiti for the past 20 years. Despite the efforts of the U.S., U.N. and other countries, Haiti still faced many challenges. To help the people of Haiti, the U.S. State Department took a closer look at the challenges and Secretary Clinton's chief of staff briefed Members on the initial findings. The U.S. hoped to better target and coordinate assistance, engage the Haitian Diaspora, and make assistance sustainable. To help the people of Haiti, the U.S. proposed granting temporary protected status to Haitians living in the U.S. and included Haiti in security initiatives such as the Merida Initiative. With the help of the U.S., U.N. and other countries, the people of Haiti could build a brighter future.

There was also a great conflict between two powerful nations, Morocco and Guinea, over a passport that had been taken away from a citizen of Guinea. The leaders of the United States and France stepped in to help and offered ideas to help the two nations come to a resolution, but the leaders of Morocco and Guinea were still unable to come to an agreement. The leaders of the United States and France then decided to meet in Paris to discuss the situation further and were able to broker a deal between Morocco and Guinea, returning the passport to its rightful owner.

There was also a man named Tom who was nominated for a prestigious position, but his nomination was held up due to a disagreement between two powerful forces. A brave negotiator was able to convince the two sides to lift the hold on Tom's nomination, allowing him to achieve his dream.

[deleted]

I agree, hence I support this lawsuit and hope that Getty wins, which I hope leads to some laws vastly curtailing which data AI can be trained on, especially when that data comes from artists/creators, who are already some of the lowest paid members of society (unless they're the lucky 0.01% of that group).

If "science" can't move to the next base without getting enthusiastic consent from the other parties it hopes to involve, then "science" should damn well keep its mitts to itself. In the case of OpenAI, "science" got handsy with people's personal stuff who were unaware of what was going on, and who would not have given consent if they had known. OpenAI's approach to science is creepy, unethical, and messed up.

All models are wrong, some are just useful.

I don't draw any association to the complexity of nature from the complexity of the latent model that scientists use to research nature.

Fair enough. I was speaking from a practical perspective, considering the types of questions that people typically ask search engines, not benchmarks.

[deleted]

Maybe

>Humans do take inspiration from others' work...

Ugh. This justification is creaky and useless.

Machines take instructions, and have zero inspiration.

Human artists aren't an endless chain of automated digital art factories producing mountains of art "by_Original_Artist".

One unimaginative guy copycatting another more imaginative artist is not going to be able to flood the market overnight with thousands of images that substantially replace the original media creator.

Honestly I don't even believe the websites anymore. Today I was searching for good sports bar in my city and couldn't find any reddit threads. I decided to give Google search a try but I didn't want to believe the information is true. It felt like the local bars are paying the websites to boost their rankings.

It saw stock photo watermarks millions of times during training. Nothing else in the training data comes even close. Even at half a bit per training image, that can add up to memorization of a shape.

Apart from the handful of known cases involving images that are duplicated many times in the training data, actual image content can't be reconstructed the same way.

Lol what? That's the exact rationale "Open"AI used for not releasing the model weights for Dalle-2 (and instead selling it to Microsoft).

I agree with the goal, but I don’t think making the internet more closed is the way to go. The purpose of the internet is to be open. Making everything on the internet cost something would have a lot of negative effects on it. The solution to the powerful exploiting our openness isn’t to make it closed, but to regulate their usage of it.

[deleted]

As it should be. If openness of internet means a few people become rich off the back of training on large swathes of data without explicit permission, then it should be stopped.

OpenAI should pay for their own labelled datasets, not harvest from the internet without explicit permission, to then sell back as GPT3 and get rich off of. This absolutely has to be punished and stopped.

> wrong information from these models is pretty rare

This is not born at out all by the literature. What are you basing this on?

There are still significant problems--everything from source material being ambiguous ("President Obama today said", "President Trump today said"--who is the U.S. President?) to problems that require chains of logic happily hallucinating due to one part of the logic chain breaking down.

Retrieval models are conceptually very cool, and seem very promising, but statements like "pretty rare" and "don't have that issue" are nonsense--at least on the basis of published SOTA.

Statements like

> I don't think it needs to be 100% resolved for it to be a viable replacement for a search engine.

are fine--but this is a qualitative value judgment, not something grounded in current published SOTA.

Obviously, if you are sitting at Google Brain and privy to next-gen unpublished solutions, of course my hat is off to you.

Hopefully. Stability winning would decrease the openness of the internet. I already know software projects that aren’t being open sourced to avoid being part of training data, I’m sure artists will be much less likely to openly share as well.

What you think rich people don't suffer from mental illness?

Not every problem can be blamed on someone else, especially if the issue is your own brain

TIL science cannot progress without training ML models on Getty images

Given that this was announced only minutes before Microsoft announced the event tomorrow where they're expected to unveil the new GPT-powered Bing, they are probably scared of that rather than ChatGPT. I know Bing is a joke right now, but if it suddenly becomes a far better information assistant than Google simply by virtue of its ability to chat about search results and keep the context, that poses a huge threat (if the new Bing goes viral like ChatGPT did).

But it doesn't sound like Bard is going to be linked to the Google search engine just yet. The article mentions separate AI search integrations coming soon, but from the screenshots it just seems to generate a paragraph or two about the search, without citations.

[deleted]

It also doesn’t give SD a chance to apply any lessons learned from the first case to the second one, I guess.

I'm quite certain Google and Meta are ahead of OpenAI, but they have significantly more to lose by making models publicly available that may potentially make things up or say something offensive. On top of which, this chat search experience seems like something Google would be pretty careful with considering how frequently they've been sued because they somehow reduced page traffic to random websites.