Thank you for the list! But I meant a book being written entirely by an AI, not just it being the co-author

Quite a long time, maybe. One of the key limitations of GPT-4, as well as other language models in its class, is the context window.

In the case of GPT-3, the context window is approximately 2,048 tokens. This means that when generating text, GPT-3 can only consider the 2,048 tokens immediately preceding the point at which it is generating text. This can make it difficult for the model to maintain coherence and consistency when generating longer texts, such as a book.

When GPT-4 is developed, it'll likely still be limited by the context window . Researchers would need to develop new architectures that are able to take into account a larger context window. This is complex as hell, and it is not clear if it'll be possible with our current hardware limitations.

NovelAI is a great tool, I have already used it a lot in the past, but I meant more like a book made out of a prompt, with little to no human interaction to create something good. And sadly NovelAI is still a bit behind of GPT-3, even with their GPT-Neox model

Correct but this was done at a small scale by chatGPT employees. I am saying we look at every novel that has data on its sales, every story on a site that has metrics of views or other measurements of quality and popularity, etc.

This might give the machine more information on what elements work that people like. Maybe enough to construct good stories.

Oh and by the way, using human ratings of the model output is exactly how ChatGPT is trained. Human-in-the-loop reinforcement learning.

It's a made up lie (a joke). Not real. Hoping that was obvious from... well, the post.

If you knew that and were playing along with it, then disregard.

This was the funniest thing I've read in a while.

Did you story have the poor and down on his luck detective who is overqualified for the job, his ratty run down office, and the clients as suspiciously attractive women?

That's because it sounds like they're full of shit.

So essentially it would just do something similar automatically.

You can ask chatGPT to write a summary of the story first, then the chapter names and chapter summaries, then each chapter one at a time. Try it! This hierarchical method can already achieve some of what you’re talking about.

They’re developing the artificial neurons to let you understand the remaining 70%.

Oh look we were right again.

Cool article. It looks like these neurons use chemical/electrical signaling that mimics action potentials and there analog nature.

So here's the feature I think you need to make the tool work:

right now, the machine works by:

<current symbol buffer> + neural network -> <current symbol buffer> + 1 symbol

It needs to become

f(all previous sessions symbols) = salient context

<salient context> + <current symbol buffer> + neural network -> <current symbol buffer> + 1 symbol + <updated salient context>

"Salient context" is whatever the machine needs to continue generating text to match to something like a detective story. So it needs to remember the instructions, the main character's names, and so on. It does not need to remember every last word previously in the story.

To make it really good it needs to be aware of metrics of quality. Amazon/royalroad number of reviews and review ratings. Number of copies sold of the novel on the market. Etc. This way it can weight what it learns from text by how much humans liked that particular structure of text.

After that you'll need the AI to generate many stories, get user feedback, and iterate. I think eventually they will be good, and at some point past that it may discover ways to make them REALLY good that humans have not.

Memories are stored in connections between neurons.

https://dornsife.usc.edu/news/stories/3617/where-are-memories-stored-in-the-brain-new-research-suggests-the/

Does novelai not count?

What if as it writes, it compresses the previous chapters to a summary with only facts that are key for the following chapters?
I think it works kinda like that in AI Dungeon, but you have to fill in those "memos" yourself.

Can they be directly rewrited/copied when assembled? I think untamperable architecture could be better for mass production AI.

[deleted]

First time I heard something like this described.
Could you link me something on the subject?
I tried googling it but it keeps thinking I must be mispelling Salazar's Pit and shows me D&D articles.

I’d say 3-5 years before it’s writing genuinely impressive original stuff on the level of pro novelists. But even next year it should be much better.

Memories are tiny globs of slime that cling to our neurons. Those tiny globs slide up and down your neurons like trains on a track. When you remember something they slide into an area of the brain called "Salitzar's Pit" which spreads the glob across a cluster of cells that 'read' the memory.

These artificial neurons can transmit memories - a capability that eluded scientists until now. Meaning we can take all the globs of a person's memories and put them in an artificial brain and I'm making all of this nonsense up.

It can already to that. It's just not available to the public as a free tool.

We are in 2023, Id say close to 2025. It only need a few more evolutions before I can write a good book with good human complexity style of writing.