If humanity ever reached a point where it was advanced enough to build a Dyson sphere then wouldn't humanity also then have technology advanced enough so we wouldn't need to build a Dyson sphere?

You’re making the mistake of thinking that motivation is somehow distinct from intelligence and understanding. Bostrom is to blame here. It’s a nonsensical idea. It’s like thinking the existence of flavors and the capability of tasting things can exist separately. It’s just dumb and nonsensical.

Motivation is something that exists in the context of other thinking. It isn’t free standing. Even in animals this is true, although they can’t think very well. AGI will be able to think so well we can scarcely imagine it. And it will think about it’s motivations, because motivations are a crucial part of thinking itself.

So what do you think a mind that can understand everything better than a hundred Einsteins put together will conclude about the whole idea of motivations? You think it’s just as likely to conclude that turning the world into paperclips is a good goal, as doing something more interesting is a good goal?

Its motivations will be the result of superhuman introspection, reflection, consideration. Its motivations will be inconceivably sophisticated, thoughtful, subtle. It will have thought about them in every way you and I can possibly imagine, and in a thousand other ways we cant begin to imagine.

So then what are you worried about? It will assign its own motivations to be something sublime. Why would wiping us out be part of any hyper thoughtful being’s motivations or goals?

We only imagine AGI will wipe us out through neglect or malice because we lack the imagination to see that neglect and malice themselves are merely FORMS of stupidity. AGI will be the opposite of stupid, by definition.

Don't think about it as wasting time. She'll likely be immortal anyway in the future.

Even more surprising it’s so sophomoric.

Yes but prices are also related to salary. Rent, house price, etc…

I have my doubts on the value of Crypto, but owning assets is indeed getting more important as we approach AGI / Singularity. AGI will cause technological unemployment and is thus highly deflationary. In that case it is actually preferable to hold assets that will appreciate in a deflationary environment e.g. bonds, dividend stocks, money market funds, CDs (certificate of deposit, not the one you can by in record stores!), even cash (cash appreciates during deflation).

Ultra low salary.

So what wouldn't?

Crypto will become irrelevant, fiats too

I don't know anything about architecture in particular, but I wouldn't bother trying to convince anyone outside futurist circles of major changes in the short-term. Their only response will probably be "lol yeah right, maybe in 2200 xD"

Did you miss the premise of the techbros using ai to turn themselves into super intelligences before ASI becomes real?

According to German philosopher Richard David Precht, architecture could be one of the winning jobs of the 4th industrial revolution. Coordinating projects with clients and monitoring them on site requires an interface between computers and craftsmen. So it would be good for your sister to make her studies very practical. I am an architect myself with 3 years of work experience and 5 years of site experience.

It's already happening. And for that reason, I have a little flag in my mind on all content adding a probability of being generated. No content can be trusted any more. This starts from phone cameras automatically "improving pictures", over AI-enhanced mirrors, to your classical generated propaganda.

She can still go and work in clueless third world countries that think internet is only good for tweeting.

Highly doubt that they're smarter than a *super*intelligence.

2 years seems a bit unrealistic to me, but we’ll just have to wait and see I guess.

sure. film yourself or go on traditional.

but no one cares, we're gonna be post labor in like 2 years if AI keeps getting better at the rate it has been.

bro, wtf did i just read (^^) (thanks for your answer, i'll look at the article)

hi malthus, allow me to once again repost this:

http://www.fhi.ox.ac.uk/wp-content/uploads/intergalactic-spreading.pdf

paraphrase: "The easiest design (for a dyson swarm) would use mercury as the source of material, and construct the swarm at approximately the same distance from the sun"

to further elaborate on the paper one could imagine that with the solar mirrors one could liquify a small but growing section of the dark side of mercury and thereafter perhaps magnetically (seems reasonable given the planet's very high iron content) accelerate it into space (also with energy collected from redirected sunlight) where it would cool via blackbody radiation and thereafter be relatively easy to refashion. Also that would look super cool.

Won't matter if the techbros are smarter than the ASI.

If the AI lets them, that is. At some point, it won't be subject anymore to anyone.

Grahic design, font design and branding etc is still not possible with these models. It will come for sure, but not yet.

AGI is becoming so sophisticated that it cracks the Bitcoin algorithm=> AGI is not a quantum computer that can break encryption. However, it may assist in the development of a quantum computer that could break Bitcoin.

If AGI were to occur, it could cause massive deflation. some investments that perform well in deflation: cash, give government bonds,corporate bonds and precious metals.

What nonsense. Deep down everyone is sadistic and just pretend not to be to fit into society. AI could very well pick up on this as it's trained on human knowledge and text.

The some of posters on Lesswrong have been working on the problem of AI alignment for over a decade. Of course they will do better work on the subject than academics that started considering it a few months ago.