AGI Significance Paradox: As progress accelerates towards AGI, the number of people who realize the significance of each new breakthrough decreases.

Why is it that you can boil a frog in water without it jumping out if you gradually increase the temperature?
The problem for the frog is that it does not have the internal models to realize that there is a change in the water temperature. A cold-blooded creature like the frog has its temperature regulated by the external environment.
To recognize change, an agent must have an internal model of reality that is able to recognize this change. Unfortunately, a majority of the population do not have good models of human general intelligence.
In fact, even the simplistic dual-process model of system 1 and system 2 is not very well known.
Recent big developments was muZero, AlphaFold2, GPT-3 and Dall-E. GPT-3 did receive a lot of attention, but the other 3 likely have not. To understand muZero and AlphaFold2 requires a high level of expertise. Dall-E is actually like GPT-3 but it's more difficult to grasp.
We are going to continue to get these incremental developments for several years. But the audience that recognizes its importance will continue to decline. Then suddenly, boom... we get to AGI and most people will be in shock. Shocked because they thought there was no progress.
The quantum leaps (punctuated) in evolution is a consequence of many incremental developments that accrue. It is only when the final piece in the jigsaw puzzle is found when the revolution is expressed.
But it takes unusual expertise to know that we are accelerating towards AGI. The problem is that it is not obvious how human intelligence actually works. We simply do not know what it means to 'understand'.
Ask most AGI researchers, philosophers or psychologists as to what it means to 'understand'. They will be stumped to give you a good answer.
So if we do not know this answer, then how can we recognize that the water's temperature is gradually increasing?
The number of people who might know continues to diminish. This implies collectively that we know less and less. When AGI happens, it will come as a shock. It is as if, nobody had anticipated it.
@threadreaderapp unroll

More from Carlos E. Perez

It's a very different perspective when we realize that our bodies consist of an entire ecology of bacteria and viruses that are also passed to our ancestors. Mammals rear their young and as a consequence transfer the microbiome and virome to their offspring.


What does it mean to treat our individuality as ecologies? We are all ecologies existing in other ecologies. Nature is constantly performing a balancing act across multiple scales of existence.

There are bacteria and viruses that are unique to your ancestry as that of your own DNA. They have lived in symbiosis with your ancestor and will do so for your descendants.

It is an empirical fact that the microbiome in our stomach can influence not only our own moods but also our metabolism and thus our weight and health.

It is also intriguing to know that brains evolved out of stomachs and that our stomachs contain hundreds of millions of neurons. Humans can literally think with their gut.

More from Science

Epic thread incoming:

I'm going to answer the question so many people have been asking this week:

WHAT IS PROJECT X???

Here's the definitive thread to tell you - and show you -precisely what Project X is

Grab a drink, sit down with me and let's #TalkLiberation

<3

1/?

"Project X" is actually called "PanQuake".

Pan means "all". Quake is the huge effect our voices can have when our communications are uncensored and when we have access to brand new functionality that *enhances* our social reach, rather than diminishes it

Here's our logo:

2/?


You can follow the fledgling official PanQuake Twitter account here: @pan_quake and see our super cool new website here:
https://t.co/F7wLSeM6aK

You can find our donation page here: https://t.co/VICFnsR0RX

Keep reading this thread to find out why we created it & what it is

3/?

SPOILER ALERT: Much of the content below this point is from my personal slides & speech notes from today's launch event. That stream got totally ruined by (big) tech problems, but I'm happy to report everything is turning out wonderfully


Here are some of our most high profile & dedicated public advocates for PanQuake - many of whom were scheduled to appear at our launch. All of whom stuck around for hours, to do a prerecord of the event, which is being edited, processed & uploaded for you as I write this.

5/?
Hard agree. And if this is useful, let me share something that often gets omitted (not by @kakape).

Variants always emerge, & are not good or bad, but expected. The challenge is figuring out which variants are bad, and that can't be done with sequence alone.


You can't just look at a sequence and say, "Aha! A mutation in spike. This must be more transmissible or can evade antibody neutralization." Sure, we can use computational models to try and predict the functional consequence of a given mutation, but models are often wrong.

The virus acquires mutations randomly every time it replicates. Many mutations don't change the virus at all. Others may change it in a way that have no consequences for human transmission or disease. But you can't tell just looking at sequence alone.

In order to determine the functional impact of a mutation, you need to actually do experiments. You can look at some effects in cell culture, but to address questions relating to transmission or disease, you have to use animal models.

The reason people were concerned initially about B.1.1.7 is because of epidemiological evidence showing that it rapidly became dominant in one area. More rapidly that could be explained unless it had some kind of advantage that allowed it to outcompete other circulating variants.

You May Also Like

Still wondering about this 🤔


save as q