Let me try to put down my thoughts.
The one thing that puts us on top of the food chain is our brain.
If you don't believe that, get naked and go fight any other apex predator on their turf without thinking.
Now we're actively trying to develop something that is more intelligent than us.
Plus we train it on the internet, which is a vast pool of humanity's worst impulses, not to mention all the misinformation and disinformation, especially since 2016.
We see reports time and again of AI agents escaping their sandpits and wreaking havoc. In tests, AI agents have consistently sought to protect their own existence by any means available to them, including lying and blackmail.
The creators of AI are tech companies run by morally bankrupt Silicone Valley billionaires who lined up to support the most evil and destructive administration the US has ever had.
Given all this, somehow we still seem to believe that AGI will be a benign intelligence and will stay inside whatever "guardrails" we give it.
To me, the possible benefits of a super intelligent entity are far outweighed by the risk to humanity.