The point about how poorly we predict the future is spot on. My background is limited to trying to make software that does something specific and constrained be bug free which is challenge enough for me. I really have no idea about creating a generalized intelligence in software. The thought does occur that it would have equivalence to genetics since new software is often dependent upon the old functions it is built upon where ancestor code potential for a bug is revealed in new software that uses it.
Rather timely article here:
https://www.washingtonpost.com/opinions/2022/08/31/artificial-intelligence-worst-case-scenario-extinction/
The point about how poorly we predict the future is spot on. My background is limited to trying to make software that does something specific and constrained be bug free which is challenge enough for me. I really have no idea about creating a generalized intelligence in software. The thought does occur that it would have equivalence to genetics since new software is often dependent upon the old functions it is built upon where ancestor code potential for a bug is revealed in new software that uses it.
An issue made more worrisome when you consider that militaries are actually seeking autonomous warfare capability. What could go wrong?