Hmm. Am I right to be concerned? One of the benefits of hiring people to do work is that it eliminates single points of failure. The last few decades have had technology automate a lot of rote processes. People have discussed crystal vs fluid dynamics and the balancing act/trade offs. Too much rigidity (automation) == slower to adapt in a dynamic environment.I guess my question is, what is a safe AI "process percentile" for a company that lets it recover if the AI goes down or goes haywire? No one knows (?), but it's worth thinking about.
I am also curious just how much direction the AI will need given the environment is dynamic. Humans generally align to the company's goals because they are rewarded (paid) to, and need to to survive. Relationships are built on unspoken and spoken communication. Unspoken could be cultural, hierarchical, environmental pressures, etc. As an extension of that, companies build relationships with other companies by sending (essentially) diplomats and ambassadors to each other (the article mentioned using AI for sales).
-- All this to say: if you have to constantly explain the job to someone, they are not fit for the job.
We'll see, I guess.