That speed has caught many IT executives off guard as techniques that have always worked for them stop working, Andersen adds. “With this absolute velocity, you are seeing the old norms of trying to figure out how much to invest, those are no longer useful tools,” he says. “If you use traditional methods, you just don’t get it.”
Although Andersen agrees that inference pricing has gone down significantly, “the reality is that we are asking for more sophisticated tasks, queries that are perhaps 1,000 times more complicated” today as compared to two years ago, he says.
Capitalizing on cloud and data
When Natarajan joined Capital One in March 2023, ChatGPT was barely four months old. Despite having been used for about 15 years at that point, generative AI didn’t take off in terms of C-suite and board mindshare until OpenAI introduced ChatGPT.