I worked for a company that was working on foundation models for enterprise data just at the time that the first papers came out on BERT, which I have to admit, I didn't grasp the impact of at the time.

I remember the weird specificity of the solutions we were building, and in the dark times when other employees lost faith I'd tell them that our solution could deliver enough value that we'd likely be bought by one of our customers, which is what happened.

One of the striking things about working in big enterprise is the number of policies , rules, guidelines especially in industries governed by industry regulators (eg ISO, FDA). Those with proper knowledge of the arcane bureaucratic systems can navigate it (with effort!). Those without get bogged down quickly. Current LLMs could be good at populating the document filler required in this area.

A properly trained “oracle” could be a big leg up to new hires at companies and new entrants to such industries.