As part of my job, I have worked across both width and depth. I have worked on the core architecture of deep learning models as well as designed large-scale machine learning systems. I have made this observation that AI Native transformation is all about who lays down a better structure around their core intelligence. Nothing else matters more. Even the context length issue can be handled through robust structure for the time being. I often term it as probabilism filled into determinism.