Regarding multimodal models, the current mainstream approach by companies like Google involves mapping multimodal information and semantic information into the same space. Specifically in autoregressive generative models, this is known as native multimodal models, which is more commonly manifested as: