Table of Content

1 Overview of Cockpit Multimodal Interaction
1.1 Definition of Multimodal Interaction
1.2 Multimodal Interaction Development System
1.3 Multimodal Interaction Industry Chain
1.3.1 Multimodal Interaction Industry Chain - Chip Vendors
1.3.2 Multimodal Interaction Industry Chain - Algorithm Providers
1.3.3 Multimodal Interaction Industry Chain - System Integrators
1.4 Multimodal Interaction Policy Environment
1.4.1 Summary of Laws and Regulations Related to Network Data Security of Intelligent Connected Vehicle
1.4.2 Multimodal Interaction Laws and Regulations (1)
1.4.2 Multimodal Interaction Laws and Regulations (2)
1.4.2 Multimodal Interaction Laws and Regulations (3)


2 Cockpit Single-modal Interaction
2.1 Installation of Cockpit Modal Interaction System
2.1.1 Installations & Installation Rate of In-vehicle Voice Recognition, 2024
2.1.2 Installations & Installation Rate of In-vehicle Voiceprint Recognition, 2024
2.1.3 Installations & Installation Rate of Exterior Voice Recognition, 2024
2.1.4 Installations & Installation Rate of In-vehicle Gesture Recognition, 2024
2.1.5 Installations & Installation Rate of In-vehicle Face Recognition (FACE ID), 2024
2.1.6 Installations & Installation Rate of In-vehicle DMS, 2024
2.1.7 Installations & Installation Rate of In-vehicle OMS, 2024
2.2 Haptic Interaction
2.2.1 Haptic Interaction Development Route
2.2.2 Application Cases of Haptic Interaction in Vehicle Models
2.2.3 Haptic Feedback Technology
2.2.4 Summary of Haptic Interaction Suppliers
2.3 Auditory Interaction
2.3.1 Voice Recognition Development Route
2.3.2 Application Cases of Voice Recognition in Vehicle Models
2.3.3 Application Cases of Voiceprint Recognition in Vehicle Models
2.3.4 Application Cases of External Voice Recognition in Vehicle Models
2.3.5 Summary of Voice Interaction Suppliers
2.4 Visual Interaction
2.4.1 Gesture Recognition Development Route
2.4.2 Application Cases of Gesture Recognition in Vehicle Models
2.4.3 Facial Recognition Development Route
2.4.4 Application Cases of Face Recognition in Vehicle Models
2.4.5 Application Case of Line of Sight Recognition Vehicle Models
2.4.6 Application Case of Lip Movement Recognition Vehicle Models
2.4.7 Summary of Visual Interaction Suppliers (1) - Gesture Recognition
2.4.7 Summary of Visual Interaction Suppliers (2) - Face Recognition
2.4.7 Summary of Visual Interaction Supplier (3) - Lip Movement Recognition
2.5 Olfactory Interaction
2.5.1 Olfactory Interaction Development Route
2.5.2 Application Cases of Olfactory Interaction in Vehicle Models
2.5.3 Summary of Automotive Smart Fragrance/Air Purification Suppliers
2.6 Other Biometric Functions
2.6.1 Iris Recognition Development Route
2.6.2 Application Case of Iris Recognition Vehicle Models
2.6.3 Iris Recognition AR/VR Applications
2.6.4 Solutions of Iris Recognition Suppliers
2.6.5 Summary of Iris Recognition Suppliers
2.6.6 Fingerprint Recognition Development Route
2.6.7 Application Cases of Fingerprint Recognition in Vehicle Models
2.6.8 Summary of Fingerprint Recognition Suppliers
2.6.9 Vein Recognition Development Route
2.6.10 Application Cases of Vein Recognition in Vehicle Models
2.6.11 Summary of Vein Recognition Suppliers
2.6.12 Heart Rate Recognition Development Route
2.6.13 Application Case of Heart Rate Recognition Vehicle Models
2.6.14 Summary of Heart Rate Recognition Suppliers
2.6.15 Electromyography Recognition Development Route
2.6.16 Introduction to Electromyography Recognition Equipment
2.6.17 Application of Electromyography Recognition Vehicle Models
2.6.18 Summary of Electromyography Recognition Suppliers


3 Cockpit Multimodal Interaction Solutions of OEMs
3.1 SAIC
3.1.1 Z-ONE Galaxy Full-stack Solution
3.1.2 Rising Intelligent Cockpit Solution
3.1.3 IM Intelligent Cockpit Solution
3.1.4 IM Generative Foundation Model
3.1.5 Multimodal Interaction OTA Content Summary (1): Rising Auto
3.1.5 Multimodal Interaction OTA Content Summary (2): IM Motors

3.2 BYD
3.2.1 Intelligent cockpit Solution
3.2.2 In-cabin Unique Multimodal Interactive Applications
3.2.3 Xuanji AI Foundation Model
3.2.4 Multimodal Interaction OTA Content Summary (1): BYD Dynasty & Ocean
3.2.4 Multimodal Interaction OTA Content Summary (2): Denza
3.2.4 Multimodal Interaction OTA Content Summary (3): Fangchengbao & Yangwang

3.3 Changan Automobile
3.3.1 Changan Intelligent Cockpit Solution
3.3.2 Nevo Intelligent Cockpit Solution
3.3.3 Deepal Intelligent Cockpit Solution
3.3.4 Avatr Intelligent Cockpit Solution
3.3.5 Automotive Foundation Model: Xinghai Model
3.3.6 Multimodal Interaction OTA Content Summary (1): Changan
3.3.6 Multimodal Interaction OTA Content Summary (2): Avatr
3.3.6 Multimodal Interaction OTA Content Summary (3): Deepal

3.4 GAC
3.4.1 Intelligent Cockpit Solution
3.4.2 ADiGO SENSE AI Foundation Model
3.4.3 Multimodal Interaction OTA Content Summary

3.5 Geely
3.5.1 Geely Intelligent Cockpit Solution
3.5.2 Zeekr Intelligent Cockpit Solution
3.5.3 Jiyue Intelligent Cockpit Solution
3.5.4 Xingrui AI Foundation Model
3.5.5 Kr AI Foundation Model
3.5.6 Multimodal Interaction OTA Content Summary (1): Geely
3.5.6 Multimodal Interaction OTA Content Summary (2): Zeekr
3.5.6 Multimodal Interaction OTA Content Summary (3): Jiyue

3.6 NIO
3.6.1 Intelligent Cockpit Solution
3.6.2 ONVO Intelligent Cockpit Solution
3.6.3 In-cabin Unique Multimodal Interactive Applications
3.6.4 Multimodal Perception Model: NOMI GPT
3.6.5 Multimodal Interaction OTA Content Summary

3.7 Xpeng Motors
3.7.1 Intelligent Cockpit Solution
3.7.2 In-cabin Unique Multimodal Interactive Applications
3.7.3 Automotive Large Language Model: XGPT
3.7.4 Multimodal Interaction OTA Content Summary

3.8 Li Auto
3.8.1 Intelligent cockpit Solution
3.8.2 In-cabin Unique Multimodal Interactive Applications
3.8.3 Intelligent Cockpit
3.8.4 Multimodal Interaction OTA Content Summary

3.9 Leapmotor
3.9.1 Intelligent Cockpit Solution (1)
3.9.1 Intelligent Cockpit Solution (2)
3.9.2 Voice Foundation Model: Tongyi
3.9.3 Multimodal Interaction OTA Content Summary

3.10 Xiaomi Auto
3.10.1 Intelligent Cockpit Solution
3.10.2 Car-side Large Model: MiLM
3.10.3 Sound Foundation Model is Installed in Cars
3.10.4 Multimodal Interaction OTA Content Summary (1)
3.10.4 Multimodal Interaction OTA Content Summary (2)

3.11 BMW
3.11.1 Intelligent Cockpit Solution (1)
3.11.1 Intelligent Cockpit Solution (2)
3.11.2 In-cabin Unique Multimodal Interactive Applications

3.12 Mercedes-Benz
3.12.1 Intelligent Cockpit Solution
3.12.2 In-cabin Unique Multimodal Interactive Applications
3.12.3 Cooperation Dynamics of Cockpit Foundation Model

3.13 Volkswagen
3.13.1 Intelligent Cockpit Solution
3.13.2 Upgrade Trends of Haptic Interaction System
3.13.3 Upgrade Trends of Voice Interaction System

4 Cockpit Multimodal Interaction Solutions of Suppliers
4.1 Desay SV
4.1.1 Profile
4.1.2 Multimodal Interaction Solution (1)
4.1.2 Multimodal Interaction Solution (2)

4.2 Joyson Electronics
4.2.1 Profile
4.2.2 Evolution of Joynext Intelligent Cockpit
4.2.3 Multimodal Interaction Layout
4.2.4 Features of Joynext Intelligent Cockpit Interaction (1)
4.2.4 Features of Joynext Intelligent Cockpit Interaction (2)

4.3 SenseTime
4.3.1 I Profile
4.3.2 SenseAuto Intelligent Cockpit Product System
4.3.3 SenseAuto Intelligent Cockpit Products
4.3.4 SenseNova Model Empowers Cockpit Interaction
4.3.5 SenseAuto Multimodal Interaction Application Case

4.4 iFLYTEK
4.4.1 Profile
4.4.2 Full-Stack Intelligent Interaction Technology
4.4.3 Features of Multimodal Perception System
4.4.4 Spark Cognitive Foundation Model
4.4.5 Spark Foundation Model Enables Cockpit Interaction
4.4.6 Multimodal Interaction Becomes the Key Direction of iFlytek Super Brain 2030 Plan

4.5 ThunderSoft
4.5.1 Profile
4.5.2 Cockpit Interaction Features
4.5.3 Rubik Model Enables Cockpit Interaction
4.5.4 Vehicle Operating System

4.6 AISpeech
4.6.1 Profile
4.6.2 Features of Multimodal Interaction Solution
4.6.3 Multimodal Interaction Products
4.6.4 Language Foundation Model

4.7 Huawei
4.7.1 Profile
4.7.2 Multimodal Interaction History
4.7.3 Harmony OS 4.0 Intelligent cockpit
4.7.4 New-generation HarmonySpace cockpit
4.7.5 HarmonySpace Interaction Features (1)
4.7.5 HarmonySpace Interaction Features (2)
4.7.5 HarmonySpace Interaction Features (3)
4.7.5 HarmonySpace Interaction Features (4)
4.7.5 HarmonySpace Interaction Features (5)
4.7.5 HarmonySpace Interaction Features (6)
4.7.6 HarmonyOS NEXT Interaction Features
4.7.7 Pangu Foundation Model

4.8 Baidu
4.8.1 Profile
4.8.2 Interaction Features of AI Native Operating System
4.8.3 ERNIE Bot Empowers Baidu Smart Cabin
4.8.4 Interaction Features of Baidu Smart Cabin Model 2.0

4.9 Tencent
4.9.1 Profile
4.9.2 Cockpit Interaction Features (1)
4.9.2 Cockpit Interaction Features (2)

4.10 NavInfo
4.10.1 Profile
4.10.2 Cockpit Interaction Features
4.10.3 Introduction to AutoChips
4.10.4 Intelligent Cockpit Domain Control SoC Chip of AutoChips
4.10.5 Application of AutoChips In-cabin Monitoring Function

4.11 Continental
4.11.1 Profile
4.11.2 Multimodal Product Layout
4.11.3 Cockpit Interaction Features
4.11.4 Multimodal Interaction Products (1)
4.11.4 Multimodal Interaction Products (2)

4.12 MediaTek
4.12.1 Profile
4.12.2 Cockpit Interaction Features


5 Application Cases of Multimodal Interaction Solutions in Benchmarking Vehicle Models
5.1 Cases of Traditional Brands
5.1.1 Yangwang U9
5.1.2 IM L6
5.1.3 Geely Galaxy E8
5.1.4 Zeekr 7X
5.1.5 Jiyue 07
5.1.6 Changan UNI-Z
5.1.7 Changan Deepal G318
5.1.8 Avatr 07
5.1.9 Dongfeng e?007
5.1.10 ARCFOX ?S5
5.1.11 Exeed Sterra ET
5.2 Cases of Emerging Brands
5.2.1 Xiaomi SU7
5.2.2 Luxeed R7
5.2.3 STELATO S9
5.2.4 Li Auto MEGA Ultra
5.2.5 Xpeng MONA 03
5.2.6 ONVO L60
5.2.7 Leapmotor C16
5.3 Cases of Joint Venture Brands
5.3.1 Volvo EX30
5.3.2 Lotus EMEYA
5.3.3 2024 Buick E5
5.3.4 2025 BMW i4
5.3.5 2025 Mercedes-Benz All-electric EQE
5.3.6 2025 Genesis GV70


6 Summary and Development Trends of Multimodal Interaction
6.1 Fusion Application of Multimodal Interaction in Intelligent Cockpits
6.2 Trend 1
6.3 Trend 2 (1): Cockpit Interaction Carriers Expand, and Interaction Range Extends outside the Vehicle
6.3 Trend 2 (2)
6.3 Trend 2 (3)
6.4 Trend 3 (1)
6.4 Trend 3 (2)
6.4 Trend 3 (3)
6.5 Trend 4