The track for new energy vehicles is getting wider and brighter, with more and more players joining in and the smart experience changing with each passing day.
Now, the chip manufacturer MediaTek has made a big move and brought a complete set of Dimensity automotive platform, which is being commercialized one after another.
Advertisement
It can bring new cockpit experiences such as satellite communications, 5G communications, Wi-Fi and Bluetooth connections, and terminal-side AIGC to smart cars, especially in various application scenarios such as human-computer interaction, driving experience, entertainment, social networking, and office Realize AI empowerment.
Market survey data shows that global passenger car sales are expected to reach 85 million units in 2024, of which new energy vehicles will account for 20%. By 2028, these two figures will reach 89 million units and 35% respectively.
Advertisement
The total sales volume of China's passenger car market is expected to be 22 million units in 2024 and reach 24 million units in 2028, of whichThe popularity of new energy is faster, accounting for 50% this year and as high as 80% in the next four years.unlimited.
What many people may not know is thatMediaTek has been working in the automotive industry for more than ten years, has achieved fruitful results, and has maintained a momentum of continuous growth.
Among them, the global market shipments of Dimensity Automotive Cockpit Platform haveMore than 20 million unitsit is expected that by 2028, global cumulative revenue willOver $3 billion;
Dimensity’s automotive connection platform has been adopted by the world’s leading car manufacturers, and TOP15 car companies have won8 homesit is expected that by 2028 global shipments willMore than 30 million units;
Dimensity automotive satellite navigation system market share by 2023More than 40%power management chip shipments by 2023More than 200 million pieces;
In addition, the progress of Tianji Automobile driving platform is also very smooth.
In April 2023, MediaTek officially released a new integrated automotive solution-Dimensity Automotive Platform “Dimensity Auto”.
it includesFour major components: cockpit platform, connection platform, driving platform and key componentswith the characteristics of high computing power, intelligence, openness, energy saving and reliability.
Just a month later, MediaTek announced its cooperation with NVIDIA,Jointly develop SoC chips integrating NVIDIA GPU graphics and computing IP and Chiplet chip designproviding a complete AI smart cockpit solution for software-defined cars.
At the NVIDIA GTC conference in March this year, MediaTek officially announced a series of Dimensity automotive cockpit platform system-on-a-chip (SoC) incorporating AI technology, includingFlagship CT-X1, high-end CT-Y1/CT-Y0, mainstream CT-M1, entry-level CT-V1,All support NVIDIA DRIVE OS car system software.
Regarding the in-depth cooperation with NVIDIA, You Renjie, senior deputy general manager of MediaTek and general manager of China Unicom’s Metaverse Business Group, told Kuai Technology,This is based on many considerations, and it is not just hardware cooperation, nor short-term cooperation, but a long-term future layout.including the integrated layout of smart cockpit and smart driving, which is the so-called cabin-driving integration.
Secondly,The two companies are quite complementary and cooperation can bring more added value to each other.such as MediaTek's low-power IP, such as the full product line layout of high, middle and low-end, can demonstrate competitiveness through cooperation.
In addition, NVIDIA is now the leader of the entire AI ecosystem, regardless of hardware SoC, software, or the entire ecosystem.MediaTek hopes to use mutual cooperation to accelerate MediaTek’s layout and development in the first year of the AIGC wave.and also bring better choices to the ecology and the industry.
in,The flagship CT-X1 uses today's most advanced 3nm manufacturing process, which is still the first in the automotive industry and the second 3nm process chip in the world after Apple's A17 Pro.
The high-end CT-Y1/Y0 also uses a very advanced 4nm process.
Such high-end technology can greatly improve the integration and performance of chips, especially multi-chip die designs, and significantly reduce power consumption and heat generation, thereby providing more powerful solutions in a more limited space.
The detailed specifications of both have not been announced. Currently we only knowBased on the latest ARMv9 CPU architecture.
MediaTek revealed,Currently, more than 6 domestic leading car companies have adopted CT-X1 and CT-Y1/Y0 platform solutions.but according to industry practice, we need to wait for the car company to announce it on its own.
CT-X1 has a built-in powerful APU AI computing unit, and its AI computing power is said to be 20% higher than the flagship product in 2023.and adopts advanced heat dissipation design to ensure the complete release of performance.
Integrate simultaneouslyDevice-side AIGC mixed-precision INT4 lightweight technology and memory hardware compression technologywhich can not only meet the accuracy of AI operations, but also more efficiently utilize memory capacity and bandwidth.
it can supportDevice-side offline application of 13 billion parameter large language model, 13 billion parameter multi-modal AIGC modelcan run a variety of mainstream large models and AI drawing functions (Stable Diffusion, etc.) in the car, and the drawing can be completed in less than 1 second.
The performance of CT-Y1 is slightly lower,Large model parameters reduced to 7 billionbut it can still generate pictures in less than 1 second.
With such a computing power foundation, advanced AI safety and entertainment applications such as in-vehicle voice assistants based on 3D graphical interfaces, rich multi-screen interaction and display technologies, and driving alertness monitoring can all be run in the Dimensity cockpit.
In addition, MediaTek also provides powerful multimedia support for vehicle system needs.“One core, multiple screens” can connect more than 10 screens (CT-Y1 6 screens)can be configured with three sets of 3K resolution high-definition screens, as well as MiraVision AI display enhancement technology.
The integrated ISP unit supports multi-channel cameras, AI-enhanced noise reduction and HDR; the integrated audio DSP supports surround sound effects.
Regarding car-machine interconnection, Zhang Yutai, deputy general manager of MediaTek and general manager of the automotive platform division, said that this is a very important matter. Mainstream Android and iPhone will definitely support it, and they will also learn from Huawei and continue to discuss with the ecosystem. Connecting a MediaTek mobile phone to a MediaTek car will give you a different experience.
So, why do we need to implement end-side AI in cars?
The current smart car cockpit relies on cloud AI. Although it can run large models with more than 100 billion parameters, it only has 1 billion parameters or even less on the device side. The performance is seriously insufficient, and there are deficiencies in latency and security.
MediaTek believes that,The future smart cockpit will be fully enhanced on the device side and can easily support large device-side models with 7 billion or even tens of billions of parameters. After being independent of the network, it can provide services at any time 24 hours a day. Of course, it can also greatly reduce latency and ensure personal privacy security. .
at the same time,The large multi-modal model is grounded end-to-end, enabling richer perceptions and applications both inside and outside the cabin.
For example, various new types of human-computer interaction such as voice, gestures, movements and even emotions in the cabin, and even in the car, it can also meet social interaction, as well as office needs such as calls, video conferencing, and summary summarization (of course in safety premise).
Outside the cabin, AI can be used to identify surrounding scenes and signs, especially assisted parking.
At present, Tianji Automotive Cockpit Platform has more than 25 AIGC partners, and large models have supported Meta Llama 2, Baidu Wenxinyiyan, Baichuan, etc.
MediaTek also provides a full suite of NeuroPilot development tools, which can adapt to large models with different parameter sizes ranging from 1 billion to 13 billion. It also supports model compression technology and the memory optimization efficiency exceeds 40%.
In terms of satellite communications, MediaTek not only provides powerful NR-NTN functions,It is also the world's first Ku band to support mainstream satellite communications and has been introduced into the car cockpit platform.its available bandwidth is significantly higher than FR1, and it also supports 6G FR3 synergy.
At the same time, MediaTek also has a series of innovative satellite communication technologies, such as Ku-band UE phased array, ephemeris-based UE beam forming, etc.
Of course, the global satellite positioning and navigation system is also indispensable, supportingL1+L5 dual-band, GPS/Beidou/Galileo/GLONASS/QZSS, WAAS (Raytheon Wide Area Augmentation System)/EGNOS (ESA Receiver Satellite Navigation System)/MSAS (Japanese Multifunctional Satellite Augmentation System) )/GAGAN (Indian GPS-assisted geostationary earth orbit augmented navigation system), high-precision IMU, horizontal and vertical accuracy are less than 1.5m and 2.25m CEP respectively, and speed accuracy is 0.05m/s.
In terms of 5G communications,By integrating advanced AI baseband, it supports the next generation of 3GPP R17 and even future 3GPP R18 solutions.compared with the previous generation, it can provide higher throughput, lower power consumption, and better coverage (such as cell edge).
In terms of Wi-Fi connection, all series come standard with 2.4/5GHz dual-band concurrent, dual or three antennas.The limit rates of Wi-Fi 6 and Wi-Fi 7 reach 1.2Gbps and 6.4Gbps respectively.covering applications such as in-car streaming, out-of-car OTA, in-car entertainment and rear-seat entertainment, and hotspot access.
At the same time, one chip integrates two Bluetooths, andThe latest Bluetooth 5.4 standard, Bluetooth LE Audio audiowhich can cover the main and co-pilots at the same time.
By the way, MediaTek also provides comprehensive support for automotive safety standards, including AEC-Q100 Level 2 automotive certification as standard for all series.
It also has high-definition AVM, DMS, and OMS, and supports 10 image inputs, 5 image outputs, and dual-screen display of instruments and central control.
Dimensity smart cockpit three-domain integration mass production platform:
7nm process, three-in-one integration of vehicle terminal, gateway, digital key and other functionsand combined with the domestically independently developed secure microkernel and high-performance HyperVisor, it performs well on key performance indicators such as GPU loss.
Dimensity Automotive AIGC Application News Selection:
Based on a large model with 7 billion parameters, it can automatically summarize news in the categories that users are interested in in the past 24 hours.giving users a brief introduction when getting on the bus.
Users can also interact through natural and direct voice,The AI is further asked to summarize or even comment on the content of interest.
This application can also be extended to scenarios such as end-side call conclusion and meeting summary.
Dimensity Automotive AIGC Application Smart Car User Manual:
Through voice input query questions, the large model combines context to identify user intentions, search for information in the knowledge base, and integrate answer output based on the real-time status of the car.
Technically,It uses a terminal-side computing arbitration model to determine the user's problem and give results by terminal-side or cloud computing.
This not only ensures a fast and correct response, but can also be completed even when not connected to the Internet, ensuring full-time online operation.
Dimensity Automotive AIGC application quick Vincent chart:
The fast Vincent graph based on SDXL Turbo acceleration can change in real time according to different prompt words (Prompt).get different pictures at any time, and everything is done end-to-end.
It can also be extended to applications such as interactive graphics games.
Tianji Automotive AIGC Application Magic Pen:
Based on the AIGC image generation large model, users draw on the touch screen and combine voice or text prompts to generate exquisite paintings with just a few strokes.
In terms of technology, it integrates multi-modal interaction and can generate high-definition pictures.
Extended application scenarios include rapid interactive graphics, personalized cockpit themes, generative game applications, etc.
Today, AI is redefining thousands of industries, and the automotive industry is no exception.
AIGC is expected to reshape the immersive cockpit experience in all aspects such as human-computer interaction, driving experience, in-car entertainment, and social office.
Based on its strong technology accumulation in the chip industry, and the full cooperation with NVIDIA, industry ecological partners, and automobile manufacturers, MediaTek's newly created Dimensity Automotive Platform not only has strong performance, innovative applications, and integrated ecology, but also opens up the automotive industry. A new chapter for on-device AIGC.
As the industry's top automotive computing platform, Dimensity Automotive not only provides flexible software and hardware platforms, mature tool chains, but also an increasingly rich AIGC ecosystem, which can help car companies quickly deploy AI functions to all models and promote the automotive industry. Entering a new era of “AI-defined cockpit”.
