Toshiba's key technology inventory of ADAS based on image processing

According to data from market research institute IHS, ADAS will develop at a high speed in the next few years. In 2019, the installed capacity in the Chinese market is expected to reach 25 million, which means that more than 80% of vehicles will be equipped with ADAS. According to the specific analysis, the most loaded vehicles are parking assistance (reversing moving object recognition, automatic parking), front vehicle collision warning, blind zone detection, and the maturity of the technology will increase. From the perspective of the global market, blind zone detection, lane keeping, and front-vehicle distance probes are the main standard of ADAS. In 2019, they will reach 1,280, 1,700, and 24.7 million units respectively. In the case of Tan Hong, deputy director of the industrial and automotive chip market development department of Toshiba Electronics (China) Co., Ltd., as the cost of hardware products is reduced, the heat and capacity of ADAS is much higher than the data predicted by IHS.

This article refers to the address: http://

1.jpg

Tan Hong, Deputy Director of Industrial and Automotive Chip Market Development, Toshiba Electronics (China) Co., Ltd.

Tan Hong said that the installed capacity and popularity of ADAS, in addition to the rigid needs of users, national regulations are very important driving factors. For example, Euro-NCAP requires automatic braking systems (AEB). In 2018, pedestrians and cyclists need to be identified at night and in low light conditions, and automatic emergency braking is required. In order to meet regulatory requirements, automakers in various countries are accelerating the development of various functions of ADAS.

"Toshiba, as a chip manufacturer, has long-term cooperation with European and Japanese automakers and world-renowned automotive electronics manufacturers. In combination with regulations and requirements of OEMs and auto electronics manufacturers, it has made the required ADAS applications for the next five years. Pre-development." Tan Hong said.

Image processing based ADAS application

Multi-sensor fusion is the trend of ADAS and autonomous driving, while Toshiba mainly provides ADAS applications based on high-precision image recognition technology. Tan Hong said that Toshiba has been developing image processing technology since the era of CRT TVs. In this field, it has accumulated more than 30 years of technology and many international patents.

“The first application to ADAS was a relatively low-cost radar sensor, such as a reversing radar. But with the high-end applications of ADAS, such as detecting pedestrians, bicycles, and opposite headlights, radar can identify objects due to their characteristics, but it is impossible to judge People, cars, etc. Image sensors can collect rich information in this regard. As far as the future development trend is concerned, the ADAS sensor combination is based on images and radar.

Tan Hong said that image recognition technology is widely used in the field of ADAS and has considerable potential and market. Through image recognition technology, it solves/compensates the short plates of current radar (millimeter wave radar, laser radar, etc.) sensors, achieving high precision while providing extremely high cost performance.

"Toshiba has been developing ADAS applications since 2003. The product line is called Visconti. The second generation (Visconti2) is now in volume production. It started in November 2015 and was delivered to the Toyota Prius production car through the products of Nippon Denso. It is put into the market in large quantities and has a monthly global shipment of more than 30,000 units. In China, it also cooperates with some leading companies in the ADAS field and plans to launch it into domestic production vehicles by the end of 2016."

"Toshiba's latest Visconti four generations have been launched. We are also working with European car manufacturers to develop the Visconti five generations, to make newer technical preparations, including the provision of new products."

“At present, in addition to the daytime use environment, the Visconti product line is also enhanced in rainy/night environment. In conjunction with new European/US requirements for active safety, Toshiba is developing new features such as night/low light conditions. Pedestrian detection." Tan Hong told reporters.

The core technology of image processor

According to Tan Hong, the Toshiba image recognition processor uses a multi-core heterogeneous dedicated processor. Visconti2 can process in real time and realize four functions in parallel, such as lane keeping, front vehicle detection, pedestrian identification, and traffic sign recognition. The Visconti four-generation feature is further enhanced to handle/implement 8 functions simultaneously.

"We use a chip, through parallel processing, on the one hand to reduce power consumption, on the other hand to improve real-time processing capabilities, processing feedback within 100 milliseconds, enhance security. In addition, Visconti uses a large number of hardware image accelerators / algorithms Accelerator, software development burden is light, development cycle is short." Tan Hong told reporters.

Compared with other automotive electronics, ADAS has a very large amount of software development. “In addition to providing hardware to our partners, we also provide drivers and basic algorithms. Algorithm optimization based on Chinese road conditions is developed by partners or vendors.” Tan Hong uses the cooperation with Denso as an example: We provide electricity. The image processor installed has a recognition rate of 95% under certain test conditions, but this does not meet the requirements of the manufacturer. After using our image recognition chip, plus millimeter wave radar and optimization algorithm, the recognition rate can reach more than 99%. "Our partner's requirements are to have certain software development capabilities, otherwise it will be difficult to introduce mature products."

Tan Hong pointed out that in addition to the basic algorithms, the key to the image processor lies in the application of real-world scenarios. For example, the detection and discrimination of different obstacles on the road. "There are various situations on the road to reality. How to determine the algorithm requires us to work together with our partners." According to Tan Hong, Toshiba has been associated with leading domestic universities and leading automotive electronics companies such as Tsinghua. Cooperation.

Tan Hong concluded that Toshiba has more than 10 years of experience in ADAS development. It has extensive and mature mass production applications in Europe and Japan. It has been promoted in the Chinese market since 2015 and hopes to cooperate with more Tier1 suppliers and car manufacturers in the future. Together to promote the application of ADAS in the Chinese market.

Wenzhou Korlen Electric Appliances Co., Ltd. , https://www.zjaccontactor.com

Posted on