:::

【2021 Application Example】 HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module. In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95%.

VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and AR/VR. VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics.

VCSEL technology has broad applications, including in drones. (Pictured: Zoyi Technology's Agricultural Drone)

▲VCSEL technology has a wide range of  applications, including in drones. (Pictured: Zoyi Technology's Agricultural Drone)

VCSEL technology has a wide range of applications, AI technology assists in defect detection

HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness. One of the key problems is the replacement of glass lens with epoxy resin lens. The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses. Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized. The release of stress caused by heat during the mounting process will directly cause the optical lens to break.

HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important. Under the constraints of packaging space, the space for fitting the package and optical lens is limited. Moreover, the optical lenses will be confined to a metal frame. If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10% in the VCSEL package reliability verification, resulting in an increase in production costs.

In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance. Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality. The problem of image collection needs to be solved first to successfully collect image data.

Therefore, HRT Technology first developed an Automated Optical Inspection (AOI) device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images. After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening. Manual labeling is carried out according to the image classification above, including: samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out. Residual neural network (ResNet) or other related algorithms are used for deep learning to identify the quality of lenses.

Implementation of AOI inspection improves production efficiency by 20% and above

Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance. The lens is packaged on the VCSEL package that has completed die bonding. After passing the general light up test, the final reliability test (high temperature reflow) is performed. Failed samples go into the rework process.

However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95% and above in the reliability verification. This is expected to help companies reduce production costs by 10% and increase production efficiency by 20% and above.

The difference before and after the introduction of AI image inspection.

▲ The difference before and after implementing AI image detection

HRT Technology pointed out that this technology is an AI application developed based on tiny images. It uses deep learning algorithms to identify defects in the images. The trained network automatically classifies image data to predetermined categories. Defect categories can be determined through reference images, so cumbersome programming is not required.

In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts. In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink. This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future.

Recommend Cases

【導入案例】屈臣氏導入insider AI 技術平台 加強客戶體驗提升轉換率
Watsons Introduces Insider AI Technology Platform to Strengthen Customer Experience and Enhance Conversion Rates

Watsons Taiwan, holding the leading position in physical chain drugstores in Taiwan, has continued to expand its digital transformation Since establishing Watsons' online store in 2014, apart from actively developing the e-commerce market, the company has significantly enhanced the online and offline OO omni-channel consumer experience by integrating Insider AI technology This integration utilizes extensive in-store sales data, consumer behavior analytics, and AI-driven personalized recommendations delivered at optimal times to increase conversion rates OO Online Plus Offline Boosts Customer Conversion Rate, Driving Business Growth Watsons Group, a global retail giant, has been deeply rooted in Taiwan for the past 30 years specializing in retail, store operation SOPs, and retail supply chain optimizations However, managing an e-commerce platform only began a few years ago Unlike the commonly discussed 'O2O' online to offline in retail, Watsons adopts 'OO', which is offline plus online Currently, about 20 of customers who order at Watsons' online store choose to pick up their goods at physical stores Proper service at these stores acts as a catalyst for converting online-originated customers into additional in-store revenues According to statistics, Watsons has nearly 6 million members with a substantial volume of transactions in physical retail outlets However, with over 12 million active app users and nearly 3 million app downloads, the level of member activation is still lacking By utilizing AI technology for data integration, such as providing optimized product recommendations through AI, Watsons could significantly enhance its customer conversion rate from offline to online consumption or guide online customers to in-store purchases, thereby driving business growth Homepage Personalized Recommendation Module Recommended for You Originally, Watsons used the e-commerce solution Hybris from the global system integrator SAP, which was more geared towards simple display and sales, lacking sufficient technical resources to handle enhancing the consumer experience Insider is a marketing technology martech company with offices in 25 cities globally, including a professional consultancy team in Taiwan that provides localized digital solutions Committed to optimizing digital marketing effectiveness with technology, Insider helps brands drive digital growth and is a partner to many domestic and global enterprises including Watsons, Carrefour, IKEA, Lenovo, Adidas, Sinyi Realty, and Singapore Airlines Insider has shown outstanding performance in improving customer conversion rates, repurchase rates, and advertising ROI through AI technology Watsons introduced Insider's AI algorithms primarily for enhancing customer experience, using AI's personalized and integrated marketing modules to elevate the customer interaction and improve e-commerce conversion rates Additionally, AI functionalities search for the right customers, expanding new customer groups and providing a superior shopping experience Page-specific Discount Code Copy Feature Recommended Based on Customer Behavior Insider has developed various technological modules that can be applied in different customer scenarios to enhance conversion rates Currently, Watsons' e-commerce websiteAPP utilizes different Insider modules, with some parts also tailored based on Watsons' unique attributes such as necessities repurchase, app navigation, and scratch card discounts, designing conversion kits or personalized recommendation modules for specific customer situations within Watsons Introduction of WebAPP Personalized Recommendation and Conversion Module Kits Effectively Increases Conversion Rates by 10 Watsons has already introduced the first four of the planned modules, with a full rollout of all five modules expected by 2021, aiming to enhance both online and offline cross-sales and thereby comprehensively improve Watsons’ overall e-commerce and retail performance 1 Web RecommendationConversion Suit 2 App RecommendationConversion Suit 3 InStory for eCommerce 4 Mobile App Template Store 5 Insider Architect Watsons has currently implemented the AT module, with completion expected by the end of 2021 Since partnering with Insider in 2020, Watsons has introduced WebAPP personalized recommendation and conversion module kits, effectively increasing transaction conversion rates by an average of over 10, with ROAS Return on Ad Spend averaging over 10 Watsons also hopes to integrate POS sales records into Insider's CDP Customer Data Platform to achieve a more optimized OO interaction mechanism and complete an all-channel consumer experience By combining Insider's AI technology, Watsons' self-operated official website, supplemented by extensive in-store sales data and member consumer behaviors, along with AI's personalized recommendations delivered at optimal points, the technology will significantly boost consumer transactions online and interactive opportunities in-store Utilizing new technologies in the competitive e-commerce sector allows Watsons to maintain a unique leadership position in the beautyhealth category in the consumers' minds「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】化身大型AIOT科技遊樂場 海科館華麗轉身好吸睛
Transforming into a Large-Scale AIoT Technology Playground: The Spectacular Makeover of the National Museum of Marine Science & Technology

Taiwan is a maritime nation When you visit the Badozi Fishing Port or Tidal Park in Keelung, do you also explore the mysteries of the ocean world at the 48-hectare National Museum of Marine Science amp Technology To get more people closer to marine technology, Keelung's Marine Museum has introduced technological services, transforming the venue into a large technology playground that delights both children and adults, fully utilizing the 'learning through play' approach After a lengthy planning process, Northern Taiwan's largest marine science museum in Keelung opened in January 2014 The museum focuses on marine education and technology, boasting Taiwan's largest IMAX 3D ocean theater The unique themes and modern viewing facilities should make it a well-known landmark in Keelung However, the original exhibition planning was static and highly specialized, lacking sufficient interaction with the public Visitors who have attended the museum also reported that the exhibits were limited and quite boring, leading to poor overall consumer experience ratings The top three dissatisfactions with the museum were weak connections to surrounding attractions, unengaging display content, and lack of exhibit material According to statistics from the Marine Museum, the ratio of local to visiting guests is approximately 64, with most foreign visitors coming from the north transportation is primarily by car and bus common types of visits include family, parent-child, and friends and the stay duration is generally 1 to 2 hours Upon deeper investigation, the top three visitor complaints were weak linkages to surrounding attractions, unengaging display content, and insufficient number of exhibits The museum analyzed potential reasons, including some displays being too specialized, making it difficult for the public to understand, and a lack of interactive elements, making the exhibition boring and the visit hurriedly brief Analysis of visitor profiles revealed that since half of the museum's visitors are locals, and accessing the museum is not so easy for out-of-towners who must travel by car or public transport, the design of the venue and exhibitions must incorporate more interactivity and intrigue to encourage locals to return and extend the duration of visitors' stays while using technological services to highlight the museum's unique features Through a recommendation from the Information Software Association, part of the Ministry of Economic Affairs' Industrial Bureau AI team, the Marine Museum commissioned Jugu Technology to resolve the issue of uninspiring venue attractions Preliminary interviews by Jugu Technology revealed that many visitors were attracted by the architectural design of the museum, notices posted on nearby walls, flags, or events being held the most interesting feature for visitors was the 3D ocean theater, indicating that content presented through audio-video and physical scenic methods was more engaging Seven major AI technologies lead to a boost in regional tourism at the Marine Museum Through the introduction of technology services, Jugu Technology designed the 48-hectare site with seven major services AI voice tours, treasure hunt puzzle games, AI exhibit interactive revitalization, AI space exhibition interactive experience, AI crowd control, Face AI interactive experience, and AI voice customer service system By utilizing AIoT and cloud technology, they made the exhibition more interesting, not only solving the issue of boring static viewings for children but also doubling the learning efficiency and dramatically improving public perception of the Marine Museum, thus increasing visitor intent and boosting regional tourism The National Museum of Marine Science and Technology introduced seven major technological application services including AI voice guide Jugu Technology aimed to improve the space optimization of the Marine Museum, using the special exhibition of coastal birds in northern Taiwan as a prototype, integrating 'face', 'limb', 'crowd' as three main axes to enhance functionality and assist in improving the museum's application of AI Practically, the Marine Museum and Jugu Technology selected the on-site special exhibits to avoid any installation of water and electricity works or pipelines in active exhibits, thereby maintaining the quality of the viewing experience Instead, they selected exhibits that were not yet open to introduce a series of technological services tailored to the unique characteristics of the exhibits In the coastal bird special exhibition inside the Marine Museum, initial construction discussions with the curators utilized Bella X1 for a welcoming interactive introduction at the exhibition entrance This was followed by an AI-powered smart guide in both Chinese and English using X1 for narration, coupled with a fun treasure hunting stamp-collecting activity - APP X1, allowing visitors to participate in challenges Subsequently, bird species within the bird exhibition were brought to life interactively using X1, and AR scenarios X1 were introduced into the exhibition space to add elements of fun and entertainment Finally, Face AI was used to interactively test facial expressions and score smiles The gorgeously transformed Marine Museum will become the best travel destination for families with children ImageMarine Museum FB Page The AIoT services introduced by the Marine Museum could be extended to various exhibition-type museums and even static art galleries in the future, tailored to the unique characteristics of different venues They could also be promoted through government projects and related plans, aiding in rural revitalization, making visits more than just sightseeing in rural areas, and breaking free from stereotypes associated with different venues The applications of these services are broad「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】海量數位工程AOI機器智能手臂檢測系統 大幅提高瑕疵檢測精準度
Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection Generally, the yield rate of products affects the costs for enterprises and the return rate for customers The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor Although there is AOI equipment to assist, these tools are mostly fixed detection machines Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5, and can be as high as 20 Three major pain points in manufacturing quality detection Robotic Arm AOI with dynamic multi-angle inspection helps to solve these issues According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry Pain point one, manual inspection of product quality is prone to errors Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production Pain point two, inability to quantify and record data from quality inspections Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet Pain point three, limitations of traditional AOI visual inspection systems Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations This method may handle flat or linear-shaped products like rectangular or square items at a single inspection point However, it is more challenging to implement for products with complex shapes eg, irregular automotive parts, requiring multi-point and multi-degree inspections Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular Selected the automotive industry as the real-world testing ground to quickly respond to customer needs The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates Automotive components are high in unit price and demand a stricter defect detection accuracy In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy Therefore, the automotive sector was chosen as the area for introduction By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs Helps to reduce communication costs and aims to become an industry standard In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis Data Analysis, based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain Supply Chain more swiftly Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application Self-driving vehicle developed by Massive Digital Engineering「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」