:::

【2021 Application Example】 HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module. In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95%.

VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and AR/VR. VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics.

VCSEL technology has broad applications, including in drones. (Pictured: Zoyi Technology's Agricultural Drone)

▲VCSEL technology has a wide range of  applications, including in drones. (Pictured: Zoyi Technology's Agricultural Drone)

VCSEL technology has a wide range of applications, AI technology assists in defect detection

HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness. One of the key problems is the replacement of glass lens with epoxy resin lens. The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses. Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized. The release of stress caused by heat during the mounting process will directly cause the optical lens to break.

HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important. Under the constraints of packaging space, the space for fitting the package and optical lens is limited. Moreover, the optical lenses will be confined to a metal frame. If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10% in the VCSEL package reliability verification, resulting in an increase in production costs.

In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance. Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality. The problem of image collection needs to be solved first to successfully collect image data.

Therefore, HRT Technology first developed an Automated Optical Inspection (AOI) device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images. After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening. Manual labeling is carried out according to the image classification above, including: samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out. Residual neural network (ResNet) or other related algorithms are used for deep learning to identify the quality of lenses.

Implementation of AOI inspection improves production efficiency by 20% and above

Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance. The lens is packaged on the VCSEL package that has completed die bonding. After passing the general light up test, the final reliability test (high temperature reflow) is performed. Failed samples go into the rework process.

However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95% and above in the reliability verification. This is expected to help companies reduce production costs by 10% and increase production efficiency by 20% and above.

The difference before and after the introduction of AI image inspection.

▲ The difference before and after implementing AI image detection

HRT Technology pointed out that this technology is an AI application developed based on tiny images. It uses deep learning algorithms to identify defects in the images. The trained network automatically classifies image data to predetermined categories. Defect categories can be determined through reference images, so cumbersome programming is not required.

In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts. In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink. This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future.

Recommend Cases

這是一張圖片。 This is a picture.
Realizing the dream of unmanned stores, Magpie Life is building the future of the smartphone industry

"The DNA of Magpie Life is not limited to vending machines We believe that vending machines combine technology, access, and humanities to bring us exciting results" This is a sentence on the official website of Magpie Life Let the vending machines bring To live a pleasant life and build a considerate, technological and sustainable future for the smartphone industry is also the original intention of Magpie Life Founded in 2018, Magpie Life launched Taiwan’s first private-brand mobile payment scan code sensor 4 months after its establishment, completing the consumption experience through screen touch The Magpie U1 smart vending machine manages the POS system and gathers data in the background, allowing consumers to synchronize with the world's new retail pace and experience a new retail consumption experience of purchasing convenience, checkout security, visual entertainment, and improved logistics replenishment efficiency Traditional vending machines lack information visibility and AI technology assists in information transparencyThis time, the Magpie smart vending machine is also equipped with AI technology to provide adjustable shelf space , a vending machine equipped with an industrial computer and a large-size touch display screen to achieve the purpose of a store-less store Magpie Life stated that the biggest problem with traditional vending machines is the lack of information visibility To check inventory, replenishment personnel must physically inspect each machine, which is time-consuming and costly When a machine breaks down, it will generally be unable to operate for a long time Most failures go unreported and are not discovered until the next restocking crew arrives to replenish supplies Then you have to wait for a service technician to be scheduled, which can take weeks Traditional vending machines lack real-time interactivity When consumers encounter problems after inserting coins, manufacturers cannot handle them immediately In addition, traditional vending machines are less flexible and cannot adapt to changes in consumer preferences Traditional vending machines have shortcomings such as limited change shopping, single payment tools, limited number of products, and few choices Affected by the COVID-19 epidemic, consumption habits have shifted to contactless methods, causing the unmanned store market to heat up Generally, vending machines can only place relatively simple products such as drinks, food, etc The properties available for sale are limited The patented vending machine developed by Magpie can adjust the shelf space and is equipped with a lifting cargo elevator, which is suitable for various types of goods In addition, the machine is equipped with an industrial computer and a large-size touch display screen, which can meet the needs of advertising support at the same time It is expected to move towards a storeless store According to Magpie Life Observation, the consumer market trend in the past two years is that consumers demand convenient life, food consumption patterns value dining experiencesimple and fast, and are equipped with mobile phone-connected ordering models, and hot drinks and Fresh food delivery is the focus of two major trends The location, items sold, consumption methods and multiple payment methods are the focus of market growth for smart vending machines In terms of convenience, Taiwanese consumers still prefer to purchase vending machine food near stations, airports, schools, and businesses in business districts Various payment methods are also gaining more support from consumers, indicating that in the future, automatic Vending machines can be developed in two directions diversified items and diversified payment methods AI sales forecast technology integrates back-end management to achieve precise marketing purposesDue to the wide variety of products, it is difficult to know the performance of products under different factors such as season, market conditions , promotional activities, etc, it is easy to cause out-of-stock or over-inventory situations Magpie Life has specially developed "AI sales forecasting technology" and integrated it into the back-end management system, hoping to lock in customer purchasing preferences and intentions through data analysis In order to achieve the purpose of precise marketing, make accurate business decisions and effectively allocate limited resources The introduction of AI systems can achieve the three major goals of precise marketing, inventory management and supply chain management This system is a replenishment decision-making aid designed specifically for supply chain managers It uses AI to predict future sales demand, helping companies effectively optimize production capacity, inventory and distribution strategies Its overall system architecture includes1 Data exploratory analysis function Provides automatic value filling, automatic coding and automatic feature screening functions for missing values in the data 2 Modeling function 1 Provides model training functions for two types of prediction problems regression Regression and time series Time Series Forecast nbsp2 Supports Auto ML automatic modeling, and the best model is recommended by the system Integrated models can also be established to improve model accuracy nbsp3 Supports multiple algorithm types Random Forest, XGBoost, GBM and other algorithms nbsp4 Supports a variety of time series models exponential smoothing, ARIMA, ARIMAX, intermittent demand, dynamic multiple regression and other models nbsp5 Supports a variety of model evaluation indicators R, MAE, MSE, RMSE, Deviance, AUC, Lift top 1, Misclassification and other indicators nbsp6 Supports automatic cutting of training data sets and Holdout verification data sets, and can manually adjust the ratio nbsp7 Supports automatic model ensemble learning Stacked Ensemble, balancing function learning Balancing Classes, and Early Stopping nbsp8 Supports the creation of multiple models at the same time The system will allocate resources according to modeling needs, so that modeling, prediction and other tasks have independent computing resources and do not affect each other In the overall server space With an upper limit, computing resources can be used efficiently nbsp9 It has in-memory computing function, which can use large-capacity and high-speed memory to perform calculations to avoid reading and writing a large number of files from the hard disk and improve computing performance 3 Data concatenation function Using API grafting and complete data concatenation automation, there is no need to manually import data, improving user experience 4 Chart analysis function Provides visual charts and basic statistical values for product sales AI data analysis solutions have two major advantages 1 Entrepreneurship machines can be rented and sold at low cost to open unmanned physical stores and cooperate with the chain retail industry Through smart machines, entrepreneurs can rent and sell them at a lower cost than the store rent Cost of running a retail business Two cooperation models, machine sales and leasing, are provided, and the choice is based on the evaluation of the industry 2 Various types of products are put on the shelves Products are sold anytime and anywhere 24 hours a day Up to 60 kinds of diversified products can be put on the shelves Large transparent windows enhance the visibility of products Regular replenishment and tracking of product sales status are available, and product types can be adjusted according to needs Recently, the line between the Internet and the physical world has blurred, the way customers interact has changed significantly, and consumer demand is changing and personalized The retail industry is facing unprecedented challenges and uncertainties, and mastering data has become key AI data analysis solutions can help the retail industry quickly activate large amounts of data, create seamless personalized experiences, optimize the operational value chain and improve efficiency, and strengthen the core competitiveness of enterprises 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】巨量遙測空間數據AI分析雲端服務平台 使衛星遙測影像順利落地應用
AI Analysis Cloud Service Platform for Remote Sensing Big Data Enables the Smooth Application of Satellite Remote Sensing Images

Although satellite remote sensing images can make all surface objects visible, it still requires a lot of time and manpower to be truly applied to the industry In order to effectively solve the problems that customers face in digesting huge amounts of image data and eliminate technical obstacles for cross-domain users to process satellite remote sensing images, ThinkTron has developed an "AI Analysis Cloud Service Platform for Remote Sensing Big Data" as a new beginning for cross-domain AI applications for spatial information In recent years, in response to the impact of industrial globalization, Taiwan's agriculture has continued to transition towards technology-based and higher quality, improving the yield and quality of crops by solving problems, such as microclimate impacts and pest and disease control The demand of agriculture on images has expanded endlessly to accurately grasp the growing environment of crops In the early years when UAVs unmanned aerial vehicles were not yet popular, manual field surveys were the most basic but most labor-intensive work With the emergence of UAV drones, aerial photography operations might not be difficult, but the range that can be photographed is limited Furthermore, surveying expertise is required to accurately capture spatial information At this time, the use of satellite remote sensing data may break away from the past imagination of using image data Taiwan Space Agency TASA ODC data warehouse services In the past ten years, with the breakthrough of modern satellite remote sensing application technology, Digital Earth has become a new trend in global data collection Countries have developed data cube image storage technology, and the development of smart agriculture has become one of the largest image users Determining planting distribution is the first step in understanding crop yields Free satellite remote sensing images, powerful data warehousing support, and the team's robust image recognition technology are important supports for accelerating agricultural transformation Using satellite remote sensing image data can accelerate the development of smart agriculture However, in the past, it was difficult to extract large-area crop distribution through satellite remote sensing images, not to mention the cost If you wanted to use free information, you had to visit all websites of international space agencies, look through the wide variety of satellite specifications, and carefully evaluate the sensor specifications, image resolution, and revisit cycle After finding suitable images, you had to look at them one by one to filter the ones you need Next is downloading dozens of images that are often several hundreds of Megabytes MB each, which might exceed the capacity of your computer Also, after overcoming image access and preparing data, you must then start to confirm the downloaded image products and which bands you want, because the image you see is not just an image file jpg or png, but rather complex multi-spectral information, attribute fields and coordinate information It takes a lot of effort just to confirm the correct information Facing GIS software packages with complex functions is the start of another trouble The complex image pre-processing process and the inflexible machine learning package greatly reduce the efficiency of analyzing data After finally getting the results of crop identification, you might find that the best time for using map information may have already passed The above-mentioned complex and time-consuming satellite image processing problems are precisely the pain points of the market ThinkTron expanded from traditional machine learning to modern deep learning applications, and developed an "AI Analysis Cloud Service Platform for Remote Sensing Big Data" under the GeoAI framework, breaking through the constraints of details in the spatial information for customers Differences between the process before and after introducing the AI analysis cloud service platform ThinkTron said that Taiwan's ODC Open Data Cube system has been completed and began providing services after years of efforts from the Taiwan Space Agency TASA, formally becoming aligned with international trends The powerful warehousing technology allows users to easily capture and use image data of a specific time and spatial range according to their needs The warehouse stores multiple satellite image resources from international space agencies, including the ESA's Sentinel-1 one image every 6 days, Sentinel-2 one image every 6 days, USGS's Landsat-7 one image every 16 days, Landsat-8 one image every 16 days, and the domestic Formosat-2 one image every day and Formosat-5 one image every 2 days ThinkTron develops satellite image recognition tools based on Python Breaking free from the limitations of GIS Geographic Information System software packages, ThinkTron integrated GDAL Geospatial Data Abstraction Library based on Python, and considered computing efficiency and parallel processing when developing all tools required for satellite image processing and image recognition modeling, including coordinate system and data format conversion, grid and vector data interaction, and data intra-difference and normalization All of the tools are designed with AI applications in mind, and some commonly used tools are packaged into an open source package under the name TronGisPy to benefit the technical community ThinkTron utilized the team's understanding of satellite remote sensing images and the collected tagged data crop distribution maps to preset the image recognition modeling process, the required training data specifications, and dataset definitions This is imported into the machine learning LightGBM or deep learning CNN framework that was completed in advance, and the entire training process to be performed in the Web GIS interface, providing users with partial flexibility to freely filter images, confirm spatial and temporal ranges, select models, and adjust hyperparameters In addition to the operation of training models, it also provides historical models to output identification results, and finally displays the identification results of crop distribution on the Web GIS map In fact, agriculture is not the only industry that needs satellite remote sensing applications AI applications of spatial information have also appeared in various fields as companies in different industries aim to enhance their global competitiveness For example, surveying and mapping companies that have a large amount of map data can use the AI analysis cloud service platform to store map data while also accelerating the efficiency of digital mapping Under the severe global climate change and the risk of strong earthquakes, there is a wide variety industrial insurance, agricultural insurance, financial insurance, or disaster insurance are all inseparable from spatial information The use of remote sensing image recognition to understand insurance targets has long been an international trend AI Analysis Cloud Service Architecture for Remote Sensing Big Data

【導入案例】防患於未然 麗臺科技研發心臟衰竭AI辨識技術可及早發現病徵
Preventing Problems Before They Arise: Leadtek Research Develops AI Technology for Early Detection of Heart Failure Symptoms

With the increase in the elderly population, the incidence of various chronic diseases is rising daily Among these, heart failure is not only a silent killer it has a very long disease course with a high recurrence rate, leading to increased burden on healthcare personnel However, by using medically certified electrocardiography acoustics devices, coupled with AI predictive assessment of heart failure risk and remote care systems, diagnosis can be aided significantly, helping doctors make accurate diagnoses for subsequent patient medical care or referrals Heart failure has a lengthy course and medical expenditure is five times that of diabetes If you find yourself short of breath even with minimal movement, or if you wake up from sleep needing to sit up to feel comfortable, or if you have symptoms such as swollen lower limbs, anxiety, restlessness, fatigue, or a loss of appetite, be cautious These could be signs of heart failure According to statistics, there are about 60 million people with heart failure worldwide, with 5 million new cases every year In China, nearly 290 million people suffer from cardiovascular diseases, accounting for the second leading cause of death among urban residents around 12 million of these are heart failure patients, accounting for over 59 of cardiac-related deaths The disease course of heart failure is exceptionally long, and both its recurrence and rehospitalization rates are exceedingly high, resulting in medical costs that are twice that of hypertension and five times those of diabetes According to US research statistics, the 30-day mortality rates for patients with myocardial infarction and heart failure are respectively 166 and 111, and the rehospitalization rates within 30 days are 199 and 244 The symptoms of heart failure, because they are similar to those of other diseases such as chronic obstructive pulmonary disease and asthma, have an 185 misdiagnosis rate, which poses a challenging problem for healthcare institutions Leadtek, a major graphics card manufacturer, has been investing in the medical and healthcare sector since 2000 Following two heart attacks in 2011 and 2015 experienced by Chairman Lu Kunshan, Leadtek has focused on health big data, independently developing AI technology for heart failure recognition This AI application reads patients' electrocardiograms and phonocardiograms to perform anomaly detection and model prediction of heart failure risk, enabling early detection of disease symptoms Leadtek independently developed heart failure AI recognition technology to predict medical history and risk Leadtek's independently developed heart failure AI recognition technology has the following three judgment functions 1 Prediction of heart failure history Classifies electrocardiogram and phonocardiogram data into 'with hospitalization history of heart failure' and 'no history of heart failure' 2 Risk prediction of heart failure Provides a predictive risk value of heart failure occurrence based on the electrocardiogram and phonocardiogram data 3 Prediction of heart failure recurrence risk For patients with heart failure, it reads their phonocardiogram and electrocardiogram data, assessing the risk prediction of heart failure recurrence Leadtek states that the application of heart failure AI recognition technology can assist doctors in making more efficient and accurate diagnoses, facilitating subsequent medical treatment or referrals for patients As an instance, in studies of heart failure patients discharged from Taipei Veterans General Hospital, using the EMAT Electromechanical Activation Time index and SDI Systolic Dysfunction Index calculated by the synchronized electrocardiography-acoustic device as treatment guidelines resulted in a higher survival rate compared to those treated based on traditional symptoms This research has also been published in the authoritative international cardiology journal JACC, receiving recognition in the international market System manufacturers can apply heart failure AI recognition technology for other value-added applications Leadtek states that cooperating system manufacturers can choose to build their own heart failure AI risk prediction engine, uploading their system's electrocardiogram and phonocardiogram data to Leadtek's heart failure AI risk prediction engine, which then returns risk prediction values for integration by system manufacturers cooperating manufacturers as a value-added application input Not just for clinical use, the heart failure AI risk prediction engine can also be extended for use at home or in the workplace Additionally, this system can be extended to other applications, including One, hospital outpatient screening Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to conduct a 10-second rapid test in outpatient and emergency departments to assess a patient's cardiac history and heart failure risk Two, discharge risk assessment Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to assess the heart failure risk during a patient's hospital stay The test data can serve as a pre-discharge risk assessment and prognostic indicator Three, continuous home care Patients can use the electrocardiogram and phonocardiogram recorder, wearable electrocardiogram recorder, and transmit through a home transmission box gateway to measure electrocardiogram and phonocardiogram signals at home and upload them to the amor health cloud platform for heart failure AI risk prediction analysis Patients can manage their health autonomously via an APP, reviewing historical physiological trends disease management nurses can manage member health through the health management backend Web Four, home rehabilitation training Patients can wear a health bracelet to monitor activity, fatigue, circulation, and sleep, autonomously managing their health through the mobile APP and observing the risk of heart failure, engaging in exercise and rehabilitation training to aid in swift recovery The heart failure AI recognition technology system can also be extended to employee home care applications Additionally, in factories or offices, this system can also achieve employee health management goals, with applications including One, workplace safety units Provide employees with wearable electrocardiogram recorders before they start work duties Two, physiological monitoring for business executors While executing business duties or training, employees wear wearable electrocardiogram recorders for fatigue warnings, signaling whether physiological conditions allow continued execution of tasks Task segments can use data transmission boxes or apps to upload physiological monitoring information to the health management platform, assessing the heart failure risk for operations staff, with test data serving as an indicator for enterprise resource human units and public safety Three, workplace physiological monitoring center care The workplace physiological monitoring center can inspect and record employees' historicalphysiological trends through the health cloud platform Four, workplace nursing units Nursing units receiving instructions from the physiological monitoring center can provide health management advice based on employees' physiological trends nursing centers can manage employee health through the health management backend Web Five, employees can wear health bracelets to monitor activity, fatigue, circulation, and sleep, autonomously managing their health and observing the risk of heart failure through the mobile APP, engaging in exercise and rehabilitation training to aid in rapid recovery Workplace application of heart failure cloud care and big data center diagram「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」