:::

【2021 Application Example】 Optical industry AOI imports AI Great Leap Forward to completely solve the pain points of lens defect detection

The stay-at-home economy such as smartphones and remote working is booming, and the information and communication industry is booming, driving the optical industry to flourish. However, the defect detection of optical lenses is mostly carried out by human eyes, which is not only time-consuming and labor-intensive, but also limited by the fact that human eyes are prone to fatigue. The misjudgment rate is also a lingering pain point for the optical industry. Benefiting from the evolution of AI technology, Shangyang Optics introduced diffraction optical technology for shooting, used the images captured by the system as the data source, introduced AI model training, and integrated the camera system and image recognition into a production line workstation, greatly improving defect identification The rate is as high as over 90%.

Taiwan’s optical production value accounts for 10% of the world’s, and the application range of precision optics is expanding day by day

The optical industry is a mainstream product in consumer electronics. Even though Taiwan was affected by the Sino-US trade dispute in 2019, the output value of optoelectronics still reached US$46.3 billion, accounting for 10% of the world's total. Among them, the "precision optics" segment accounts for NT$87 billion (approximately US$2.9 billion) in output value. In view of the increase in the number of smartphone lenses, precision optics still maintains a sustained growth of 4% compared to the decline in other fields.

Since Sharp launched the world's first camera phone equipped with a rear 110,000-pixel lens in 2000, end consumers' requirements for smartphone camera performance have continued to increase, and with the wave of 5G high-speed Internet The advent of the technology has led to the activation of application markets such as augmented reality (AR) or virtual reality (VR). The innovation and application of its technology have added a lot of momentum to the optical industry, and the application fields have extended from smartphones to popularization. to the mass consumer markets such as automobiles and home entertainment.

Optical lenses are inseparable from the economic development of "precision optics". As semiconductor technology continues to mature and network speeds continue to increase, optical lenses are used not only in smartphones, tablets, traditional cameras, projectors, In the field of people's livelihood vehicles, the demand for engineering visual inspection and security applications in high-precision manufacturing processes continues to grow rapidly.

Optical lens defects Detection is mostly done manually.

▲ Optical lens defect detection is mostly done manually.

"Optical lenses" are essential components of the overall optical-mechanical system. The lens finish inspection after incoming materials and before shipment not only affects the overall production line efficiency development, but also has an impact on the quality commitment of end customers that cannot be underestimated. For a long time, the optical industry has mostly used human eye detection for defect inspection. As production volume continues to increase, not only labor costs continue to rise. As inspectors age, their eyesight gradually declines, and the misjudgment rate increases every year. In addition, manpower recruitment has been difficult in recent years. Even if they are lucky enough to be recruited, it is not easy to develop the inspection technology, and the training time is lengthy, making it impossible to respond to the production line manpower needs in a timely manner.

Introducing diffraction optical technology and AI training model to improve defect recognition rate to more than 90%

The current market is flooded with a large number of automated optical inspection systems, and there are many substantial cases of lens defects. However, after years of market exploration and evaluation by Shangyang Optics, this system still cannot solve the current manual inspection problem. The main reason is that the appearance of the optical lens is curved and transparent, and it is not easy to photograph various defects, and once the defects are around There is interference from other stray lights, making judgment more difficult. Moreover, different types of lenses need to be individually rotated and lit and adjusted according to the defect status before entering the judgment stage. The labor consumption ratio is still high, which is not in line with the efficiency and cost.

Through this, through the matchmaking of the AI ​​project execution team of the Industrial Bureau of the Ministry of Economic Affairs, Xiaoma Optics assisted Shangyang Optoelectronics in establishing an effective defect photography system. Pony Optics provides guidance on precision diffraction optics. Based on the characteristics of "light" fluctuations, lens defects can be obtained through a unified lens shooting method. Current photography systems on the market mostly use geometric optics. Geometric optics uses linear light and is not easy to capture defects such as missing coatings, tiny scratches, and liquid dirt. The cooperation plan introduces diffraction optical technology for shooting. Through precise imaging from all angles, it can achieve higher contrast and better noise reduction than ordinary geometric optical elements, so as to obtain the necessary defective images.

Image of scratches and defects on the optical lens.

▲Schematic diagram of optical lens scratches and defects.

In order to improve the more detailed defect detection and recognition rate in this case, Shangyang Optics used the image captured by the system as the data source, imported AI model training, and integrated the camera system and image recognition into a production line workstation, which not only improved the defect recognition rate Reaching more than 90%, it is more conducive to the subsequent development of automated production lines.

The AI ​​model training for this cooperation project is provided by Yirui Technology. Currently, most manufacturers have introduced AOI systems for production line defect inspection. Most of them use OCR (optical character recognition), which refers to the analysis and recognition processing of image files of text data. , the process of obtaining text and layout information) technology needs to be 100% accurate, and there is no room for error, resulting in accidental killings often occurring.

After adding the AI ​​training model, optical lens defects The recognition rate is greatly improved
.

▲After adding the AI ​​training model, the optical lens defect recognition rate is greatly improved.

AI+AOI solves the two major pain points of insufficient manpower and high misjudgment rate

This time, Yirui Technology and Xiaoma Optics cooperated to install Yirui's AI system in the optical inspection instruments developed by Xiaoma Optics, adding AI algorithms to the optical detection of defects, and training based on the data and needs provided by customers. AI model identification can greatly improve the accuracy of identification of defects, improve yield rate, and increase production line efficiency. Through the tripartite cooperation between Shangyang Optics, Xiaoma Optics and Yirui Technology, the optical industry AOI is introduced into AI, hoping to completely solve the pain points of industrial lens defect detection.

Since setting up the production line in 2019, Shangyang Optics hopes to introduce a smart production model. In view of the continuous growth of the company's operations and the continuous improvement of production volume, through the introduction and expansion of this achievement, the demand for manpower will be significantly reduced, and the impact of production scheduling can be reduced due to the high accuracy of the discrimination rate index, thereby improving production efficiency.

Shangyang Optics stated that as the development results are implemented, it will lead the technology to be promoted to upstream and downstream players in the optical industry, such as upstream optical lens raw material suppliers to downstream finished product applications, including immersive gaming equipment and related curved glass products , people's livelihood vehicle and security camera devices, etc.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

這是一張圖片。 This is a picture.
Using Plant Growth Chambers as an Example - Standardizing Electronic Device Procedures Based on Imaging

In recent years, global climate change and environmental issues have become increasingly severe, causing major impacts on agricultural production Traditional agriculture heavily relies on weather conditions, facing challenges such as unstable crop quality, plummeting yields, and difficult pest control Particularly in Taiwan, agricultural biotech companies and farmers have suffered continuous losses, creating an urgent need for innovative solutions Meanwhile, Taiwan's plant factory industry faces many challenges high equipment and labor costs, an incomplete industrial chain diminishing international competitiveness, and a lack of cooperation among enterprises, all of which limit industry development Additionally, COVID-19the pandemic has highlighted the importance of remote monitoring and management Traditional manual inspections and data collection methods no longer meet the needs of modern agricultural production These issues collectively underline the urgent need for smart agricultural solutions, driving companies like Taiwan's HaiBoTe to develop innovative projects integrating IoT, cloud computing, and artificial intelligence technologies HaiBoTe Cloud Data Integration and Analysis Platform Facing these challenges, the agricultural sector urgently needs a system that can precisely control growth environments, improve resource efficiency, enable remote monitoring, and facilitate intelligent management Existing plant factory equipment often requires complete replacement, with poor compatibility with older equipment, and sensors and camera systems may require different interfaces, making them inconvenient to use Therefore, there is a need for a flexible solution that can integrate various equipment and technologies, providing real-time monitoring and data analysis, and automatically adjusting environmental parameters based on plant growth conditions This demand exists not only in Taiwan but is also a global trend in the development of smart agriculture By incorporating artificial intelligence, more scientific evaluation standards can be established, optimizing production processes, improving yield and quality, while reducing energy consumption and environmental impact Additionally, such smart solutions can attract more young people to participate in agricultural production, promoting industry upgrading and sustainable development Overall, the demand for smart agricultural solutions stems from the urgent requirements to address climate change, enhance production efficiency, reduce costs, and achieve precise management, and this is exactly the problem companies like Taiwan's HaiBoTe are striving to solve Taiwan's plant factory operators are facing a series of severe challenges, which are gradually eroding their competitiveness and survival space Firstly, the high cost of equipment and operations is their biggest burden Each electricity bill feels like a heavy blow, forcing them to balance between ensuring product quality and controlling costs Secondly, the unpredictability brought by climate change has become their nightmare Sudden extreme weather events can destroy their carefully nurtured crops in a short time, causing massive economic losses What's worse, they find themselves increasingly at a disadvantage in international market competition In contrast, large overseas plant factories, with their advanced automation technology and well-organized supply chains, can produce stable-quality agricultural products at lower costs, putting unprecedented pressure on Taiwan's operators On the technical level, they also face numerous challenges Compatibility issues between new and old equipment often put them in a bind, encountering various technical obstacles when trying to integrate different systems Lack of precise data analysis and forecasting capabilities also makes it difficult for them to make production decisions and accurately determine the best growth conditions for each crop Existing monitoring systems provide data that is often disorganized, difficult to interpret and apply Human resource challenges are also severe, with young people generally lacking interest in agricultural work, making it difficult for them to recruit employees with modern agricultural skills Even existing employees often feel exhausted from tedious manual operations and monitoring tasks These problems are intertwined, creating a complex dilemma that leaves plant factory operators confused and anxious They urgently need a comprehensive solution that can enhance factory operational efficiency, reduce costs, and improve product competitiveness, helping them overcome difficulties and regain their footing in the fierce market competition In facing the various challenges of plant factory operators, Taiwan's HaiBoTe company has demonstrated exceptional technical innovation and a flexible customer-oriented development strategy They deeply understand that the solution must be able to seamlessly integrate existing equipment while providing highly intelligent management functions To this end, HaiBoTe's RampD team adopted a modular design approach to develop a system that can be flexibly configuredIoTIoT system The core of this system is a smart control hub that can communicate with various sensors and actuators During development, HaiBoTe worked closely with customers, deeply understanding their specific needs and operational environments They even dispatched engineers onsite to observe the daily operations of the plant factories, ensuring that the developed system actually solves practical problems This in-depth cooperation not only helped HaiBoTe optimize their product design but also established a close relationship with customers, laying the foundation for subsequent continuous improvements HaiBoTe's innovation is not just reflected in hardware design but also in their developed intelligent software system This system integrates advanced machine learning algorithms, capable of precise forecasts and optimal control of plant growth conditions based on large amounts of historical data and real-time monitoring information To help customers overcome technical barriers, HaiBoTe designed an intuitive and easy-to-use user interface, which even non-technical operators can master easily Additionally, they provide comprehensive training and tech support services, ensuring customers can fully utilize all functions of the system When facing challenges, HaiBoTe's technical team can quickly identify problems through remote diagnostics and provide solutions In one incident, during a serious equipment failure emergency faced by a customer, HaiBoTe's engineers guided the customer through system remote access, successfully instructing them on repairs and avoiding potential massive losses This full-range service not only solves customers' immediate difficulties but also strengthens their confidence in intelligent management, driving the entire industry toward more efficient and sustainable development HaiBoTe's developed smart agriculture solution not only brought revolutionary changes to plant factories but also painted an encouraging picture for the future of the entire agricultural industry The excellence of this system is evident in several aspects firstly, it achieves precise control of the plant growth environment, significantly improving crop yield and quality stability Through advanced artificial intelligence algorithms, the system can forecast and adjust optimum growth conditions based on historical data and real-time monitoring information, ensuring each plant grows in the ideal environment Secondly, it significantly reduces energy consumption and operational costs, improving resource efficiency The intelligent management system optimizes water, electricity, and nutrient supply, reducing waste and lowering manpower costs Additionally, the system's modular design and strong compatibility allow it to seamlessly integrate various new and old equipment, providing a flexible solution for gradual upgrades of plant factories Most importantly, the system injects a sense of technology and modernity into agricultural production, helping to attract the younger generation to the field and injecting new vitality into the industry Looking ahead, HaiBoTe's smart agriculture system has broad application prospects and expansion potential In addition to plant factories, this system can also be applied to traditional greenhouse cultivation, urban agriculture, and even home gardening In the field of aquaculture, similar technology can be used to monitor and optimize the breeding environments for fish or shrimp In the food processing industry, similar intelligent monitoring and forecasting systems can be used to optimize production processes and enhance food safety Even in the pharmaceutical industry, this type of precise environmental management system could be applied to drug research and production processes To further promote this system, HaiBoTe could adopt a multifaceted strategy Firstly, they could collaborate with agricultural colleges and research institutions to establish demonstration bases, allowing more people to experience the benefits of smart agriculture firsthand Secondly, they could develop customized solutions tailored to different scales and types of agricultural production, expanding the applicability of their products Furthermore, they could raise awareness and acceptance of smart agriculture within the industry by hosting forums, online seminars, and sharing success stories Lastly, they could explore collaborations with government departments to integrate this system into policies supporting the modernization and sustainable development of agriculture, thereby promoting the widespread adoption of smart agriculture on a larger scale Through these efforts, HaiBoTe not only can expand its market share but also make a significant contribution to the sustainable development of global agriculture, truly realizing the vision of technology empowering agriculture 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」

【導入案例】防患於未然 麗臺科技研發心臟衰竭AI辨識技術可及早發現病徵
Preventing Problems Before They Arise: Leadtek Research Develops AI Technology for Early Detection of Heart Failure Symptoms

With the increase in the elderly population, the incidence of various chronic diseases is rising daily Among these, heart failure is not only a silent killer it has a very long disease course with a high recurrence rate, leading to increased burden on healthcare personnel However, by using medically certified electrocardiography acoustics devices, coupled with AI predictive assessment of heart failure risk and remote care systems, diagnosis can be aided significantly, helping doctors make accurate diagnoses for subsequent patient medical care or referrals Heart failure has a lengthy course and medical expenditure is five times that of diabetes If you find yourself short of breath even with minimal movement, or if you wake up from sleep needing to sit up to feel comfortable, or if you have symptoms such as swollen lower limbs, anxiety, restlessness, fatigue, or a loss of appetite, be cautious These could be signs of heart failure According to statistics, there are about 60 million people with heart failure worldwide, with 5 million new cases every year In China, nearly 290 million people suffer from cardiovascular diseases, accounting for the second leading cause of death among urban residents around 12 million of these are heart failure patients, accounting for over 59 of cardiac-related deaths The disease course of heart failure is exceptionally long, and both its recurrence and rehospitalization rates are exceedingly high, resulting in medical costs that are twice that of hypertension and five times those of diabetes According to US research statistics, the 30-day mortality rates for patients with myocardial infarction and heart failure are respectively 166 and 111, and the rehospitalization rates within 30 days are 199 and 244 The symptoms of heart failure, because they are similar to those of other diseases such as chronic obstructive pulmonary disease and asthma, have an 185 misdiagnosis rate, which poses a challenging problem for healthcare institutions Leadtek, a major graphics card manufacturer, has been investing in the medical and healthcare sector since 2000 Following two heart attacks in 2011 and 2015 experienced by Chairman Lu Kunshan, Leadtek has focused on health big data, independently developing AI technology for heart failure recognition This AI application reads patients' electrocardiograms and phonocardiograms to perform anomaly detection and model prediction of heart failure risk, enabling early detection of disease symptoms Leadtek independently developed heart failure AI recognition technology to predict medical history and risk Leadtek's independently developed heart failure AI recognition technology has the following three judgment functions 1 Prediction of heart failure history Classifies electrocardiogram and phonocardiogram data into 'with hospitalization history of heart failure' and 'no history of heart failure' 2 Risk prediction of heart failure Provides a predictive risk value of heart failure occurrence based on the electrocardiogram and phonocardiogram data 3 Prediction of heart failure recurrence risk For patients with heart failure, it reads their phonocardiogram and electrocardiogram data, assessing the risk prediction of heart failure recurrence Leadtek states that the application of heart failure AI recognition technology can assist doctors in making more efficient and accurate diagnoses, facilitating subsequent medical treatment or referrals for patients As an instance, in studies of heart failure patients discharged from Taipei Veterans General Hospital, using the EMAT Electromechanical Activation Time index and SDI Systolic Dysfunction Index calculated by the synchronized electrocardiography-acoustic device as treatment guidelines resulted in a higher survival rate compared to those treated based on traditional symptoms This research has also been published in the authoritative international cardiology journal JACC, receiving recognition in the international market System manufacturers can apply heart failure AI recognition technology for other value-added applications Leadtek states that cooperating system manufacturers can choose to build their own heart failure AI risk prediction engine, uploading their system's electrocardiogram and phonocardiogram data to Leadtek's heart failure AI risk prediction engine, which then returns risk prediction values for integration by system manufacturers cooperating manufacturers as a value-added application input Not just for clinical use, the heart failure AI risk prediction engine can also be extended for use at home or in the workplace Additionally, this system can be extended to other applications, including One, hospital outpatient screening Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to conduct a 10-second rapid test in outpatient and emergency departments to assess a patient's cardiac history and heart failure risk Two, discharge risk assessment Doctors can use the electrocardiogram and phonocardiogram recorder along with the heart failure AI risk prediction model to assess the heart failure risk during a patient's hospital stay The test data can serve as a pre-discharge risk assessment and prognostic indicator Three, continuous home care Patients can use the electrocardiogram and phonocardiogram recorder, wearable electrocardiogram recorder, and transmit through a home transmission box gateway to measure electrocardiogram and phonocardiogram signals at home and upload them to the amor health cloud platform for heart failure AI risk prediction analysis Patients can manage their health autonomously via an APP, reviewing historical physiological trends disease management nurses can manage member health through the health management backend Web Four, home rehabilitation training Patients can wear a health bracelet to monitor activity, fatigue, circulation, and sleep, autonomously managing their health through the mobile APP and observing the risk of heart failure, engaging in exercise and rehabilitation training to aid in swift recovery The heart failure AI recognition technology system can also be extended to employee home care applications Additionally, in factories or offices, this system can also achieve employee health management goals, with applications including One, workplace safety units Provide employees with wearable electrocardiogram recorders before they start work duties Two, physiological monitoring for business executors While executing business duties or training, employees wear wearable electrocardiogram recorders for fatigue warnings, signaling whether physiological conditions allow continued execution of tasks Task segments can use data transmission boxes or apps to upload physiological monitoring information to the health management platform, assessing the heart failure risk for operations staff, with test data serving as an indicator for enterprise resource human units and public safety Three, workplace physiological monitoring center care The workplace physiological monitoring center can inspect and record employees' historicalphysiological trends through the health cloud platform Four, workplace nursing units Nursing units receiving instructions from the physiological monitoring center can provide health management advice based on employees' physiological trends nursing centers can manage employee health through the health management backend Web Five, employees can wear health bracelets to monitor activity, fatigue, circulation, and sleep, autonomously managing their health and observing the risk of heart failure through the mobile APP, engaging in exercise and rehabilitation training to aid in rapid recovery Workplace application of heart failure cloud care and big data center diagram「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】巨量遙測空間數據AI分析雲端服務平台 使衛星遙測影像順利落地應用
AI Analysis Cloud Service Platform for Remote Sensing Big Data Enables the Smooth Application of Satellite Remote Sensing Images

Although satellite remote sensing images can make all surface objects visible, it still requires a lot of time and manpower to be truly applied to the industry In order to effectively solve the problems that customers face in digesting huge amounts of image data and eliminate technical obstacles for cross-domain users to process satellite remote sensing images, ThinkTron has developed an "AI Analysis Cloud Service Platform for Remote Sensing Big Data" as a new beginning for cross-domain AI applications for spatial information In recent years, in response to the impact of industrial globalization, Taiwan's agriculture has continued to transition towards technology-based and higher quality, improving the yield and quality of crops by solving problems, such as microclimate impacts and pest and disease control The demand of agriculture on images has expanded endlessly to accurately grasp the growing environment of crops In the early years when UAVs unmanned aerial vehicles were not yet popular, manual field surveys were the most basic but most labor-intensive work With the emergence of UAV drones, aerial photography operations might not be difficult, but the range that can be photographed is limited Furthermore, surveying expertise is required to accurately capture spatial information At this time, the use of satellite remote sensing data may break away from the past imagination of using image data Taiwan Space Agency TASA ODC data warehouse services In the past ten years, with the breakthrough of modern satellite remote sensing application technology, Digital Earth has become a new trend in global data collection Countries have developed data cube image storage technology, and the development of smart agriculture has become one of the largest image users Determining planting distribution is the first step in understanding crop yields Free satellite remote sensing images, powerful data warehousing support, and the team's robust image recognition technology are important supports for accelerating agricultural transformation Using satellite remote sensing image data can accelerate the development of smart agriculture However, in the past, it was difficult to extract large-area crop distribution through satellite remote sensing images, not to mention the cost If you wanted to use free information, you had to visit all websites of international space agencies, look through the wide variety of satellite specifications, and carefully evaluate the sensor specifications, image resolution, and revisit cycle After finding suitable images, you had to look at them one by one to filter the ones you need Next is downloading dozens of images that are often several hundreds of Megabytes MB each, which might exceed the capacity of your computer Also, after overcoming image access and preparing data, you must then start to confirm the downloaded image products and which bands you want, because the image you see is not just an image file jpg or png, but rather complex multi-spectral information, attribute fields and coordinate information It takes a lot of effort just to confirm the correct information Facing GIS software packages with complex functions is the start of another trouble The complex image pre-processing process and the inflexible machine learning package greatly reduce the efficiency of analyzing data After finally getting the results of crop identification, you might find that the best time for using map information may have already passed The above-mentioned complex and time-consuming satellite image processing problems are precisely the pain points of the market ThinkTron expanded from traditional machine learning to modern deep learning applications, and developed an "AI Analysis Cloud Service Platform for Remote Sensing Big Data" under the GeoAI framework, breaking through the constraints of details in the spatial information for customers Differences between the process before and after introducing the AI analysis cloud service platform ThinkTron said that Taiwan's ODC Open Data Cube system has been completed and began providing services after years of efforts from the Taiwan Space Agency TASA, formally becoming aligned with international trends The powerful warehousing technology allows users to easily capture and use image data of a specific time and spatial range according to their needs The warehouse stores multiple satellite image resources from international space agencies, including the ESA's Sentinel-1 one image every 6 days, Sentinel-2 one image every 6 days, USGS's Landsat-7 one image every 16 days, Landsat-8 one image every 16 days, and the domestic Formosat-2 one image every day and Formosat-5 one image every 2 days ThinkTron develops satellite image recognition tools based on Python Breaking free from the limitations of GIS Geographic Information System software packages, ThinkTron integrated GDAL Geospatial Data Abstraction Library based on Python, and considered computing efficiency and parallel processing when developing all tools required for satellite image processing and image recognition modeling, including coordinate system and data format conversion, grid and vector data interaction, and data intra-difference and normalization All of the tools are designed with AI applications in mind, and some commonly used tools are packaged into an open source package under the name TronGisPy to benefit the technical community ThinkTron utilized the team's understanding of satellite remote sensing images and the collected tagged data crop distribution maps to preset the image recognition modeling process, the required training data specifications, and dataset definitions This is imported into the machine learning LightGBM or deep learning CNN framework that was completed in advance, and the entire training process to be performed in the Web GIS interface, providing users with partial flexibility to freely filter images, confirm spatial and temporal ranges, select models, and adjust hyperparameters In addition to the operation of training models, it also provides historical models to output identification results, and finally displays the identification results of crop distribution on the Web GIS map In fact, agriculture is not the only industry that needs satellite remote sensing applications AI applications of spatial information have also appeared in various fields as companies in different industries aim to enhance their global competitiveness For example, surveying and mapping companies that have a large amount of map data can use the AI analysis cloud service platform to store map data while also accelerating the efficiency of digital mapping Under the severe global climate change and the risk of strong earthquakes, there is a wide variety industrial insurance, agricultural insurance, financial insurance, or disaster insurance are all inseparable from spatial information The use of remote sensing image recognition to understand insurance targets has long been an international trend AI Analysis Cloud Service Architecture for Remote Sensing Big Data