:::

【2021 Application Example】 Optical industry AOI imports AI Great Leap Forward to completely solve the pain points of lens defect detection

The stay-at-home economy such as smartphones and remote working is booming, and the information and communication industry is booming, driving the optical industry to flourish. However, the defect detection of optical lenses is mostly carried out by human eyes, which is not only time-consuming and labor-intensive, but also limited by the fact that human eyes are prone to fatigue. The misjudgment rate is also a lingering pain point for the optical industry. Benefiting from the evolution of AI technology, Shangyang Optics introduced diffraction optical technology for shooting, used the images captured by the system as the data source, introduced AI model training, and integrated the camera system and image recognition into a production line workstation, greatly improving defect identification The rate is as high as over 90%.

Taiwan’s optical production value accounts for 10% of the world’s, and the application range of precision optics is expanding day by day

The optical industry is a mainstream product in consumer electronics. Even though Taiwan was affected by the Sino-US trade dispute in 2019, the output value of optoelectronics still reached US$46.3 billion, accounting for 10% of the world's total. Among them, the "precision optics" segment accounts for NT$87 billion (approximately US$2.9 billion) in output value. In view of the increase in the number of smartphone lenses, precision optics still maintains a sustained growth of 4% compared to the decline in other fields.

Since Sharp launched the world's first camera phone equipped with a rear 110,000-pixel lens in 2000, end consumers' requirements for smartphone camera performance have continued to increase, and with the wave of 5G high-speed Internet The advent of the technology has led to the activation of application markets such as augmented reality (AR) or virtual reality (VR). The innovation and application of its technology have added a lot of momentum to the optical industry, and the application fields have extended from smartphones to popularization. to the mass consumer markets such as automobiles and home entertainment.

Optical lenses are inseparable from the economic development of "precision optics". As semiconductor technology continues to mature and network speeds continue to increase, optical lenses are used not only in smartphones, tablets, traditional cameras, projectors, In the field of people's livelihood vehicles, the demand for engineering visual inspection and security applications in high-precision manufacturing processes continues to grow rapidly.

Optical lens defects Detection is mostly done manually.

▲ Optical lens defect detection is mostly done manually.

"Optical lenses" are essential components of the overall optical-mechanical system. The lens finish inspection after incoming materials and before shipment not only affects the overall production line efficiency development, but also has an impact on the quality commitment of end customers that cannot be underestimated. For a long time, the optical industry has mostly used human eye detection for defect inspection. As production volume continues to increase, not only labor costs continue to rise. As inspectors age, their eyesight gradually declines, and the misjudgment rate increases every year. In addition, manpower recruitment has been difficult in recent years. Even if they are lucky enough to be recruited, it is not easy to develop the inspection technology, and the training time is lengthy, making it impossible to respond to the production line manpower needs in a timely manner.

Introducing diffraction optical technology and AI training model to improve defect recognition rate to more than 90%

The current market is flooded with a large number of automated optical inspection systems, and there are many substantial cases of lens defects. However, after years of market exploration and evaluation by Shangyang Optics, this system still cannot solve the current manual inspection problem. The main reason is that the appearance of the optical lens is curved and transparent, and it is not easy to photograph various defects, and once the defects are around There is interference from other stray lights, making judgment more difficult. Moreover, different types of lenses need to be individually rotated and lit and adjusted according to the defect status before entering the judgment stage. The labor consumption ratio is still high, which is not in line with the efficiency and cost.

Through this, through the matchmaking of the AI ​​project execution team of the Industrial Bureau of the Ministry of Economic Affairs, Xiaoma Optics assisted Shangyang Optoelectronics in establishing an effective defect photography system. Pony Optics provides guidance on precision diffraction optics. Based on the characteristics of "light" fluctuations, lens defects can be obtained through a unified lens shooting method. Current photography systems on the market mostly use geometric optics. Geometric optics uses linear light and is not easy to capture defects such as missing coatings, tiny scratches, and liquid dirt. The cooperation plan introduces diffraction optical technology for shooting. Through precise imaging from all angles, it can achieve higher contrast and better noise reduction than ordinary geometric optical elements, so as to obtain the necessary defective images.

Image of scratches and defects on the optical lens.

▲Schematic diagram of optical lens scratches and defects.

In order to improve the more detailed defect detection and recognition rate in this case, Shangyang Optics used the image captured by the system as the data source, imported AI model training, and integrated the camera system and image recognition into a production line workstation, which not only improved the defect recognition rate Reaching more than 90%, it is more conducive to the subsequent development of automated production lines.

The AI ​​model training for this cooperation project is provided by Yirui Technology. Currently, most manufacturers have introduced AOI systems for production line defect inspection. Most of them use OCR (optical character recognition), which refers to the analysis and recognition processing of image files of text data. , the process of obtaining text and layout information) technology needs to be 100% accurate, and there is no room for error, resulting in accidental killings often occurring.

After adding the AI ​​training model, optical lens defects The recognition rate is greatly improved
.

▲After adding the AI ​​training model, the optical lens defect recognition rate is greatly improved.

AI+AOI solves the two major pain points of insufficient manpower and high misjudgment rate

This time, Yirui Technology and Xiaoma Optics cooperated to install Yirui's AI system in the optical inspection instruments developed by Xiaoma Optics, adding AI algorithms to the optical detection of defects, and training based on the data and needs provided by customers. AI model identification can greatly improve the accuracy of identification of defects, improve yield rate, and increase production line efficiency. Through the tripartite cooperation between Shangyang Optics, Xiaoma Optics and Yirui Technology, the optical industry AOI is introduced into AI, hoping to completely solve the pain points of industrial lens defect detection.

Since setting up the production line in 2019, Shangyang Optics hopes to introduce a smart production model. In view of the continuous growth of the company's operations and the continuous improvement of production volume, through the introduction and expansion of this achievement, the demand for manpower will be significantly reduced, and the impact of production scheduling can be reduced due to the high accuracy of the discrimination rate index, thereby improving production efficiency.

Shangyang Optics stated that as the development results are implemented, it will lead the technology to be promoted to upstream and downstream players in the optical industry, such as upstream optical lens raw material suppliers to downstream finished product applications, including immersive gaming equipment and related curved glass products , people's livelihood vehicle and security camera devices, etc.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【導入案例】無人智慧販賣機 黑沃咖啡一分鐘打造精品咖啡
Unmanned Intelligent Vending Machines - Black Wo Coffee Creates Boutique Coffee in a Minute

Technology also carries the aroma of coffee Situated on Gaogong Road in the Southern District of Taichung, the original Black Wo Coffee store covers a space of 28 ping, filled with the scent of coffee mixed with cultural creativity and technology Since its establishment in October 2016, Black Wo Coffee has expanded to 7 directly managed stores and 28 franchise stores across Taiwan Among the 15,000 coffee sellers nationwide, Black Wo Coffee has risen uniquely through the use of AI technology to create an unmanned intelligent vending machine that brews exquisite and aromatic coffee in just one minute Black Wo Coffee's physical store creates a culturally creative and fashionable atmosphere Image Black Wo Coffee official website According to the International Coffee Organization ICO, Taiwanese people consume 285 billion cups of coffee annually, with the market size exceeding 70 billion NT dollars Ambitiously, as per Starbucks' survey, by 2018 the overall Taiwanese coffee market reached 72 billion NT dollars and rose to 90 billion by 2020 Over the last five years, the Taiwanese coffee market has expanded annually by about 20, showing remarkable growth potential Coffee demand presents incredible business opportunities, growing at a rate of 20 annually With coffee now being a symbol of fashionable consumption in Taiwan, aside from first-tier coffee shops like Starbucks and Louisa, there are convenience stores like 7-11 and FamilyMart, and numerous boutique coffee houses scattered through the streets and alleys How to capture consumer attention and stand out in the 'red ocean' of the coffee market requires flexibility and creativity, understanding consumer needs and tastes, which are also essential for cultivating brand loyalty Beyond physical storefronts, Black Wo Coffee is also actively developing digital channels Its ecommerce platform includes the official website, PChome, momo, and group-buying hosts, providing multiple channels and ensuring steady growth in performance Even so, the founder of Black Wo Coffee, Lin Pei-ni, continually seeks innovation Due to the passive and scattered situation with franchise stores in the first three years, it was difficult to actively grasp market trends and the company noticed a certain lag in communicating with consumers and keeping up with brand dynamics, making it challenging to cultivate loyal brand advocates Artisan boutique coffee is deeply beloved by consumers Image Black Wo Coffee official website Through the AI Eagle Eye System, market intelligence costs are significantly reduced To address the dual challenges of not being able to quickly capture market trends and high market research costs, Black Wo Coffee introduced the AI Eagle Eye System in 2020 to scout market intelligence By comprehensively crawling articles from social websites, news platforms, and forums, automatically tagging, and suitably filtering, this system scanned 4,858 articles using 24,290 keywords, enabling precise insights into consumer preferences at minimal costs At the same time, after launching new products, not only can franchise stores be notified promptly, but the acceptance level of consumers can also be assessed through social platforms It serves as a reference for whether to promote aggressively Through the collection of data and analysis by AI algorithms, consumer-preferred flavors are selected, reducing the risks associated with new launches and increasing the success rate of new products Therefore, in 2021, Black Wo Coffee boldly explored new markets by introducing the world's first AIoT smart coffee innovative concept in collaboration with Pxmart for the first 'Intelligent Supermarket', integrating Black Wo Coffee to create an unmanned intelligent hand-drip coffee machine for consumers to enjoy a unique flavor experience Insight into consumer tastes leads to the creation of AIoT Unmanned Intelligent Vending Machines Taiwan's first Pxmart 'Intelligent Supermarket' in Neihu, Taipei introduces the world's first AIoT smart coffee concept store, able to interact with the AI smart coffee vending machine, AI hand-washing coffee machine, and AI vacuum cold brew machine through a mobile app, meeting three different coffee technology experiences in one place The self-service area features the only unmanned intelligent coffee vending machine in Taiwan that uses chilled milk to make milk foam, selecting Black Wo's 5A grade milk, and completing the payment, grinding, and brewing all within one minute The first Pxmart 'Intelligent Supermarket' was established on Ruiguang Road in Neihu District, Taipei Image Pxmart FB fan page The Pxmart Intelligent Supermarket features an AI smart coffee vending machine, which is operated using an app to enjoy aromatic coffee Image Pxmart FB fan page Now, with the addition of AI technology elements, drinking coffee is not just about having coffee it also brings more brand-new tech experiences and conveniences to consumers「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】赫銳特科技VCSEL封裝元件瑕疵導入AOI檢測 提升產能效率20
HRT Technology Improves Production Efficiency by 20% Through AOI Detection of Defects in VCSEL Packaging

In 2017, the launch of the iPhone X made 3D sensor technology used in Face ID highly popular, which drove the development of VCSEL, a core component in the 3D sensor module In the detection of defects in incoming packaged VCSEL, the use of AI inference models can solve the industry's issue with low yield and improve reliability to 95 VCSEL technology currently can be used in many applications and various end consumer markets, including robots, mobile devices, surveillance, drones, and ARVR VCSELs are a good solution in applications that require high-speed modulation capabilities, such as cameras and biometrics VCSEL technology has a wide range ofnbsp applications, including in drones Pictured Zoyi Technology's Agricultural Drone VCSEL technology has a wide range of applications, AI technology assists in defect detection HRT Technology stated that the packaged VCSEL market is also facing strong price competition from competitors, and needs to further reduce costs and enhance product competitiveness One of the key problems is the replacement of glass lens with epoxy resin lens The production of traditional glass lenses has high yield, but the cost is higher than that of epoxy resin lenses Due to the cutting process of epoxy resin, the side wall of cutting lines can easily have rough edges, causing it to be oversized The release of stress caused by heat during the mounting process will directly cause the optical lens to break HRT Technology pointed out that the incoming inspection of VCSEL epoxy resin lenses is very important Under the constraints of packaging space, the space for fitting the package and optical lens is limited Moreover, the optical lenses will be confined to a metal frame If the dimensional tolerances are properly controlled, stress release due to heat during mounting can easily cause the optical lens to break, resulting in a yield loss of up to 10 in the VCSEL package reliability verification, resulting in an increase in production costs In order to solve the problems above, HRT Technology hopes to use AI to monitor the size and appearance defects of epoxy resin components in the VCSEL epoxy resin lens incoming stage, verifying whether their dimensions meet specifications, whether the cutting edges are smooth, and whether there are any defects in their appearance Since traditional incoming material inspection requires a rough visual inspection by humans to distinguish the quality The problem of image collection needs to be solved first to successfully collect image data Therefore, HRT Technology first developed an Automated Optical Inspection AOI device, which includes X, Y, Z three-axis motion, high-resolution cameras, and related control software to automatically record images After collecting the image data, opencv aligns the test image and a normal image to determine differences between the two images, and then pixel mapping is used to compare the pixel area to complete initial screening Manual labeling is carried out according to the image classification above, including samples that are normal, have defects in appearance, or have different shape characteristics, and then algorithm training and verification is carried out Residual neural network ResNet or other related algorithms are used for deep learning to identify the quality of lenses Implementation of AOI inspection improves production efficiency by 20 and above Comparing the differences before and after the implementation of AI image inspection, the incoming VCSEL lens inspection before implementation only involved manual inspection of the appearance The lens is packaged on the VCSEL package that has completed die bonding After passing the general light up test, the final reliability test high temperature reflow is performed Failed samples go into the rework process However, after the implementation of AOI inspection, it can screen defective lenses sooner and reduce the cost of subsequent materials input, it can also reduce the need for rework due to failure, improving yield to 95 and above in the reliability verification This is expected to help companies reduce production costs by 10 and increase production efficiency by 20 and above The difference before and after implementing AI image detection HRT Technology pointed out that this technology is an AI application developed based on tiny images It uses deep learning algorithms to identify defects in the images The trained network automatically classifies image data to predetermined categories Defect categories can be determined through reference images, so cumbersome programming is not required In the industrial machine vision environment, deep learning is mainly used for classification tasks in applications, such as inspection of industrial products or identification of parts In the future, with the development of IoT wearable devices and the trend of energy saving, the size of optoelectronic components will continue to shrink This technology can be applied to the detection of defects in the appearance of other tiny optoelectronic components in the future

【導入案例】AI嘛會煮咖啡 無人烘豆機靠AI 精準設點與培養忠實客群
AI Can Make Coffee! Autonomous Coffee Roasters Relying on AI for Precise Location Setting and Cultivating Loyal Customers

Have you had your morning coffee yet Over the past decade, Taiwan has gradually formed a coffee drinking culture With the advancement of AI technology, autonomous coffee roasters can now rely on AI for precise location setting while also cultivating a loyal customer base Let's see how this is done According to the International Coffee Organization ICO, Taiwanese consume approximately 285 billion cups of coffee annually, with the coffee market in Taiwan estimated at 80 billion TWD, growing about 20 each year In recent years, the 'drinking coffee' culture in Taiwan has become synonymous with popularity, with coffee being the most frequently chosen daily beverage by 65 of the population Coffee enthusiasts, particularly the more avid ones, are willing to pay more for coffee beans that suit their tastes An increasing number of unmanned drink kiosks have also begun to appear in the Taiwanese beverage market Unmanned coffee beverage shops face difficulties in expanding quickly, primarily due to two major issues one is the appropriateness of customer flow and machine placement locations which still rely on manual analysis the second is penetrating the market of mid to high-end coffee lovers accurately AI resolves two major challenges for autonomous coffee roasters suitable placement and cultivating a loyal customer base To tackle these issues and help autonomous coffee roasters quickly break into the market, Raysharp Electronics intends to implement AI for people flow counting analysis and unfamiliar face recognition These technologies aim to calculate the crowd size at potential roaster locations and classify consumers by gender and age for more precise market analysis They also provide multiple choices for the roasting of raw coffee beans, offering a more customized service tailored to the needs and tastes of professional coffee aficionados with a pack of 'high-quality roasted beans' Since 2018, the rise of unmanned stores has been mainly due to owners wanting to reduce persistently rising rent and personnel costs However, the initial assessment of store locations still requires hourly labor expenses for manual estimation of customer flow, leading to possible miscalculations of both on-site consumers and passerby traffic These inaccuracies may prevent precise real-time analysis of customer flow, or even misguided estimations of operational efficacy after a trial run, thus missing the optimal timing for loss-preventing location retraction Raysharp Electronics introduces autonomous coffee roasters equipped with AI-based people counting analysis and facial recognition Raysharp Electronics combines AI people counting analysis and facial recognition with the coffee trend known as 'black gold', addressing the preferences of numerous coffee connoisseurs in Taiwan who enjoy personally selecting coffee beans at bulk stores and frequenting high-quality grinding cafes or chain coffee shops A new concept for the first autonomous coffee roaster offering choices based on the origin, variety, and roasting methods of coffee beans has emerged AI coffee roasters enhance customer loyalty and materials management efficiency by 20 For the advanced development of autonomous coffee roasters, Raysharp Electronics engineers have equipped the AI NVIDIA development platform on the basis of TCNNFacenet Through AI, tens of thousands of images related to gender and age are used for sample training, allowing even first-time coffee roasting customers to be easily classified using unfamiliar face recognition This gains consumer trust, enhances willingness to use, and allows for recording purchase information and future product recommendations, leading to consumer purchase behavior analysis This information helps owners tailor future material preparation based on consumer preferences for different coffee beans, reducing raw material transportation and storage issues, and improving material management efficiency by 20 Moreover, by placing these autonomous coffee roasters in high-traffic areas, owners can use cameras to capture the crowd and assess whether the machine location has an adequate customer base, quickly analyzing whether to reposition the machines, and more easily targeting the best locations for middle and high-end coffee lovers The unmanned coffee roaster features a professional roasting mode interface, providing options based on the origin and variety of coffee beans, their roasting methods light, medium, deep, and related temperature, wind speed, and timing settings If improvement needs arise during the process, engineers can adjust firmware parameters and also assist in integration with the owner's ordering system Staff members briefly describe the operation of the autonomous coffee roaster 'Black Gold' penetrates deeper into coffee shops, science parks, and commercial buildings through AI This autonomous coffee roaster targets coffee connoisseurs and can be placed in middle to high-end coffee shops to roast more customized coffee beans than those available in bulk stores Upon completing a batch of coffee beans, it immediately provides them to professional technicians within the coffee shops for grinding and manual brewing The remaining roasted beans can also be taken home for brewing and enjoyment It also adds value to coffee shops by better understanding consumer preferences for coffee beans and launching more customer-attracting drink promotions and appropriate inventory management In addition to coffee shops, the autonomous coffee roaster can also utilize AI-based people counting analysis to precisely set up near scientific parks and commercial buildings, offering high-quality coffee beans for office brewing to internal employees with high coffee consumption needs Furthermore, implementing a physical membership system can initiate coffee bean purchase promotions or periodic payment incentives, thus attracting new clients and cultivating existing customer loyalty and retention The operation interface of the smart autonomous coffee roaster「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」