:::

【2021 Application Example】 Optical industry AOI imports AI Great Leap Forward to completely solve the pain points of lens defect detection

The stay-at-home economy such as smartphones and remote working is booming, and the information and communication industry is booming, driving the optical industry to flourish. However, the defect detection of optical lenses is mostly carried out by human eyes, which is not only time-consuming and labor-intensive, but also limited by the fact that human eyes are prone to fatigue. The misjudgment rate is also a lingering pain point for the optical industry. Benefiting from the evolution of AI technology, Shangyang Optics introduced diffraction optical technology for shooting, used the images captured by the system as the data source, introduced AI model training, and integrated the camera system and image recognition into a production line workstation, greatly improving defect identification The rate is as high as over 90%.

Taiwan’s optical production value accounts for 10% of the world’s, and the application range of precision optics is expanding day by day

The optical industry is a mainstream product in consumer electronics. Even though Taiwan was affected by the Sino-US trade dispute in 2019, the output value of optoelectronics still reached US$46.3 billion, accounting for 10% of the world's total. Among them, the "precision optics" segment accounts for NT$87 billion (approximately US$2.9 billion) in output value. In view of the increase in the number of smartphone lenses, precision optics still maintains a sustained growth of 4% compared to the decline in other fields.

Since Sharp launched the world's first camera phone equipped with a rear 110,000-pixel lens in 2000, end consumers' requirements for smartphone camera performance have continued to increase, and with the wave of 5G high-speed Internet The advent of the technology has led to the activation of application markets such as augmented reality (AR) or virtual reality (VR). The innovation and application of its technology have added a lot of momentum to the optical industry, and the application fields have extended from smartphones to popularization. to the mass consumer markets such as automobiles and home entertainment.

Optical lenses are inseparable from the economic development of "precision optics". As semiconductor technology continues to mature and network speeds continue to increase, optical lenses are used not only in smartphones, tablets, traditional cameras, projectors, In the field of people's livelihood vehicles, the demand for engineering visual inspection and security applications in high-precision manufacturing processes continues to grow rapidly.

Optical lens defects Detection is mostly done manually.

▲ Optical lens defect detection is mostly done manually.

"Optical lenses" are essential components of the overall optical-mechanical system. The lens finish inspection after incoming materials and before shipment not only affects the overall production line efficiency development, but also has an impact on the quality commitment of end customers that cannot be underestimated. For a long time, the optical industry has mostly used human eye detection for defect inspection. As production volume continues to increase, not only labor costs continue to rise. As inspectors age, their eyesight gradually declines, and the misjudgment rate increases every year. In addition, manpower recruitment has been difficult in recent years. Even if they are lucky enough to be recruited, it is not easy to develop the inspection technology, and the training time is lengthy, making it impossible to respond to the production line manpower needs in a timely manner.

Introducing diffraction optical technology and AI training model to improve defect recognition rate to more than 90%

The current market is flooded with a large number of automated optical inspection systems, and there are many substantial cases of lens defects. However, after years of market exploration and evaluation by Shangyang Optics, this system still cannot solve the current manual inspection problem. The main reason is that the appearance of the optical lens is curved and transparent, and it is not easy to photograph various defects, and once the defects are around There is interference from other stray lights, making judgment more difficult. Moreover, different types of lenses need to be individually rotated and lit and adjusted according to the defect status before entering the judgment stage. The labor consumption ratio is still high, which is not in line with the efficiency and cost.

Through this, through the matchmaking of the AI ​​project execution team of the Industrial Bureau of the Ministry of Economic Affairs, Xiaoma Optics assisted Shangyang Optoelectronics in establishing an effective defect photography system. Pony Optics provides guidance on precision diffraction optics. Based on the characteristics of "light" fluctuations, lens defects can be obtained through a unified lens shooting method. Current photography systems on the market mostly use geometric optics. Geometric optics uses linear light and is not easy to capture defects such as missing coatings, tiny scratches, and liquid dirt. The cooperation plan introduces diffraction optical technology for shooting. Through precise imaging from all angles, it can achieve higher contrast and better noise reduction than ordinary geometric optical elements, so as to obtain the necessary defective images.

Image of scratches and defects on the optical lens.

▲Schematic diagram of optical lens scratches and defects.

In order to improve the more detailed defect detection and recognition rate in this case, Shangyang Optics used the image captured by the system as the data source, imported AI model training, and integrated the camera system and image recognition into a production line workstation, which not only improved the defect recognition rate Reaching more than 90%, it is more conducive to the subsequent development of automated production lines.

The AI ​​model training for this cooperation project is provided by Yirui Technology. Currently, most manufacturers have introduced AOI systems for production line defect inspection. Most of them use OCR (optical character recognition), which refers to the analysis and recognition processing of image files of text data. , the process of obtaining text and layout information) technology needs to be 100% accurate, and there is no room for error, resulting in accidental killings often occurring.

After adding the AI ​​training model, optical lens defects The recognition rate is greatly improved
.

▲After adding the AI ​​training model, the optical lens defect recognition rate is greatly improved.

AI+AOI solves the two major pain points of insufficient manpower and high misjudgment rate

This time, Yirui Technology and Xiaoma Optics cooperated to install Yirui's AI system in the optical inspection instruments developed by Xiaoma Optics, adding AI algorithms to the optical detection of defects, and training based on the data and needs provided by customers. AI model identification can greatly improve the accuracy of identification of defects, improve yield rate, and increase production line efficiency. Through the tripartite cooperation between Shangyang Optics, Xiaoma Optics and Yirui Technology, the optical industry AOI is introduced into AI, hoping to completely solve the pain points of industrial lens defect detection.

Since setting up the production line in 2019, Shangyang Optics hopes to introduce a smart production model. In view of the continuous growth of the company's operations and the continuous improvement of production volume, through the introduction and expansion of this achievement, the demand for manpower will be significantly reduced, and the impact of production scheduling can be reduced due to the high accuracy of the discrimination rate index, thereby improving production efficiency.

Shangyang Optics stated that as the development results are implemented, it will lead the technology to be promoted to upstream and downstream players in the optical industry, such as upstream optical lens raw material suppliers to downstream finished product applications, including immersive gaming equipment and related curved glass products , people's livelihood vehicle and security camera devices, etc.

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-05-19」

Recommend Cases

【導入案例】海量數位工程AOI機器智能手臂檢測系統 大幅提高瑕疵檢測精準度
Massive Digital Engineering AOI Intelligent Robotic Arm Inspection System Significantly Improves Defect Detection Accuracy

Taiwan is known as a manufacturing powerhouse, yet quality defect detection has always been a chronic sore point in production lines While AOI equipment is available to assist, most use fixed machinery which are limited by angles, resulting in less precise diagnostics and high false positive rates Massive Digital Engineering introduced an AOI intelligent robotic arm detection system that effectively reduces false positives and increases the accuracy of defect detection Generally, the yield rate of products affects the costs for enterprises and the return rate for customers The quality defect detection process in the manufacturing industry often necessitates a substantial amount of quality inspection labor Although there is AOI equipment to assist, these tools are mostly fixed detection machines Fixed cameras are easily limited by angles, resulting in less precise diagnostics and high false positive rates Thus, personnel need to re-screen and inspect afterwards, often manually visual inspection misses defects on average about 5, and can be as high as 20 Three major pain points in manufacturing quality detection Robotic Arm AOI with dynamic multi-angle inspection helps to solve these issues According to the practical understanding by Massive Digital Engineering, there are three main pain points in detecting product quality within the manufacturing industry Pain point one, manual inspection of product quality is prone to errors Currently, the manufacturing industry largely relies on human labor to inspect product appearance, but human judgment often entails errors, such as surface scratches, color differences, solder appearance, etc The error rate in defect judgment is high, and can only be inspected at the finished product stage, often leading to whole batch rejections and high costs in labor and production Pain point two, inability to quantify and record data from quality inspections Traditional manual inspections do not maintain inspection data, which makes it difficult to assign responsibility when quality disputes occur Moreover, high-end contract manufacturing orders from overseas brands often require traceability and corresponding defect records, which traditional human inspection methods struggle to meet Pain point three, limitations of traditional AOI visual inspection systems Current manufacturing uses AOI visual inspection systems, which due to the limitations of visual software technology, employ fixed cameras, fixed lighting, and single-angle operations This method may handle flat or linear-shaped products like rectangular or square items at a single inspection point However, it is more challenging to implement for products with complex shapes eg, irregular automotive parts, requiring multi-point and multi-degree inspections Massive Digital Engineering developed an AOI intelligent robotic arm detection system, effectively improving the accuracy of defect detection To address the pain points in quality inspection in manufacturing, Massive Digital Engineering initiated the concept of developing a multi-angle, movable inspection device, starting with the combination of two representative technologies in factory automation - robotic arms and machine vision By integrating robotic arms with AOI for dynamic multi-angle AI real-time quality inspection, the limitations of fixed inspection systems are addressed, and visual inspection techniques are enhanced by leveraging artificial intelligence, further elevating the sampling of images from flat to multi-dimensional and multi-angular Selected the automotive industry as the real-world testing ground to quickly respond to customer needs The AOI intelligent robotic arm detection system, utilizing AI technology including unsupervised learning, supervised learning, and semi-supervised learning, allows operators to use unsupervised deep learning techniques to learn about good products even when initial samples are incomplete or there are no defective samples, applying it in the visual inspection of automatic welding of car trusses This can solve issues of limited angles with fixed machinery before implementation, less precise diagnostics, and high false positive rates Automotive components are high in unit price and demand a stricter defect detection accuracy In industries that have adopted AI services, the automotive manufacturing sector was chosen as the real-world testing ground Massive Digital Engineering states that the automotive industry mainly consists of related component manufacturers and components typically have a higher unit price, hence requiring more in terms of quality inspection and yield rates, and demanding stricter accuracy Therefore, the automotive sector was chosen as the area for introduction By using a robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection, not only can the defect quality error rate of automotive components be improved, but the fixed-point AOI optical inspection can be enhanced to meet the measurement needs of most industries and finally, establishing a third-party system platform to build an integrated monitoring system platform, enabling immediate response and action when issues arise This system allows for recording and storing important data of products leaving the factory, serving as a basis for future digital production lines and virtual production At the same time, in the event of defects, it can immediately connect to Massive's MES monitoring system, quickly responding to the relevant manufacturing decision-making department, subsequently utilizing ERP systems for project management and reviews, effectively improving production efficiency and reducing production costs Helps to reduce communication costs and aims to become an industry standard In terms of industry integration, it provides a foundational standard for data continuity among upstream and downstream businesses, reducing communication costs within the supply chain Through certification of the contract manufacturers and brand owners, there is a chance to become the industry standard configuration Through the data database established by this project, operators can further optimize their supply chain management solutions using big data analysis Data Analysis, based on data, establish forecast planning, and utilizing technology to link upstream and downstream data of the supply chain, accurately controlling product quality In the future, when interfacing with European, American, and Japanese markets, which demand highly fine-tuned orders, operators can respond and integrate the industry supply chain Supply Chain more swiftly Ultimately, through the benchmark demonstration industry's field verification, such as with the automotive component manufacturing industry used as the benchmark demonstration field, by implementing the robotic arm combined with AI for dynamic multi-angle AOI visual real-time quality inspection system project, the supply chain connection between automotive contract manufacturers and OEMs can be optimized, becoming the industry standard Further seeking more AI teams to join the cross-industry development on the field collaboration platform, driving the overall ecosystem combining AI innovation with field application Self-driving vehicle developed by Massive Digital Engineering「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【解決方案】連聯合國都買單 悠由數據應用運用農業數據搶攻全球商機
Even the United Nations is on board! Yoyo Data Application captures global business opportunities with agricultural data

Nearly 2,000 days in the fields have made Yoyo Data Application a top player in Taiwan’s agricultural data sector Their comprehensive grasp of crop yields, production periods, and prices has enabled them to collaborate with the United Nations The service area for agricultural land skyrocketed from 24 hectares to over 6,000 hectares in less than three years—a 250-fold increase For Wu Junxiao, founder and CEO of Yoyo Data Application, aligning with global environmental trends and becoming a data company at the intersection of climate technology and the green economy to serve the global market is his ultimate entrepreneurial goal Wu Junxiao, originally an engineer, joined the Industrial Technology Research Institute in 2010, where he honed his profound technical and data science analytic skills 'At that time, I was working in data analysis engineering, and almost all data-related materials would be directed to me Additionally, I worked on indoor cultivation boxes, planting vegetables and mushrooms, hence planting the seed of entrepreneurship by integrating agriculture with data analysis,' Wu recalls Since 2016, Wu Junxiao has been frequently visiting farms to 'embed' himself among farmers and agricultural researchers, chatting and sharing information systematically, which quickly established his agricultural know-how Solid data analysis capabilities have even convinced the United Nations In 2017, he left the Institute to start his own business and founded Yoyo Data Application in 2019 Today, many agricultural businesses are his clients, with service areas rapidly climbing from 24 hectares to over 6,000 hectares, expected to surpass 7,000 hectares in 2022 His clientele includes markets in Japan, Central America, and even entities under the United Nations like the World Farmers Organization, which utilizes the 'Yoyo Crop Algorithm System' supported by Yoyo Data How exactly does Yoyo Data Application manage to impress even UN agencies The 'Yoyo Crop Algorithm System' developed by Yoyo Data Application accurately predicts the production period, yield, and prices Firstly, due to Wu Junxiao's precise mastery over agricultural data, Yoyo Data Application's clients don't necessarily need sensors or other hardware devices 'Sensors are expensive and if you buy cheap devices, you just collect a lot of noise or flawed data, which is useless,' Wu explains He continues, 'Collecting data doesn't necessarily require sensors our data solutions can solve problems more directly and effectively' For instance, one of Yoyo Data Application's products, the Yoyo Money Report Agri-price Linebot, developed in collaboration with LINE in 2020, gathers data on origin, wholesale, and terminal prices spanning over 10 years, driven by Yoyo Data’s proprietary AI algorithms This enables the system to autonomously learn about agricultural product trading prices, using big data and AI to perform price prediction analysis, thereby helping buyers reduce transaction risks and expanding the data application to the entire agricultural supply chain Regarding banana prices, the accuracy of price predictions increased from the original 70 to 998 Wu Junxiao notes that both buyers and farmers are very sensitive to prices Now, through the Yoyo Money Report service, both buyers and farmers can precisely understand the fluctuations in agricultural product prices Yoyo Data can also provide customers with optimal decision-making advice based on predictive models for crop growth, yield, and price estimations Currently, price predictions cover 28 types of crops Precise estimates of production periods and price fluctuations allow Yoyo Data to provide differentiated services based on data analysis The 'Yoyo Crop Algorithm System' provided by Yoyo Data Application incorporates a 'Parameter Bank', usually collecting 200-300 parameters, not just straightforward data like temperature and humidity, but also data divided according to the physiological characteristics of the crops Through effective dynamic data algorithms, it can accurately calculate when crops will flower and when they can be harvested, what the yield will be, and so forth For instance, the prediction accuracy of the broccoli production period is 0-4 days, with the flowering period predicted this year to be precisely 0 days, perfectly matching the actual flowering time in the field In these dynamic calculations, a 7-day range is considered reasonable, and the average error value of Yoyo Data's predictions typically ranges from 2-4 days, with most crop production period accuracies above 80 Through effective dynamic data algorithms, over 120 global crops can have their production periods and yields accurately estimated Using these effective dynamic data algorithms can set estimates for production quantities, helping adjust at the production end Yoyo Data Application's clientele primarily includes exporters of fruit crops like pineapples, bananas, guavas, mangos, pomelos, sugar apples, Taiwan's agricultural production is highly homogenized, often leading to a rush to plant the same crops and resulting in price crashes Yoyo Data Application helps clients differentiate their offerings Thus, Wu Junxiao positions his company as a boutique digital consultant, carefully selecting clients for quality over quantity He notes that Taiwanese agricultural clients focus on how to improve yield rates, even categorizing yield rates by quality, aiming for high-quality, specialized export markets whereas international clients prioritize maximizing per-unit yields, showing different operational approaches in domestic and international markets In addition to agricultural fruit, Yoyo Data Application has also extended its services to the fisheries sector, including species like milkfish, sea bass, and white shrimp, all using the same system to establish various parameters related to the growth of fish and shrimp, such as when to feed and when to harvest, and the anticipated yield, timing, and prices Yoyo Data Application harnesses the power of data to create miracles in smart agriculture In response to the company's rapid development, Yoyo Data Application introduced venture capital funds in 2021 to expand its staff and promote its business Wu Junxiao states that in response to the global trend towards net zero carbon emissions by 2050, he plans to help clients plant carbon in the soil, effectively retaining carbon in the land while also connecting clients to carbon trading platforms, creating environmental business opportunities together Wu Junxiao says that from the start of his entrepreneurial journey, he positioned the company as a global entity, thus continuous international collaborations are planned As a data company serving a global clientele and focused on climate technology and the green economy, this represents Wu’s expectations for himself and his company's long-term goals Yoyo Data Application founder and CEO Wu Junxiao「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

這是一張圖片。 This is a picture.
Using Plant Growth Chambers as an Example - Standardizing Electronic Device Procedures Based on Imaging

In recent years, global climate change and environmental issues have become increasingly severe, causing major impacts on agricultural production Traditional agriculture heavily relies on weather conditions, facing challenges such as unstable crop quality, plummeting yields, and difficult pest control Particularly in Taiwan, agricultural biotech companies and farmers have suffered continuous losses, creating an urgent need for innovative solutions Meanwhile, Taiwan's plant factory industry faces many challenges high equipment and labor costs, an incomplete industrial chain diminishing international competitiveness, and a lack of cooperation among enterprises, all of which limit industry development Additionally, COVID-19the pandemic has highlighted the importance of remote monitoring and management Traditional manual inspections and data collection methods no longer meet the needs of modern agricultural production These issues collectively underline the urgent need for smart agricultural solutions, driving companies like Taiwan's HaiBoTe to develop innovative projects integrating IoT, cloud computing, and artificial intelligence technologies HaiBoTe Cloud Data Integration and Analysis Platform Facing these challenges, the agricultural sector urgently needs a system that can precisely control growth environments, improve resource efficiency, enable remote monitoring, and facilitate intelligent management Existing plant factory equipment often requires complete replacement, with poor compatibility with older equipment, and sensors and camera systems may require different interfaces, making them inconvenient to use Therefore, there is a need for a flexible solution that can integrate various equipment and technologies, providing real-time monitoring and data analysis, and automatically adjusting environmental parameters based on plant growth conditions This demand exists not only in Taiwan but is also a global trend in the development of smart agriculture By incorporating artificial intelligence, more scientific evaluation standards can be established, optimizing production processes, improving yield and quality, while reducing energy consumption and environmental impact Additionally, such smart solutions can attract more young people to participate in agricultural production, promoting industry upgrading and sustainable development Overall, the demand for smart agricultural solutions stems from the urgent requirements to address climate change, enhance production efficiency, reduce costs, and achieve precise management, and this is exactly the problem companies like Taiwan's HaiBoTe are striving to solve Taiwan's plant factory operators are facing a series of severe challenges, which are gradually eroding their competitiveness and survival space Firstly, the high cost of equipment and operations is their biggest burden Each electricity bill feels like a heavy blow, forcing them to balance between ensuring product quality and controlling costs Secondly, the unpredictability brought by climate change has become their nightmare Sudden extreme weather events can destroy their carefully nurtured crops in a short time, causing massive economic losses What's worse, they find themselves increasingly at a disadvantage in international market competition In contrast, large overseas plant factories, with their advanced automation technology and well-organized supply chains, can produce stable-quality agricultural products at lower costs, putting unprecedented pressure on Taiwan's operators On the technical level, they also face numerous challenges Compatibility issues between new and old equipment often put them in a bind, encountering various technical obstacles when trying to integrate different systems Lack of precise data analysis and forecasting capabilities also makes it difficult for them to make production decisions and accurately determine the best growth conditions for each crop Existing monitoring systems provide data that is often disorganized, difficult to interpret and apply Human resource challenges are also severe, with young people generally lacking interest in agricultural work, making it difficult for them to recruit employees with modern agricultural skills Even existing employees often feel exhausted from tedious manual operations and monitoring tasks These problems are intertwined, creating a complex dilemma that leaves plant factory operators confused and anxious They urgently need a comprehensive solution that can enhance factory operational efficiency, reduce costs, and improve product competitiveness, helping them overcome difficulties and regain their footing in the fierce market competition In facing the various challenges of plant factory operators, Taiwan's HaiBoTe company has demonstrated exceptional technical innovation and a flexible customer-oriented development strategy They deeply understand that the solution must be able to seamlessly integrate existing equipment while providing highly intelligent management functions To this end, HaiBoTe's RD team adopted a modular design approach to develop a system that can be flexibly configuredIoTIoT system The core of this system is a smart control hub that can communicate with various sensors and actuators During development, HaiBoTe worked closely with customers, deeply understanding their specific needs and operational environments They even dispatched engineers onsite to observe the daily operations of the plant factories, ensuring that the developed system actually solves practical problems This in-depth cooperation not only helped HaiBoTe optimize their product design but also established a close relationship with customers, laying the foundation for subsequent continuous improvements HaiBoTe's innovation is not just reflected in hardware design but also in their developed intelligent software system This system integrates advanced machine learning algorithms, capable of precise forecasts and optimal control of plant growth conditions based on large amounts of historical data and real-time monitoring information To help customers overcome technical barriers, HaiBoTe designed an intuitive and easy-to-use user interface, which even non-technical operators can master easily Additionally, they provide comprehensive training and tech support services, ensuring customers can fully utilize all functions of the system When facing challenges, HaiBoTe's technical team can quickly identify problems through remote diagnostics and provide solutions In one incident, during a serious equipment failure emergency faced by a customer, HaiBoTe's engineers guided the customer through system remote access, successfully instructing them on repairs and avoiding potential massive losses This full-range service not only solves customers' immediate difficulties but also strengthens their confidence in intelligent management, driving the entire industry toward more efficient and sustainable development HaiBoTe's developed smart agriculture solution not only brought revolutionary changes to plant factories but also painted an encouraging picture for the future of the entire agricultural industry The excellence of this system is evident in several aspects firstly, it achieves precise control of the plant growth environment, significantly improving crop yield and quality stability Through advanced artificial intelligence algorithms, the system can forecast and adjust optimum growth conditions based on historical data and real-time monitoring information, ensuring each plant grows in the ideal environment Secondly, it significantly reduces energy consumption and operational costs, improving resource efficiency The intelligent management system optimizes water, electricity, and nutrient supply, reducing waste and lowering manpower costs Additionally, the system's modular design and strong compatibility allow it to seamlessly integrate various new and old equipment, providing a flexible solution for gradual upgrades of plant factories Most importantly, the system injects a sense of technology and modernity into agricultural production, helping to attract the younger generation to the field and injecting new vitality into the industry Looking ahead, HaiBoTe's smart agriculture system has broad application prospects and expansion potential In addition to plant factories, this system can also be applied to traditional greenhouse cultivation, urban agriculture, and even home gardening In the field of aquaculture, similar technology can be used to monitor and optimize the breeding environments for fish or shrimp In the food processing industry, similar intelligent monitoring and forecasting systems can be used to optimize production processes and enhance food safety Even in the pharmaceutical industry, this type of precise environmental management system could be applied to drug research and production processes To further promote this system, HaiBoTe could adopt a multifaceted strategy Firstly, they could collaborate with agricultural colleges and research institutions to establish demonstration bases, allowing more people to experience the benefits of smart agriculture firsthand Secondly, they could develop customized solutions tailored to different scales and types of agricultural production, expanding the applicability of their products Furthermore, they could raise awareness and acceptance of smart agriculture within the industry by hosting forums, online seminars, and sharing success stories Lastly, they could explore collaborations with government departments to integrate this system into policies supporting the modernization and sustainable development of agriculture, thereby promoting the widespread adoption of smart agriculture on a larger scale Through these efforts, HaiBoTe not only can expand its market share but also make a significant contribution to the sustainable development of global agriculture, truly realizing the vision of technology empowering agriculture 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」