:::

【2020 Application Example】 Automatic fruit screening system: A solution that uses neural networks, AI, and automation to improve fruit screening efficiency by 10 times, increase output value by NT$1.7 billion, and significantly improve quality with 93% accuracy

Taiwan is located in the subtropics and has a diverse geographic environment that is very suitable for growing fruit. Bananas and pineapples were once extremely popular export commodities that we are proud of. However, farmers in consuming countries gradually obtained the excellent seeds of Taiwan’s fruits, and were able to grow the same quality fruit but at a more affordable price, causing our fruit exports to face a major crisis! At present, although Taiwan's fruits such as mango and guava still have certain competitive advantages, if they fail to make further progress compared with other countries, they will still encounter the same problem over time and cannot be ignored! Fruit quality and brand value are the only ways for Taiwan's fruit industry to remain competitive internationally.

Fruit screening is the main link in fruit production and marketing that determines quality. Currently, the industry is highly dependent on aging rural manpower, resulting in rising fruit screening costs due to labor shortage and making it extremely difficult to maintain stable yield. Therefore, the automation of fruit screening work has become a very important and urgent issue. Professor Chi-Chun Lee at the Department of Electrical Engineering of National Tsing Hua University led a team to develop an automatic fruit screening system that combines cameras, conveyor belts, and AI. The system currently has an accuracy reaching 93%. One production season can increase the output value of mango by NT$1.7 billion. With the gradual development of the AI system, the accuracy is expected to improve in the future, and the same system can also be applied to other fruits, further promoting traceable fruit and driving the technological upgrading of Taiwan's fruit industry.

Fruit screening relies heavily on scarce manpower, and the aging of the rural population makes the situation even worse

Professor Chi-Chun Lee learned about the fruit industry’s dilemma from his classmate Yu (alias), who had studied together in the United States. Yu is the young second-generation successor of one of Taiwan's largest fruit import and export companies. According to Yu's observations in the industry over numerous years, Taiwan's fruit production and export usually generated good profits at first, but after fruit farmers in the consuming countries obtained the seeds, they will often attempt to grow the fruit locally to reduce costs and obtain greater profits. If Taiwanese fruits cannot surpass the products of fruit farmers in consuming countries in terms of quality or brand value, they will be eliminated because competitors' costs are indeed lower.

Fruit screening is used to divide fruits according to quality. If they cannot pass the minimum specification, they will be discarded as waste products. In practice, the work of screening fruits will be carried out by farmers' goods yards and distributor' packaging yards respectively. However, if it is not properly handled by the collection freight yards and the packaging yards do not do a good job in sampling in the early stage, it will result in a loss for distributors and cause 30% of A/A+ grade fruits to be eliminated.

This job relies heavily on experienced fruit screeners. More experienced fruit screeners can not only control the quality and reduce the chance of fruit damage in the fruit screening process, but also have the ability to pick out about 10% more A+ grade fruits, which adds great value. What worries the industry is that experienced fruit screeners are gradually decreasing due to the aging population in rural areas, making them a very rare resource. Such rare human resources are often in high demand during busy farming periods. Farmers or distributors who fail to hire experienced fruit screeners have to settle for less experienced one, taking on the risk of additional losses and paying greater costs. The most unfortunate situation suffering a loss of 30% mentioned above.

▲ Fruit screening is an important process in the later stages of fruit production when packaging and selling. Failure to properly control quality will result in huge losses.

AI is very suitable for assisting in fruit screening, but it is difficult to obtain data sets

After understanding Yu's difficulties, Professor Lee found that this was a problem that could be solved using AI - although fruit screening relies heavily on experienced fruit screeners, it is a highly repetitive task. Handling repetitive tasks with a large amount of data has always been a strength of AI.

However, the first problem appeared even before research and development work started: Which fruit do we start with?

First of all, a suitable fruit must reach a certain export volume, and the fruit must still have considerable room for growth. For some fruits that lack international competitiveness, such as bananas and pineapples, companies no longer have the ability to invest more funds to purchase equipment, let alone sponsor R&D or assist the R&D team in experiments.

When you have an idea, you need to pick up the pace and put it into practice as soon as possible! Therefore, Irwin mango, which still has a certain advantage in terms of scale, was selected as the first experimental subject of the automatic fruit screening system.

The first step after harvesting mangoes is to screen the fruits for the first time at the goods yard. After the fruits are screened, they are sent to the packaging yard for fumigation and disinfection, and preparation for sale or loaded into containers for export. However, exporters with a deeper understanding of the target market will have stricter quality requirements and will often screen the fruit again to ensure the quality of the fruit before fumigation at the packaging site. Since employees at the goods yard are paid based on the number of mangoes screened rather than on the quality of the mangoes, they focus on quantity when working. As a result, to ensure the quality of the selected fruits, the subsequent packaging factory has to screen the fruit again, increasing labor. The solution seems simple and clear - A camera, machine conveyor belts for grading and sorting, and an AI that can distinguish the quality of mangoes from their appearance are all that are needed to achieve automatic fruit screening. However, the hard part is how can AI distinguish the quality of mangoes? That’s right, you must start by establishing a training data set! In order to create the data set, Professor Lee's team established a website that allows anyone to upload photos of mangoes and rate them. Once the data sets are refined, they can be used to train AI.

▲ The fruit screening machine developed by Professor Lee's team uses AI image recognition to select the best looking mangoes.

The accuracy of the trained AI reaches 93%, which can increase the output value by NT$1.7 billion in one season.

In 2019, the assistance of the Industrial Development Bureau (now the Industrial Development Administration of the Ministry of Economic Affairs) and AI HUB accelerated the verification of the technology.

Professor Lee's team accumulated 100,000 entries of data during the 2-month empirical period, and the accuracy of the trained AI reached 93%! This is far higher than the manual screening accuracy of 70%, resulting in a clear difference in quality. In terms of export value, the output value of mango is expected to be increased by NT$1.7 billion in one season! It can also reduce labor costs by NT$1.866 million and avoid the seasonal labor shortage problem mentioned above.

In addition, since it is no longer necessary to screen the fruit once at the goods yard and packaging yard each, it also reduces losses caused by human error in the fruit screening process. When the technology becomes more mature, the same system can be applied to other fruits exported by Taiwan, such as wax apple and guava, in the future, taking Taiwan's fruit industry to the next level.

Since it is AI, accuracy can be improved through continuous training, and continuous adjustment of algorithms and cooperation with equipment manufacturers can significantly improve production capacity. In addition, Professor Lee is also organizing the AI Cup competition with the sponsorship of manufacturers and the government, allowing more teams to use the same data set to continue to develop the algorithm, in hopes of facilitating further cooperation with companies that are interested.

Irwin mango grade identification system on AI HUB

Professor Lee's team hopes to use the power of AI to achieve complete traceability of fruits from production to packaging and transportation, thereby increasing the brand value of Taiwan's fruits! Besides hoping to allow Taiwan's fruits to seize a place in the fiercely competitive foreign markets, with high-quality supply, Taiwan's fruits can also shine internationally and become the pride of Taiwan.

▲ Taiwan's fruits still have certain competitive advantages in the international market, but they also face competitive pressure from fruit farmers in consuming countries as they are exported.


▲ Easily save NT$1.866 million per mango season and significantly improve quality.

 

 

 

 

 

 

Recommend Cases

這是一張圖片。 This is a picture.
AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOIAIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us Our company's current development We are committed toIOTsmart manufacturing our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification After discussing with IT service providers, we defined it asAOIAIa feasible operational model Tzuhong Technology has invested inAOIAIan inspection plan to checkSMTtext on components, solder joints, polarity, missing partsand usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates Industry pain points Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections Previous consumer products with undetected anomalies were acceptable within a certain ratio However, in the automotive industry today, undetected defects could lead to fatalities hence, the automotive industry has extremely high quality demands To survive in the automotive supply chain, we must address the issue of undetectable anomalies Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry Application technology and explanation Initially,Figure 1,PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products At this point, the 'suspected defective' portion accounts for20manual review for these20parts, further classifying the 'suspected defective' portion into good and defective products With We aim to leverageAItechnology, to shift from manual re-inspection of these20technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3thus reducing the workload of Tzuhong's employees from20down to only3In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0IAIDetectionFigure 2。 The original AOI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI information on defective products, then manually re-inspect one by one to determine if they are defective AOIAI inspection process The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after, then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward, then manually re-inspect one by one to determine if they are defective Process differences By introducing theAOIAIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees Difference between pre and post-introduction Promotion strategy 1 Similar field diffusion allSMTmanufacturers face bottlenecks in inspections leading to shipment delays introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs 2 Cross-industry expansion plans negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness Profit strategy 1 In collaboration withAOImanufacturers, collect licensing fees 2 Direct sales toSMTthe manufacturing industryAIsystems 3 ProvideSMTmanufacturing industryAOIAIsystem subscription model「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」

這是一張圖片。 This is a picture.
Using Plant Growth Chambers as an Example - Standardizing Electronic Device Procedures Based on Imaging

In recent years, global climate change and environmental issues have become increasingly severe, causing major impacts on agricultural production Traditional agriculture heavily relies on weather conditions, facing challenges such as unstable crop quality, plummeting yields, and difficult pest control Particularly in Taiwan, agricultural biotech companies and farmers have suffered continuous losses, creating an urgent need for innovative solutions Meanwhile, Taiwan's plant factory industry faces many challenges high equipment and labor costs, an incomplete industrial chain diminishing international competitiveness, and a lack of cooperation among enterprises, all of which limit industry development Additionally, COVID-19the pandemic has highlighted the importance of remote monitoring and management Traditional manual inspections and data collection methods no longer meet the needs of modern agricultural production These issues collectively underline the urgent need for smart agricultural solutions, driving companies like Taiwan's HaiBoTe to develop innovative projects integrating IoT, cloud computing, and artificial intelligence technologies HaiBoTe Cloud Data Integration and Analysis Platform Facing these challenges, the agricultural sector urgently needs a system that can precisely control growth environments, improve resource efficiency, enable remote monitoring, and facilitate intelligent management Existing plant factory equipment often requires complete replacement, with poor compatibility with older equipment, and sensors and camera systems may require different interfaces, making them inconvenient to use Therefore, there is a need for a flexible solution that can integrate various equipment and technologies, providing real-time monitoring and data analysis, and automatically adjusting environmental parameters based on plant growth conditions This demand exists not only in Taiwan but is also a global trend in the development of smart agriculture By incorporating artificial intelligence, more scientific evaluation standards can be established, optimizing production processes, improving yield and quality, while reducing energy consumption and environmental impact Additionally, such smart solutions can attract more young people to participate in agricultural production, promoting industry upgrading and sustainable development Overall, the demand for smart agricultural solutions stems from the urgent requirements to address climate change, enhance production efficiency, reduce costs, and achieve precise management, and this is exactly the problem companies like Taiwan's HaiBoTe are striving to solve Taiwan's plant factory operators are facing a series of severe challenges, which are gradually eroding their competitiveness and survival space Firstly, the high cost of equipment and operations is their biggest burden Each electricity bill feels like a heavy blow, forcing them to balance between ensuring product quality and controlling costs Secondly, the unpredictability brought by climate change has become their nightmare Sudden extreme weather events can destroy their carefully nurtured crops in a short time, causing massive economic losses What's worse, they find themselves increasingly at a disadvantage in international market competition In contrast, large overseas plant factories, with their advanced automation technology and well-organized supply chains, can produce stable-quality agricultural products at lower costs, putting unprecedented pressure on Taiwan's operators On the technical level, they also face numerous challenges Compatibility issues between new and old equipment often put them in a bind, encountering various technical obstacles when trying to integrate different systems Lack of precise data analysis and forecasting capabilities also makes it difficult for them to make production decisions and accurately determine the best growth conditions for each crop Existing monitoring systems provide data that is often disorganized, difficult to interpret and apply Human resource challenges are also severe, with young people generally lacking interest in agricultural work, making it difficult for them to recruit employees with modern agricultural skills Even existing employees often feel exhausted from tedious manual operations and monitoring tasks These problems are intertwined, creating a complex dilemma that leaves plant factory operators confused and anxious They urgently need a comprehensive solution that can enhance factory operational efficiency, reduce costs, and improve product competitiveness, helping them overcome difficulties and regain their footing in the fierce market competition In facing the various challenges of plant factory operators, Taiwan's HaiBoTe company has demonstrated exceptional technical innovation and a flexible customer-oriented development strategy They deeply understand that the solution must be able to seamlessly integrate existing equipment while providing highly intelligent management functions To this end, HaiBoTe's RD team adopted a modular design approach to develop a system that can be flexibly configuredIoTIoT system The core of this system is a smart control hub that can communicate with various sensors and actuators During development, HaiBoTe worked closely with customers, deeply understanding their specific needs and operational environments They even dispatched engineers onsite to observe the daily operations of the plant factories, ensuring that the developed system actually solves practical problems This in-depth cooperation not only helped HaiBoTe optimize their product design but also established a close relationship with customers, laying the foundation for subsequent continuous improvements HaiBoTe's innovation is not just reflected in hardware design but also in their developed intelligent software system This system integrates advanced machine learning algorithms, capable of precise forecasts and optimal control of plant growth conditions based on large amounts of historical data and real-time monitoring information To help customers overcome technical barriers, HaiBoTe designed an intuitive and easy-to-use user interface, which even non-technical operators can master easily Additionally, they provide comprehensive training and tech support services, ensuring customers can fully utilize all functions of the system When facing challenges, HaiBoTe's technical team can quickly identify problems through remote diagnostics and provide solutions In one incident, during a serious equipment failure emergency faced by a customer, HaiBoTe's engineers guided the customer through system remote access, successfully instructing them on repairs and avoiding potential massive losses This full-range service not only solves customers' immediate difficulties but also strengthens their confidence in intelligent management, driving the entire industry toward more efficient and sustainable development HaiBoTe's developed smart agriculture solution not only brought revolutionary changes to plant factories but also painted an encouraging picture for the future of the entire agricultural industry The excellence of this system is evident in several aspects firstly, it achieves precise control of the plant growth environment, significantly improving crop yield and quality stability Through advanced artificial intelligence algorithms, the system can forecast and adjust optimum growth conditions based on historical data and real-time monitoring information, ensuring each plant grows in the ideal environment Secondly, it significantly reduces energy consumption and operational costs, improving resource efficiency The intelligent management system optimizes water, electricity, and nutrient supply, reducing waste and lowering manpower costs Additionally, the system's modular design and strong compatibility allow it to seamlessly integrate various new and old equipment, providing a flexible solution for gradual upgrades of plant factories Most importantly, the system injects a sense of technology and modernity into agricultural production, helping to attract the younger generation to the field and injecting new vitality into the industry Looking ahead, HaiBoTe's smart agriculture system has broad application prospects and expansion potential In addition to plant factories, this system can also be applied to traditional greenhouse cultivation, urban agriculture, and even home gardening In the field of aquaculture, similar technology can be used to monitor and optimize the breeding environments for fish or shrimp In the food processing industry, similar intelligent monitoring and forecasting systems can be used to optimize production processes and enhance food safety Even in the pharmaceutical industry, this type of precise environmental management system could be applied to drug research and production processes To further promote this system, HaiBoTe could adopt a multifaceted strategy Firstly, they could collaborate with agricultural colleges and research institutions to establish demonstration bases, allowing more people to experience the benefits of smart agriculture firsthand Secondly, they could develop customized solutions tailored to different scales and types of agricultural production, expanding the applicability of their products Furthermore, they could raise awareness and acceptance of smart agriculture within the industry by hosting forums, online seminars, and sharing success stories Lastly, they could explore collaborations with government departments to integrate this system into policies supporting the modernization and sustainable development of agriculture, thereby promoting the widespread adoption of smart agriculture on a larger scale Through these efforts, HaiBoTe not only can expand its market share but also make a significant contribution to the sustainable development of global agriculture, truly realizing the vision of technology empowering agriculture 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-09」

這是一張圖片。 This is a picture.
AI Assists the Red Cross for Smarter Emergency Response

More Preparation Less Loss The Taiwan Food Bank Association, a non-profit organization, collects donations daily from wholesalers, retailers, manufacturers, and even kind-hearted individuals across Taiwan They also rescue consumable materials that are about to be discarded, properly allocate and deliver to households in need, aiding local underprivileged populations When natural disasters such as earthquakes, landslides, mudslides, typhoons, floods, and droughts occur in Taiwan, the food bank's resources can be immediately deployed for disaster relief This field verification unit is the Nantou County Red Cross AssociationOne of the food bank locations, hereinafter referred to as the Nantou Red CrossIs responsible for tasks like pre-disaster supplies preparation and disaster relief material distribution, helping the government bear the responsibility of disaster relief and aid In Taiwan, various natural disasters have characteristics of different duration and spatial coverage, wide or narrow With the normalization of extreme weather, the scale and number of disasters are gradually increasing and becoming harder to predict The required amount and type of materials differ by disaster, and they must address the lifestyles of the affected areas, rescue needs, traffic conditions, geographical restrictions, and other factors for varied material allocation, facing numerous challenges Typhoon Kanu severely damaged transportation in Nantou mountain areas Nantou County Red Cross planned the mountainous route Puli gt Fazhi Elementary School gt Qin'ai Village gt Aowanda to deliver supplies Disasters happen repeatedly We need to be prepared at all times Effective disaster preparedness can mitigate the impact, including swift response to material needs in affected areas, aid distribution, and even psychological support, providing added security for life and property of those in disaster zones Lack of Timeliness in Disaster Information To improve the living conditions and address the lack of supplies in remote areas, the Taiwan Food Bank Association has partnered with the Nantou Red Cross and has successively established food bank points in Nantou City, Puli, and Ren'aiLixing, Ruiyan, XinyiWangmei, Tongfu, Shuili, Lugu and Caotun among others9establish food bank locations, providing supplies worth a certain amount per household every month6001000in New Taiwan Dollars However, many challenges still need to be overcome during natural disasters For example, when typhoons, earthquakes, and landslides occur, the information source for disaster relief dispatch systems relies on post-disaster reports The time lag between reporting, response, and execution prevents timely adjustment and distribution of 'disaster relief' supplies based on the needs of affected areas, affecting rescue efficiency due to lack of timely information The 'preparedness' supplies of the Nantou Red Crosssuch as dry food, water, instant noodles, etc,are recorded manually in terms of stock, expiration dates, and distribution,When a disaster occurs, there is a chance that 'preparedness' supplies have expired and cannot become 'disaster relief' supplies It’s also possible that both conditions mentioned above occur simultaneously, leading to a need for more time to reassign 'preparedness' supplies into usable 'disaster relief' materials On the other hand, upon receiving information about shortages in disaster areas, the supplies donated by the public often grossly differ from the actual needs of the disaster zone, leading to an excess of supplies The Process of Material Operations Before and After a Natural Disaster AIAnticipating Natural Disasters Reinforcing the Accuracy of Preparedness Material Dispatch Application API Technology connects to compute the state of the climate, the intensity of disaster rescues, prioritizing the main tasks of the Nantou Red Cross and the needed areas of search and rescue Coordinated with the existing heavy rain and typhoon simulation disaster training of the Nantou Red Cross, a 'Natural Disaster Emergency Preparedness Material Dispatch and Supplement Decision System' is establishedreferred to as the Emergency Preparedness Material System。 In material management, inventory data along with immediate supply data are entered into the Emergency Preparedness Material System for comparison and analysis, helping the Nantou Red Cross quickly recognize materials like cookiesdry food, beverages, frozen food, toilet paper, etc, and determining whether they should be 'preparedness' materials or regularly distributed materials Adding to this, information forecasting understands the potential disaster conditions in remote areas, facilitating food delivery, addressing both front-end food wastage and backend practical needs When a natural disaster occurs, it enables faster response and decision-making, completing material deployment, hence increasing the speed of material operation transition20。 AI Emergency Preparedness Material System Helps Rapidly Adapt Material Distribution Through the field verification of the Nantou Red CrossAIthe system, material management, and related applications are promoted to more emergency response organizations in different areas, while continuously improving the alert functions within the Emergency Preparedness Material System, strengthening the technological foundation for alerts, enhancing prediction accuracySystem immediacy, and optimizing the data collection and analysis process Simultaneously, it can collaborate with government agencies, meteorological departments, or other rescue teams to discuss integrating more data sources, establishing a mechanism to share resources and data promptly, sharing information in real-time, helping more emergency response organizations enhance their disaster response abilities, seizing the golden rescue time 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」