:::

【2020 Application Example】 Automatic fruit screening system: A solution that uses neural networks, AI, and automation to improve fruit screening efficiency by 10 times, increase output value by NT$1.7 billion, and significantly improve quality with 93% accuracy

Taiwan is located in the subtropics and has a diverse geographic environment that is very suitable for growing fruit. Bananas and pineapples were once extremely popular export commodities that we are proud of. However, farmers in consuming countries gradually obtained the excellent seeds of Taiwan’s fruits, and were able to grow the same quality fruit but at a more affordable price, causing our fruit exports to face a major crisis! At present, although Taiwan's fruits such as mango and guava still have certain competitive advantages, if they fail to make further progress compared with other countries, they will still encounter the same problem over time and cannot be ignored! Fruit quality and brand value are the only ways for Taiwan's fruit industry to remain competitive internationally.

Fruit screening is the main link in fruit production and marketing that determines quality. Currently, the industry is highly dependent on aging rural manpower, resulting in rising fruit screening costs due to labor shortage and making it extremely difficult to maintain stable yield. Therefore, the automation of fruit screening work has become a very important and urgent issue. Professor Chi-Chun Lee at the Department of Electrical Engineering of National Tsing Hua University led a team to develop an automatic fruit screening system that combines cameras, conveyor belts, and AI. The system currently has an accuracy reaching 93%. One production season can increase the output value of mango by NT$1.7 billion. With the gradual development of the AI system, the accuracy is expected to improve in the future, and the same system can also be applied to other fruits, further promoting traceable fruit and driving the technological upgrading of Taiwan's fruit industry.

Fruit screening relies heavily on scarce manpower, and the aging of the rural population makes the situation even worse

Professor Chi-Chun Lee learned about the fruit industry’s dilemma from his classmate Yu (alias), who had studied together in the United States. Yu is the young second-generation successor of one of Taiwan's largest fruit import and export companies. According to Yu's observations in the industry over numerous years, Taiwan's fruit production and export usually generated good profits at first, but after fruit farmers in the consuming countries obtained the seeds, they will often attempt to grow the fruit locally to reduce costs and obtain greater profits. If Taiwanese fruits cannot surpass the products of fruit farmers in consuming countries in terms of quality or brand value, they will be eliminated because competitors' costs are indeed lower.

Fruit screening is used to divide fruits according to quality. If they cannot pass the minimum specification, they will be discarded as waste products. In practice, the work of screening fruits will be carried out by farmers' goods yards and distributor' packaging yards respectively. However, if it is not properly handled by the collection freight yards and the packaging yards do not do a good job in sampling in the early stage, it will result in a loss for distributors and cause 30% of A/A+ grade fruits to be eliminated.

This job relies heavily on experienced fruit screeners. More experienced fruit screeners can not only control the quality and reduce the chance of fruit damage in the fruit screening process, but also have the ability to pick out about 10% more A+ grade fruits, which adds great value. What worries the industry is that experienced fruit screeners are gradually decreasing due to the aging population in rural areas, making them a very rare resource. Such rare human resources are often in high demand during busy farming periods. Farmers or distributors who fail to hire experienced fruit screeners have to settle for less experienced one, taking on the risk of additional losses and paying greater costs. The most unfortunate situation suffering a loss of 30% mentioned above.

▲ Fruit screening is an important process in the later stages of fruit production when packaging and selling. Failure to properly control quality will result in huge losses.

AI is very suitable for assisting in fruit screening, but it is difficult to obtain data sets

After understanding Yu's difficulties, Professor Lee found that this was a problem that could be solved using AI - although fruit screening relies heavily on experienced fruit screeners, it is a highly repetitive task. Handling repetitive tasks with a large amount of data has always been a strength of AI.

However, the first problem appeared even before research and development work started: Which fruit do we start with?

First of all, a suitable fruit must reach a certain export volume, and the fruit must still have considerable room for growth. For some fruits that lack international competitiveness, such as bananas and pineapples, companies no longer have the ability to invest more funds to purchase equipment, let alone sponsor R&D or assist the R&D team in experiments.

When you have an idea, you need to pick up the pace and put it into practice as soon as possible! Therefore, Irwin mango, which still has a certain advantage in terms of scale, was selected as the first experimental subject of the automatic fruit screening system.

The first step after harvesting mangoes is to screen the fruits for the first time at the goods yard. After the fruits are screened, they are sent to the packaging yard for fumigation and disinfection, and preparation for sale or loaded into containers for export. However, exporters with a deeper understanding of the target market will have stricter quality requirements and will often screen the fruit again to ensure the quality of the fruit before fumigation at the packaging site. Since employees at the goods yard are paid based on the number of mangoes screened rather than on the quality of the mangoes, they focus on quantity when working. As a result, to ensure the quality of the selected fruits, the subsequent packaging factory has to screen the fruit again, increasing labor. The solution seems simple and clear - A camera, machine conveyor belts for grading and sorting, and an AI that can distinguish the quality of mangoes from their appearance are all that are needed to achieve automatic fruit screening. However, the hard part is how can AI distinguish the quality of mangoes? That’s right, you must start by establishing a training data set! In order to create the data set, Professor Lee's team established a website that allows anyone to upload photos of mangoes and rate them. Once the data sets are refined, they can be used to train AI.

▲ The fruit screening machine developed by Professor Lee's team uses AI image recognition to select the best looking mangoes.

The accuracy of the trained AI reaches 93%, which can increase the output value by NT$1.7 billion in one season.

In 2019, the assistance of the Industrial Development Bureau (now the Industrial Development Administration of the Ministry of Economic Affairs) and AI HUB accelerated the verification of the technology.

Professor Lee's team accumulated 100,000 entries of data during the 2-month empirical period, and the accuracy of the trained AI reached 93%! This is far higher than the manual screening accuracy of 70%, resulting in a clear difference in quality. In terms of export value, the output value of mango is expected to be increased by NT$1.7 billion in one season! It can also reduce labor costs by NT$1.866 million and avoid the seasonal labor shortage problem mentioned above.

In addition, since it is no longer necessary to screen the fruit once at the goods yard and packaging yard each, it also reduces losses caused by human error in the fruit screening process. When the technology becomes more mature, the same system can be applied to other fruits exported by Taiwan, such as wax apple and guava, in the future, taking Taiwan's fruit industry to the next level.

Since it is AI, accuracy can be improved through continuous training, and continuous adjustment of algorithms and cooperation with equipment manufacturers can significantly improve production capacity. In addition, Professor Lee is also organizing the AI Cup competition with the sponsorship of manufacturers and the government, allowing more teams to use the same data set to continue to develop the algorithm, in hopes of facilitating further cooperation with companies that are interested.

Irwin mango grade identification system on AI HUB

Professor Lee's team hopes to use the power of AI to achieve complete traceability of fruits from production to packaging and transportation, thereby increasing the brand value of Taiwan's fruits! Besides hoping to allow Taiwan's fruits to seize a place in the fiercely competitive foreign markets, with high-quality supply, Taiwan's fruits can also shine internationally and become the pride of Taiwan.

▲ Taiwan's fruits still have certain competitive advantages in the international market, but they also face competitive pressure from fruit farmers in consuming countries as they are exported.


▲ Easily save NT$1.866 million per mango season and significantly improve quality.

 

 

 

 

 

 

Recommend Cases

【導入案例】救命急如星火 AI病危系統監測掌握黃金搶救期
Life-saving is as urgent as a spark AI critical illness system monitors and grasps the golden rescue period

60-year-old Mr Huang was admitted to the hospital due to a stroke After lying in the intensive care unit for two weeks, his condition suddenly took a turn for the worse After rescue, he was lucky enough to survive In fact, with the assistance of AI critical illness early warning technology, hospitals can detect signs and take timely and accurate medical measures 6-8 hours before a patient's heart stops, which can greatly reduce the chance of death in the hospital The deterioration of the condition is a process that evolves over time, and its subtle changes are by no means without context Previous research reports show that about 60 to 70 of inpatients who experience unexpected in-hospital cardiac arrest had symptoms 6 to 8 hours before their cardiac arrest, but only a quarter of them were recognized by clinical staff Detection and discovery, therefore, there is a need for a risk warning tool or system that can be used earlier and continuously to monitor the condition, alert medical staff to pay attention to subtle changes in the patient's condition at any time, and take timely and accurate intervention measures before the condition progresses to effectively reduce adverse events or the risk of serious adverse events Unexpected deterioration cannot be detected early Acute and severe patients often undergo unpredictable changes, and timely detection or prediction of potential acute and severe patients is an important issue The currently commonly used clinical assessment method is Modified Early Warning Score MEWS, which uses simple physiological parameter assessment including heartbeat, respiratory rate, systolic blood pressure, body temperature, urine output and state of consciousness to screen out high-risk patients, and has been proven to be predictive Patient clinical prognosis MEWS is a scoring mechanism with a single time point and a standardized formula However, the AI crisis warning system developed by Boxin Medical Electronics - Hospital Emergency and Critical Care Early Warning Index System EWS is designed to predict patient status with immediate response , collect the physiological data of patients over time for deep learning, find the best prediction model, and improve the overall accuracy Boxin Medical Electronics uses a big data analysis model to build an early warning system EWS, IoT Internet of Things and 5G communication technology, allowing medical staff to remotely monitor the physiological status of patients through communication equipment, and monitor emergency and severe cases quickly The patient's condition changes and the golden rescue period of 6-8 hours before cardiac arrest can be grasped After Boxin Medical Electronics introduces AI visual interpretation, unmanned operation can greatly reduce medical manpower The AI technology developed by Boxin Medical Electronics is the Gradient Boosting Ensemble Learning System GBELS to build an early warning system It is a learning-based EWS prediction algorithm developed by the company, which is an integrated learning Ensemble Learning and is classified as supervised learning, providing the following three functions 1 Early warning risk notification is used to analyze representative data using GBELS to provide an early risk score so that medical staff can conduct immediate clinical assessment and provide appropriate medical treatment 2 Reduce medical manpower Collect continuous physiological monitoring data, such as heartbeat, respiration, blood pressure and blood oxygen concentration, etc, to reduce the time for medical staff to write cases 3 Combine IOT logistics network and 5G communication technology to quickly transmit medical data such as monitoring parameters and imaging data, and assist medical staff to monitor changes in patients' condition remotely through communication equipment AI critical illness system monitoring to master the golden treatment period Boxin Medical Electronics stated that assessing the severity of the disease in acute and severe patients is a complex task, and patients often experience unpredictable changes Clinical medical staff often judge the condition based on their own clinical experience or intuition, which lacks science and objectivity, resulting in the inability to correctly identify and timely detect potentially acute and severe patients, resulting in or misdiagnosis leading to increased in-hospital mortality of patients The introduction of an AI early critical illness warning system can assist emergency and critical care medical staff to correctly predict the patient's condition and allow patients to receive the care they need immediately This can reduce the manpower arrangement of the emergency and critical care ward at the same time and reduce labor costs In addition, the easy-to-carry design will help the system be introduced into ambulances, home care and other places in the future, so that emergency patients can receive appropriate care earlier Other departments within the hospital can also develop new applications around this system, which can effectively accelerate the development and promotion of smart medical technology With the COVID-19 epidemic still raging in many countries around the world, this system can also help hospitals in various places to operate more effectively Caring for and monitoring the condition of critically ill patients In addition to AI critical illness warning, Boxin Medical Electronics has also developed AI image interpretation - Medical Physiological Monitor Life Cycle Compliance Testing AVS, which uses AI image interpretation technology to develop automated quality inspection of life support medical equipment The instrument solves the time-consuming problem of medical instrument testing It can reduce testing time by 70, increase the number of tests by 3 times, and effectively reduce labor costs by 50 At the same time, it is 100 compliant with regulatory requirements, and gradually solves the shortage of manpower and medical resources in the medical field , medical work overload and other issues It has now taken root in mainland China and is actively preparing for its launch in Europe It will develop towards the Japanese and American markets in the future Boxin Medical Electronics develops AI image interpretation-medical physiological monitor life cycle compliance testing AVS to solve the time-consuming problem of medical instrument testing and can reduce testing by 70 time At this stage, Boxin Medical's smart medical technology has been introduced into medical hospitals including Hsinchu MacKay, Changkei, Dongyuan General Hospital, Kaohsiung University of Technology Affiliated Hospital, Zhenxin Hospital, Hsintai Hospital, Taipei Medical University Affiliated Hospital, etc GE HealthcareInc, an internationally renowned medical materials manufacturer, and Mindray Medical, China's largest medical materials manufacturer, are both representative customers of Boxin Medical Electronics 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

這是一張圖片。 This is a picture.
Realizing the dream of unmanned stores, Magpie Life is building the future of the smartphone industry

"The DNA of Magpie Life is not limited to vending machines We believe that vending machines combine technology, access, and humanities to bring us exciting results" This is a sentence on the official website of Magpie Life Let the vending machines bring To live a pleasant life and build a considerate, technological and sustainable future for the smartphone industry is also the original intention of Magpie Life Founded in 2018, Magpie Life launched Taiwan’s first private-brand mobile payment scan code sensor 4 months after its establishment, completing the consumption experience through screen touch The Magpie U1 smart vending machine manages the POS system and gathers data in the background, allowing consumers to synchronize with the world's new retail pace and experience a new retail consumption experience of purchasing convenience, checkout security, visual entertainment, and improved logistics replenishment efficiency Traditional vending machines lack information visibility and AI technology assists in information transparencyThis time, the Magpie smart vending machine is also equipped with AI technology to provide adjustable shelf space , a vending machine equipped with an industrial computer and a large-size touch display screen to achieve the purpose of a store-less store Magpie Life stated that the biggest problem with traditional vending machines is the lack of information visibility To check inventory, replenishment personnel must physically inspect each machine, which is time-consuming and costly When a machine breaks down, it will generally be unable to operate for a long time Most failures go unreported and are not discovered until the next restocking crew arrives to replenish supplies Then you have to wait for a service technician to be scheduled, which can take weeks Traditional vending machines lack real-time interactivity When consumers encounter problems after inserting coins, manufacturers cannot handle them immediately In addition, traditional vending machines are less flexible and cannot adapt to changes in consumer preferences Traditional vending machines have shortcomings such as limited change shopping, single payment tools, limited number of products, and few choices Affected by the COVID-19 epidemic, consumption habits have shifted to contactless methods, causing the unmanned store market to heat up Generally, vending machines can only place relatively simple products such as drinks, food, etc The properties available for sale are limited The patented vending machine developed by Magpie can adjust the shelf space and is equipped with a lifting cargo elevator, which is suitable for various types of goods In addition, the machine is equipped with an industrial computer and a large-size touch display screen, which can meet the needs of advertising support at the same time It is expected to move towards a storeless store According to Magpie Life Observation, the consumer market trend in the past two years is that consumers demand convenient life, food consumption patterns value dining experiencesimple and fast, and are equipped with mobile phone-connected ordering models, and hot drinks and Fresh food delivery is the focus of two major trends The location, items sold, consumption methods and multiple payment methods are the focus of market growth for smart vending machines In terms of convenience, Taiwanese consumers still prefer to purchase vending machine food near stations, airports, schools, and businesses in business districts Various payment methods are also gaining more support from consumers, indicating that in the future, automatic Vending machines can be developed in two directions diversified items and diversified payment methods AI sales forecast technology integrates back-end management to achieve precise marketing purposesDue to the wide variety of products, it is difficult to know the performance of products under different factors such as season, market conditions , promotional activities, etc, it is easy to cause out-of-stock or over-inventory situations Magpie Life has specially developed "AI sales forecasting technology" and integrated it into the back-end management system, hoping to lock in customer purchasing preferences and intentions through data analysis In order to achieve the purpose of precise marketing, make accurate business decisions and effectively allocate limited resources The introduction of AI systems can achieve the three major goals of precise marketing, inventory management and supply chain management This system is a replenishment decision-making aid designed specifically for supply chain managers It uses AI to predict future sales demand, helping companies effectively optimize production capacity, inventory and distribution strategies Its overall system architecture includes1 Data exploratory analysis function Provides automatic value filling, automatic coding and automatic feature screening functions for missing values in the data 2 Modeling function 1 Provides model training functions for two types of prediction problems regression Regression and time series Time Series Forecast nbsp2 Supports Auto ML automatic modeling, and the best model is recommended by the system Integrated models can also be established to improve model accuracy nbsp3 Supports multiple algorithm types Random Forest, XGBoost, GBM and other algorithms nbsp4 Supports a variety of time series models exponential smoothing, ARIMA, ARIMAX, intermittent demand, dynamic multiple regression and other models nbsp5 Supports a variety of model evaluation indicators R, MAE, MSE, RMSE, Deviance, AUC, Lift top 1, Misclassification and other indicators nbsp6 Supports automatic cutting of training data sets and Holdout verification data sets, and can manually adjust the ratio nbsp7 Supports automatic model ensemble learning Stacked Ensemble, balancing function learning Balancing Classes, and Early Stopping nbsp8 Supports the creation of multiple models at the same time The system will allocate resources according to modeling needs, so that modeling, prediction and other tasks have independent computing resources and do not affect each other In the overall server space With an upper limit, computing resources can be used efficiently nbsp9 It has in-memory computing function, which can use large-capacity and high-speed memory to perform calculations to avoid reading and writing a large number of files from the hard disk and improve computing performance 3 Data concatenation function Using API grafting and complete data concatenation automation, there is no need to manually import data, improving user experience 4 Chart analysis function Provides visual charts and basic statistical values for product sales AI data analysis solutions have two major advantages 1 Entrepreneurship machines can be rented and sold at low cost to open unmanned physical stores and cooperate with the chain retail industry Through smart machines, entrepreneurs can rent and sell them at a lower cost than the store rent Cost of running a retail business Two cooperation models, machine sales and leasing, are provided, and the choice is based on the evaluation of the industry 2 Various types of products are put on the shelves Products are sold anytime and anywhere 24 hours a day Up to 60 kinds of diversified products can be put on the shelves Large transparent windows enhance the visibility of products Regular replenishment and tracking of product sales status are available, and product types can be adjusted according to needs Recently, the line between the Internet and the physical world has blurred, the way customers interact has changed significantly, and consumer demand is changing and personalized The retail industry is facing unprecedented challenges and uncertainties, and mastering data has become key AI data analysis solutions can help the retail industry quickly activate large amounts of data, create seamless personalized experiences, optimize the operational value chain and improve efficiency, and strengthen the core competitiveness of enterprises 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】化身大型AIOT科技遊樂場 海科館華麗轉身好吸睛
Transforming into a Large-Scale AIoT Technology Playground: The Spectacular Makeover of the National Museum of Marine Science & Technology

Taiwan is a maritime nation When you visit the Badozi Fishing Port or Tidal Park in Keelung, do you also explore the mysteries of the ocean world at the 48-hectare National Museum of Marine Science amp Technology To get more people closer to marine technology, Keelung's Marine Museum has introduced technological services, transforming the venue into a large technology playground that delights both children and adults, fully utilizing the 'learning through play' approach After a lengthy planning process, Northern Taiwan's largest marine science museum in Keelung opened in January 2014 The museum focuses on marine education and technology, boasting Taiwan's largest IMAX 3D ocean theater The unique themes and modern viewing facilities should make it a well-known landmark in Keelung However, the original exhibition planning was static and highly specialized, lacking sufficient interaction with the public Visitors who have attended the museum also reported that the exhibits were limited and quite boring, leading to poor overall consumer experience ratings The top three dissatisfactions with the museum were weak connections to surrounding attractions, unengaging display content, and lack of exhibit material According to statistics from the Marine Museum, the ratio of local to visiting guests is approximately 64, with most foreign visitors coming from the north transportation is primarily by car and bus common types of visits include family, parent-child, and friends and the stay duration is generally 1 to 2 hours Upon deeper investigation, the top three visitor complaints were weak linkages to surrounding attractions, unengaging display content, and insufficient number of exhibits The museum analyzed potential reasons, including some displays being too specialized, making it difficult for the public to understand, and a lack of interactive elements, making the exhibition boring and the visit hurriedly brief Analysis of visitor profiles revealed that since half of the museum's visitors are locals, and accessing the museum is not so easy for out-of-towners who must travel by car or public transport, the design of the venue and exhibitions must incorporate more interactivity and intrigue to encourage locals to return and extend the duration of visitors' stays while using technological services to highlight the museum's unique features Through a recommendation from the Information Software Association, part of the Ministry of Economic Affairs' Industrial Bureau AI team, the Marine Museum commissioned Jugu Technology to resolve the issue of uninspiring venue attractions Preliminary interviews by Jugu Technology revealed that many visitors were attracted by the architectural design of the museum, notices posted on nearby walls, flags, or events being held the most interesting feature for visitors was the 3D ocean theater, indicating that content presented through audio-video and physical scenic methods was more engaging Seven major AI technologies lead to a boost in regional tourism at the Marine Museum Through the introduction of technology services, Jugu Technology designed the 48-hectare site with seven major services AI voice tours, treasure hunt puzzle games, AI exhibit interactive revitalization, AI space exhibition interactive experience, AI crowd control, Face AI interactive experience, and AI voice customer service system By utilizing AIoT and cloud technology, they made the exhibition more interesting, not only solving the issue of boring static viewings for children but also doubling the learning efficiency and dramatically improving public perception of the Marine Museum, thus increasing visitor intent and boosting regional tourism The National Museum of Marine Science and Technology introduced seven major technological application services including AI voice guide Jugu Technology aimed to improve the space optimization of the Marine Museum, using the special exhibition of coastal birds in northern Taiwan as a prototype, integrating 'face', 'limb', 'crowd' as three main axes to enhance functionality and assist in improving the museum's application of AI Practically, the Marine Museum and Jugu Technology selected the on-site special exhibits to avoid any installation of water and electricity works or pipelines in active exhibits, thereby maintaining the quality of the viewing experience Instead, they selected exhibits that were not yet open to introduce a series of technological services tailored to the unique characteristics of the exhibits In the coastal bird special exhibition inside the Marine Museum, initial construction discussions with the curators utilized Bella X1 for a welcoming interactive introduction at the exhibition entrance This was followed by an AI-powered smart guide in both Chinese and English using X1 for narration, coupled with a fun treasure hunting stamp-collecting activity - APP X1, allowing visitors to participate in challenges Subsequently, bird species within the bird exhibition were brought to life interactively using X1, and AR scenarios X1 were introduced into the exhibition space to add elements of fun and entertainment Finally, Face AI was used to interactively test facial expressions and score smiles The gorgeously transformed Marine Museum will become the best travel destination for families with children ImageMarine Museum FB Page The AIoT services introduced by the Marine Museum could be extended to various exhibition-type museums and even static art galleries in the future, tailored to the unique characteristics of different venues They could also be promoted through government projects and related plans, aiding in rural revitalization, making visits more than just sightseeing in rural areas, and breaking free from stereotypes associated with different venues The applications of these services are broad「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」