:::

【2024 Application Example】 AI-Based PCBA Surface Defect Detection Improvements

With the introduction of theAOI+AIWith the introduction of the system, we can improve product yield, reduce costs, and from a business perspective, increase customer trust and sales revenue. Moreover, AIit has advantages that are difficult to imitate, unlike other equipment that can be bought with money, making it hard for our competitors to catch up with us.

Our company's current development

We are committed toIOTsmart manufacturing; our systems already include smart materials systems, environmental humidity control systems, anti-miscarriage systems, smart procurement computation systems, smart inventory systems, solder paste management systems, and production management systems. We have asked other manufacturers about the possibility ofAIinspectingPCBAsurface defects, each hoping that we would purchase their equipment, but none were effective upon verification. After discussing with IT service providers, we defined it asAOI+AIa feasible operational model.

Tzuhong Technology has invested inAOI+AIan inspection plan to checkSMTtext on components, solder joints, polarity, missing parts....and usingAIto replace manual learningAOIand define the 'potentially defective' parts, enhancing productivity and reducing misjudgment rates.

Industry pain points

    Taiwan faces a severe labor shortage, especially those willing to perform visual inspections are few and typically older, increasing the frequency of missed inspections. Thus, the most critical bottleneck in the pursuit of high-quality electronics has become post-production inspections. Previous consumer products with undetected anomalies were acceptable within a certain ratio. However, in the automotive industry today, undetected defects could lead to fatalities; hence, the automotive industry has extremely high quality demands. To survive in the automotive supply chain, we must address the issue of undetectable anomalies.

    Moreover, as wages in Taiwan continue to rise, we can only endeavor toAIreplace traditional manpower with technology, otherwise, even if the anomaly leakage problem is resolved, the relatively high labor costs will still prevent competitiveness in this industry.

Application technology and explanation

    Initially,(Figure 1)PCBUpon emerging,Reflowsystem, it will undergoAOIwill undergo inspection, dividing into 'suspected defective' and good products. At this point, the 'suspected defective' portion accounts for20%manual review for these20%parts, further classifying the 'suspected defective' portion into good and defective products. With

    We aim to leverageAItechnology, to shift from manual re-inspection of these20%technology, we aim to replace manual review of 'suspected defective' products withAIand after review, the results still yield 'good' and 'suspected defective' products, but now 'suspected defective' comprises only3%thus reducing the workload of Tzuhong's employees from20%down to only3%In theory, it isAOIIn theory, after inspection, it is further reviewed byAIbut it appears to go throughAOIonly, so we call this technologyA0I+AIDetection(Figure 2)

The original AOI inspection process
The original AOI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOI

information on defective products, then manually re-inspect one by one to determine if they are defective.

AOI+AI inspection process
AOI+AI inspection process

The operator will place the testPCBboard intoAOIthe inspection equipment, outputtingAOIinformation on defective products after,

then proceed byAIfirst performingAOIre-assessment of defective products, outputtingAIinformation on defective products afterward,

then manually re-inspect one by one to determine if they are defective.

Process differences

    By introducing theAOI+AIsystem, not only can we enhance the efficiency and yield of visual inspection personnel, we also have this timeAIexperience in system introduction, we will also incorporateAIthe use of big data into Tzuhong's existing smart manufacturing systems, further enhancing the performance of our smart manufacturing systems and reducing the pressure on employees.

Difference between pre and post-introduction
Difference between pre and post-introduction

Promotion strategy

(1)       Similar field diffusion: allSMTmanufacturers face bottlenecks in inspections leading to shipment delays; introducing this system can solve the severe labor shortage issue and enhance shipment speed and quality, allowing self-promotion to customers or through equipment dealers to cater to relevant needs.

(2)       Cross-industry expansion plans: negotiate withAOImanufacturers to directly integrateAIthe system intoAOItheir systems, enhancing their market competitiveness.

 

Profit strategy

(1)       In collaboration withAOImanufacturers, collect licensing fees.

(2)       Direct sales toSMTthe manufacturing industryAIsystems.

(3)       ProvideSMTmanufacturing industryAOI+AIsystem subscription model

「Translated content is generated by ChatGPT and is for reference only. Translation date:2024-12-09」

Recommend Cases

【解決方案】連聯合國都買單 悠由數據應用運用農業數據搶攻全球商機
Even the United Nations is on board! Yoyo Data Application captures global business opportunities with agricultural data

Nearly 2,000 days in the fields have made Yoyo Data Application a top player in Taiwan’s agricultural data sector Their comprehensive grasp of crop yields, production periods, and prices has enabled them to collaborate with the United Nations The service area for agricultural land skyrocketed from 24 hectares to over 6,000 hectares in less than three years—a 250-fold increase For Wu Junxiao, founder and CEO of Yoyo Data Application, aligning with global environmental trends and becoming a data company at the intersection of climate technology and the green economy to serve the global market is his ultimate entrepreneurial goal Wu Junxiao, originally an engineer, joined the Industrial Technology Research Institute in 2010, where he honed his profound technical and data science analytic skills 'At that time, I was working in data analysis engineering, and almost all data-related materials would be directed to me Additionally, I worked on indoor cultivation boxes, planting vegetables and mushrooms, hence planting the seed of entrepreneurship by integrating agriculture with data analysis,' Wu recalls Since 2016, Wu Junxiao has been frequently visiting farms to 'embed' himself among farmers and agricultural researchers, chatting and sharing information systematically, which quickly established his agricultural know-how Solid data analysis capabilities have even convinced the United Nations In 2017, he left the Institute to start his own business and founded Yoyo Data Application in 2019 Today, many agricultural businesses are his clients, with service areas rapidly climbing from 24 hectares to over 6,000 hectares, expected to surpass 7,000 hectares in 2022 His clientele includes markets in Japan, Central America, and even entities under the United Nations like the World Farmers Organization, which utilizes the 'Yoyo Crop Algorithm System' supported by Yoyo Data How exactly does Yoyo Data Application manage to impress even UN agencies The 'Yoyo Crop Algorithm System' developed by Yoyo Data Application accurately predicts the production period, yield, and prices Firstly, due to Wu Junxiao's precise mastery over agricultural data, Yoyo Data Application's clients don't necessarily need sensors or other hardware devices 'Sensors are expensive and if you buy cheap devices, you just collect a lot of noise or flawed data, which is useless,' Wu explains He continues, 'Collecting data doesn't necessarily require sensors our data solutions can solve problems more directly and effectively' For instance, one of Yoyo Data Application's products, the Yoyo Money Report Agri-price Linebot, developed in collaboration with LINE in 2020, gathers data on origin, wholesale, and terminal prices spanning over 10 years, driven by Yoyo Data’s proprietary AI algorithms This enables the system to autonomously learn about agricultural product trading prices, using big data and AI to perform price prediction analysis, thereby helping buyers reduce transaction risks and expanding the data application to the entire agricultural supply chain Regarding banana prices, the accuracy of price predictions increased from the original 70 to 998 Wu Junxiao notes that both buyers and farmers are very sensitive to prices Now, through the Yoyo Money Report service, both buyers and farmers can precisely understand the fluctuations in agricultural product prices Yoyo Data can also provide customers with optimal decision-making advice based on predictive models for crop growth, yield, and price estimations Currently, price predictions cover 28 types of crops Precise estimates of production periods and price fluctuations allow Yoyo Data to provide differentiated services based on data analysis The 'Yoyo Crop Algorithm System' provided by Yoyo Data Application incorporates a 'Parameter Bank', usually collecting 200-300 parameters, not just straightforward data like temperature and humidity, but also data divided according to the physiological characteristics of the crops Through effective dynamic data algorithms, it can accurately calculate when crops will flower and when they can be harvested, what the yield will be, and so forth For instance, the prediction accuracy of the broccoli production period is 0-4 days, with the flowering period predicted this year to be precisely 0 days, perfectly matching the actual flowering time in the field In these dynamic calculations, a 7-day range is considered reasonable, and the average error value of Yoyo Data's predictions typically ranges from 2-4 days, with most crop production period accuracies above 80 Through effective dynamic data algorithms, over 120 global crops can have their production periods and yields accurately estimated Using these effective dynamic data algorithms can set estimates for production quantities, helping adjust at the production end Yoyo Data Application's clientele primarily includes exporters of fruit crops like pineapples, bananas, guavas, mangos, pomelos, sugar apples, Taiwan's agricultural production is highly homogenized, often leading to a rush to plant the same crops and resulting in price crashes Yoyo Data Application helps clients differentiate their offerings Thus, Wu Junxiao positions his company as a boutique digital consultant, carefully selecting clients for quality over quantity He notes that Taiwanese agricultural clients focus on how to improve yield rates, even categorizing yield rates by quality, aiming for high-quality, specialized export markets whereas international clients prioritize maximizing per-unit yields, showing different operational approaches in domestic and international markets In addition to agricultural fruit, Yoyo Data Application has also extended its services to the fisheries sector, including species like milkfish, sea bass, and white shrimp, all using the same system to establish various parameters related to the growth of fish and shrimp, such as when to feed and when to harvest, and the anticipated yield, timing, and prices Yoyo Data Application harnesses the power of data to create miracles in smart agriculture In response to the company's rapid development, Yoyo Data Application introduced venture capital funds in 2021 to expand its staff and promote its business Wu Junxiao states that in response to the global trend towards net zero carbon emissions by 2050, he plans to help clients plant carbon in the soil, effectively retaining carbon in the land while also connecting clients to carbon trading platforms, creating environmental business opportunities together Wu Junxiao says that from the start of his entrepreneurial journey, he positioned the company as a global entity, thus continuous international collaborations are planned As a data company serving a global clientele and focused on climate technology and the green economy, this represents Wu’s expectations for himself and his company's long-term goals Yoyo Data Application founder and CEO Wu Junxiao「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【導入案例】化身大型AIOT科技遊樂場 海科館華麗轉身好吸睛
Transforming into a Large-Scale AIoT Technology Playground: The Spectacular Makeover of the National Museum of Marine Science & Technology

Taiwan is a maritime nation When you visit the Badozi Fishing Port or Tidal Park in Keelung, do you also explore the mysteries of the ocean world at the 48-hectare National Museum of Marine Science amp Technology To get more people closer to marine technology, Keelung's Marine Museum has introduced technological services, transforming the venue into a large technology playground that delights both children and adults, fully utilizing the 'learning through play' approach After a lengthy planning process, Northern Taiwan's largest marine science museum in Keelung opened in January 2014 The museum focuses on marine education and technology, boasting Taiwan's largest IMAX 3D ocean theater The unique themes and modern viewing facilities should make it a well-known landmark in Keelung However, the original exhibition planning was static and highly specialized, lacking sufficient interaction with the public Visitors who have attended the museum also reported that the exhibits were limited and quite boring, leading to poor overall consumer experience ratings The top three dissatisfactions with the museum were weak connections to surrounding attractions, unengaging display content, and lack of exhibit material According to statistics from the Marine Museum, the ratio of local to visiting guests is approximately 64, with most foreign visitors coming from the north transportation is primarily by car and bus common types of visits include family, parent-child, and friends and the stay duration is generally 1 to 2 hours Upon deeper investigation, the top three visitor complaints were weak linkages to surrounding attractions, unengaging display content, and insufficient number of exhibits The museum analyzed potential reasons, including some displays being too specialized, making it difficult for the public to understand, and a lack of interactive elements, making the exhibition boring and the visit hurriedly brief Analysis of visitor profiles revealed that since half of the museum's visitors are locals, and accessing the museum is not so easy for out-of-towners who must travel by car or public transport, the design of the venue and exhibitions must incorporate more interactivity and intrigue to encourage locals to return and extend the duration of visitors' stays while using technological services to highlight the museum's unique features Through a recommendation from the Information Software Association, part of the Ministry of Economic Affairs' Industrial Bureau AI team, the Marine Museum commissioned Jugu Technology to resolve the issue of uninspiring venue attractions Preliminary interviews by Jugu Technology revealed that many visitors were attracted by the architectural design of the museum, notices posted on nearby walls, flags, or events being held the most interesting feature for visitors was the 3D ocean theater, indicating that content presented through audio-video and physical scenic methods was more engaging Seven major AI technologies lead to a boost in regional tourism at the Marine Museum Through the introduction of technology services, Jugu Technology designed the 48-hectare site with seven major services AI voice tours, treasure hunt puzzle games, AI exhibit interactive revitalization, AI space exhibition interactive experience, AI crowd control, Face AI interactive experience, and AI voice customer service system By utilizing AIoT and cloud technology, they made the exhibition more interesting, not only solving the issue of boring static viewings for children but also doubling the learning efficiency and dramatically improving public perception of the Marine Museum, thus increasing visitor intent and boosting regional tourism The National Museum of Marine Science and Technology introduced seven major technological application services including AI voice guide Jugu Technology aimed to improve the space optimization of the Marine Museum, using the special exhibition of coastal birds in northern Taiwan as a prototype, integrating 'face', 'limb', 'crowd' as three main axes to enhance functionality and assist in improving the museum's application of AI Practically, the Marine Museum and Jugu Technology selected the on-site special exhibits to avoid any installation of water and electricity works or pipelines in active exhibits, thereby maintaining the quality of the viewing experience Instead, they selected exhibits that were not yet open to introduce a series of technological services tailored to the unique characteristics of the exhibits In the coastal bird special exhibition inside the Marine Museum, initial construction discussions with the curators utilized Bella X1 for a welcoming interactive introduction at the exhibition entrance This was followed by an AI-powered smart guide in both Chinese and English using X1 for narration, coupled with a fun treasure hunting stamp-collecting activity - APP X1, allowing visitors to participate in challenges Subsequently, bird species within the bird exhibition were brought to life interactively using X1, and AR scenarios X1 were introduced into the exhibition space to add elements of fun and entertainment Finally, Face AI was used to interactively test facial expressions and score smiles The gorgeously transformed Marine Museum will become the best travel destination for families with children ImageMarine Museum FB Page The AIoT services introduced by the Marine Museum could be extended to various exhibition-type museums and even static art galleries in the future, tailored to the unique characteristics of different venues They could also be promoted through government projects and related plans, aiding in rural revitalization, making visits more than just sightseeing in rural areas, and breaking free from stereotypes associated with different venues The applications of these services are broad「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

這是一張圖片。 This is a picture.
CCTV Intelligent Video Search System

Search for a specific person, find someone with a suitcase entering the factory in Gao'an area Color features of the person and the object confirmed, person in blue and black top, suitcase in black color, throughCCTV the intelligent video search system, by setting object and color retrieval conditions, it can successfully locate three video clips containing the target subject This greatly aids operational staff in finding the target items, and through this system, search speed can far surpass manual effort6fold Pain Points The CSE-Kaohsiung Plant is densely equippedCCTVto monitor every corner of the plant area, but when an incidenthappens, it's impossible within a limited time throughCCTVvideo playback to find the incident, the implications and risks behind this are self-evident Many areas that are usually unmanned can easily become security blind spots Thus, how to monitor a vast plant area more intelligently and effectively is one of the crucial aspects of building a smart plant for the semiconductor industry The AES Plant in Kaohsiung covers a vast area, with many important sites requiring monitoring of personnel movements to ensure corporate secrets and employee safety 1 Automated production lines and warehouses In semiconductor enterprises’ automated production lines and warehouses, oftenAGV(Automated Guided VehicleAGVs automated guided vehicles travel at high speeds if plant personnel inadvertently enterAGVthe moving area and cannot issue a warning to the person, then the regrettable accidents that occur will be too late to reverse 2 Material and product storage areas Materials used in semiconductor-related processes are costly if areas storing materials or products are breached, there is a risk of loss of high-value materialsproducts 3 High-security areas Trade secrets relate to the core technological competitiveness of semiconductor-related enterprises if someone breaches the high-security areas, there is a risk of corporate secrets being leaked The safety of trade secrets has always been one of the most critical issues for semiconductor enterprises 4 Loading docks At AESLButthe dock area often has loading vehicles coming and going if someone intrudes into the dock area, there is a risk of vehicle collisions and accidents Additionally, goods awaiting shipment at the dock area could be stolen or potentially damaged from collisions, thus causing significant reputation and financial losses for the company, further leading to production and shipping inconvenience When an abnormal event occurs, how to quickly search for the relevant key footage from massive data Many important locations within the AES Kaohsiung Plant need to be equippedCCTVfor safety checks, butCCTVWith thousands to tens of thousands of cameras, manually searching through footage for an event requires laborious frame-by-frame review which is time-consuming and inefficient In light of advancements in computer vision, it's beneficial to utilizeAIto replace manual playback and searching Problem Scenario Object Detection The data source for object detection comprises two parts Open-source datasetsOIDv4and AES Kaohsiung PlantCCTVImage files For these files, search for usable data, specificallyOIDv4image files For these files, extract the defined nine major categories of objects for training data among them, two object categories, knives and gasoline barrels, were not found inOIDv4found usable data for knives and gasoline barrels, while the remaining seven categories of objects are available fromOIDv4useful training data found for the remaining seven categories of objects, all marked Regarding the Kaohsiung PlantCCTVimage files, select some frames Frame of the footage, and manually annotate the objects to be_detected for training and testing data Nine Major Objects Color Recognition The data source for color recognition is divided into two partsInternet image screenshots, and Kaohsiung PlantCCTVimage files Currently, no publicly available open-source datasets specifically for color recognition applications have been found, so images are collected from the web Search the web for images of the defined nine major object categories, save the images after separating the objects from the background, keeping only the object sections, and mark the images according to color Additionally, for the Kaohsiung PlantCCTVimage files, use the already-markedbounding boxextractCCTVimage files from variousFramesections of objects identified by color, and finally, visually identifiable images are marked according to color Each object category has its specific color definition, depending on the usual colors seen in these objects in real life Dynamic Ignore during Training FromOIDv4during the training of the object detection pilot model, since each image in this dataset is only marked for a single category, but the image may contain other desired detection categories unmarked For such cases, dynamic ignore techniques will be employed during training to avoid confusion Next, use the extracted training data from the Kaohsiung Plant toFine-Tuneenhance the detection rate of the object in specific designated areas Finally, select the model that computes the lowest loss value in the test set during the training process as the main object_detection model Dynamic Ignoring AIHelp You View CCTV The intelligent video search system primarily serves as an assistive system for searching surveillance footage, capable of speeding up the process of finding target events by setting search conditions for objects By simply defining the search conditions, you can quickly produce thumbnails of critical objects and playback for review, shortening the time required for manual case retrieval of the past The search time is quickly6doubled, allowing the front-end security unit to use this platform to strengthen the first line of risk management supervision and take timely preventive measures 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-12-12」