:::

【2021 Solutions】 After eight years of hard work, LIPS Corporation is poised to seize the 3D sensor market worth tens of billions of dollars

2D industrial cameras of European, American and Japanese brands have been popular in the market for many years. The market has been reshuffled as it transitions from 2D to 3D. The domestic brand LIPS, which mainly focuses on 3D cameras, has taken advantage of the trend and launched a variety of 3D camera from standard to industrial models. It provides total solutions through hardware, software, and systems, has become a hot commodity in the market. Since its establishment eight years ago, LIPS has focused on the 3D sensor market and aims to become a leading brand in machine vision.

The 3D image and sensor market will exceed US$10 billion in 2026 with an annual growth rate of 14%

According to forecasts of Yole Développement, the 3D image and sensor market will grow from US$6.8 billion in 2020 to US$15 billion in 2026, with a compound annual growth rate reaching 14.5%. Among them, the mobile and consumer markets will account for 46%, becoming the mainstream of the market, followed by the automotive and industrial fields, accounting for 22%. In terms of mobile and consumer markets, in addition to mobile phones, 3D sensor technology has a wide impact on the consumer market, including: tablets, VR/AR, robot vacuum cleaners, and AIoT (AI combined with IoT). For example, the 3D facial recognition of Apple's iPhone is the most popular 3D sensor technology today.

LIPS focuses on the development of 3D vision and AI, providing software development kits and software and hardware solutions. The software development kit is based on 3D depth images combined with AI algorithms, and can be quickly applied to industrial automation, smart logistics, smart healthcare, smart retail, industrial safety, and automotive assistance systems.

LIPS has three core competencies.

▲ LIPS has three core competencies.

Benson Lee, chief marketing officer of LIPS, said that 3D depth cameras integrate optics, electronics, mechanisms, parallel processing, algorithms, and AI, and has a high technical threshold. The three most common 3D sensor technologies are Time-of-Flight (TOF), stereo, and structured light depth cameras. The company provides 3D sensor total solutions. Benson Lee also pointed out that the company’s has an advantage in 3D sensor end-to-end solutions:

1. In terms of 3D depth cameras, it covers three technologies: ToF, stereo, and structured light. It is rare for a manufacturer to have all three technologies at the same time.

2. 3D sensor intermediary software supports AI sensor intermediary software, such as: facial recognition, head count, body tracking, gesture recognition, and spatial measurement.

3. One-stop solutions for 3D sensor systems, such as: 3D scanners, advanced driving assistance systems, and facial recognition systems are provided as standard products and can be customized according to customer needs. The company has become the best 3D AI technology partner for many iconic customers around the world.

LIPS 3D vision guided robot solution.

▲ LIPS 3D vision guided robot solution.

Obtained 30 patents around the world, LIPS products reach deep into the Japanese market

LIPS has obtained more than 30 patents for its 3D AI technology, mainly in the United States, China, and Taiwan. Its marketing strategy has shifted from exports to domestic sales, starting with Japan and working with tier one Japanese customers, such as: multinational tech company in precision ceramics, one of the top eight electric machinery companies in Japan, and Japanese device manufacturing and solutions providers. The company has shipped large quantities of goods to several world class customers, such as the multinational tech company in precision ceramics, the largest manufacturer of industrial self-propelled vehicles in Germany, and one of the top eight electric machinery companies in Japan. Among them, the LIPS 3D camera supports the leading AI company Isaac and has been fully adopted for autonomous mobile robots (AMR) in the factory of the largest industrial self-propelled vehicle manufacturer in Germany. LIPS has also obtained a supplier code of the largest industrial self-propelled vehicle manufacturer in Germany.

LIPS also provides the best 3D vision solution for the platform of the leading AI company, and can be integrated into the automation platforms of leading AI companies Isaac and Jetson. This platform mainly provides total solutions for robotic arms, factory automation, AGV, and self-propelled vehicles. LIPSedge supports the SDK of the leading AI company Isaac, and there is currently only a handful of certified 3D cameras.

LIPS's 3D sensing solutions offer greater precision than 2D solutions.

▲ Mr. Luke Liu introduces the robotic arm.

The 3D sensor solution provided by LIPS is more accurate than 2D. It uses 3D skeleton technology to provide a safe "3D virtual fence" for robotic arms, which were provided to the robot factory of a Japanese multinational tech company that makes precision ceramics. It is expected to become the standard equipment of robotic arms around the world.

The 3D measurement market has unlimited potential, targeting the global logistics and transportation industry

After the pandemic, LIPS actively invested in related applications and is currently targeting logistics and industrial automation solutions. Besides application in virtual fences, 3D package size measuring machines used in the logistics and transportation industry are developing the fastest and the most mature. The product has entered the Japanese market through Japanese partners, and has unlimited potential for application in post offices, logistics stores, and convenience stores.

LIPS' strategy is to first enter the Japanese market and then expand to the global market after establishing successful application cases. Benson Lee pointed out that the technical threshold of 3D measurement algorithms is extremely high. Japanese logistics companies deploy it in stores to measure irregular items, such as suitcases, shopping bags, and paper bags. Manual measurement was time-consuming and labor-intensive. The use of 3D cameras to measure length, width, and height greatly reduces the manpower requirement, and gives store clerks more time to serve customers properly.

LIPS 3D measuring machines have been certified by Japan's top three logistics solution providers. In addition to 3D measuring machines, LIPS is also actively developing other logistics solutions, such as assembly lines and mobile versions. Customers include the world's top logistics companies. LIPS hopes to provide 3D measuring solutions to post offices, convenience stores, and logistics centers worldwide, and has gained one-third of the market share in logistics automation. LIPS was founded in 2013 by Luke Liu, who studied at MIT. The company is highly technology-oriented and specializes in 3D sensor and AI technology. It uses depth cameras with software algorithms to provide machine vision and AI solutions that meet customer needs, and applies the solutions in various industries.

Recommend Cases

【解決方案】瑕疵辨識率達百分百 耐銳利科技獲面板大廠青睞
Defect identification rate reaches 100%, Nairi Technology is favored by major panel manufacturers

On the machine tool production line, there are some slight differences in the first step of assembly Accumulated tolerances will cause the assembly work to be repeated, which is time-consuming and labor-intensive, resulting in shipment delays that will impact the company's reputation Narili Technology Company focuses on the field of smart manufacturing and provides various AI solutions It uses machine learning models to inherit the experience of old masters In the CNC processing machine assembly and casting process, it uses AI to analyze production line data, accurately adjust various data, and improve Production accuracy is 25 This AI production line data analysis system is called "Master 40" by Huang Changding, chairman of Naruili Technology It is the most evolved version of the master plus artificial intelligence It has been used in machine tool processing factories with remarkable results In addition, Nairi Technology used AI defect detection technology to participate in the 2021 AI Rookie Selection Competition of the Industrial Bureau of the Ministry of Economic Affairs, assisting AUO in advanced panel image defect detection, with an accuracy rate of 100, and won the award Assisted panel manufacturer AUO to solve problems with 100 accuracy in defect detectionHuang Changding further explained that during the production of general panels, edges and corners are There may be defects in the corners Although the defects are visible to the naked eye, AOI is often difficult to identify, causing the detection error rate to often exceed 30 Therefore, re-inspection must be carried out with manpower to improve the accuracy rate However, in response to the demand for a small number of diverse products and insufficient manpower, using AI detection is indeed a good method Nairui Technology, founded in 2018, has been able to win the favor of major panel manufacturers with its AI technology in just three years In fact, it has been honed in the field of CNC machine tools for a long time Tang Guowei, general manager of Narili Technology, pointed out that the top three CNC machine tool factories in Taiwan hope to introduce AI into the two production lines of assembly and casting Among them, on the assembly line, in order to maintain the accuracy of assembly, every part of the component is designed Tolerances are designed During assembly, each component is within the tolerance However, the cumulative tolerance still fails the final quality inspection and must be dismantled and reassembled This is not only time-consuming and labor-intensive, but also causes waste "After entering the production line, I realized that some masters have accumulated a lot of experience and are good at adjustment After his adjustment, the accuracy rate has improved a lot and the speed is faster" On the contrary, the new engineers did not Based on experience, it takes a long time to adjust and may not pass the quality inspection The yield rate of Master 40 system has increased significantly from 70 to 95Tang Guowei then said that the original size data set by Master during assembly All were recorded on paper After the information was written, it was stored in the warehouse and sealed No one studied the relationship between the dimensions Narili assists customers in designing the Fu 40 system Through the human-machine panel, the master can directly input the measured dimensions and related data during assembly After collecting data from different masters, AI algorithms are used to analyze the relationship between the data and create an AI model The AI model automatically notifies the operator what size to adjust to, and the quality inspection will definitely pass In this way, the yield rate will be improved It has increased significantly from 70 to more than 95 Narili Technology Company focuses on the field of smart manufacturing and provides various AI solutionsTang Guowei added, assembling the spindle of a CNC processing machine It took four hours In the first step, the machine made measurement errors, including vibration, temperature, speed, etc that were out of range It had to be dismantled and reinstalled, which took another four hours How to adjust after disassembly depends on the experience of the master At first, the master may have done the best assembly method based on experience, but the error rate was also 30, and the assembly took several days With the assistance of AI masters, the assembly time only takes half a day, and the yield rate reaches over 95, saving a lot of time and manpower "Use the AI model of machine learning to collect the experience of all the masters and provide it for AI learning The first step is digitalization, and the second step is knowledgeization This is the transformation of the enterprise "An important key", Huang Changding believes that Narili Technology is an important partner in the transformation of traditional manufacturing from automated production to digital transformation In addition, another industry that Naili Technology focuses on is the smart car dispatching system of the leading brand of elevator manufacturers The so-called car dispatch referring to the elevator car means that if there are more than two elevators, group management is required In the past, car dispatching was based on fixed rules If the elevator was closer to the requested car, that elevator would be automatically dispatched On the one hand, it did not take into account that dispatching a car if the elevator was called too many times might make other people wait longer The previous vehicle dispatching model did not take into account the usage characteristics of the building, resulting in a lot of waste For example, in an office building, there are peak hours in the morning, lunch break, and afternoon after work AI smart car dispatch can be flexibly adjusted according to off-peak and peak hours, increasing the efficiency of car dispatch, reducing waiting time, and reducing wasted electricity Introducing elevator smart dispatch to improve transportation efficiency and have environmental protection functionsHuang Changding added that just like the previous traffic lights at intersections, the system has already The number of seconds to stop and pass on highways, sub-trunks and small streets is programmed Smart traffic lights are now used to flexibly adjust waiting times to make road sections prone to congestion smoother Using AI to learn usage scenarios and introducing a smart dispatch system into elevators will improve transportation efficiency and make it more environmentally friendly In addition to introducing smart elevator dispatching, Nairili also introduced AI into the smart production and shipment scheduling system of elevator factories Elevator factories often cannot accurately estimate the customer's elevator delivery date For example, office buildings or stores must be completed to a certain extent before the elevator can be installed on the construction site If affected by unexpected factors such as delays in the customer's construction period, the elevator factory will often be idle or the schedule will be difficult to arrange Tang Guowei pointed out that generally those who understand the progress of client projects may be from business or engineering, but overall, the accuracy rate of shipments is only about 60, which means that 40 of them will not be shipped as scheduled Therefore, if the shipping schedule can be accurately estimated, the production line can be freed up for emergency orders or other product production needs The AI smart scheduling system will analyze past shipment data, about 20-30 parameters such as climate, distance between the factory and the construction site, and customer credit, and put them into the AI algorithm to accurately predict whether shipments can be made as scheduled goods Huang Changding also specifically stated that the machine learning of Naili Technology is not ordinary machine learning, but also incorporates various calculation methods such as traditional image processing technology and statistics Only by being very familiar with the domain knowledge can we make good products AI models are also where the company’s competitiveness lies He emphasized that the data that general SaaS platforms can process is very limited, and the accuracy rate has increased from 70 to 75 at most Naili’s strength lies in AI algorithms and machine learning, and it must be coupled with in-depth industry knowledge to produce output Good AI model Narili Technology started with the AI project, gradually deepened the technology, chose to start with the more difficult tasks, and accumulated rules of thumb It is expected to develop SaaS services this year 2022, based on customer needs starting point, gradually gaining a foothold and becoming an important partner in smart manufacturing The picture left shows the general manager of Naruili Technology Tang Guowei and Chairman Huang Changding right「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

【解決方案】7毫秒內分離人聲 洞見未來科技協助聽損者「聽說更簡單」
Voice Separation in 7 Milliseconds: RelaJet's Future Technology Makes 'Hearing and Speaking Easier' for the Hearing Impaired

One rainy Thursday afternoon near Taipei Arena, the Taipei Experience Center of RelaJet was fully booked with appointments from people with hearing loss eager to try hearing aids made with a voice separation engine For the hearing impaired, having affordable, lightweight, and effective noise-reducing hearing aids is truly a blessing 'We hope to help users in need to hear the world's wonders again' This empathetic expectation by RelaJet's founder and CEO Po-Ju Chen, who is also hearing impaired, illustrates his understanding of the needs of the hearing impaired He hopes that RelaJet's unique voice amplification hearing aid technology will benefit many more people Affordable hearing aids benefit many with hearing loss Founded in 2018 by Po-Ju Chen and his brother Yu-Ren Chen, RelaJet developed a multi-voice separation engine paired with Qualcomm's Bluetooth audio platform, drastically reducing the price of imported hearing aids, typically costing 80,000-100,000 NT dollars, to just under 10,000 NT dollars They aim to develop affordable goods with excellent noise-cancelling capabilities that wirelessly connect to smartphones In its first two years, the company primarily developed the multi-voice separation engine, which significantly improved the noise reduction quality Once equipped with Qualcomm Bluetooth earphone chips, the audio processing time is drastically short, at about 7 milliseconds to enhance main voice projection and reduce ambient noise, less than half the time required by traditional medical standard of 16 milliseconds for hearing aids, nearly 'zero-delay' 洞見未來科技推出平價助輔聽器,大大嘉惠聽損者 Yu-Ren Chen explains that the primary use of Qualcomm chips for edge computing, along with a streamlined algorithm, achieves extremely low latency and better noise reduction The hearing aids can cover 18 channels, whereas traditional hearing aids cover 4-48 channels In the future, RelaJet will progressively increase the number of channels According to statistics, there are 470 million people globally with hearing disabilities, with a 30 average device use rate in developed countries, with the highest in Western countries Taiwan has nearly 15 million people with disabling hearing loss, of which the middle-aged and elderly make up 30, yet the device use rate is only about 10, which is quite low Yu-Ren Chen further analyzes that the low device usage rate is due to two reasons firstly, the high average selling price of international big brands ranges from 80,000 to 200,000 NT dollars with a three-year usability period, which deters many due to the high cost and maintenance Secondly, in noisy environments, the noise is also amplified which does not necessarily ensure clarity for the users, and the sound parameters can't be adjusted in real-time, making it inconvenient to frequently visit stores for tuning Thirdly, most models cannot connect to smartphones, making it inconvenient for the hearing impaired to take phone calls Utilizing Qualcomm Bluetooth chips for rapid product development In light of this, Po-Ju Chen, formerly a semiconductor engineer at MediaTek, leads the technical development, while Yu-Ren Chen, with a legal background, manages the operations Their seamless collaboration, along with their team employing AI algorithms and chip integration, learns from thousands of hours of audio files in databases through neural networks and deep learning technologies to develop low-latency, high-noise-reduction voice amplification technologies for hearing aids In 2019, this sound processing technology was integrated into Qualcomm Bluetooth chips, winning first place in the Qualcomm Taiwan Startup Competition and becoming a partner in Qualcomm's Global Expansion Program, significantly boosting product development pace In 2021, they launched their own Otoadd series of hearingenhancement products in Taiwan, which received both market favor and positive reviews from many with hearing loss Based on different consumer needs, various product designs are available According to Yu-Ren Chen, the Otoadd wireless earphones with hearing enhancement functions, model N1, are entry-level neckband style priced at 9,500 NT per pair Users can wear the hearing aid while taking calls, and control noise reduction strength and volume through a mobile app They plan to develop accessories in the future tailored to the needs of older adults Besides being available for trials at experience centers in Taipei and Kaohsiung, this hearing aid is also sold through PChome, Taiwan Mobile's myfone, and Elder Age networks, among other channels Another model intended for individuals with mild to severe hearing loss is the Classic R hearing aid, which received the Japanese Good Design Award in 2021 Since its market debut last year, it has attracted those with congenital hearing loss, with users noting improved clarity in noisy environments and appreciating the convenience of Bluetooth connectivity for calls and watching videos This product is anticipated to be exported to international markets in the latter half of this year Additionally, a hearing aid product combining Bluetooth functionality, set to launch in June this year, is sized like typical Bluetooth earphones, targeting visually conscious consumers with hearing loss Its small size and attractive wireless earphone design allow for phone calls, and if approved by the Ministry of Health and Welfare, eligible users can apply for government subsidies RelaJet to expand into overseas markets, using the USA as a beachhead An interesting question arises due to the pandemic everyone must wear masks which impedes lip-reading How does this affect those with hearing loss Yu-Ren Chen indicates that this situation highlights RelaJet's advantages As each person with hearing loss has different levels of hearing ability, hearing aids can only augment to an appropriate volume, assisting users to hear about 60-70 content, with the remainder relying on lip reading and gestures During the pandemic, as everyone wears masks, masks also muffle sounds, but RelaJet's voice separation engine can correct and strengthen the separation, making it easier for those with hearing loss to recognize voices Besides the Taiwan market, RelaJet's next stage will be expanding into overseas markets, expecting to obtain ISO 13485 medical device quality management system certification and US medical device approval in 2022 They plan to enter the US market, either under their own brand or through OEM arrangements Apart from the Taiwan market, RelaJet will also enter the US market in the next phase for hearing aids「Translated content is generated by ChatGPT and is for reference only Translation date:2024-05-19」

這是一張圖片。 This is a picture.
AI Smart Health Prevention Plan

Herji Ltd held an interactive teaching session with AI storybooks at the 'Taiwan Early Childhood Development and Remedial Association Taitung Office', allowing children, teachers, and parents to engage in immersive educational experiences AI-generated children's educational storybook materials AI Learning Platform In recent years, changes in the social structure of Taiwan, combined with experiences in hospital emergency departments, have often led us to overlook the depressive symptoms exhibited by adolescents, resulting in tragic incidents of self-harm or even suicide among children A significant part of children's depression stems from their academic performance, with parents worrying about their children's future competitiveness, thus placing a lot of pressure on children who perform poorly academically In a family with two children with the same genetic background and provided with the same resources for growth, we often find that the second child's academic performance is not up to par, with poor grades, an inability to concentrate in class, and even lacking the patience and perseverance to finish reading a comic book or playing a video game We have been exploring why these differences occur and discovered that these issues often arise from undiagnosed learning disabilities during early childhood Due to environmental factors, children with delayed learning abilities are often not acknowledged by over 80 of parents who are reluctant to seek treatment for their children, primarily fearing that their child will be labeled as delayed As a result, the child's learning ability is hindered from an early age, with their academic struggles increasing as they enter primary and secondary school, leading to greater academic lag, frustration from parents, struggles from the child, and increased family disputes If tutoring does not yield effective results, expenditure without achieving positive outcomes often leads to further family conflicts, creating a vicious cycle that accumulates a lot of negative emotions in children during their developmental process, which in turn affects various factors impacting their health In reality, the main reasons behind a child's poor academic performance, inability to learn, lack of interest in learning new things, or even developing health-impacting psychological conditions, actually stem from accumulated learning delays during early childhood The period before the age of six is considered the golden window for treating learning delays If these can be identified and addressed during this time, there is a chance that the child's learning abilities can be greatly improved10The industry's current pain points are as follows 1Lack of methodologies for assessing learning abilitiesLack of databases for sample comparisons in the market 2Traditional parental misconceptionsFear of labeling and treatment delays for mild to moderate cases 3Lack of therapeutic materials and toolsShortage of therapeutic storybooks and series courses This project will develop a national talent development support system, utilizing AI Technological development of a system for assessing children's learning abilities that supports parents in safeguarding their children's health from the start of learning ability testing, offering early detection and treatment In the future, all Taiwanese children, regardless of background, will be able to establish a healthy foundation in early childhood, growing up to become valuable assets for national development 2、 As proposed in this planAIApplications and explanations 'Child Language Ability'AI'Analysis Model' This model quantitatively analyzes 'the condition of children's use of Mandarin' when 'expressing an event' Scenario Preschool teachers guide children in narrating storybook contentAITools analyze the sentences used by children to describe storybook content, applying statistical algorithms for quantitative analysis Analysis indicators include 'sentence type' and 'lexical items' Analysis aspects include correctness of sentence structures, diversity of vocabulary, quantity of vocabulary used, and accuracy of vocabulary usage Application Comparative analysis between an individual child and peers' language abilities can offer more detailed language skills teaching by preschool teachers Techniques used Chinese word segmentation, Chinese POS tagging, Chinese syntactic rules analysis algorithm, and quantitative analysis algorithms Tools usedChinese word segmentation tools, POS tagging toolsChinese POS Tagging Tool 3、 Expected Industrial Value Establish a learning ability assessment and support system, through therapeutic storybooks and courses Collaborate with kindergartens to develop learning ability bases, preventing children from being stuck at the starting point Alongside parents, protect children's health starting with learning ability testing, backed by a robust database, allowing parents to identify early any delays in learning, helping children regain their learning abilities 4、 Expected Industrial Benefits Economic Benefit and Future Spread and Impetus By supporting children with delayed learning abilities, enhancing their learning prowess through this project, these children serve as the future of our nation and can thus significantly contribute to national talent development Furthermore, the purpose of establishing a learning ability development base is to help reunite children with their parents, increasing their interaction time, allowing the children to move beyond mere one-dimensional interactions 3C This facilitates two-way interactions between the child and parents, potentially impacting children who may have been otherwise delayed in developing their capabilities due to environmental factors 「Translated content is generated by ChatGPT and is for reference only Translation date:2024-11-15」