Intelligent 3-D human modelling technology projects body shape and size accurately within 10 seconds

April 11, 2018, Hong Kong Polytechnic University
The innovation allows a customised model in arbitrary dynamic poses to be created automatically within 5-10 seconds. Credit: The Hong Kong Polytechnic University

Buying well-fitting clothes online or making bespoke garments is easier with intelligent 3-D human modeling technology developed by The Hong Kong Polytechnic University (PolyU). The software digitally reconstructs the shape and size of a person accurately from two full body photographs within five to 10 seconds. This PolyU innovation, developed by Dr. Tracy P.Y. Mok, associate professor, and Dr. Zhu Shuaiyin, Ph.D., from PolyU, can solve the problem of ill-fitting clothes and enhance the online shopping experience.

Existing methods have known limitations and involve expensive and bulky scanners and too much approximation, and therefore are of questionable accuracy. By integrating cutting-edge computer graphic and vision technology, this innovation generates a customised model in arbitrary dynamic poses in seconds. The system can reconstruct the 3-D shape and extract over 50 size measurements of different parts of an individual, including accurate measurements of chest, waist, hip, thigh, knee, calf and neck, as well as arm length, and shoulder slope. The discrepancies in tight-fitting and loose-fitting clothing are less than 1 cm and 2 cm respectively, which are precise enough for the specific requirements of the clothing industry for fashion applications and comparable to body scans.

Four methods were developed to realise automatic shape modelling of individuals by:

  1. detecting body parts in tight fitting clothing from front-view and side-view 2-D images and then construct them to 3-D models;
  2. predicting under-the-clothes body profiles of the subjects based on input images where the body profiles are covered in arbitrary clothing, including tight-fitting, normal-fitting and loose-fitting clothing;
  3. applying cutting-edge deep learning technology to segmentise the human body image from the background. It also improves the robustness, efficiency and accuracy of shape modelling of individuals;
  4. applying the above modelling methods to develop a client-server system. It is a mobile application of the automatic shape customisation technology, starting from photo taking to model customization and size extraction: https://itunes.apple.com/us/app/1measure/id1234853015?mt=8 https://play.google.com/store/apps/details?id=com.tozmart.imeasure&hl=zh_HK

These methods are enabled by Big Data analytics, in which a large dataset with over 10,000 human scan models were used to analyse local 3-D shape features and predict under-the-clothes body profiles. Different from other existing methods that analyse 3-D scans globally, PolyU's research team decomposes the data yielded from a 3-D scan into local features for data analysis. The team then predicts and assembles the 2-D and 3-D shapes of subjects based on 2-D photographs. The resulting 3-D models have precisely reconstructed both global and local shape characteristics of individuals, and accurate body measurements can be extracted from these customised models.

The digital reconstruction of human subjects can provide competitive advantages for the fashion industry. "With an accurate projection of the size and shape of the human body, these customised models will enhance online shopping experience, and stimulate growth in fashion online shopping," said Dr. Mok.

"The output models can also enable customers to visualise try-on effects before purchases in online stores. This frees us from the limitations imposed by taking body measurements physically, helping customers to select the right size in online clothing purchases," added Dr. Zhu.

Commercialisation of the technology

With the support from Shanghai Technology Entrepreneurship Foundation-PolyU China Entrepreneurship Fund, Dr. Zhu has set up the start-up, TOZI, in Shenzhen in 2017 to commercialise and further develop the 3-D human modelling technology, echoing PolyU's commitment to foster culture that boosts entrepreneurship and inspires entrepreneurs.

Based on the intelligent 3-D human modelling technology, TOZI has collaborated with Industry 4.0 factories to launch a brand-new customer-to-manufacturer (C2M) service for customers. It brings unmatched online shopping experience to end users by empowering them to order tailor-made clothing within just three minutes anywhere anytime. By a few clicks on smartphones, customers can measure their own shape and size, and order tailored made shirts, with a range of fabrics, collars, pockets, cuffs, front plackets to choose from.

Explore further: i.Dummy: New breakthrough in mannequin technology

Related Stories

i.Dummy: New breakthrough in mannequin technology

March 21, 2013

At its first glance, the mannequin 'i.Dummy' developed by researchers of The Hong Kong Polytechnic University (PolyU) looks no different from an ordinary dummy but it is no plain stuff - this sophisticated mannequin can change ...

Scientists create program to calculate body shape

October 27, 2008

Imagine you are a police detective trying to identify a suspect wearing a trench coat, baggy pants and a baseball cap pulled low. Or imagine you are a fashion industry executive who wants to market virtual clothing that customers ...

Recommended for you

China auto show highlights industry's electric ambitions

April 22, 2018

The biggest global auto show of the year showcases China's ambitions to become a leader in electric cars and the industry's multibillion-dollar scramble to roll out models that appeal to price-conscious but demanding Chinese ...

Robot designed for faster, safer uranium plant pipe cleanup

April 21, 2018

Ohio crews cleaning up a massive former Cold War-era uranium enrichment plant in Ohio plan this summer to deploy a high-tech helper: an autonomous, radiation-measuring robot that will roll through miles of large overhead ...

Virtually modelling the human brain in a computer

April 19, 2018

Neurons that remain active even after the triggering stimulus has been silenced form the basis of short-term memory. The brain uses rhythmically active neurons to combine larger groups of neurons into functional units. Until ...

'Poker face' stripped away by new-age tech

April 14, 2018

Dolby Laboratories chief scientist Poppy Crum tells of a fast-coming time when technology will see right through people no matter how hard they try to hide their feelings.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.