Log in
Research at the University of Cambridge Department of Engineering (DoEng) since 1997 created methods for reconstructing a three-dimensional (3D) model of an object from a single two-dimensional photograph. Metail, a company founded in 2008, sponsored further research at the DoEng and commercialised the results in an online fashion retailing application. Metail enables customers to select an item of clothing and see how they would look wearing it from a variety of angles, having entered just one photograph of themselves and a few basic body measurements. Metail attracted over GBP3.5M investment. Its application is used by Shop Direct, Tesco, Warehouse, Zalando and Dafiti. Sales data shows that the Metail application increases the propensity of customers to buy and reduces the proportion of goods returned.
This case study involves the development and implementation of novel algorithms that control the mapping of depth from a scene being imaged by a camera to an image being viewed on a stereoscopic display so as to make viewing more comfortable for the human visual system. The algorithms, developed at Durham University between 2003 and 2005:
The introduction of computer vision algorithms that allow creation of stereo 3D content in film and broadcast using conventional 2D monocular video cameras has permitted fundamental advances in the 3D reconstruction of complex real-world dynamic scenes from video, enabling the rendering of stereo views from a single camera view. Technology introduced by Surrey has been used for 3D scene analysis by the UK company, The Foundry, in their film post-production for major Hollywood 3D film productions (Avatar, Harry Potter, Planet of the Apes, Tron, The Hobbit). Since 2007, The Foundry has transformed to become the leading provider of 3D stereo production software tools to the global visual effects industry, growing from 20 to over 200 employees.
The Geometric Modelling and Pattern Recognition (GMPR) Group at Sheffield Hallam University (SHU) has developed and patented internationally-known line projection technologies for fast 3D scan, reconstruction and recognition. Three types of impact can be identified: (i) through our patents, we have licensed to companies in Europe and the USA; (ii) these technologies are being transferred to Small and Medium-sized Enterprises (SMEs) across Europe, through the European funded MARWIN and ADMOS projects; and (iii) social and cultural impacts are evidenced by the 3D scanning of representative items from the Museums Sheffield Metalwork Collection which have been made publicly available on the web, and through the `Man of Steel' community project where a landmark sculpture will form a gateway to South Yorkshire and the Sheffield City Region.
Research at the University of Cambridge Department of Engineering on computer vision tracking led to the creation of Extra Reality Limited in 2010, which was subsequently acquired by a new company called Zappar Limited in May 2011. Zappar employs 17 staff and had revenue of GBP612k in the financial year 2012/13, an increase of 35% on the previous year.
Over 50 different brands have used Zappar's augmented reality application across more than 300 offerings in over 17 countries to deliver entertainment-based marketing interactions from 2011 to 2013. [text removed for publication] Examples of partners include Disney, Warner Brothers and Marvel. Zappar has changed attitudes in the media sector by showing that "augmented reality is finally ready for prime time" (President, Creative Strategies Inc, Time Online, 2012).
In the late 1990s, a significant barrier to the adoption of virtual reality software was the expense of manually creating models of real-world scenes. To address this, between 1998 and 2004, the ICARUS software system was developed, which enabled the creation of structured, 3D geometric models from a sequence of images or video. The system also pioneered improved methods of camera tracking. ICARUS was subsequently licensed and developed commercially, and became the foundation for video and film post-production products that are used worldwide in the film (e.g. Universal Pictures, Warner Bros, Paramount Pictures) and television (e.g. BBC) industries, underpinning a company with an annual turnover in excess of £1m.
UCL's pioneering use of 3D body surface scanning and national anthropometric surveys has had impact in the fashion industry and healthcare. In 2008, a UCL spinout, Sizemic, was founded to sell clothing size charts and fit mannequins based on the UK survey data, helping manufacturers and retailers improve the fit of their clothing, and reduce their product development times and costs. Sizemic now has 10 employees and a turnover of £1m. The research also led to other national sizing surveys, including in Germany (2008/9), Thailand (2009/10) and Mexico (2010), with results used for product development. In 2009, UCL built a prototype 3D-healthcare system for GPs and established a company, ShapeDynamics, to support the platform. The software is being tested at a private healthcare practice in London. Another UCL spinout, Bodymetrics, has commercialised body scanners for use as a clothes-fitting aid in stores.
Motion blur is the effect that occurs when objects are filmed at speed. Researchers at Bournemouth University's (BU) National Centre for Computer Animation (NCCA) developed a new approach to more accurately model this effect in 3D image production. This produces aesthetically superior images without any penalty in rendering time. The technique was implemented by Pixar in their own films and in the commercial PRMan software they supply to other animation and effects studios in New Zealand, Canada, the USA and the UK, among others. As well as contributing significantly to Pixar's revenue, the technique improves the viewing experience and has been used on virtually every major feature film produced since 2008. This contributes to the global animation industry worth $207 US billion (2012, R1).
Phase unwrapping is an essential algorithmic step in any measurement system or sensor that seeks to determine continuous phase. Instances of such devices are widespread: e.g. image reconstruction in magnetic resonance imaging (MRI), synthetic aperture radar (SAR) by satellite systems, analysis of seismic data in geophysics and optical instrumentation, to name but a few. Without successfully solving the phase unwrapping problem these instruments cannot function.
The topic is well developed and competition among algorithms is fierce. In 2012 alone, some 235 papers, most of which were describing potential new algorithms, were published in the area. But the continuing need for high-speed, automated and robust unwrapping algorithms poses a major limitation on the employability of phase measuring systems.
Working originally within the context of structured light 3D measurement systems, our research has developed new phase image unwrapping algorithms that constitute significance advances in speed, automation and robustness. The work has led to adoption by industry, as well as use in commercial and government research centres around the globe. Our approach since 2010 has been to make these algorithms freely available to end users. Third parties have gone on to translate our algorithms into other languages, widely used numerical software libraries have incorporated the algorithms and there are high profile industrial users.
This impact is on society, culture and creativity. Series and Schleimer from Warwick's Geometry and Topology group have produced attractive visualisations and physical realisations of mathematical objects arising in their research. These have elicited a wide response from members of the public, with designs being creatively used for commercial, aesthetic and educational purposes.
Series popularised a novel form of fractal art, based on the geometry of iterated Möbius maps, in her book Indra's Pearls. This has inspired many artists working in a variety of media ranging from posters to quilts. Schleimer designs elegant yet mathematically accurate realisations of three and four dimensional figures, such as knots and related surfaces, suitable for 3D printing. These are being commercially manufactured, sold and displayed publically.