Designers draw extensively to externalize their ideas and communicate with others. However, drawings are currently not directly interpretable by computers. To test their ideas against physical reality, designers have to create 3D models suitable for simulation and 3D printing. However, the visceral and approximate nature of drawing clashes with the tediousness and rigidity of 3D modeling. As a result, designers only model finalized concepts, and have no feedback on feasibility during creative exploration.
Our ambition is to bring the power of 3D engineering tools to the creative phase of design by automatically estimating 3D models from drawings. However, this problem is ill-posed: a point in the drawing can lie anywhere in depth. Existing solutions are limited to simple shapes, or require user input to ``explain'' to the computer how to interpret the drawing. Our originality is to exploit professional drawing techniques that designers developed to communicate shape most efficiently. Each technique provides geometric constraints that help viewers understand drawings, and that we shall leverage for 3D reconstruction.
In addition to tackling the long-standing problem of single-image 3D reconstruction, our research will significantly tighten design and engineering for rapid prototyping.
News
April 2023 | Science story
The ERC showcased our project as a Scence Story. The short interview and accompanying video summarizes well our achievements!
August 2022 | Paper
We presented three papers at SIGGRAPH 2022. As we are approaching the end of this 5-years ERC project, we made strong progress on key challenges of line drawing interpretation. We proposed a robust algorithm to reconstruct real-world sketches of symmetric objects, and we described how to use machine learning to segment a freehand drawing into parts that can be modeled by CAD operations. We also presented a method to create 3D surfaces from sparse 3D sketches.
April 2022 | Paper
We presented our work on inverse design of self-actuated structures for rapid prototyping with desktop 3D printers, at Eurographics 2022.
May 2021 | Paper
We presented our work on 3D sketching in immersive environments at ACM CHI 2021, and obtained the best paper award - honorable mention.
Video summary from ERC Science Stories
Contact
Adrien Bousseau, principal investigator