[{"type":"conference","conference":{"name":"SIGGRAPH: Computer Graphics and Interactive Techniques Conference","location":"Los Angeles, CA, United States","end_date":"2023-08-10","start_date":"2023-08-06"},"tmp":{"legal_code_url":"https://creativecommons.org/licenses/by/4.0/legalcode","image":"/images/cc_by.png","name":"Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)","short":"CC BY (4.0)"},"status":"public","keyword":["color","gloss","perception","color compensation","color management"],"_id":"12979","file_date_updated":"2024-01-29T10:14:10Z","department":[{"_id":"BeBi"}],"date_updated":"2024-02-28T12:52:04Z","ddc":["004"],"month":"07","abstract":[{"text":"Color and gloss are fundamental aspects of surface appearance. State-of-the-art fabrication techniques can manipulate both properties of the printed 3D objects. However, in the context of appearance reproduction, perceptual aspects of color and gloss are usually handled separately, even though previous perceptual studies suggest their interaction. Our work is motivated by previous studies demonstrating a perceived color shift due to a change in the object's gloss, i.e., two samples with the same color but different surface gloss appear as they have different colors. In this paper, we conduct new experiments which support this observation and provide insights into the magnitude and direction of the perceived color change. We use the observations as guidance to design a new method that estimates and corrects the color shift enabling the fabrication of objects with the same perceived color but different surface gloss. We formulate the problem as an optimization procedure solved using differentiable rendering. We evaluate the effectiveness of our method in perceptual experiments with 3D objects fabricated using a multi-material 3D printer and demonstrate potential applications. ","lang":"eng"}],"oa_version":"Published Version","license":"https://creativecommons.org/licenses/by/4.0/","publication_identifier":{"isbn":["9798400701597"]},"publication_status":"published","file":[{"file_id":"12983","checksum":"84a437739af5d46507928939b20c0c28","success":1,"content_type":"application/pdf","access_level":"open_access","relation":"main_file","date_created":"2023-05-16T09:32:50Z","file_name":"Condor2023_supplemental.pdf","date_updated":"2023-05-16T09:32:50Z","file_size":42323971,"creator":"mpiovarc"},{"file_size":26079404,"date_updated":"2024-01-29T10:14:10Z","creator":"dernst","file_name":"2023_Siggraph_Condor.pdf","date_created":"2024-01-29T10:14:10Z","content_type":"application/pdf","relation":"main_file","access_level":"open_access","success":1,"file_id":"14893","checksum":"0f5c8b242e8e7c153c04888c4d0c6f37"}],"language":[{"iso":"eng"}],"project":[{"grant_number":"M03319","name":"Perception-Aware Appearance Fabrication","_id":"eb901961-77a9-11ec-83b8-f5c883a62027"}],"article_number":"21","author":[{"full_name":"Condor, Jorge","last_name":"Condor","first_name":"Jorge"},{"last_name":"Piovarci","full_name":"Piovarci, Michael","orcid":"0000-0002-5062-4474","id":"62E473F4-5C99-11EA-A40E-AF823DDC885E","first_name":"Michael"},{"id":"49876194-F248-11E8-B48F-1D18A9856A87","first_name":"Bernd","full_name":"Bickel, Bernd","orcid":"0000-0001-6511-9385","last_name":"Bickel"},{"first_name":"Piotr","full_name":"Didyk, Piotr","last_name":"Didyk"}],"external_id":{"isi":["001117690500021"]},"article_processing_charge":"No","title":"Gloss-aware color correction for 3D printing","citation":{"mla":"Condor, Jorge, et al. “Gloss-Aware Color Correction for 3D Printing.” SIGGRAPH ’23 Conference Proceedings, 21, Association for Computing Machinery, 2023, doi:10.1145/3588432.3591546.","ama":"Condor J, Piovarci M, Bickel B, Didyk P. Gloss-aware color correction for 3D printing. In: SIGGRAPH ’23 Conference Proceedings. Association for Computing Machinery; 2023. doi:10.1145/3588432.3591546","apa":"Condor, J., Piovarci, M., Bickel, B., & Didyk, P. (2023). Gloss-aware color correction for 3D printing. In SIGGRAPH ’23 Conference Proceedings. Los Angeles, CA, United States: Association for Computing Machinery. https://doi.org/10.1145/3588432.3591546","ieee":"J. Condor, M. Piovarci, B. Bickel, and P. Didyk, “Gloss-aware color correction for 3D printing,” in SIGGRAPH ’23 Conference Proceedings, Los Angeles, CA, United States, 2023.","short":"J. Condor, M. Piovarci, B. Bickel, P. Didyk, in:, SIGGRAPH ’23 Conference Proceedings, Association for Computing Machinery, 2023.","chicago":"Condor, Jorge, Michael Piovarci, Bernd Bickel, and Piotr Didyk. “Gloss-Aware Color Correction for 3D Printing.” In SIGGRAPH ’23 Conference Proceedings. Association for Computing Machinery, 2023. https://doi.org/10.1145/3588432.3591546.","ista":"Condor J, Piovarci M, Bickel B, Didyk P. 2023. Gloss-aware color correction for 3D printing. SIGGRAPH ’23 Conference Proceedings. SIGGRAPH: Computer Graphics and Interactive Techniques Conference, 21."},"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","quality_controlled":"1","publisher":"Association for Computing Machinery","oa":1,"acknowledgement":"We thank Matthew S Zurawski for the 3D model of the car speed shape. This research has been supported by the Swiss National Science Foundation (SNSF, Grant 200502) and the FWF Lise Meitner (Grant M 3319).","date_published":"2023-07-23T00:00:00Z","doi":"10.1145/3588432.3591546","date_created":"2023-05-16T09:34:13Z","isi":1,"has_accepted_license":"1","year":"2023","day":"23","publication":"SIGGRAPH ’23 Conference Proceedings"},{"project":[{"call_identifier":"H2020","_id":"24F9549A-B435-11E9-9278-68D0E5697425","name":"MATERIALIZABLE: Intelligent fabrication-oriented Computational Design and Modeling","grant_number":"715767"}],"title":"Inverse shape design with parametric representations: Kirchhoff Rods and parametric surface models","article_processing_charge":"No","author":[{"full_name":"Hafner, Christian","last_name":"Hafner","id":"400429CC-F248-11E8-B48F-1D18A9856A87","first_name":"Christian"}],"user_id":"400429CC-F248-11E8-B48F-1D18A9856A87","citation":{"mla":"Hafner, Christian. Inverse Shape Design with Parametric Representations: Kirchhoff Rods and Parametric Surface Models. Institute of Science and Technology Austria, 2023, doi:10.15479/at:ista:12897.","apa":"Hafner, C. (2023). Inverse shape design with parametric representations: Kirchhoff Rods and parametric surface models. Institute of Science and Technology Austria. https://doi.org/10.15479/at:ista:12897","ama":"Hafner C. Inverse shape design with parametric representations: Kirchhoff Rods and parametric surface models. 2023. doi:10.15479/at:ista:12897","ieee":"C. Hafner, “Inverse shape design with parametric representations: Kirchhoff Rods and parametric surface models,” Institute of Science and Technology Austria, 2023.","short":"C. Hafner, Inverse Shape Design with Parametric Representations: Kirchhoff Rods and Parametric Surface Models, Institute of Science and Technology Austria, 2023.","chicago":"Hafner, Christian. “Inverse Shape Design with Parametric Representations: Kirchhoff Rods and Parametric Surface Models.” Institute of Science and Technology Austria, 2023. https://doi.org/10.15479/at:ista:12897.","ista":"Hafner C. 2023. Inverse shape design with parametric representations: Kirchhoff Rods and parametric surface models. Institute of Science and Technology Austria."},"oa":1,"publisher":"Institute of Science and Technology Austria","date_created":"2023-05-05T10:40:14Z","doi":"10.15479/at:ista:12897","date_published":"2023-05-05T00:00:00Z","page":"180","day":"05","year":"2023","has_accepted_license":"1","status":"public","type":"dissertation","_id":"12897","file_date_updated":"2023-12-08T23:30:04Z","department":[{"_id":"GradSch"},{"_id":"BeBi"}],"ddc":["516","004","518","531"],"date_updated":"2024-01-29T10:47:51Z","supervisor":[{"id":"49876194-F248-11E8-B48F-1D18A9856A87","first_name":"Bernd","orcid":"0000-0001-6511-9385","full_name":"Bickel, Bernd","last_name":"Bickel"}],"month":"05","alternative_title":["ISTA Thesis"],"oa_version":"Published Version","abstract":[{"text":"Inverse design problems in fabrication-aware shape optimization are typically solved on discrete representations such as polygonal meshes. This thesis argues that there are benefits to treating these problems in the same domain as human designers, namely, the parametric one. One reason is that discretizing a parametric model usually removes the capability of making further manual changes to the design, because the human intent is captured by the shape parameters. Beyond this, knowledge about a design problem can sometimes reveal a structure that is present in a smooth representation, but is fundamentally altered by discretizing. In this case, working in the parametric domain may even simplify the optimization task. We present two lines of research that explore both of these aspects of fabrication-aware shape optimization on parametric representations.\r\n\r\nThe first project studies the design of plane elastic curves and Kirchhoff rods, which are common mathematical models for describing the deformation of thin elastic rods such as beams, ribbons, cables, and hair. Our main contribution is a characterization of all curved shapes that can be attained by bending and twisting elastic rods having a stiffness that is allowed to vary across the length. Elements like these can be manufactured using digital fabrication devices such as 3d printers and digital cutters, and have applications in free-form architecture and soft robotics.\r\n\r\nWe show that the family of curved shapes that can be produced this way admits geometric description that is concise and computationally convenient. In the case of plane curves, the geometric description is intuitive enough to allow a designer to determine whether a curved shape is physically achievable by visual inspection alone. We also present shape optimization algorithms that convert a user-defined curve in the plane or in three dimensions into the geometry of an elastic rod that will naturally deform to follow this curve when its endpoints are attached to a support structure. Implemented in an interactive software design tool, the rod geometry is generated in real time as the user edits a curve and enables fast prototyping. \r\n\r\nThe second project tackles the problem of general-purpose shape optimization on CAD models using a novel variant of the extended finite element method (XFEM). Our goal is the decoupling between the simulation mesh and the CAD model, so no geometry-dependent meshing or remeshing needs to be performed when the CAD parameters change during optimization. This is achieved by discretizing the embedding space of the CAD model, and using a new high-accuracy numerical integration method to enable XFEM on free-form elements bounded by the parametric surface patches of the model. Our simulation is differentiable from the CAD parameters to the simulation output, which enables us to use off-the-shelf gradient-based optimization procedures. The result is a method that fits seamlessly into the CAD workflow because it works on the same representation as the designer, enabling the alternation of manual editing and fabrication-aware optimization at will.","lang":"eng"}],"acknowledged_ssus":[{"_id":"M-Shop"}],"ec_funded":1,"related_material":{"record":[{"relation":"part_of_dissertation","id":"9817","status":"public"},{"status":"public","id":"7117","relation":"part_of_dissertation"},{"id":"13188","status":"public","relation":"dissertation_contains"}]},"language":[{"iso":"eng"}],"file":[{"date_updated":"2023-12-08T23:30:04Z","file_size":50714445,"creator":"chafner","date_created":"2023-05-11T10:43:20Z","file_name":"thesis-hafner-2023may11-a2b.pdf","content_type":"application/pdf","access_level":"open_access","relation":"main_file","checksum":"cc2094e92fa27000b70eb4bfb76d6b5a","file_id":"12942","embargo":"2023-12-07"},{"creator":"chafner","date_updated":"2023-12-08T23:30:04Z","file_size":265319,"date_created":"2023-05-11T10:43:44Z","file_name":"thesis-release-form.pdf","access_level":"closed","relation":"source_file","content_type":"application/pdf","embargo_to":"open_access","file_id":"12943","checksum":"a6b51334be2b81672357b1549afab40c"}],"publication_status":"published","degree_awarded":"PhD","publication_identifier":{"issn":["2663-337X"],"isbn":["978-3-99078-031-2"]}},{"oa_version":"Submitted Version","abstract":[{"text":"The Kirchhoff rod model describes the bending and twisting of slender elastic rods in three dimensions, and has been widely studied to enable the prediction of how a rod will deform, given its geometry and boundary conditions. In this work, we study a number of inverse problems with the goal of computing the geometry of a straight rod that will automatically deform to match a curved target shape after attaching its endpoints to a support structure. Our solution lets us finely control the static equilibrium state of a rod by varying the cross-sectional profiles along its length.\r\nWe also show that the set of physically realizable equilibrium states admits a concise geometric description in terms of linear line complexes, which leads to very efficient computational design algorithms. Implemented in an interactive software tool, they allow us to convert three-dimensional hand-drawn spline curves to elastic rods, and give feedback about the feasibility and practicality of a design in real time. We demonstrate the efficacy of our method by designing and manufacturing several physical prototypes with applications to interior design and soft robotics.","lang":"eng"}],"acknowledged_ssus":[{"_id":"M-Shop"}],"intvolume":" 42","month":"09","language":[{"iso":"eng"}],"file":[{"date_created":"2023-07-04T08:11:28Z","file_name":"kirchhoff-rods.pdf","creator":"chafner","date_updated":"2023-07-04T08:11:28Z","file_size":19635168,"file_id":"13194","checksum":"4954c1cfa487725bc156dcfec872478a","success":1,"access_level":"open_access","relation":"main_file","content_type":"application/pdf"},{"relation":"supplementary_material","access_level":"open_access","content_type":"application/pdf","file_id":"13190","checksum":"79c9975fbc82ff71f1767331d2204cca","creator":"chafner","file_size":420909,"date_updated":"2023-07-04T07:46:28Z","file_name":"supp-main.pdf","date_created":"2023-07-04T07:46:28Z","title":"Supplemental Material with Proofs"},{"file_size":430086,"date_updated":"2023-07-04T07:46:30Z","creator":"chafner","file_name":"supp-cheat.pdf","title":"Cheat Sheet for Notation","date_created":"2023-07-04T07:46:30Z","content_type":"application/pdf","relation":"supplementary_material","access_level":"open_access","checksum":"4ab647e4f03c711e1e6a5fc1eb8684db","file_id":"13191"},{"file_name":"kirchhoff-video-final.mp4","title":"Supplemental Video","date_created":"2023-07-04T07:46:39Z","file_size":268088064,"date_updated":"2023-07-04T07:46:39Z","creator":"chafner","file_id":"13192","checksum":"c0fd9a57d012046de90c185ffa904b76","content_type":"video/mp4","relation":"supplementary_material","access_level":"open_access"},{"creator":"chafner","file_size":25790,"date_updated":"2023-07-04T07:47:10Z","file_name":"matlab-submission.zip","date_created":"2023-07-04T07:47:10Z","title":"Matlab Source Code with Example","relation":"supplementary_material","access_level":"open_access","content_type":"application/x-zip-compressed","checksum":"71b00712b489ada2cd9815910ee180a9","file_id":"13193"}],"publication_status":"published","publication_identifier":{"issn":["0730-0301"],"eissn":["1557-7368"]},"ec_funded":1,"related_material":{"record":[{"relation":"part_of_dissertation","id":"12897","status":"public"}]},"issue":"5","volume":42,"_id":"13188","keyword":["Computer Graphics","Computational Design","Computational Geometry","Shape Modeling"],"status":"public","article_type":"original","type":"journal_article","ddc":["516"],"date_updated":"2024-03-27T23:30:46Z","file_date_updated":"2023-07-04T08:11:28Z","department":[{"_id":"BeBi"}],"acknowledgement":"We thank the anonymous reviewers for their generous feedback, and Julian Fischer for his help in proving Proposition 1. This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715767).","oa":1,"publisher":"Association for Computing Machinery","quality_controlled":"1","publication":"ACM Transactions on Graphics","day":"20","year":"2023","isi":1,"has_accepted_license":"1","date_created":"2023-07-04T07:41:30Z","date_published":"2023-09-20T00:00:00Z","doi":"10.1145/3606033","article_number":"171","project":[{"grant_number":"715767","name":"MATERIALIZABLE: Intelligent fabrication-oriented Computational Design and Modeling","call_identifier":"H2020","_id":"24F9549A-B435-11E9-9278-68D0E5697425"}],"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","citation":{"ista":"Hafner C, Bickel B. 2023. The design space of Kirchhoff rods. ACM Transactions on Graphics. 42(5), 171.","chicago":"Hafner, Christian, and Bernd Bickel. “The Design Space of Kirchhoff Rods.” ACM Transactions on Graphics. Association for Computing Machinery, 2023. https://doi.org/10.1145/3606033.","ieee":"C. Hafner and B. Bickel, “The design space of Kirchhoff rods,” ACM Transactions on Graphics, vol. 42, no. 5. Association for Computing Machinery, 2023.","short":"C. Hafner, B. Bickel, ACM Transactions on Graphics 42 (2023).","apa":"Hafner, C., & Bickel, B. (2023). The design space of Kirchhoff rods. ACM Transactions on Graphics. Association for Computing Machinery. https://doi.org/10.1145/3606033","ama":"Hafner C, Bickel B. The design space of Kirchhoff rods. ACM Transactions on Graphics. 2023;42(5). doi:10.1145/3606033","mla":"Hafner, Christian, and Bernd Bickel. “The Design Space of Kirchhoff Rods.” ACM Transactions on Graphics, vol. 42, no. 5, 171, Association for Computing Machinery, 2023, doi:10.1145/3606033."},"title":"The design space of Kirchhoff rods","article_processing_charge":"No","external_id":{"isi":["001086833300010"]},"author":[{"last_name":"Hafner","full_name":"Hafner, Christian","id":"400429CC-F248-11E8-B48F-1D18A9856A87","first_name":"Christian"},{"orcid":"0000-0001-6511-9385","full_name":"Bickel, Bernd","last_name":"Bickel","first_name":"Bernd","id":"49876194-F248-11E8-B48F-1D18A9856A87"}]},{"year":"2022","has_accepted_license":"1","publication":"SIGGRAPH Asia 2022 Conference Papers","day":"01","date_created":"2023-01-12T12:03:56Z","doi":"10.1145/3550469.3555406","date_published":"2022-11-01T00:00:00Z","acknowledgement":"This work is supported by FWF Lise Meitner (Grant M 3319), European Research Council (project CHAMELEON, Grant no. 682080), Swiss National Science Foundation (Grant no. 200502), and academic gifts from Meta.","oa":1,"quality_controlled":"1","publisher":"Association for Computing Machinery","citation":{"chicago":"Chen, Bin, Michael Piovarci, Chao Wang, Hans-Peter Seidel, Piotr Didyk, Karol Myszkowski, and Ana Serrano. “Gloss Management for Consistent Reproduction of Real and Virtual Objects.” In SIGGRAPH Asia 2022 Conference Papers, Vol. 2022. Association for Computing Machinery, 2022. https://doi.org/10.1145/3550469.3555406.","ista":"Chen B, Piovarci M, Wang C, Seidel H-P, Didyk P, Myszkowski K, Serrano A. 2022. Gloss management for consistent reproduction of real and virtual objects. SIGGRAPH Asia 2022 Conference Papers. SIGGRAPH: Computer Graphics and Interactive Techniques Conference vol. 2022, 35.","mla":"Chen, Bin, et al. “Gloss Management for Consistent Reproduction of Real and Virtual Objects.” SIGGRAPH Asia 2022 Conference Papers, vol. 2022, 35, Association for Computing Machinery, 2022, doi:10.1145/3550469.3555406.","short":"B. Chen, M. Piovarci, C. Wang, H.-P. Seidel, P. Didyk, K. Myszkowski, A. Serrano, in:, SIGGRAPH Asia 2022 Conference Papers, Association for Computing Machinery, 2022.","ieee":"B. Chen et al., “Gloss management for consistent reproduction of real and virtual objects,” in SIGGRAPH Asia 2022 Conference Papers, Daegu, South Korea, 2022, vol. 2022.","apa":"Chen, B., Piovarci, M., Wang, C., Seidel, H.-P., Didyk, P., Myszkowski, K., & Serrano, A. (2022). Gloss management for consistent reproduction of real and virtual objects. In SIGGRAPH Asia 2022 Conference Papers (Vol. 2022). Daegu, South Korea: Association for Computing Machinery. https://doi.org/10.1145/3550469.3555406","ama":"Chen B, Piovarci M, Wang C, et al. Gloss management for consistent reproduction of real and virtual objects. In: SIGGRAPH Asia 2022 Conference Papers. Vol 2022. Association for Computing Machinery; 2022. doi:10.1145/3550469.3555406"},"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","article_processing_charge":"No","author":[{"last_name":"Chen","full_name":"Chen, Bin","first_name":"Bin"},{"first_name":"Michael","id":"62E473F4-5C99-11EA-A40E-AF823DDC885E","last_name":"Piovarci","full_name":"Piovarci, Michael"},{"first_name":"Chao","full_name":"Wang, Chao","last_name":"Wang"},{"first_name":"Hans-Peter","last_name":"Seidel","full_name":"Seidel, Hans-Peter"},{"full_name":"Didyk, Piotr","last_name":"Didyk","first_name":"Piotr"},{"full_name":"Myszkowski, Karol","last_name":"Myszkowski","first_name":"Karol"},{"full_name":"Serrano, Ana","last_name":"Serrano","first_name":"Ana"}],"title":"Gloss management for consistent reproduction of real and virtual objects","article_number":"35","project":[{"name":"Perception-Aware Appearance Fabrication","grant_number":"M03319","_id":"eb901961-77a9-11ec-83b8-f5c883a62027"}],"publication_status":"published","publication_identifier":{"isbn":["9781450394703"]},"language":[{"iso":"eng"}],"file":[{"date_created":"2023-01-24T07:35:21Z","file_name":"2022_ACM_SIGGRAPH_Chen.pdf","date_updated":"2023-01-24T07:35:21Z","file_size":28826826,"creator":"dernst","checksum":"f47f3215ab8bb919e3546b3438c34c21","file_id":"12351","success":1,"content_type":"application/pdf","access_level":"open_access","relation":"main_file"}],"volume":2022,"abstract":[{"text":"A good match of material appearance between real-world objects and their digital on-screen representations is critical for many applications such as fabrication, design, and e-commerce. However, faithful appearance reproduction is challenging, especially for complex phenomena, such as gloss. In most cases, the view-dependent nature of gloss and the range of luminance values required for reproducing glossy materials exceeds the current capabilities of display devices. As a result, appearance reproduction poses significant problems even with accurately rendered images. This paper studies the gap between the gloss perceived from real-world objects and their digital counterparts. Based on our psychophysical experiments on a wide range of 3D printed samples and their corresponding photographs, we derive insights on the influence of geometry, illumination, and the display’s brightness and measure the change in gloss appearance due to the display limitations. Our evaluation experiments demonstrate that using the prediction to correct material parameters in a rendering system improves the match of gloss appearance between real objects and their visualization on a display device.","lang":"eng"}],"oa_version":"Published Version","scopus_import":"1","intvolume":" 2022","month":"11","date_updated":"2023-02-13T09:15:25Z","ddc":["000"],"department":[{"_id":"BeBi"}],"file_date_updated":"2023-01-24T07:35:21Z","_id":"12135","conference":{"location":"Daegu, South Korea","end_date":"2022-12-09","start_date":"2022-12-06","name":"SIGGRAPH: Computer Graphics and Interactive Techniques Conference"},"tmp":{"legal_code_url":"https://creativecommons.org/licenses/by/4.0/legalcode","image":"/images/cc_by.png","name":"Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)","short":"CC BY (4.0)"},"type":"conference","status":"public"},{"date_created":"2022-06-10T06:41:47Z","doi":"10.1145/3528223.3530144","date_published":"2022-06-01T00:00:00Z","year":"2022","has_accepted_license":"1","publication":"ACM Transactions on Graphics","day":"01","oa":1,"quality_controlled":"1","publisher":"Association for Computing Machinery","acknowledgement":"This work is graciously supported by the following grant agencies: FWF Lise Meitner (Grant M 3319), SNSF (Grant 200502), ERC Starting Grant (MATERIALIZABLE-715767), NSF (Grant IIS-181507).\r\n","external_id":{"arxiv":["2201.11819"]},"article_processing_charge":"No","author":[{"last_name":"Piovarci","full_name":"Piovarci, Michael","first_name":"Michael","id":"62E473F4-5C99-11EA-A40E-AF823DDC885E"},{"full_name":"Foshey, Michael","last_name":"Foshey","first_name":"Michael"},{"full_name":"Xu, Jie","last_name":"Xu","first_name":"Jie"},{"full_name":"Erps, Timothy","last_name":"Erps","first_name":"Timothy"},{"first_name":"Vahid","last_name":"Babaei","full_name":"Babaei, Vahid"},{"first_name":"Piotr","last_name":"Didyk","full_name":"Didyk, Piotr"},{"full_name":"Rusinkiewicz, Szymon","last_name":"Rusinkiewicz","first_name":"Szymon"},{"last_name":"Matusik","full_name":"Matusik, Wojciech","first_name":"Wojciech"},{"orcid":"0000-0001-6511-9385","full_name":"Bickel, Bernd","last_name":"Bickel","first_name":"Bernd","id":"49876194-F248-11E8-B48F-1D18A9856A87"}],"title":"Closed-loop control of direct ink writing via reinforcement learning","citation":{"short":"M. Piovarci, M. Foshey, J. Xu, T. Erps, V. Babaei, P. Didyk, S. Rusinkiewicz, W. Matusik, B. Bickel, ACM Transactions on Graphics 41 (2022).","ieee":"M. Piovarci et al., “Closed-loop control of direct ink writing via reinforcement learning,” ACM Transactions on Graphics, vol. 41, no. 4. Association for Computing Machinery, 2022.","apa":"Piovarci, M., Foshey, M., Xu, J., Erps, T., Babaei, V., Didyk, P., … Bickel, B. (2022). Closed-loop control of direct ink writing via reinforcement learning. ACM Transactions on Graphics. Association for Computing Machinery. https://doi.org/10.1145/3528223.3530144","ama":"Piovarci M, Foshey M, Xu J, et al. Closed-loop control of direct ink writing via reinforcement learning. ACM Transactions on Graphics. 2022;41(4). doi:10.1145/3528223.3530144","mla":"Piovarci, Michael, et al. “Closed-Loop Control of Direct Ink Writing via Reinforcement Learning.” ACM Transactions on Graphics, vol. 41, no. 4, 112, Association for Computing Machinery, 2022, doi:10.1145/3528223.3530144.","ista":"Piovarci M, Foshey M, Xu J, Erps T, Babaei V, Didyk P, Rusinkiewicz S, Matusik W, Bickel B. 2022. Closed-loop control of direct ink writing via reinforcement learning. ACM Transactions on Graphics. 41(4), 112.","chicago":"Piovarci, Michael, Michael Foshey, Jie Xu, Timothy Erps, Vahid Babaei, Piotr Didyk, Szymon Rusinkiewicz, Wojciech Matusik, and Bernd Bickel. “Closed-Loop Control of Direct Ink Writing via Reinforcement Learning.” ACM Transactions on Graphics. Association for Computing Machinery, 2022. https://doi.org/10.1145/3528223.3530144."},"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","project":[{"name":"Perception-Aware Appearance Fabrication","grant_number":"M03319","_id":"eb901961-77a9-11ec-83b8-f5c883a62027"},{"call_identifier":"H2020","_id":"24F9549A-B435-11E9-9278-68D0E5697425","name":"MATERIALIZABLE: Intelligent fabrication-oriented Computational Design and Modeling","grant_number":"715767"}],"article_number":"112","ec_funded":1,"related_material":{"link":[{"relation":"press_release","url":"https://ista.ac.at/en/news/machine-learning-3d-printing-fluids/","description":"News on ISTA website"}]},"volume":41,"issue":"4","publication_status":"published","publication_identifier":{"eissn":["1557-7368"],"issn":["0730-0301"]},"language":[{"iso":"eng"}],"file":[{"file_name":"2022_ACM_acceptedversion_Piovarci.pdf","date_created":"2022-06-28T08:32:58Z","file_size":33994829,"date_updated":"2022-06-28T08:32:58Z","creator":"dernst","success":1,"checksum":"27f6fe41c6ff84d50445cc9b0176d45b","file_id":"11467","content_type":"application/pdf","relation":"main_file","access_level":"open_access"}],"intvolume":" 41","month":"06","abstract":[{"lang":"eng","text":"Enabling additive manufacturing to employ a wide range of novel, functional materials can be a major boost to this technology. However, making such materials printable requires painstaking trial-and-error by an expert operator,\r\nas they typically tend to exhibit peculiar rheological or hysteresis properties. Even in the case of successfully finding the process parameters, there is no guarantee of print-to-print consistency due to material differences between batches. These challenges make closed-loop feedback an attractive option where the process parameters are adjusted on-the-fly. There are several challenges for designing an efficient controller: the deposition parameters are complex and highly coupled, artifacts occur after long time horizons, simulating the deposition is computationally costly, and learning on hardware is intractable. In this work, we demonstrate the feasibility of learning a closed-loop control policy for additive manufacturing using reinforcement learning. We show that approximate, but efficient, numerical simulation is\r\nsufficient as long as it allows learning the behavioral patterns of deposition that translate to real-world experiences. In combination with reinforcement learning, our model can be used to discover control policies that outperform\r\nbaseline controllers. Furthermore, the recovered policies have a minimal sim-to-real gap. We showcase this by applying our control policy in-vivo on a single-layer, direct ink writing printer. "}],"oa_version":"Submitted Version","file_date_updated":"2022-06-28T08:32:58Z","department":[{"_id":"BeBi"}],"date_updated":"2023-05-31T12:38:21Z","ddc":["000"],"tmp":{"legal_code_url":"https://creativecommons.org/licenses/by/4.0/legalcode","image":"/images/cc_by.png","name":"Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)","short":"CC BY (4.0)"},"article_type":"original","type":"journal_article","status":"public","_id":"11442"},{"project":[{"call_identifier":"H2020","_id":"24F9549A-B435-11E9-9278-68D0E5697425","grant_number":"715767","name":"MATERIALIZABLE: Intelligent fabrication-oriented Computational Design and Modeling"}],"citation":{"apa":"Liu, Z., Hu, J., Xu, H., Song, P., Zhang, R., Bickel, B., & Fu, C.-W. (2022). Worst-case rigidity analysis and optimization for assemblies with mechanical joints. Computer Graphics Forum. Wiley. https://doi.org/10.1111/cgf.14490","ama":"Liu Z, Hu J, Xu H, et al. Worst-case rigidity analysis and optimization for assemblies with mechanical joints. Computer Graphics Forum. 2022;41(2):507-519. doi:10.1111/cgf.14490","short":"Z. Liu, J. Hu, H. Xu, P. Song, R. Zhang, B. Bickel, C.-W. Fu, Computer Graphics Forum 41 (2022) 507–519.","ieee":"Z. Liu et al., “Worst-case rigidity analysis and optimization for assemblies with mechanical joints,” Computer Graphics Forum, vol. 41, no. 2. Wiley, pp. 507–519, 2022.","mla":"Liu, Zhenyuan, et al. “Worst-Case Rigidity Analysis and Optimization for Assemblies with Mechanical Joints.” Computer Graphics Forum, vol. 41, no. 2, Wiley, 2022, pp. 507–19, doi:10.1111/cgf.14490.","ista":"Liu Z, Hu J, Xu H, Song P, Zhang R, Bickel B, Fu C-W. 2022. Worst-case rigidity analysis and optimization for assemblies with mechanical joints. Computer Graphics Forum. 41(2), 507–519.","chicago":"Liu, Zhenyuan, Jingyu Hu, Hao Xu, Peng Song, Ran Zhang, Bernd Bickel, and Chi-Wing Fu. “Worst-Case Rigidity Analysis and Optimization for Assemblies with Mechanical Joints.” Computer Graphics Forum. Wiley, 2022. https://doi.org/10.1111/cgf.14490."},"user_id":"4359f0d1-fa6c-11eb-b949-802e58b17ae8","author":[{"full_name":"Liu, Zhenyuan","orcid":"0000-0001-9200-5690","last_name":"Liu","first_name":"Zhenyuan","id":"70f0d7cf-ae65-11ec-a14f-89dfc5505b19"},{"full_name":"Hu, Jingyu","last_name":"Hu","first_name":"Jingyu"},{"full_name":"Xu, Hao","last_name":"Xu","first_name":"Hao"},{"last_name":"Song","full_name":"Song, Peng","first_name":"Peng"},{"last_name":"Zhang","full_name":"Zhang, Ran","first_name":"Ran"},{"first_name":"Bernd","id":"49876194-F248-11E8-B48F-1D18A9856A87","orcid":"0000-0001-6511-9385","full_name":"Bickel, Bernd","last_name":"Bickel"},{"first_name":"Chi-Wing","last_name":"Fu","full_name":"Fu, Chi-Wing"}],"external_id":{"isi":["000802723900039"]},"article_processing_charge":"No","title":"Worst-case rigidity analysis and optimization for assemblies with mechanical joints","acknowledgement":"This work was supported by the Research Grants Council of the Hong Kong Special Administrative Region, China [Project No.: CUHK 14201921] and the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 715767 – MATERIALIZABLE). We thank the anonymous reviewers for their insightful feedback; Christian Hafner for proofreading and discussions; Ziqi Wang,\r\nHaisen Zhao, and Martin Hafskjold Thoresen for the helpful discussions; and the Miba Machine Shop at IST Austria for 3D printing the BUNNY and BOOMERANG models.","quality_controlled":"1","publisher":"Wiley","oa":1,"has_accepted_license":"1","isi":1,"year":"2022","day":"01","publication":"Computer Graphics Forum","page":"507-519","doi":"10.1111/cgf.14490","date_published":"2022-05-01T00:00:00Z","date_created":"2022-03-27T17:34:17Z","_id":"10922","type":"journal_article","article_type":"original","status":"public","date_updated":"2023-08-03T06:17:13Z","ddc":["000"],"department":[{"_id":"BeBi"}],"file_date_updated":"2022-03-27T17:34:11Z","abstract":[{"lang":"eng","text":"We study structural rigidity for assemblies with mechanical joints. Existing methods identify whether an assembly is structurally rigid by assuming parts are perfectly rigid. Yet, an assembly identified as rigid may not be that “rigid” in practice, and existing methods cannot quantify how rigid an assembly is. We address this limitation by developing a new measure, worst-case rigidity, to quantify the rigidity of an assembly as the largest possible deformation that the assembly undergoes for arbitrary external loads of fixed magnitude. Computing worst-case rigidity is non-trivial due to non-rigid parts and different joint types. We thus formulate a new computational approach by encoding parts and their connections into a stiffness matrix, in which parts are modeled as deformable objects and joints as soft constraints. Based on this, we formulate worst-case rigidity analysis as an optimization that seeks the worst-case deformation of an assembly for arbitrary external loads, and solve the optimization problem via an eigenanalysis. Furthermore, we present methods to optimize the geometry and topology of various assemblies to enhance their rigidity, as guided by our rigidity measure. In the end, we validate our method on a variety of assembly structures with physical experiments and demonstrate its effectiveness by designing and fabricating several structurally rigid assemblies."}],"acknowledged_ssus":[{"_id":"M-Shop"}],"oa_version":"Submitted Version","scopus_import":"1","month":"05","intvolume":" 41","publication_identifier":{"issn":["0167-7055"],"eissn":["1467-8659"]},"publication_status":"published","file":[{"content_type":"application/pdf","relation":"main_file","access_level":"open_access","checksum":"b62188b07f5c000f1638c782ec92da41","file_id":"10923","file_size":19601689,"date_updated":"2022-03-27T17:34:11Z","creator":"bbickel","file_name":"paper.pdf","date_created":"2022-03-27T17:34:11Z"}],"language":[{"iso":"eng"}],"issue":"2","volume":41,"ec_funded":1},{"_id":"11735","article_type":"original","type":"journal_article","status":"public","date_updated":"2023-08-03T13:21:22Z","ddc":["000"],"department":[{"_id":"BeBi"}],"file_date_updated":"2022-08-28T07:56:19Z","abstract":[{"lang":"eng","text":"Interlocking puzzles are intriguing geometric games where the puzzle pieces are held together based on their geometric arrangement, preventing the puzzle from falling apart. High-level-of-difficulty, or simply high-level, interlocking puzzles are a subclass of interlocking puzzles that require multiple moves to take out the first subassembly from the puzzle. Solving a high-level interlocking puzzle is a challenging task since one has to explore many different configurations of the puzzle pieces until reaching a configuration where the first subassembly can be taken out. Designing a high-level interlocking puzzle with a user-specified level of difficulty is even harder since the puzzle pieces have to be interlocking in all the configurations before the first subassembly is taken out.\r\n\r\nIn this paper, we present a computational approach to design high-level interlocking puzzles. The core idea is to represent all possible configurations of an interlocking puzzle as well as transitions among these configurations using a rooted, undirected graph called a disassembly graph and leverage this graph to find a disassembly plan that requires a minimal number of moves to take out the first subassembly from the puzzle. At the design stage, our algorithm iteratively constructs the geometry of each puzzle piece to expand the disassembly graph incrementally, aiming to achieve a user-specified level of difficulty. We show that our approach allows efficient generation of high-level interlocking puzzles of various shape complexities, including new solutions not attainable by state-of-the-art approaches."}],"oa_version":"Submitted Version","scopus_import":"1","intvolume":" 41","month":"07","publication_status":"published","publication_identifier":{"eissn":["1557-7368"],"issn":["0730-0301"]},"language":[{"iso":"eng"}],"file":[{"file_id":"11992","checksum":"0b51651be45b1b33f2072bd5d2686c69","success":1,"access_level":"open_access","relation":"main_file","content_type":"application/pdf","date_created":"2022-08-28T07:56:19Z","file_name":"Chen-2022-High-LevelPuzzle_authorVersion.pdf","creator":"bbickel","date_updated":"2022-08-28T07:56:19Z","file_size":16896871}],"ec_funded":1,"issue":"4","volume":41,"related_material":{"link":[{"description":"News on ISTA website","url":"https://ista.ac.at/en/news/unlocking-interlocking-riddles/","relation":"press_release"}]},"article_number":"150","project":[{"grant_number":"715767","name":"MATERIALIZABLE: Intelligent fabrication-oriented Computational Design and Modeling","_id":"24F9549A-B435-11E9-9278-68D0E5697425","call_identifier":"H2020"}],"citation":{"ama":"Chen R, Wang Z, Song P, Bickel B. Computational design of high-level interlocking puzzles. ACM Transactions on Graphics. 2022;41(4). doi:10.1145/3528223.3530071","apa":"Chen, R., Wang, Z., Song, P., & Bickel, B. (2022). Computational design of high-level interlocking puzzles. ACM Transactions on Graphics. Association for Computing Machinery. https://doi.org/10.1145/3528223.3530071","short":"R. Chen, Z. Wang, P. Song, B. Bickel, ACM Transactions on Graphics 41 (2022).","ieee":"R. Chen, Z. Wang, P. Song, and B. Bickel, “Computational design of high-level interlocking puzzles,” ACM Transactions on Graphics, vol. 41, no. 4. Association for Computing Machinery, 2022.","mla":"Chen, Rulin, et al. “Computational Design of High-Level Interlocking Puzzles.” ACM Transactions on Graphics, vol. 41, no. 4, 150, Association for Computing Machinery, 2022, doi:10.1145/3528223.3530071.","ista":"Chen R, Wang Z, Song P, Bickel B. 2022. Computational design of high-level interlocking puzzles. ACM Transactions on Graphics. 41(4), 150.","chicago":"Chen, Rulin, Ziqi Wang, Peng Song, and Bernd Bickel. “Computational Design of High-Level Interlocking Puzzles.” ACM Transactions on Graphics. Association for Computing Machinery, 2022. https://doi.org/10.1145/3528223.3530071."},"user_id":"4359f0d1-fa6c-11eb-b949-802e58b17ae8","article_processing_charge":"No","external_id":{"isi":["000830989200018"]},"author":[{"first_name":"Rulin","last_name":"Chen","full_name":"Chen, Rulin"},{"first_name":"Ziqi","last_name":"Wang","full_name":"Wang, Ziqi"},{"full_name":"Song, Peng","last_name":"Song","first_name":"Peng"},{"id":"49876194-F248-11E8-B48F-1D18A9856A87","first_name":"Bernd","last_name":"Bickel","full_name":"Bickel, Bernd","orcid":"0000-0001-6511-9385"}],"title":"Computational design of high-level interlocking puzzles","acknowledgement":"We thank the reviewers for the valuable comments, David Gontier for sharing the source code of the baseline design approach, Christian Hafner for proofreading the paper, Keenan Crane for the 3D model of Cow, and Thingiverse for the 3D models of Moai and Owl. This work was supported by the SUTD Start-up Research Grant (Number: SRG ISTD 2019 148), the Swiss National Science Foundation (NCCR Digital Fabrication Agreement #51NF40-141853), and\r\nthe European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Grant Agreement No 715767 – MATERIALIZABLE).","oa":1,"publisher":"Association for Computing Machinery","quality_controlled":"1","year":"2022","isi":1,"has_accepted_license":"1","publication":"ACM Transactions on Graphics","day":"22","date_created":"2022-08-07T22:01:57Z","date_published":"2022-07-22T00:00:00Z","doi":"10.1145/3528223.3530071"},{"oa_version":"Submitted Version","abstract":[{"text":"Moulding refers to a set of manufacturing techniques in which a mould, usually a cavity or a solid frame, is used to shape a liquid or pliable material into an object of the desired shape. The popularity of moulding comes from its effectiveness, scalability and versatility in terms of employed materials. Its relevance as a fabrication process is demonstrated by the extensive literature covering different aspects related to mould design, from material flow simulation to the automation of mould geometry design. In this state-of-the-art report, we provide an extensive review of the automatic methods for the design of moulds, focusing on contributions from a geometric perspective. We classify existing mould design methods based on their computational approach and the nature of their target moulding process. We summarize the relationships between computational approaches and moulding techniques, highlighting their strengths and limitations. Finally, we discuss potential future research directions.","lang":"eng"}],"month":"09","intvolume":" 41","scopus_import":"1","file":[{"checksum":"c40cc8ceb7b7f0512172b883d712198e","file_id":"11994","description":"This is the pre-peer reviewed version of the following article: Alderighi, T., Malomo, L., Auzinger, T., Bickel, B., Cignoni, P. and Pietroni, N. (2022), State of the Art in Computational Mould Design. Computer Graphics Forum, which has been published in final form at https://doi.org/10.1111/cgf.14581. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions.","content_type":"application/pdf","relation":"main_file","access_level":"open_access","file_name":"star_molding_preprint.pdf","title":"pre-peer reviewed version","date_created":"2022-08-28T18:18:08Z","file_size":32480850,"date_updated":"2022-08-28T18:18:08Z","creator":"bbickel"}],"language":[{"iso":"eng"}],"publication_identifier":{"issn":["0167-7055"],"eissn":["1467-8659"]},"publication_status":"published","issue":"6","volume":41,"_id":"11993","status":"public","keyword":["Computer Graphics and Computer-Aided Design"],"article_type":"original","type":"journal_article","ddc":["000"],"date_updated":"2023-08-03T13:21:55Z","file_date_updated":"2022-08-28T18:18:08Z","department":[{"_id":"BeBi"}],"publisher":"Wiley","quality_controlled":"1","oa":1,"day":"01","publication":"Computer Graphics Forum","isi":1,"has_accepted_license":"1","year":"2022","doi":"10.1111/cgf.14581","date_published":"2022-09-01T00:00:00Z","date_created":"2022-08-28T18:17:01Z","page":"435-452","user_id":"4359f0d1-fa6c-11eb-b949-802e58b17ae8","citation":{"chicago":"Alderighi, Thomas, Luigi Malomo, Thomas Auzinger, Bernd Bickel, Paulo Cignoni, and Nico Pietroni. “State of the Art in Computational Mould Design.” Computer Graphics Forum. Wiley, 2022. https://doi.org/10.1111/cgf.14581.","ista":"Alderighi T, Malomo L, Auzinger T, Bickel B, Cignoni P, Pietroni N. 2022. State of the art in computational mould design. Computer Graphics Forum. 41(6), 435–452.","mla":"Alderighi, Thomas, et al. “State of the Art in Computational Mould Design.” Computer Graphics Forum, vol. 41, no. 6, Wiley, 2022, pp. 435–52, doi:10.1111/cgf.14581.","short":"T. Alderighi, L. Malomo, T. Auzinger, B. Bickel, P. Cignoni, N. Pietroni, Computer Graphics Forum 41 (2022) 435–452.","ieee":"T. Alderighi, L. Malomo, T. Auzinger, B. Bickel, P. Cignoni, and N. Pietroni, “State of the art in computational mould design,” Computer Graphics Forum, vol. 41, no. 6. Wiley, pp. 435–452, 2022.","apa":"Alderighi, T., Malomo, L., Auzinger, T., Bickel, B., Cignoni, P., & Pietroni, N. (2022). State of the art in computational mould design. Computer Graphics Forum. Wiley. https://doi.org/10.1111/cgf.14581","ama":"Alderighi T, Malomo L, Auzinger T, Bickel B, Cignoni P, Pietroni N. State of the art in computational mould design. Computer Graphics Forum. 2022;41(6):435-452. doi:10.1111/cgf.14581"},"title":"State of the art in computational mould design","author":[{"full_name":"Alderighi, Thomas","last_name":"Alderighi","first_name":"Thomas"},{"full_name":"Malomo, Luigi","last_name":"Malomo","first_name":"Luigi"},{"full_name":"Auzinger, Thomas","orcid":"0000-0002-1546-3265","last_name":"Auzinger","first_name":"Thomas","id":"4718F954-F248-11E8-B48F-1D18A9856A87"},{"last_name":"Bickel","full_name":"Bickel, Bernd","orcid":"0000-0001-6511-9385","first_name":"Bernd","id":"49876194-F248-11E8-B48F-1D18A9856A87"},{"full_name":"Cignoni, Paulo","last_name":"Cignoni","first_name":"Paulo"},{"first_name":"Nico","last_name":"Pietroni","full_name":"Pietroni, Nico"}],"article_processing_charge":"No","external_id":{"isi":["000842638900001"]}},{"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","citation":{"mla":"Rao, Pramod, et al. “VoRF: Volumetric Relightable Faces.” 33rd British Machine Vision Conference, 708, British Machine Vision Association and Society for Pattern Recognition, 2022.","short":"P. Rao, M. B R, G. Fox, T. Weyrich, B. Bickel, H.-P. Seidel, H. Pfister, W. Matusik, A. Tewari, C. Theobalt, M. Elgharib, in:, 33rd British Machine Vision Conference, British Machine Vision Association and Society for Pattern Recognition, 2022.","ieee":"P. Rao et al., “VoRF: Volumetric Relightable Faces,” in 33rd British Machine Vision Conference, London, United Kingdom, 2022.","apa":"Rao, P., B R, M., Fox, G., Weyrich, T., Bickel, B., Seidel, H.-P., … Elgharib, M. (2022). VoRF: Volumetric Relightable Faces. In 33rd British Machine Vision Conference. London, United Kingdom: British Machine Vision Association and Society for Pattern Recognition.","ama":"Rao P, B R M, Fox G, et al. VoRF: Volumetric Relightable Faces. In: 33rd British Machine Vision Conference. British Machine Vision Association and Society for Pattern Recognition; 2022.","chicago":"Rao, Pramod, Mallikarjun B R, Gereon Fox, Tim Weyrich, Bernd Bickel, Hans-Peter Seidel, Hanspeter Pfister, et al. “VoRF: Volumetric Relightable Faces.” In 33rd British Machine Vision Conference. British Machine Vision Association and Society for Pattern Recognition, 2022.","ista":"Rao P, B R M, Fox G, Weyrich T, Bickel B, Seidel H-P, Pfister H, Matusik W, Tewari A, Theobalt C, Elgharib M. 2022. VoRF: Volumetric Relightable Faces. 33rd British Machine Vision Conference. BMVC: British Machine Vision Conference, 708."},"title":"VoRF: Volumetric Relightable Faces","article_processing_charge":"No","author":[{"last_name":"Rao","full_name":"Rao, Pramod","first_name":"Pramod"},{"last_name":"B R","full_name":"B R, Mallikarjun","first_name":"Mallikarjun"},{"first_name":"Gereon","last_name":"Fox","full_name":"Fox, Gereon"},{"last_name":"Weyrich","full_name":"Weyrich, Tim","first_name":"Tim"},{"last_name":"Bickel","orcid":"0000-0001-6511-9385","full_name":"Bickel, Bernd","id":"49876194-F248-11E8-B48F-1D18A9856A87","first_name":"Bernd"},{"last_name":"Seidel","full_name":"Seidel, Hans-Peter","first_name":"Hans-Peter"},{"first_name":"Hanspeter","last_name":"Pfister","full_name":"Pfister, Hanspeter"},{"first_name":"Wojciech","full_name":"Matusik, Wojciech","last_name":"Matusik"},{"first_name":"Ayush","full_name":"Tewari, Ayush","last_name":"Tewari"},{"first_name":"Christian","full_name":"Theobalt, Christian","last_name":"Theobalt"},{"full_name":"Elgharib, Mohamed","last_name":"Elgharib","first_name":"Mohamed"}],"article_number":"708","publication":"33rd British Machine Vision Conference","day":"01","year":"2022","has_accepted_license":"1","date_created":"2023-01-30T10:47:06Z","date_published":"2022-12-01T00:00:00Z","acknowledgement":"This work was supported by the ERC Consolidator Grant 4DReply (770784).","oa":1,"publisher":"British Machine Vision Association and Society for Pattern Recognition","quality_controlled":"1","ddc":["000"],"date_updated":"2023-10-31T08:40:55Z","department":[{"_id":"BeBi"}],"file_date_updated":"2023-01-30T10:48:37Z","_id":"12452","status":"public","conference":{"name":"BMVC: British Machine Vision Conference","location":"London, United Kingdom","end_date":"2022-11-24","start_date":"2022-11-21"},"type":"conference","language":[{"iso":"eng"}],"file":[{"title":"VoRF: Volumetric Relightable Faces","date_created":"2023-01-30T10:48:18Z","file_name":"vorf_main.pdf","creator":"bbickel","date_updated":"2023-01-30T10:48:18Z","file_size":5202710,"file_id":"12453","checksum":"b60b70bb48700aee709c85a69231821d","access_level":"open_access","relation":"main_file","content_type":"application/pdf"},{"file_id":"12454","checksum":"ce5f4ce66eaaa1590ee5df989fca6f61","content_type":"application/pdf","relation":"supplementary_material","access_level":"open_access","file_name":"vorf_supp.pdf","title":"VoRF: Volumetric Relightable Faces – SUPPLEMENTAL MATERIAL –","date_created":"2023-01-30T10:48:29Z","file_size":37953188,"date_updated":"2023-01-30T10:48:29Z","creator":"bbickel"},{"file_id":"12455","checksum":"08aecca434b08fee75ee1efe87943718","relation":"supplementary_material","access_level":"open_access","content_type":"video/mp4","file_name":"video.mp4","date_created":"2023-01-30T10:48:37Z","creator":"bbickel","file_size":57855492,"date_updated":"2023-01-30T10:48:37Z"}],"publication_status":"published","oa_version":"Published Version","abstract":[{"text":"Portrait viewpoint and illumination editing is an important problem with several applications in VR/AR, movies, and photography. Comprehensive knowledge of geometry and illumination is critical for obtaining photorealistic results. Current methods are unable to explicitly model in 3D while handing both viewpoint and illumination editing from a single image. In this paper, we propose VoRF, a novel approach that can take even a single portrait image as input and relight human heads under novel illuminations that can be viewed from arbitrary viewpoints. VoRF represents a human head as a continuous volumetric field and learns a prior model of human heads using a coordinate-based MLP with separate latent spaces for identity and illumination. The prior model is learnt in an auto-decoder manner over a diverse class of head shapes and appearances, allowing VoRF to generalize to novel test identities from a single input image. Additionally, VoRF has a reflectance MLP that uses the intermediate features of the prior model for rendering One-Light-at-A-Time (OLAT) images under novel views. We synthesize novel illuminations by combining these OLAT images with target environment maps. Qualitative and quantitative evaluations demonstrate the effectiveness of VoRF for relighting and novel view synthesis even when applied to unseen subjects under uncontrolled illuminations.","lang":"eng"}],"month":"12","main_file_link":[{"url":"https://bmvc2022.mpi-inf.mpg.de/708/","open_access":"1"}],"scopus_import":"1"},{"_id":"11943","type":"preprint","status":"public","date_updated":"2024-03-27T23:30:20Z","citation":{"ieee":"P. Velicky et al., “Saturated reconstruction of living brain tissue,” bioRxiv. Cold Spring Harbor Laboratory.","short":"P. Velicky, E. Miguel Villalba, J.M. Michalska, D. Wei, Z. Lin, J. Watson, J. Troidl, J. Beyer, Y. Ben Simon, C.M. Sommer, W. Jahr, A. Cenameri, J. Broichhagen, S.G.N. Grant, P.M. Jonas, G. Novarino, H. Pfister, B. Bickel, J.G. Danzl, BioRxiv (n.d.).","apa":"Velicky, P., Miguel Villalba, E., Michalska, J. M., Wei, D., Lin, Z., Watson, J., … Danzl, J. G. (n.d.). Saturated reconstruction of living brain tissue. bioRxiv. Cold Spring Harbor Laboratory. https://doi.org/10.1101/2022.03.16.484431","ama":"Velicky P, Miguel Villalba E, Michalska JM, et al. Saturated reconstruction of living brain tissue. bioRxiv. doi:10.1101/2022.03.16.484431","mla":"Velicky, Philipp, et al. “Saturated Reconstruction of Living Brain Tissue.” BioRxiv, Cold Spring Harbor Laboratory, doi:10.1101/2022.03.16.484431.","ista":"Velicky P, Miguel Villalba E, Michalska JM, Wei D, Lin Z, Watson J, Troidl J, Beyer J, Ben Simon Y, Sommer CM, Jahr W, Cenameri A, Broichhagen J, Grant SGN, Jonas PM, Novarino G, Pfister H, Bickel B, Danzl JG. Saturated reconstruction of living brain tissue. bioRxiv, 10.1101/2022.03.16.484431.","chicago":"Velicky, Philipp, Eder Miguel Villalba, Julia M Michalska, Donglai Wei, Zudi Lin, Jake Watson, Jakob Troidl, et al. “Saturated Reconstruction of Living Brain Tissue.” BioRxiv. Cold Spring Harbor Laboratory, n.d. https://doi.org/10.1101/2022.03.16.484431."},"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","article_processing_charge":"No","author":[{"id":"39BDC62C-F248-11E8-B48F-1D18A9856A87","first_name":"Philipp","last_name":"Velicky","orcid":"0000-0002-2340-7431","full_name":"Velicky, Philipp"},{"last_name":"Miguel Villalba","orcid":"0000-0001-5665-0430","full_name":"Miguel Villalba, Eder","id":"3FB91342-F248-11E8-B48F-1D18A9856A87","first_name":"Eder"},{"last_name":"Michalska","orcid":"0000-0003-3862-1235","full_name":"Michalska, Julia M","id":"443DB6DE-F248-11E8-B48F-1D18A9856A87","first_name":"Julia M"},{"full_name":"Wei, Donglai","last_name":"Wei","first_name":"Donglai"},{"first_name":"Zudi","last_name":"Lin","full_name":"Lin, Zudi"},{"first_name":"Jake","id":"63836096-4690-11EA-BD4E-32803DDC885E","orcid":"0000-0002-8698-3823","full_name":"Watson, Jake","last_name":"Watson"},{"last_name":"Troidl","full_name":"Troidl, Jakob","first_name":"Jakob"},{"first_name":"Johanna","full_name":"Beyer, Johanna","last_name":"Beyer"},{"last_name":"Ben Simon","full_name":"Ben Simon, Yoav","first_name":"Yoav","id":"43DF3136-F248-11E8-B48F-1D18A9856A87"},{"first_name":"Christoph M","id":"4DF26D8C-F248-11E8-B48F-1D18A9856A87","full_name":"Sommer, Christoph M","orcid":"0000-0003-1216-9105","last_name":"Sommer"},{"id":"425C1CE8-F248-11E8-B48F-1D18A9856A87","first_name":"Wiebke","full_name":"Jahr, Wiebke","last_name":"Jahr"},{"last_name":"Cenameri","full_name":"Cenameri, Alban","first_name":"Alban","id":"9ac8f577-2357-11eb-997a-e566c5550886"},{"full_name":"Broichhagen, Johannes","last_name":"Broichhagen","first_name":"Johannes"},{"first_name":"Seth G. N.","last_name":"Grant","full_name":"Grant, Seth G. N."},{"last_name":"Jonas","full_name":"Jonas, Peter M","orcid":"0000-0001-5001-4804","first_name":"Peter M","id":"353C1B58-F248-11E8-B48F-1D18A9856A87"},{"first_name":"Gaia","id":"3E57A680-F248-11E8-B48F-1D18A9856A87","full_name":"Novarino, Gaia","orcid":"0000-0002-7673-7178","last_name":"Novarino"},{"first_name":"Hanspeter","last_name":"Pfister","full_name":"Pfister, Hanspeter"},{"orcid":"0000-0001-6511-9385","full_name":"Bickel, Bernd","last_name":"Bickel","id":"49876194-F248-11E8-B48F-1D18A9856A87","first_name":"Bernd"},{"first_name":"Johann G","id":"42EFD3B6-F248-11E8-B48F-1D18A9856A87","last_name":"Danzl","orcid":"0000-0001-8559-3973","full_name":"Danzl, Johann G"}],"title":"Saturated reconstruction of living brain tissue","department":[{"_id":"PeJo"},{"_id":"GaNo"},{"_id":"BeBi"},{"_id":"JoDa"}],"abstract":[{"lang":"eng","text":"Complex wiring between neurons underlies the information-processing network enabling all brain functions, including cognition and memory. For understanding how the network is structured, processes information, and changes over time, comprehensive visualization of the architecture of living brain tissue with its cellular and molecular components would open up major opportunities. However, electron microscopy (EM) provides nanometre-scale resolution required for full in-silico reconstruction1–5, yet is limited to fixed specimens and static representations. Light microscopy allows live observation, with super-resolution approaches6–12 facilitating nanoscale visualization, but comprehensive 3D-reconstruction of living brain tissue has been hindered by tissue photo-burden, photobleaching, insufficient 3D-resolution, and inadequate signal-to-noise ratio (SNR). Here we demonstrate saturated reconstruction of living brain tissue. We developed an integrated imaging and analysis technology, adapting stimulated emission depletion (STED) microscopy6,13 in extracellularly labelled tissue14 for high SNR and near-isotropic resolution. Centrally, a two-stage deep-learning approach leveraged previously obtained information on sample structure to drastically reduce photo-burden and enable automated volumetric reconstruction down to single synapse level. Live reconstruction provides unbiased analysis of tissue architecture across time in relation to functional activity and targeted activation, and contextual understanding of molecular labelling. This adoptable technology will facilitate novel insights into the dynamic functional architecture of living brain tissue."}],"oa_version":"Preprint","main_file_link":[{"url":"https://doi.org/10.1101/2022.03.16.484431","open_access":"1"}],"oa":1,"publisher":"Cold Spring Harbor Laboratory","month":"05","publication_status":"submitted","year":"2022","language":[{"iso":"eng"}],"publication":"bioRxiv","day":"09","date_created":"2022-08-23T11:07:59Z","date_published":"2022-05-09T00:00:00Z","related_material":{"record":[{"relation":"dissertation_contains","status":"public","id":"12470"}]},"doi":"10.1101/2022.03.16.484431"}]