{"intvolume":"        41","file":[{"checksum":"27f6fe41c6ff84d50445cc9b0176d45b","file_size":33994829,"access_level":"open_access","creator":"dernst","date_updated":"2022-06-28T08:32:58Z","file_name":"2022_ACM_acceptedversion_Piovarci.pdf","file_id":"11467","success":1,"relation":"main_file","content_type":"application/pdf","date_created":"2022-06-28T08:32:58Z"}],"has_accepted_license":"1","publication_status":"published","oa_version":"Submitted Version","oa":1,"article_type":"original","tmp":{"short":"CC BY (4.0)","name":"Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)","legal_code_url":"https://creativecommons.org/licenses/by/4.0/legalcode","image":"/images/cc_by.png"},"acknowledgement":"This work is graciously supported by the following grant agencies: FWF Lise Meitner (Grant M 3319), SNSF (Grant 200502), ERC Starting Grant (MATERIALIZABLE-715767), NSF (Grant IIS-181507).\r\n","author":[{"last_name":"Piovarci","full_name":"Piovarci, Michael","id":"62E473F4-5C99-11EA-A40E-AF823DDC885E","first_name":"Michael"},{"first_name":"Michael","last_name":"Foshey","full_name":"Foshey, Michael"},{"first_name":"Jie","last_name":"Xu","full_name":"Xu, Jie"},{"last_name":"Erps","full_name":"Erps, Timothy","first_name":"Timothy"},{"first_name":"Vahid","full_name":"Babaei, Vahid","last_name":"Babaei"},{"first_name":"Piotr","full_name":"Didyk, Piotr","last_name":"Didyk"},{"last_name":"Rusinkiewicz","full_name":"Rusinkiewicz, Szymon","first_name":"Szymon"},{"first_name":"Wojciech","full_name":"Matusik, Wojciech","last_name":"Matusik"},{"last_name":"Bickel","full_name":"Bickel, Bernd","first_name":"Bernd","id":"49876194-F248-11E8-B48F-1D18A9856A87","orcid":"0000-0001-6511-9385"}],"ddc":["000"],"year":"2022","type":"journal_article","article_number":"112","month":"06","date_updated":"2023-05-31T12:38:21Z","volume":41,"date_created":"2022-06-10T06:41:47Z","department":[{"_id":"BeBi"}],"_id":"11442","title":"Closed-loop control of direct ink writing via reinforcement learning","file_date_updated":"2022-06-28T08:32:58Z","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","article_processing_charge":"No","related_material":{"link":[{"relation":"press_release","url":"https://ista.ac.at/en/news/machine-learning-3d-printing-fluids/","description":"News on ISTA website"}]},"issue":"4","language":[{"iso":"eng"}],"abstract":[{"text":"Enabling additive manufacturing to employ a wide range of novel, functional materials can be a major boost to this technology. However, making such materials printable requires painstaking trial-and-error by an expert operator,\r\nas they typically tend to exhibit peculiar rheological or hysteresis properties. Even in the case of successfully finding the process parameters, there is no guarantee of print-to-print consistency due to material differences between batches. These challenges make closed-loop feedback an attractive option where the process parameters are adjusted on-the-fly. There are several challenges for designing an efficient controller: the deposition parameters are complex and highly coupled, artifacts occur after long time horizons, simulating the deposition is computationally costly, and learning on hardware is intractable. In this work, we demonstrate the feasibility of learning a closed-loop control policy for additive manufacturing using reinforcement learning. We show that approximate, but efficient, numerical simulation is\r\nsufficient as long as it allows learning the behavioral patterns of deposition that translate to real-world experiences. In combination with reinforcement learning, our model can be used to discover control policies that outperform\r\nbaseline controllers. Furthermore, the recovered policies have a minimal sim-to-real gap. We showcase this by applying our control policy in-vivo on a single-layer, direct ink writing printer. ","lang":"eng"}],"publisher":"Association for Computing Machinery","citation":{"chicago":"Piovarci, Michael, Michael Foshey, Jie Xu, Timothy Erps, Vahid Babaei, Piotr Didyk, Szymon Rusinkiewicz, Wojciech Matusik, and Bernd Bickel. “Closed-Loop Control of Direct Ink Writing via Reinforcement Learning.” <i>ACM Transactions on Graphics</i>. Association for Computing Machinery, 2022. <a href=\"https://doi.org/10.1145/3528223.3530144\">https://doi.org/10.1145/3528223.3530144</a>.","ieee":"M. Piovarci <i>et al.</i>, “Closed-loop control of direct ink writing via reinforcement learning,” <i>ACM Transactions on Graphics</i>, vol. 41, no. 4. Association for Computing Machinery, 2022.","ama":"Piovarci M, Foshey M, Xu J, et al. Closed-loop control of direct ink writing via reinforcement learning. <i>ACM Transactions on Graphics</i>. 2022;41(4). doi:<a href=\"https://doi.org/10.1145/3528223.3530144\">10.1145/3528223.3530144</a>","short":"M. Piovarci, M. Foshey, J. Xu, T. Erps, V. Babaei, P. Didyk, S. Rusinkiewicz, W. Matusik, B. Bickel, ACM Transactions on Graphics 41 (2022).","apa":"Piovarci, M., Foshey, M., Xu, J., Erps, T., Babaei, V., Didyk, P., … Bickel, B. (2022). Closed-loop control of direct ink writing via reinforcement learning. <i>ACM Transactions on Graphics</i>. Association for Computing Machinery. <a href=\"https://doi.org/10.1145/3528223.3530144\">https://doi.org/10.1145/3528223.3530144</a>","ista":"Piovarci M, Foshey M, Xu J, Erps T, Babaei V, Didyk P, Rusinkiewicz S, Matusik W, Bickel B. 2022. Closed-loop control of direct ink writing via reinforcement learning. ACM Transactions on Graphics. 41(4), 112.","mla":"Piovarci, Michael, et al. “Closed-Loop Control of Direct Ink Writing via Reinforcement Learning.” <i>ACM Transactions on Graphics</i>, vol. 41, no. 4, 112, Association for Computing Machinery, 2022, doi:<a href=\"https://doi.org/10.1145/3528223.3530144\">10.1145/3528223.3530144</a>."},"doi":"10.1145/3528223.3530144","project":[{"grant_number":"M03319","name":"Perception-Aware Appearance Fabrication","_id":"eb901961-77a9-11ec-83b8-f5c883a62027"},{"_id":"24F9549A-B435-11E9-9278-68D0E5697425","call_identifier":"H2020","name":"MATERIALIZABLE: Intelligent fabrication-oriented Computational Design and Modeling","grant_number":"715767"}],"date_published":"2022-06-01T00:00:00Z","publication_identifier":{"issn":["0730-0301"],"eissn":["1557-7368"]},"day":"01","status":"public","ec_funded":1,"publication":"ACM Transactions on Graphics","external_id":{"arxiv":["2201.11819"]},"quality_controlled":"1"}