---
_id: '9820'
abstract:
- lang: eng
text: Material appearance hinges on material reflectance properties but also surface
geometry and illumination. The unlimited number of potential combinations between
these factors makes understanding and predicting material appearance a very challenging
task. In this work, we collect a large-scale dataset of perceptual ratings of
appearance attributes with more than 215,680 responses for 42,120 distinct combinations
of material, shape, and illumination. The goal of this dataset is twofold. First,
we analyze for the first time the effects of illumination and geometry in material
perception across such a large collection of varied appearances. We connect our
findings to those of the literature, discussing how previous knowledge generalizes
across very diverse materials, shapes, and illuminations. Second, we use the collected
dataset to train a deep learning architecture for predicting perceptual attributes
that correlate with human judgments. We demonstrate the consistent and robust
behavior of our predictor in various challenging scenarios, which, for the first
time, enables estimating perceived material attributes from general 2D images.
Since our predictor relies on the final appearance in an image, it can compare
appearance properties across different geometries and illumination conditions.
Finally, we demonstrate several applications that use our predictor, including
appearance reproduction using 3D printing, BRDF editing by integrating our predictor
in a differentiable renderer, illumination design, or material recommendations
for scene design.
acknowledgement: This project has received funding from the European Union’s Horizon
2020 research and innovation programme under the Marie Skłodowska-Curie, grant agreement
Nº 765911 (RealVision) and from the European Research Council (ERC), grant agreement
Nº 804226 (PERDY).
article_number: '125'
article_processing_charge: No
article_type: original
author:
- first_name: Ana
full_name: Serrano, Ana
last_name: Serrano
- first_name: Bin
full_name: Chen, Bin
last_name: Chen
- first_name: Chao
full_name: Wang, Chao
last_name: Wang
- first_name: Michael
full_name: Piovarci, Michael
id: 62E473F4-5C99-11EA-A40E-AF823DDC885E
last_name: Piovarci
orcid: 0000-0002-5062-4474
- first_name: Hans Peter
full_name: Seidel, Hans Peter
last_name: Seidel
- first_name: Piotr
full_name: Didyk, Piotr
last_name: Didyk
- first_name: Karol
full_name: Myszkowski, Karol
last_name: Myszkowski
citation:
ama: 'Serrano A, Chen B, Wang C, et al. The effect of shape and illumination on
material perception: Model and applications. ACM Transactions on Graphics.
2021;40(4). doi:10.1145/3450626.3459813'
apa: 'Serrano, A., Chen, B., Wang, C., Piovarci, M., Seidel, H. P., Didyk, P., &
Myszkowski, K. (2021). The effect of shape and illumination on material perception:
Model and applications. ACM Transactions on Graphics. Association for Computing
Machinery. https://doi.org/10.1145/3450626.3459813'
chicago: 'Serrano, Ana, Bin Chen, Chao Wang, Michael Piovarci, Hans Peter Seidel,
Piotr Didyk, and Karol Myszkowski. “The Effect of Shape and Illumination on Material
Perception: Model and Applications.” ACM Transactions on Graphics. Association
for Computing Machinery, 2021. https://doi.org/10.1145/3450626.3459813.'
ieee: 'A. Serrano et al., “The effect of shape and illumination on material
perception: Model and applications,” ACM Transactions on Graphics, vol.
40, no. 4. Association for Computing Machinery, 2021.'
ista: 'Serrano A, Chen B, Wang C, Piovarci M, Seidel HP, Didyk P, Myszkowski K.
2021. The effect of shape and illumination on material perception: Model and applications.
ACM Transactions on Graphics. 40(4), 125.'
mla: 'Serrano, Ana, et al. “The Effect of Shape and Illumination on Material Perception:
Model and Applications.” ACM Transactions on Graphics, vol. 40, no. 4,
125, Association for Computing Machinery, 2021, doi:10.1145/3450626.3459813.'
short: A. Serrano, B. Chen, C. Wang, M. Piovarci, H.P. Seidel, P. Didyk, K. Myszkowski,
ACM Transactions on Graphics 40 (2021).
date_created: 2021-08-08T22:01:28Z
date_published: 2021-08-01T00:00:00Z
date_updated: 2023-08-10T14:20:10Z
day: '01'
department:
- _id: BeBi
doi: 10.1145/3450626.3459813
external_id:
isi:
- '000674930900090'
intvolume: ' 40'
isi: 1
issue: '4'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://zaguan.unizar.es/record/110704/files/texto_completo.pdf
month: '08'
oa: 1
oa_version: Submitted Version
publication: ACM Transactions on Graphics
publication_identifier:
eissn:
- '15577368'
issn:
- '07300301'
publication_status: published
publisher: Association for Computing Machinery
quality_controlled: '1'
scopus_import: '1'
status: public
title: 'The effect of shape and illumination on material perception: Model and applications'
type: journal_article
user_id: 4359f0d1-fa6c-11eb-b949-802e58b17ae8
volume: 40
year: '2021'
...
---
_id: '9818'
abstract:
- lang: eng
text: Triangle mesh-based simulations are able to produce satisfying animations
of knitted and woven cloth; however, they lack the rich geometric detail of yarn-level
simulations. Naive texturing approaches do not consider yarn-level physics, while
full yarn-level simulations may become prohibitively expensive for large garments.
We propose a method to animate yarn-level cloth geometry on top of an underlying
deforming mesh in a mechanics-aware fashion. Using triangle strains to interpolate
precomputed yarn geometry, we are able to reproduce effects such as knit loops
tightening under stretching. In combination with precomputed mesh animation or
real-time mesh simulation, our method is able to animate yarn-level cloth in real-time
at large scales.
acknowledged_ssus:
- _id: ScienComp
acknowledgement: "We wish to thank the anonymous reviewers and the members of the
Visual Computing Group at IST Austria for their valuable feedback. We also thank
Seddi Labs for providing the garment model with fold-over seams.\r\nThis research
was supported by the Scientific Service Units (SSU) of IST Austria through resources
provided by Scientific\r\nComputing. This project has received funding from the
European Research Council (ERC) under the European Union’s Horizon 2020 research
and innovation programme under grant agreement No. 638176. Rahul Narain is supported
by a Pankaj Gupta Young Faculty Fellowship and a gift from Adobe Inc."
article_number: '168'
article_processing_charge: Yes (in subscription journal)
article_type: original
author:
- first_name: Georg
full_name: Sperl, Georg
id: 4DD40360-F248-11E8-B48F-1D18A9856A87
last_name: Sperl
- first_name: Rahul
full_name: Narain, Rahul
last_name: Narain
- first_name: Christopher J
full_name: Wojtan, Christopher J
id: 3C61F1D2-F248-11E8-B48F-1D18A9856A87
last_name: Wojtan
orcid: 0000-0001-6646-5546
citation:
ama: Sperl G, Narain R, Wojtan C. Mechanics-aware deformation of yarn pattern geometry.
ACM Transactions on Graphics. 2021;40(4). doi:10.1145/3450626.3459816
apa: Sperl, G., Narain, R., & Wojtan, C. (2021). Mechanics-aware deformation
of yarn pattern geometry. ACM Transactions on Graphics. Association for
Computing Machinery. https://doi.org/10.1145/3450626.3459816
chicago: Sperl, Georg, Rahul Narain, and Chris Wojtan. “Mechanics-Aware Deformation
of Yarn Pattern Geometry.” ACM Transactions on Graphics. Association for
Computing Machinery, 2021. https://doi.org/10.1145/3450626.3459816.
ieee: G. Sperl, R. Narain, and C. Wojtan, “Mechanics-aware deformation of yarn pattern
geometry,” ACM Transactions on Graphics, vol. 40, no. 4. Association for
Computing Machinery, 2021.
ista: Sperl G, Narain R, Wojtan C. 2021. Mechanics-aware deformation of yarn pattern
geometry. ACM Transactions on Graphics. 40(4), 168.
mla: Sperl, Georg, et al. “Mechanics-Aware Deformation of Yarn Pattern Geometry.”
ACM Transactions on Graphics, vol. 40, no. 4, 168, Association for Computing
Machinery, 2021, doi:10.1145/3450626.3459816.
short: G. Sperl, R. Narain, C. Wojtan, ACM Transactions on Graphics 40 (2021).
date_created: 2021-08-08T22:01:27Z
date_published: 2021-08-01T00:00:00Z
date_updated: 2023-08-10T14:24:36Z
day: '01'
department:
- _id: GradSch
- _id: ChWo
doi: 10.1145/3450626.3459816
ec_funded: 1
external_id:
isi:
- '000674930900132'
intvolume: ' 40'
isi: 1
issue: '4'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://doi.org/10.1145/3450626.3459816
month: '08'
oa: 1
oa_version: Published Version
project:
- _id: 2533E772-B435-11E9-9278-68D0E5697425
call_identifier: H2020
grant_number: '638176'
name: Efficient Simulation of Natural Phenomena at Extremely Large Scales
publication: ACM Transactions on Graphics
publication_identifier:
eissn:
- '15577368'
issn:
- '07300301'
publication_status: published
publisher: Association for Computing Machinery
quality_controlled: '1'
related_material:
link:
- description: News on IST Webpage
relation: press_release
url: https://ist.ac.at/en/news/knitting-virtual-yarn/
record:
- id: '12358'
relation: dissertation_contains
status: public
- id: '9327'
relation: software
status: public
scopus_import: '1'
status: public
title: Mechanics-aware deformation of yarn pattern geometry
type: journal_article
user_id: 4359f0d1-fa6c-11eb-b949-802e58b17ae8
volume: 40
year: '2021'
...
---
_id: '9828'
abstract:
- lang: eng
text: Amplitude demodulation is a classical operation used in signal processing.
For a long time, its effective applications in practice have been limited to narrowband
signals. In this work, we generalize amplitude demodulation to wideband signals.
We pose demodulation as a recovery problem of an oversampled corrupted signal
and introduce special iterative schemes belonging to the family of alternating
projection algorithms to solve it. Sensibly chosen structural assumptions on the
demodulation outputs allow us to reveal the high inferential accuracy of the method
over a rich set of relevant signals. This new approach surpasses current state-of-the-art
demodulation techniques apt to wideband signals in computational efficiency by
up to many orders of magnitude with no sacrifice in quality. Such performance
opens the door for applications of the amplitude demodulation procedure in new
contexts. In particular, the new method makes online and large-scale offline data
processing feasible, including the calculation of modulator-carrier pairs in higher
dimensions and poor sampling conditions, independent of the signal bandwidth.
We illustrate the utility and specifics of applications of the new method in practice
by using natural speech and synthetic signals.
acknowledgement: The author thanks his colleagues K. Huszár and G. Tkačik for valuable
discussions and comments on the manuscript.
article_processing_charge: No
article_type: original
author:
- first_name: Mantas
full_name: Gabrielaitis, Mantas
id: 4D5B0CBC-F248-11E8-B48F-1D18A9856A87
last_name: Gabrielaitis
orcid: 0000-0002-7758-2016
citation:
ama: Gabrielaitis M. Fast and accurate amplitude demodulation of wideband signals.
IEEE Transactions on Signal Processing. 2021;69:4039-4054. doi:10.1109/TSP.2021.3087899
apa: Gabrielaitis, M. (2021). Fast and accurate amplitude demodulation of wideband
signals. IEEE Transactions on Signal Processing. Institute of Electrical
and Electronics Engineers. https://doi.org/10.1109/TSP.2021.3087899
chicago: Gabrielaitis, Mantas. “Fast and Accurate Amplitude Demodulation of Wideband
Signals.” IEEE Transactions on Signal Processing. Institute of Electrical
and Electronics Engineers, 2021. https://doi.org/10.1109/TSP.2021.3087899.
ieee: M. Gabrielaitis, “Fast and accurate amplitude demodulation of wideband signals,”
IEEE Transactions on Signal Processing, vol. 69. Institute of Electrical
and Electronics Engineers, pp. 4039–4054, 2021.
ista: Gabrielaitis M. 2021. Fast and accurate amplitude demodulation of wideband
signals. IEEE Transactions on Signal Processing. 69, 4039–4054.
mla: Gabrielaitis, Mantas. “Fast and Accurate Amplitude Demodulation of Wideband
Signals.” IEEE Transactions on Signal Processing, vol. 69, Institute of
Electrical and Electronics Engineers, 2021, pp. 4039–54, doi:10.1109/TSP.2021.3087899.
short: M. Gabrielaitis, IEEE Transactions on Signal Processing 69 (2021) 4039–4054.
date_created: 2021-08-08T22:01:31Z
date_published: 2021-06-09T00:00:00Z
date_updated: 2023-08-10T14:19:33Z
day: '09'
department:
- _id: GaTk
doi: 10.1109/TSP.2021.3087899
external_id:
arxiv:
- '2102.04832'
isi:
- '000682123900002'
intvolume: ' 69'
isi: 1
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://arxiv.org/abs/2102.04832
month: '06'
oa: 1
oa_version: Preprint
page: 4039 - 4054
publication: IEEE Transactions on Signal Processing
publication_identifier:
eissn:
- 1941-0476
issn:
- 1053-587X
publication_status: published
publisher: Institute of Electrical and Electronics Engineers
quality_controlled: '1'
scopus_import: '1'
status: public
title: Fast and accurate amplitude demodulation of wideband signals
type: journal_article
user_id: 4359f0d1-fa6c-11eb-b949-802e58b17ae8
volume: 69
year: '2021'
...
---
_id: '9327'
abstract:
- lang: eng
text: "This archive contains the missing sweater mesh animations and displacement
models for the code of \"Mechanics-Aware Deformation of Yarn Pattern Geometry\"\r\n\r\nCode
Repository: https://git.ist.ac.at/gsperl/MADYPG"
author:
- first_name: Georg
full_name: Sperl, Georg
id: 4DD40360-F248-11E8-B48F-1D18A9856A87
last_name: Sperl
- first_name: Rahul
full_name: Narain, Rahul
last_name: Narain
- first_name: Christopher J
full_name: Wojtan, Christopher J
id: 3C61F1D2-F248-11E8-B48F-1D18A9856A87
last_name: Wojtan
orcid: 0000-0001-6646-5546
citation:
ama: Sperl G, Narain R, Wojtan C. Mechanics-Aware Deformation of Yarn Pattern Geometry
(Additional Animation/Model Data). 2021. doi:10.15479/AT:ISTA:9327
apa: Sperl, G., Narain, R., & Wojtan, C. (2021). Mechanics-Aware Deformation
of Yarn Pattern Geometry (Additional Animation/Model Data). IST Austria. https://doi.org/10.15479/AT:ISTA:9327
chicago: Sperl, Georg, Rahul Narain, and Chris Wojtan. “Mechanics-Aware Deformation
of Yarn Pattern Geometry (Additional Animation/Model Data).” IST Austria, 2021.
https://doi.org/10.15479/AT:ISTA:9327.
ieee: G. Sperl, R. Narain, and C. Wojtan, “Mechanics-Aware Deformation of Yarn Pattern
Geometry (Additional Animation/Model Data).” IST Austria, 2021.
ista: Sperl G, Narain R, Wojtan C. 2021. Mechanics-Aware Deformation of Yarn Pattern
Geometry (Additional Animation/Model Data), IST Austria, 10.15479/AT:ISTA:9327.
mla: Sperl, Georg, et al. Mechanics-Aware Deformation of Yarn Pattern Geometry
(Additional Animation/Model Data). IST Austria, 2021, doi:10.15479/AT:ISTA:9327.
short: G. Sperl, R. Narain, C. Wojtan, (2021).
date_created: 2021-04-16T14:26:19Z
date_published: 2021-05-01T00:00:00Z
date_updated: 2023-08-10T14:24:36Z
ddc:
- '005'
department:
- _id: GradSch
- _id: ChWo
doi: 10.15479/AT:ISTA:9327
file:
- access_level: open_access
checksum: 0324cb519273371708743f3282e7c081
content_type: application/zip
creator: gsperl
date_created: 2021-04-16T14:15:12Z
date_updated: 2021-04-16T14:15:12Z
file_id: '9328'
file_name: MADYPG_extra_data.zip
file_size: 802586232
relation: main_file
success: 1
- access_level: open_access
checksum: 4c224551adf852b136ec21a4e13f0c1b
content_type: application/gzip
creator: pub-gitlab-bot
date_created: 2021-04-26T09:33:44Z
date_updated: 2021-04-26T09:33:44Z
file_id: '9353'
file_name: MADYPG.zip
file_size: 64962865
relation: main_file
file_date_updated: 2021-04-26T09:33:44Z
gitlab_commit_id: 6a77e7e22769230ae5f5edaa090fb4b828e57573
gitlab_url: https://git.ist.ac.at/gsperl/MADYPG
has_accepted_license: '1'
license: https://opensource.org/licenses/MIT
month: '05'
oa: 1
publisher: IST Austria
related_material:
record:
- id: '9818'
relation: used_for_analysis_in
status: public
status: public
title: Mechanics-Aware Deformation of Yarn Pattern Geometry (Additional Animation/Model
Data)
tmp:
legal_code_url: https://opensource.org/licenses/MIT
name: The MIT License
short: MIT
type: software
user_id: 8b945eb4-e2f2-11eb-945a-df72226e66a9
year: '2021'
...
---
_id: '9770'
abstract:
- lang: eng
text: We study an effective one-dimensional quantum model that includes friction
and spin-orbit coupling (SOC), and show that the model exhibits spin polarization
when both terms are finite. Most important, strong spin polarization can be observed
even for moderate SOC, provided that the friction is strong. Our findings might
help to explain the pronounced effect of chirality on spin distribution and transport
in chiral molecules. In particular, our model implies static magnetic properties
of a chiral molecule, which lead to Shiba-like states when a molecule is placed
on a superconductor, in accordance with recent experimental data.
acknowledgement: "We thank Rafael Barfknecht for useful discussions. This work has
received funding from the European Union’s Horizon 2020 research and innovation
programme under the Marie Skłodowska-Curie Grant Agreement No. 754411 (A.G.\r\nand
A.G.V.). M.L. acknowledges support by the European Research Council (ERC) Starting
Grant No. 801770 (ANGULON). Y.P. and O.M. acknowledge funding from the Nidersachsen
Ministry of Science and Culture, and from the\r\nAcademia Sinica Research Program.
O.M. is thankful for support through the Harry de Jur Chair in Applied Science."
article_number: '024430'
article_processing_charge: No
article_type: original
author:
- first_name: Artem
full_name: Volosniev, Artem
id: 37D278BC-F248-11E8-B48F-1D18A9856A87
last_name: Volosniev
orcid: 0000-0003-0393-5525
- first_name: Hen
full_name: Alpern, Hen
last_name: Alpern
- first_name: Yossi
full_name: Paltiel, Yossi
last_name: Paltiel
- first_name: Oded
full_name: Millo, Oded
last_name: Millo
- first_name: Mikhail
full_name: Lemeshko, Mikhail
id: 37CB05FA-F248-11E8-B48F-1D18A9856A87
last_name: Lemeshko
orcid: 0000-0002-6990-7802
- first_name: Areg
full_name: Ghazaryan, Areg
id: 4AF46FD6-F248-11E8-B48F-1D18A9856A87
last_name: Ghazaryan
orcid: 0000-0001-9666-3543
citation:
ama: Volosniev A, Alpern H, Paltiel Y, Millo O, Lemeshko M, Ghazaryan A. Interplay
between friction and spin-orbit coupling as a source of spin polarization. Physical
Review B. 2021;104(2). doi:10.1103/physrevb.104.024430
apa: Volosniev, A., Alpern, H., Paltiel, Y., Millo, O., Lemeshko, M., & Ghazaryan,
A. (2021). Interplay between friction and spin-orbit coupling as a source of spin
polarization. Physical Review B. American Physical Society. https://doi.org/10.1103/physrevb.104.024430
chicago: Volosniev, Artem, Hen Alpern, Yossi Paltiel, Oded Millo, Mikhail Lemeshko,
and Areg Ghazaryan. “Interplay between Friction and Spin-Orbit Coupling as a Source
of Spin Polarization.” Physical Review B. American Physical Society, 2021.
https://doi.org/10.1103/physrevb.104.024430.
ieee: A. Volosniev, H. Alpern, Y. Paltiel, O. Millo, M. Lemeshko, and A. Ghazaryan,
“Interplay between friction and spin-orbit coupling as a source of spin polarization,”
Physical Review B, vol. 104, no. 2. American Physical Society, 2021.
ista: Volosniev A, Alpern H, Paltiel Y, Millo O, Lemeshko M, Ghazaryan A. 2021.
Interplay between friction and spin-orbit coupling as a source of spin polarization.
Physical Review B. 104(2), 024430.
mla: Volosniev, Artem, et al. “Interplay between Friction and Spin-Orbit Coupling
as a Source of Spin Polarization.” Physical Review B, vol. 104, no. 2,
024430, American Physical Society, 2021, doi:10.1103/physrevb.104.024430.
short: A. Volosniev, H. Alpern, Y. Paltiel, O. Millo, M. Lemeshko, A. Ghazaryan,
Physical Review B 104 (2021).
date_created: 2021-08-04T15:05:32Z
date_published: 2021-07-01T00:00:00Z
date_updated: 2023-08-10T14:27:07Z
day: '01'
department:
- _id: MiLe
doi: 10.1103/physrevb.104.024430
ec_funded: 1
external_id:
arxiv:
- '2101.05173'
isi:
- '000678780800003'
intvolume: ' 104'
isi: 1
issue: '2'
language:
- iso: eng
main_file_link:
- open_access: '1'
url: https://arxiv.org/abs/2101.05173
month: '07'
oa: 1
oa_version: Preprint
project:
- _id: 260C2330-B435-11E9-9278-68D0E5697425
call_identifier: H2020
grant_number: '754411'
name: ISTplus - Postdoctoral Fellowships
- _id: 2688CF98-B435-11E9-9278-68D0E5697425
call_identifier: H2020
grant_number: '801770'
name: 'Angulon: physics and applications of a new quasiparticle'
publication: Physical Review B
publication_identifier:
eissn:
- 2469-9969
issn:
- 2469-9950
publication_status: published
publisher: American Physical Society
quality_controlled: '1'
scopus_import: '1'
status: public
title: Interplay between friction and spin-orbit coupling as a source of spin polarization
type: journal_article
user_id: 4359f0d1-fa6c-11eb-b949-802e58b17ae8
volume: 104
year: '2021'
...