TY - JOUR
AB - Three-dimensional (3D) reconstruction of living brain tissue down to an individual synapse level would create opportunities for decoding the dynamics and structure–function relationships of the brain’s complex and dense information processing network; however, this has been hindered by insufficient 3D resolution, inadequate signal-to-noise ratio and prohibitive light burden in optical imaging, whereas electron microscopy is inherently static. Here we solved these challenges by developing an integrated optical/machine-learning technology, LIONESS (live information-optimized nanoscopy enabling saturated segmentation). This leverages optical modifications to stimulated emission depletion microscopy in comprehensively, extracellularly labeled tissue and previous information on sample structure via machine learning to simultaneously achieve isotropic super-resolution, high signal-to-noise ratio and compatibility with living tissue. This allows dense deep-learning-based instance segmentation and 3D reconstruction at a synapse level, incorporating molecular, activity and morphodynamic information. LIONESS opens up avenues for studying the dynamic functional (nano-)architecture of living brain tissue.
AU - Velicky, Philipp
AU - Miguel Villalba, Eder
AU - Michalska, Julia M
AU - Lyudchik, Julia
AU - Wei, Donglai
AU - Lin, Zudi
AU - Watson, Jake
AU - Troidl, Jakob
AU - Beyer, Johanna
AU - Ben Simon, Yoav
AU - Sommer, Christoph M
AU - Jahr, Wiebke
AU - Cenameri, Alban
AU - Broichhagen, Johannes
AU - Grant, Seth G.N.
AU - Jonas, Peter M
AU - Novarino, Gaia
AU - Pfister, Hanspeter
AU - Bickel, Bernd
AU - Danzl, Johann G
ID - 13267
JF - Nature Methods
SN - 1548-7091
TI - Dense 4D nanoscale reconstruction of living brain tissue
VL - 20
ER -
TY - GEN
AB - Complex wiring between neurons underlies the information-processing network enabling all brain functions, including cognition and memory. For understanding how the network is structured, processes information, and changes over time, comprehensive visualization of the architecture of living brain tissue with its cellular and molecular components would open up major opportunities. However, electron microscopy (EM) provides nanometre-scale resolution required for full in-silico reconstruction1–5, yet is limited to fixed specimens and static representations. Light microscopy allows live observation, with super-resolution approaches6–12 facilitating nanoscale visualization, but comprehensive 3D-reconstruction of living brain tissue has been hindered by tissue photo-burden, photobleaching, insufficient 3D-resolution, and inadequate signal-to-noise ratio (SNR). Here we demonstrate saturated reconstruction of living brain tissue. We developed an integrated imaging and analysis technology, adapting stimulated emission depletion (STED) microscopy6,13 in extracellularly labelled tissue14 for high SNR and near-isotropic resolution. Centrally, a two-stage deep-learning approach leveraged previously obtained information on sample structure to drastically reduce photo-burden and enable automated volumetric reconstruction down to single synapse level. Live reconstruction provides unbiased analysis of tissue architecture across time in relation to functional activity and targeted activation, and contextual understanding of molecular labelling. This adoptable technology will facilitate novel insights into the dynamic functional architecture of living brain tissue.
AU - Velicky, Philipp
AU - Miguel Villalba, Eder
AU - Michalska, Julia M
AU - Wei, Donglai
AU - Lin, Zudi
AU - Watson, Jake
AU - Troidl, Jakob
AU - Beyer, Johanna
AU - Ben Simon, Yoav
AU - Sommer, Christoph M
AU - Jahr, Wiebke
AU - Cenameri, Alban
AU - Broichhagen, Johannes
AU - Grant, Seth G. N.
AU - Jonas, Peter M
AU - Novarino, Gaia
AU - Pfister, Hanspeter
AU - Bickel, Bernd
AU - Danzl, Johann G
ID - 11943
T2 - bioRxiv
TI - Saturated reconstruction of living brain tissue
ER -
TY - CONF
AB - In the context of robotic manipulation and grasping, the shift from a view that is static (force closure of a single posture) and contact-deprived (only contact for force closure is allowed, everything else is obstacle) towards a view that is dynamic and contact-rich (soft manipulation) has led to an increased interest in soft hands. These hands can easily exploit environmental constraints and object surfaces without risk, and safely interact with humans, but present also some challenges. Designing them is difficult, as well as predicting, modelling, and “programming” their interactions with the objects and the environment. This paper tackles the problem of simulating them in a fast and effective way, leveraging on novel and existing simulation technologies. We present a triple-layered simulation framework where dynamic properties such as stiffness are determined from slow but accurate FEM simulation data once, and then condensed into a lumped parameter model that can be used to fast simulate soft fingers and soft hands. We apply our approach to the simulation of soft pneumatic fingers.
AU - Pozzi, Maria
AU - Miguel Villalba, Eder
AU - Deimel, Raphael
AU - Malvezzi, Monica
AU - Bickel, Bernd
AU - Brock, Oliver
AU - Prattichizzo, Domenico
ID - 6195
SN - 9781538630815
TI - Efficient FEM-based simulation of soft robots modeled as kinematic chains
ER -
TY - CONF
AB - We present a computational method for designing wire sculptures consisting of interlocking wires. Our method allows the computation of aesthetically pleasing structures that are structurally stable, efficiently fabricatable with a 2D wire bending machine, and assemblable without the need of additional connectors. Starting from a set of planar contours provided by the user, our method automatically tests for the feasibility of a design, determines a discrete ordering of wires at intersection points, and optimizes for the rest shape of the individual wires to maximize structural stability under frictional contact. In addition to their application to art, wire sculptures present an extremely efficient and fast alternative for low-fidelity rapid prototyping because manufacturing time and required material linearly scales with the physical size of objects. We demonstrate the effectiveness of our approach on a varied set of examples, all of which we fabricated.
AU - Miguel Villalba, Eder
AU - Lepoutre, Mathias
AU - Bickel, Bernd
ID - 1364
IS - 4
TI - Computational design of stable planar-rod structures
VL - 35
ER -
TY - JOUR
AB - In this paper, we present a method to model hyperelasticity that is well suited for representing the nonlinearity of real-world objects, as well as for estimating it from deformation examples. Previous approaches suffer several limitations, such as lack of integrability of elastic forces, failure to enforce energy convexity, lack of robustness of parameter estimation, or difficulty to model cross-modal effects. Our method avoids these problems by relying on a general energy-based definition of elastic properties. The accuracy of the resulting elastic model is maximized by defining an additive model of separable energy terms, which allow progressive parameter estimation. In addition, our method supports efficient modeling of extreme nonlinearities thanks to energy-limiting constraints. We combine our energy-based model with an optimization method to estimate model parameters from force-deformation examples, and we show successful modeling of diverse deformable objects, including cloth, human finger skin, and internal human anatomy in a medical imaging application.
AU - Miguel Villalba, Eder
AU - Miraut, David
AU - Otaduy, Miguel
ID - 1414
IS - 2
JF - Computer Graphics Forum
TI - Modeling and estimation of energy-based hyperelastic objects
VL - 35
ER -