EFECS 2022
B-CRATOS participated at the EFECS 2022 in Amsterdam. The B-CRATOS booth was visited by many curious participants, eager to learn more about our robotic hand and BCIs!
2nd B-CRATOS Newsletter
April 2023
B-CRATOS PROGRESS AND NEXT STEPS
Wireless Interface
Our Wireless Interface team is responsible for wireless powering of the brain implant, two-way wireless communication for telemetry and telecommand, and a high data rate brain interface link.
Over the past two years, NTNU has developed and tested a battery-free wireless backscatter communication system for transmitting the high bandwidth neural signals. This system uses a new compact antenna setup for radio signaling and an innovative receiver system for data decoding and connection through standard communication protocols. Additionally, a system has been developed for powering the implant to the limit of its needs, while also enabling simultaneous wireless communication for programming the implant for stimulation purposes. Preliminary tests on bench-top and phantom models have been demonstrated. An ongoing activity is the software development to support reliable connectivity, and different versions are being created and evaluated for system reliability.
We are currently working on interconnecting the systems and integrating the Blackrock neural stim/record ASIC (application specific integrated circuit) chip with the implant. We are also testing the powering unit to ensure that it can effectively run the ASIC setup. Data transfer and formatting to the RF backscatter system and designing the command line for stimulation with the ASIC are also in progress. Furthermore, we are in the process of interconnecting the systems with Fat-intra Body Communication (WP3) and establishing a two-way connection and data transfer. Latency tests and data error rate evaluations are also underway. Our plan is to test the overall system in the coming months and verify the information connectivity and reliability.
Fat-Intra Body Communication
In the first 2 years of B-CRATOS the focus has been towards designing antenna interfaces for NHP models so as to efficiently couple microwave signals into the subdermal fat layer. We have designed and simulated mainly 2 versions: one optimized using a genetic algorithm-based topological optimization, and another using conventional antenna design approach with a standard CST microwave suite.
The conventional technique-based design had been fabricated and tested on phantom models. As the second main initiative, we explored various transceiver design for Fat-IBC interfaces and have implemented WLAN based solutions for modem design supporting higher in-body data rates required for the project.
In the coming year, the genetic algorithm-based antenna design will be realized and tested on phantom and NHP model along with conventional design. In vivo Fat-IBC testing will be carried out by sending representative brain signal data through the NHP model, and the performance of distal and proximal modems will be evaluated.
E-skin
In the first two years, we have developed (1) tactile sensors based on the triboelectronic transistors that feature self-powered and event-driven sensing, (2) electronic circuits based on the leaky “integrate & fire” neuron model for neuromimetic encoding of tactile information, (3) fabrication of e-skins with an array of tactile sensors (4) a unique measurement setup for a comprehensive characterization of e-skin performance, and (5) realization of object classification by learning touching and grasping objects using an e-skin and machine learning technique based on spiking neural network.
In the second phase, we aim to improve the tactile sensors to have larger response range in terms of force and reduced proximity effect. We are also to develop e-skins with (1) larger number of sensors, (2) stretchable and compliant capabilities, (3) high spatial and temporal resolutions.
System Integration
A major focus of System Integration in the past period has been ensuring the proper collaboration and coordination of the technical Work Packages to ensure the B-CRATOS technologies will not only function individually, but work as a complete end-to-end system, through establishing and updating system-wide requirements, identifying and escalating technical risks, and the critically, the definition and documentation of intra-system interfaces. This culminated at the end of Year 2 with the integration of the Implant system RF-Backscatter, Fat-IBC Modem (with tissue phantom), AI Processing Module, and Mia Hand at the in-person Pisa consortium meeting, where after some elbow grease and troubleshooting, we demonstrated successful data signal connectivity across the individual WP sub-systems to issue grip movement commands originating from the implant communications modules to the prosthetic hand.
Members of the B-CRATOS technical team after a successfully performing the benchtop system integration and signal transmission demonstration in Pisa.
The successful first integration at the Pisa meeting will be incrementally built upon during the third year of the project, adding additional sub-system components (decoding, upstream sense & stimulation modules) to characterize the full capabilities of the closed-loop end-to-end system. The System Integration team will closely track individual sub-system testing and replicate the performances on a dedicated test bench, which will support future end-to-end demonstrators with phantoms and with the non-human primate studies.
In Vivo Testing
In the first two years of the B-CRATOS project, WP6 has been in close collaboration with the rest of the groups make the main experimental part of the project a success. As the aim of B-CRATOS is to develop a bidirectional brain machine interface for persons with disabilities, extensive testing is required before this technology can be considered for human applications. For this reason, testing in primate models is crucial for the safety of this advanced technology. Safe animal experimentation is our expertise and we have guided the other groups in this respect with definition of safety guidelines, ethical considerations and good experimental practices. We have also shared existing data and know-how to perform simulations previous to the experiments before testing on live animals.
In the second half of the project we aim to start the experimental phase of the project, combining our exiting techniques with the technical developments of other work groups. In an initial preparation for an offline in vivo test we have been closely working with WP3 to understand the implications of intra-fat communication and performing important measurement tests with artificial skin and muscles. In the next two months we hope the safety requirements are met and we will be testing the communication in live tissue. We also hope to continue working closely with the WP4 and WP5 team as the next key step: integration of prototype systems for a test with non-human primates.
B-CRATOS INTERVIEW: WHERE ARE WE NOW, TWO YEARS AFTER THE START OF THE PROJECT?
A bi-directional interview with Dr. Paul Wanda (WP Leader, Blackrock Microsystems Europe GmbH) and Dr. Robin Augustine (Project coordinator, Uppsala University).
In this interview, Dr. Paul Wanda and Dr. Robin Augustine reflect on the progress made thus far in the B-CRATOS Project and consider the upcoming challenges for the next phase of the project.
Meeting (finally!) in Real Life for Discussions and Demonstrations
In the beginning of June 2022, we had our first in–person consortium meeting in Uppsala University!
We traveled all the way to Uppsala University (Sweden) and presented all the progress and goals of each work–package, as well as upcoming objectives and perspectives.
We traveled all the way to Uppsala University (Sweden) and presented all the progress and goals of each work–package, as well as upcoming objectives and perspectives.
Over two days, we had very fruitful discussions and all left Sweden with renewed energy and updated plans for B–CRATOS.
Then, in the end of February 2023, we had another in person Consortium meeting in Pisa at Sant’Anna University (but somehow with less sun in Italy!).
- On the first day, each Work Package updated the consortium on their progress and upcoming perspectives.
- On the second day, we planned individual workshops. Indeed, half–way through
B–CRATOS, it was a crucial day for the partners as they are trying to connect all thedifferent systems from the soon–to–be–achieved 2023 milestones:Robotics Hand integrated with Electronic Skin- FAT–IBC initial tests in phantom set–up
- Functional stim/read prototypes with
- wireless data and power transfer lab demonstration
- End-to-end integration and data transmission via wireless and intra-body communications systems with AI decoding module and prosthetic hand
Get to Know our B-CRATOS Team Members
Interviews
In the last months, we decided it was time for you to meet some of the people behind B–CRATOS.
We interviewed our colleagues and asked them about their role in the project: everyone plays a different but crucial part!
You can (re)watch the interviews on our Youtube Channel.
- ROSSELLA GAFFOGLIO
Rossella Gaffoglio is a researcher at the LINKS foundation. She is part of the B-CRATOS project, working on innovative antenna design methods (WP3), and was just recently selected to the Women Leadership Programme of the European Innovation Council.
“I would like to thank the ‘EIC Women Leadership Programme’ for providing this wonderful opportunity for scientists, which motivates me to explain how I arrived at this stage in life.
I have always been fascinated by the world of physics, which allows us to elegantly describe the reality around us, in its incredible complexity and variety. For this reason, I decided to study physics at the university and obtain a Ph.D. in physics and astrophysics. A study in physics is versatile and enables one to pursue a broad range of interests in STEM sciences. The encouragement and support from tutors and leading professors have been marvelous enabling me to excel in my field. It was during my Ph.D. that I shifted my research field to the world of microwave engineering and biomedical applications. This led me to join Fondazione LINKS in 2018, where I currently work on exciting projects such as B-CRATOS. The strong social impact of the latter project makes me proud to provide a contribution and allows me to understand the fundamental role of research in improving healthcare and quality of life, and to inspire other young scientists to follow this path!”
- PAOLO VIVIANI
Paolo Viviani earned a degree in theoretical physics and a PhD in computer science both at University of Torino. He is now Senior Researcher at LINKS Foundation and leading development of a machine learning decoder for the B-CRATOS system (WP4). His main interests are High-Performance Computing, Quantum Computing and systems for Machine Learning/AI. His current activity focuses on HPC and scientific computing topics like the acceleration of complex scientific and industrial workflows on large scale HPC infrastructures and optimization algorithms for near-term analog quantum hardware. He published several peer-reviewed papers, both to conferences and journals. He was also involved in several funded research projects in the field of HPC (ACROSS EuroHPC-02-2019, B-CRATOS H2020-EU – FET Open, Lexis H2020-ICT-11, Fortissimo 2 H2020-FoF, CloudFlow FP7-I4MS).
- BURIM KABASHI
Burim Kabashi received his BSc degree in Electronic and Telecommunications Engineering at the University of Trento and his MSc degree in Electronic Engineering – Micro & Nanosystems at the Polytechnic University of Turin. Main interests are oriented toward biomedical applications, such as research and development of neuroprosthetics, robotic and artificial limbs. Current activities are focused on Hardware and Firmware upgrade of Prosthetic Hands provided for the B-Cratos project (WP4) and Hardware and Firmware development and implementation in the Liquid Handling Robot project for industry application. He has contributed to the publiation of scientific papers in the area of energy harvesting system using green power generation devices and in the development of battery consume optimization algorithm for prosthetic hand.
- PAUL MEANEY
Dr. Paul Meaney is a professor of biomedical engineering and a member of the B-CRATOS Advisory Board. Here, he explains why the B-CRATOS project is of high interest to him and the potential impacts of its results.
- ANDRES AGUDELO-TORO
Dr. Andres Agudelo-Toro is a neuro-engineer working as a scientist at the Deutsches Primaten Zentrum, a core primate facility in Germany and part of the Leibniz Society. He is supporting the development of in vivo demonstrations and real-time BCI decoding methods (WP6).
Following his goal to develop a high-accuracy neuro-prosthesis for grasping, he combines neural decoding, virtual environments, and robotics in experiments with primates. To prepare for this, Andres was trained in control systems, real-time distributed systems, and neuroscience at EAFIT (Colombia), Rutgers (USA), and the Max Plack Institute (Germany).
Thanks to the advice of his mother and grandmother as a child, Andres chose education to support his family in the barrios of Medellin in times of Pablo Escobar’s cartel. After a series of scholarships, he graduated with honors with a bachelor’s degree in Computer Science and a master’s degree in Applied Mathematics from Universidad EAFIT while working at the Sistemas de Control lab and Realidad Virtual lab and interning at the former CAIP center in Rutgers. He obtained his doctoral degree in Theoretical and Computational Neuroscience from Göttingen University and MPI-DS with his dissertation on theoretical models of brain stimulation.
- LETIZIA BERGAMASCO
Letizia Bergamasco received the B.Sc. degree in Electronics Engineering and the M.Sc. degree in ICT for Smart Societies from Politecnico di Torino (Italy). She also graduated from Alta Scuola Politecnica, an honour programme focused on innovation, obtaining a Double Degree from Politecnico di Torino and Politecnico di Milano. She is collaborating closely with the B-CRATOS technical teams to implement methods to decode information from the artificial sensors into stimulation commands (WP4).
She is currently a researcher in Fondazione LINKS in the “Connected Systems and Cybersecurity” research domain, where she participates in different research projects both at regional and international level (EC Horizon 2020 Programs), developing software and artificial intelligence solutions for medical and industrial applications.
She is passionate about the application of ICTs in the medical field, and she has recently started a PhD in Computer and Control Engineering, focused on the study of artificial intelligence techniques for the identification of early markers of neurodegenerative diseases.
- ZHIBIN ZHANG
Dr. Zhibin Zhang is docent in electronics and group leader of Flexible Electronics and Neuromorphic Engineering (FENE) at Uppsala University, the Department of Electrical
Engineering, since 2011. He obtained his bachelor and master degree in physics at Lanzhou University in 1993 and 1997, respectively, and received his PhD degree in Shanghai Institute of Applied Physics, Chinese Academy of Sciences in 2001. He worked as a postdoctor from 2002 for two years and then as researcher for 6 years at Royal Institute of Technology, Sweden.
He has published around 110 peer-review journal articles with h-index 26 (google scholar). His research spans from nanomaterials (carbon nanotubes, graphene), printed electronic components, energy devices, electronic skin, neuromorphic circuit and neuromimetic systems
Stay tuned for more interviews to come!
B-CRATOS Webinars
Upcoming
Our next webinar is planned in June with Dr. Marco Controzzi, from Scuola Superiore Sant’Anna (Italy). We’ll discuss hand prostheses and we expect an invited speaker to make this webinar even more interesting. Stay tuned, so you don’t miss the registration time!
Past
By the way, if you missed the other webinars, it’s possible to watch them in replay!
watch the webinars
We had the chance to meet some of you in person since the last newsletter! Here are a few events we attended to present or talk of B-CRATOS in the last few months, and some upcoming events.
Upcoming events
BCI INTERNATIONAL Meeting
Every three years, experts from every continent gather together to discuss the progress and future of brain computer interfaces. This happens in the BCI international meeting. By good luck this meeting is happening this June, in Brussels. We are excited to participate!
Summer School in Trondheim (Norway) : 27-29 September
What about spending a part of the summer with a B-CRATOS team? We’ll be heading to Norway for a 3 days Summer school in Trondheim on the thematic Next Generation Wireless / In–Body Technologies for BCI and Medical Implantable Systems. More information soon on that topic!
Past events
Project details:
TITLE: Wireless Brain-Connect inteRfAce TO machineS
START-END: March 2021 – February 2025
EU CONTRIBUTION: €4,475,059.25
TOPIC: FETOPEN-01-2018-2019-2020: FET-Open Challenging Current Thinking
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement N° 965044