SALSA - We develop AI-based systems for autonomous driving

© Fraunhofer IOSB
Being able to sleep safely and relaxed at the wheel will be one of the benefits of autonomous vehicles. Our research is focused on ensuring that the sleep is relaxed and restful, that you wake up safely and that you can continue the rest of the journey as soon as you are fit and refreshed after sleeping.
© Fraunhofer IOSB

Short description of the project

In SALSA (Smart, Adaptive and Learnable Systems for All), the research focuses on vehicle interiors for cars and trucks. These should adapt as far as possible to different driving situations, including enabling relaxed sleeping, but also safe takeover of the driving task and intuitive use of driver assistance and autonomous driving functions.

Project objectives

At Fraunhofer IOSB, AI is being developed that recognizes when a person is sleeping and waking up and ensures that when the vehicle is taken over, attention is focused on the driving task. Our “Perceptual User Interfaces” group is also researching the AI-generated interaction between AI systems and occupants and developing so-called generated user interfaces (GenU-In) in SALSA.

Project result

SALSA will deliver research results for safe autonomous driving and develop a competitive AI assistant. Fraunhofer IOSB has already set standards in human-AI interaction and prepared important research fields around safe sleeping while driving. On behalf of customers, Fraunhofer IOSB is already transferring these research results into many related applications and prototypes in the automotive industry.

Project partners

  • AUDI AG
  • Bundesanstalt für Straßenwesen
  • CanControls
  • Elektrobit
  • FKFS Forschungsinstitut für Kraftfahrwesen und Fahrzeugmotoren Stuttgart
  • Fraunhofer IOSB, Hochschule der Medien Stuttgart
  • INVENSITY
  • MAN Truck & Bus SE
  • Spiegel Institut Mannheim GmbH
  • studiokurbos®
  • Universität Stuttgart
  • BASF
  • Porsche AG
  • Valeo Deutschland

AI solutions for the car of the future

Do you have similar challenges? We are happy to develop intelligent AI assistance systems for vehicles and adapt our services to your needs. 

 

Project details

SALSA: Smart, Adaptive and Learning Systems for All

Project duration: July 2024 to June 2027

The project is funded by the Federal Ministry for Economic Affairs and Climate Protection.

KARLI

In the completed KARLI project, we developed AI applications for the introduction of multilevel-capable automated vehicles in collaboration with other partners.

Find out more about vehicle interior recording in our new white paper!

Advanced In-Cabin Monitoring Systems will significantly change the user experience of passenger cars and promise to become the next fundamental milestone for vehicle safety.

In this white paper "Pioneering In-Cabin Monitoring — Unmasking the Power of 2D and 3D Cameras", Fraunhofer IOSB experts on computer vision and automotive in-cabin sensing provide helpful insights to

  • Current and future legislation on driver monitoring systems
  • Current and future applications and functions of occupant monitoring
  • Roadmap towards the future of in-cabin monitoring
  • Sensor comparisons, especially benefits of 2D vs 3D sensing
  • Outlook to the impact of generative AI, LLM and multi modal vision models.

Contact us for more information, research collaboration and contracted research.