Development of an open-source toolkit for creating haptic effects with ultrasound displays

Internship title

Development of an open-source toolkit for creating haptic effects with ultrasound displays

Context

Founded in 2002, Metalab is the research laboratory of the Society for Arts and Technology [SAT]. Metalab's mission is twofold:

  1. to stimulate the emergence of innovative immersive experiences,
  2. to make their design accessible to artists and creators of immersion through an ecosystem of free software.

Besides our set of tools for audio- and visual rendering, we are exploring ways to enhance immersive experiences with haptic feedback, to create simulations that stimulate the sense of touch. One first haptic rendering device created at Metalab is the Scalable Haptic Floor that transmits haptic feedback to our bodies through their points of contact with the floor. In addition, ultrasound haptics render air-borne haptic feedback in mid-air, without contact, and without requiring to wear devices [1,2], opening new perspectives for immersion through focused haptic feedback.

Objective

The main objective of this internship is to develop an open-source toolkit for creating haptic feedback with ultrasound displays, reusing recent research works [1,2], and facilitating the authoring of ultrasound haptic effects for artists and creators of immersion.

This toolkit could complement other Metalab tools, for instance using Poire for haptic generation through audio signals as proxy, similarly to the Scalable Haptic Floor, and LivePose for posture or hand detection to support interactive scenarios.

Tasks

  • Review haptic effects that can be generated with ultrasound displays.
  • Develop the open-source toolkit (hardware and software building upon recent research works [1,2]).
  • Create a demo video.
  • Participate in the life of the laboratory: scrums, code review, etc.
  • Document our work in a lab notebook and git repositories and ensure its reproducibility.
  • Co-author a publication in the scope of this internship.

Work environment

  • Hardware deployment: Arduino or Raspberry Pi
  • Software development: C++, JavaScript or Python
  • Documentation: BibTeX, LaTeX, Markdown
  • Workflows: Confluence, Gitlab, Jira
  • Ecosystem: Linux, Free and Open Source Software (FOSS)

References

Contacts

Please send your CV to metalab-dir@sat.qc.ca