Natural language generation in the context of multimodal interaction in Portuguese

  • José Casimiro Pereira
  • António J. S. Teixeira
  • Joaquim Sousa Pinto


In many situations, systems and people have to interact and share information. With demographic ageing a group of users that deserves special attention are the older adults. Multimodal interaction aims to improve the interaction between human users and electronic devices. A key technology for the output part of a Multimodal system is conversion of the concepts handled by systems into readable text or audible speech output, area with almost no work for Portuguese. As a starting point for the development of output generation modules for use in multimodal interaction contexts, we developed, as proof of concept, a prototype of a NLG module to support transmission of information on drugs to older adults based on a data-driven translation approach. First sample results of the generation are presented.