Smart Glasses with Machine Learning for Sound Transcription and Classification Aimed at Auditory Accessibility
DOI:
https://doi.org/10.5281/zenodo.20298109Keywords:
Internet of Things, Artificial Intelligence, Accessibility, Hearing ImpairmentAbstract
Hearing impairment affects sound perception, communication, and social interaction for people around the world. Aiming to promote greater accessibility, autonomy, and democratize access to assistive technologies, this exploratory, qualitative study describes the development of Auris, an affordable smart glasses device that performs real-time sound transcription. Auris uses concepts such as the Internet of Things (IoT) and Machine Learning (ML) to capture environmental sounds, transcribe conversations, and identify non-verbal sounds. The tests demonstrate the feasibility of the project, presenting it as a more accessible alternative to improve the quality of life of people with hearing impairments.
Downloads
References
Danuello, J. C.; Amadei, J. R. P.; Ferraz, V. C. T. ABNT NBR 6023:2018 - Guia para elaboração de referências. Bauru, SP: Serviço de Biblioteca e Documentação, USP, Out. 2023. Disponível em: https://usp.br/sddarquivos/arquivos/abnt6023.pdf. Acesso em: 10 mar. 2024.
ALPHA CEPHEI. Vosk. Disponível em: https://alphacephei.com/vosk/. Acesso em: 10 nov. 2025.
BRASIL. Lei Nº13.146, de 6 de Julho de 2015. Institui a Lei Brasileira de Inclusão da Pessoa com Deficiência (Estatuto da Pessoa com Deficiência). Diário Oficial da União, Brasília, DF, 6 jul. 2015. Disponível em: https://www.planalto.gov.br/ccivil_03/_ato2015-2018/2015/lei/l13146.htm. Acesso em: 15 jun. 2025.
ESPRESSIF SYSTEMS. ESP32-C3. c2025. Disponível em: https://www.espressif.com/en/products/socs/esp32-c3 . Acesso em: 10 nov. 2025.
FERREIRA, Fernando Borba; MANZAN, Renato; DURAES, Wellington. Arquitetura de soluções IoT: desenvolva com internet das coisas para o mundo real. [S. L.]: Casa do Código, 2022. ISBN: 978-8555193200.
GOOGLE FOR DEVELOPERS. Android Studio. 2025. Disponível em: https://developer.android.com/studio?hl=pt-br . Acesso em: 10 nov. 2025.
INSTITUTO BRASILEIRO DE GEOGRAFIA E ESTATÍSTICA (IBGE). PNAD Contínua: Pessoas com deficiência têm menor acesso à educação, ao trabalho e à renda. Agência de Notícias, 07 jul. 2023. Disponível em: https://agenciadenoticias.ibge.gov.br/agencia-noticias/2012-agencia-de-noticias/noticias/37317-pessoas-com-deficiencia-tem-menor-acesso-a-educacao-ao-trabalho-e-a-renda . Acesso em: 15 jun. 2025.
INSTITUTO BRASILEIRO DE GEOGRAFIA E ESTATÍSTICA (IBGE). PNS 2019: país tem 17,3 milhões de pessoas com algum tipo de deficiência. Agência de Notícias, 26 ago. 2021. Disponível em: https://agenciadenoticias.ibge.gov.br/agencia-sala-de-imprensa/2013-agencia-de-noticias/releases/31445-pns-2019-pais-tem-17-3-milhoes-de-pessoas-com-algum-tipo-de-deficiencia . Acesso em: 15 jun. 2025.
INVENSENSE INC. INMP441: omnidirectional microphone with bottom port and i 2 s digital output. San Jose, CA, USA: InvenSense Inc., 2015. Disponível em: https://invensense.tdk.com/wp-content/uploads/2015/02/INMP441.pdf . Acesso em: 10 nov. 2025.
NANJING TOP POWER ASIC CORP. TP4056: 1a standalone linear li-ion battery charger. [S. L.]: Nanjing Top Power Asic Corp., 2014. Disponível em: http://toppwr.com/uploadfile/file/20240913/66e3a367981a1.pdf . Acesso em: 10 nov. 2025.
OLIVEIRA, Ana Carolina Machado de; NOSSA, Tamires de Souza. Avaliação do Comportamento Mecânico de amostras de PLA produzido por Impressão 3D FFF utilizando modos heterogêneos de preenchimento. Revista Brasileira de Iniciação Científica, [S. l.], p. e025004, 2025. Disponível em: https://periodicoscientificos.itp.ifsp.edu.br/index.php/rbic/article/view/2231 . Acesso em: 10 nov. 2025.
PAIXÃO, Gabriela Miana de Mattos et al. Machine Learning na Medicina: revisão e aplicabilidade. Arquivos Brasileiros de Cardiologia, [S.L.], v. 118, n. 1, p. 95-102, jan. 2022. Sociedade Brasileira de Cardiologia. http://dx.doi.org/10.36660/abc.20200596. Disponível em: https://www.scielo.br/j/abc/a/WMgVngCLbYfJrkmC65VFCkp/?lang=pt . Acesso em: 10 nov. 2025.
RESENDE, Kassiano. Kotlin com Android: crie aplicativos de maneira fácil e divertida. [S. L.]: Casa do Código, 2018. ISBN: 978-8594188762.
SARDENBERG, Luís Felipe; BUOGO, Sarah. Cerca de um bilhão de pessoas com deficiência têm acesso negado a tecnologia assistiva. Nações Unidas Brasil, 17 mai. 2022. Disponível em: https://brasil.un.org/pt-br/182189-cerca-de-um-bilh%C3%A3o-de-pessoas-com-defici%C3%AAncia-t%C3%AAm-acesso-negado-tecnologia-assistiva . Acesso em: 15 jun. 2025.
TENSORFLOW. Sound classification with YAMNet. 2024. Disponível em: https://www.tensorflow.org/hub/tutorials/yamnet . Acesso em: 10 nov. 2025.
TENSORFLOW. TensorFlow Lite. 2021. Disponível em: https://www.tensorflow.org/lite/guide?hl=pt-br . Acesso em: 10 nov. 2025.
TORRES, Gabriel. Redes de Computadores. 2. ed. Rio de Janeiro: Clube do Hardware, 2021. ISBN: 978-85-52971-00-9.
WOUK, Luana Cristina. CONTROLE DA TRANSFERÊNCIA DE ENERGIA EM POLÍMEROS CONJUGADOS PARA OBTENÇÃO DE EMISSÃO BRANCA. 2014. 89 f. Dissertação de Mestrado (Pós-Graduação em Física), Universidade Estadual de Londrina, Londrina, 2014. Disponível em: https://repositorio.uel.br/srv-c0003-s01/api/core/bitstreams/d476f259-1131-4fcd-b43b-ad7f615f7b01/content . Acesso em: 10 nov. 2025.
XRAI INC. XRAI: life. subtitled. Life. Subtitled. c2025. Disponível em: https://xrai.glass/ . Acesso em: 10 nov. 2025.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Guilherme Lima de Paula , Gustavo Santos Siqueira, Kayky de Sousa, Melissa da Silva Conceição, Cristina Correa de Oliveira
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright Policy
By submitting a manuscript for publication in the journal Advances in Global Innovation & Technology (@_GIT), authors agree, in advance and unrestrictedly, to the following terms:
- The authors retain the copyright and grant to the Journal Advances in Global Innovation & Technology (@_GIT) the right of first publication of the manuscript, without any financial burden, and waive any other remuneration for its publication in the Journal of Advances in Global Innovation & Technology (@_GIT).
- Upon submission to the Journal of Advances in Global Innovation & Technology (@_GIT), the manuscript is automatically licensed under the Creative Commons Attribution License, which allows the sharing of the work with acknowledgment of authorship and initial publication in the Journal Advances in Global Innovation & Technology (@_GIT).
- Authors are authorized to enter into additional contracts separately, for non-exclusive distribution of the version of the work published in the Journal Advances in Global Innovation & Technology (@_GIT) (publish in repositories or as a book chapter), with acknowledgment of the initial publication in the Journal Advances in Global Innovation & Technology (@_GIT), provided that such agreement does not imply an endorsement of the content of the manuscript or the new vehicle by the Journal of Advances in Global Innovation & Technology (@_GIT).
- Authors are allowed and encouraged to publish and distribute their work online, in institutional repositories, for example after the editorial process is completed.
- The authors warrant that they have obtained proper permission from their employers for the transfer of rights under this agreement, if those employers own any copyright in the manuscript. In addition, the authors assume any and all responsibility for possible copyright infringements of these employers, exempting Advances in Global Innovation & Technology (@_GIT) from any and all liability in this regard.
- The authors assume all responsibility for the content of the work, including the due and necessary authorizations for the disclosure of data collected and results obtained, exempting the Journal of Advances in Global Innovation & Technology (@_GIT) from any and all liability in this regard.
