Quando a inteligência artificial lê o humano: potencialidades e limites da investigação qualitativa assistida por IA generativa

Sara Cristina Mateus; Yakamury Rebouças de Lira; António Pedro Costa

doi:10.34624/t1ewh062

Authors

Sara Cristina Mateus University of Aveiro https://orcid.org/0009-0001-7951-3786 (unauthenticated)
Yakamury Rebouças de Lira University of Aveiro , Centro de Investigação Didática e Tecnologia na Formação de Formadores https://orcid.org/0000-0002-2615-3115 (unauthenticated)
António Pedro Costa University of Aveiro , Centro de Investigação Didática e Tecnologia na Formação de Formadores https://orcid.org/0000-0002-4644-5879 (unauthenticated)

DOI:

https://doi.org/10.34624/t1ewh062

Keywords:

Generative artificial intelligence, Qualitative research, AbductivAI, Research ethics, Human–AI collaboration

Abstract

The integration of generative artificial intelligence (GenAI) into qualitative research has sparked debates over the balance between automation and human discernment, challenging the epistemological foundations of interpretive analysis. This exploratory study critically examines the potential and limitations of human–AI collaboration in qualitative categorisation, based on experiences developed within the PIC-Edu 2024/2025 project. The research was guided by two central questions: (Q1) to what extent can GenAI support exploratory processes of qualitative data analysis, and (Q2) what are its main epistemological, ethical, and operational limitations. Methodologically, the AbductivAI model — abductive in nature — was applied to the categorisation of 324 scientific abstracts from the World Conference on Qualitative Research (WCQR), using ChatGPT-4.0 through interative prompt refinement cycles and cross-validation by two researchers. The results show a mean agreement rate of 72% between automated and human coding, with higher precision in controlled semantic categories but recurrent hallucination errors and classificatory instability in complex interpretive contexts. It is concluded that GenAI is effective for repetitive and pre-analysis tasks but insufficient for contextual and ethical interpretations, reaffirming the indispensability of human mediation. The study proposes a replicable methodological protocol, based on systematic documentation, cross-validation, and ethical supervision, and recommends governance policies ensuring transparency, traceability, and epistemic equity. The conclusions highlight the importance of integrating GenAI as an analytical and formative partner, ensuring methodological rigour and ethical responsibility in contemporary qualitative research.

Downloads

Download data is not yet available.

References

Acheampong, I., & Nyaaba, M. (2024). Review of qualitative research in the era of generative artificial intelligence. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4686920

Arar, K. H., Özen, H., Polat, G., & Turan, S. (2025). Artificial intelligence, generative artificial intelligence and research integrity: A hybrid systemic review. Smart Learning Environments, 12, 44. https://doi.org/10.1186/s40561-025-00403-3

Bail, C. (2024). Can generative AI improve social science? Proceedings of the National Academy of Sciences of the United States of America, 121(1). https://doi.org/10.1073/pnas.2314021121

Bano, M., Zowghi, D., & Whittle, J. (2023). AI and Human Reasoning: Qualitative Research in the Age of Large Language Models. The AI Ethics Journal, 3(1). https://doi.org/10.47289/AIEJ20240122

Bjelobaba, S., Waddington, L., Perkins, M., & et al. (2025). Maintaining research integrity in the age of GenAI: An analysis of ethical challenges and recommendations to researchers. International Journal for Educational Integrity, 21(1), 18. https://doi.org/10.1007/s40979-025-00191-w

Bryda, G., & Costa, A. P. (2023). Qualitative research in digital era: Innovations, methodologies and collaborations. Social Sciences, 12(10), 570. https://doi.org/10.3390/socsci12100570

Bryda, G., & Costa, A. P. (2024). Transformative technologies: Artificial intelligence and large language models in qualitative research: AI and large language models in qualitative research. Revista Baiana de Enfermagem, 38. https://doi.org/10.18471/rbe.v38.61024

Burneo, P., Costa, A. P., Pinho, I., Muniz, A. B. X., & Moresi, E. A. D. (2025). Competence Frameworks for Exploring Generative AI in Education. In Artificial Intelligence (AI) in Social Research (pp. 160–175). CABI. https://doi.org/10.1079/9781800626607.0015

Cai, L., Msambwa, M., & Daniel, K. (2024). Exploring the impact of integrating AI tools in higher education using the zone of proximal development. Education and Information Technologies, 30, 7191–7264. https://doi.org/10.1007/s10639-024-13112-0

Campo-Ruiz, I. (2025). Artificial intelligence may affect diversity: Architecture and cultural context reflected through ChatGPT, Midjourney, and Google Maps. Humanities and Social Sciences Communications, 12(1). https://doi.org/10.1057/s41599-024-03968-5

Chatzichristos, G. (2025). Qualitative research in the era of AI: A return to positivism or a new paradigm? International Journal of Qualitative Methods, 24(1). https://doi.org/10.1177/16094069251337583

Christou, P. (2023). How to use artificial intelligence (AI) as a resource, methodological and analysis tool in qualitative research? The Qualitative Report, 28(7), 1968–1980. https://doi.org/10.46743/2160-3715/2023.6406

Costa, A. P. (2024). Human-in-the-loop: A investigação qualitativa na era da IA. Universidade de Aveiro / Ludomedia.

Costa, A. P., Bryda, G., Christou, P. A., & Kasperiuniene, J. (2025). AI as a co-researcher in the qualitative research workflow: Transforming Human-AI Collaboration. International Journal of Qualitative Methods, in press. (Original work published)

Eacersall, D., Pretorius, L., Smirnov, I., Spray, E., Illingworth, S., Chugh, R., Strydom, S., Stratton-Maher, D., Simmons, J., Jennings, I., Roux, R., Kamrowski, R., Downie, A., Thong, C. L., & Howel, K. A. (2025). Navigating ethical challenges in generative AI-enhanced research: The ETHICAL framework for responsible generative AI use. Journal of Applied Learning & Teaching, 8(2), 1–14. https://doi.org/10.37074/jalt.2025.8.2.9

Fierro. (2025). Short circuit: Court AI ‘hallucinations’ in legal filings and how to avoid making headlines. Reuters. https://www.reuters.com/legal/legalindustry/short-circuit-court-ai-hallucinations-legal-filings-how-avoid-making-headlines-2025-08-04

Flanders, S., Nungsari, M., & Loong, M. C. W. (2025). Big meaning: Qualitative analysis on large bodies of data using AI. arXiv. https://doi.org/10.48550/arXiv.2504.08213

Gao, J., Choo, K., Cao, J., Lee, R., & Perrault, S. (2023). CoAIcoder: Examining the effectiveness of AI-assisted human-to-human collaboration in qualitative analysis. ACM Transactions on Computer-Human Interaction, 31(1), 1–38. https://doi.org/10.1145/3617362

García-López, M., & Trujillo-Liñán, J. (2025). Ethical and regulatory challenges of generative AI in education: A systematic review. Frontiers in Education, 10, 1565938. https://doi.org/10.3389/feduc.2025.1565938

Gebreegziabher, S., Zhang, Z., Tang, X., Meng, Y., Glassman, E., & Li, T. (2023). PaTAT: Human-AI collaborative qualitative coding with explainable interactive rule synthesis. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1–14). ACM. https://doi.org/10.1145/3544548.3581352

Gibson, A., & Beattie, A. (2024). More or less than human? Evaluating the role of AI-as-participant in online qualitative research. Qualitative Research in Psychology, 21(2), 175–199. https://doi.org/10.1080/14780887.2024.2311427

Hamilton, L., Elliott, D., Quick, A., Smith, S., & Choplin, V. (2023). Exploring the use of AI in qualitative analysis: A comparative study of guaranteed income data. International Journal of Qualitative Methods, 22(1). https://doi.org/10.1177/16094069231201504

Hemmer, P., Westphal, M., Schemmer, M., Vetter, S., & Satzger, G. (2023). Human-AI collaboration: The effect of AI delegation on human task performance and task satisfaction [Preprint]. arXiv. https://arxiv.org/abs/2303.09224

Hosanagar, K., & Ahn, D. (2024). Designing human and generative AI collaboration [Preprint]. arXiv. https://arxiv.org/abs/2412.14199

Huang, Q., & Willems, T. (2025). Empowering educators in the age of AI: An empirical study on creating custom GPTs in qualitative research method education. arXiv. https://doi.org/10.48550/arXiv.2507.21074

Jiang, Q., Gao, Z., & Karniadakis, G. (2025). DeepSeek vs. ChatGPT vs. Claude: A comparative study for scientific computing and scientific machine learning tasks. Theoretical and Applied Mechanics Letters, 15(1), 100583. https://doi.org/10.1016/j.taml.2025.100583

Jiang, Y., Ko-Wong, L., & Valdovinos Gutierrez, I. (2025). The feasibility and comparability of using artificial intelligence for qualitative data analysis in equity-focused research. Educational Researcher, 54(3), 153–163. https://doi.org/10.3102/0013189X251314821

Karjus, A. (2025). Machine-assisted quantitizing designs: Augmenting humanities and social sciences with artificial intelligence. Humanities and Social Sciences Communications, 12, 277. https://doi.org/10.1057/s41599-025-04503-w

Lintner, T. (2024). A systematic review of AI literacy scales. NPJ Science of Learning, 9, 24. https://doi.org/10.1038/s41539-024-00264-4

Lira, Y. R., Burneo, P. S., & Costa, A. P. (2026). Identifying key competencies for education PhD students with generative AI integration: A scoping review. In P. A. Christou, G. Bryda, J. Kasperiuniene, & A. Gupta (Eds.), Computer supported qualitative research. WCQR 2025 (Lecture Notes in Networks and Systems, Vol. 1595). Springer. https://doi.org/10.1007/978-3-032-02999-7_9

Lumivero. (2025). State of AI in qualitative research 2025. https://lumivero.com/resources/blog/state-of-ai-in-qualitative-research

Ma, D., Akram, H., & Chen, I.-H. (2024). Artificial intelligence in higher education: A cross-cultural examination of students’ behavioral intentions and attitudes. The International Review of Research in Open and Distributed Learning, 25(3), 134–157. https://doi.org/10.19173/irrodl.v25i3.7703

Makarius, E., Mukherjee, D., Fox, J., & Fox, A. (2020). Rising with the machines: A sociotechnical framework for bringing artificial intelligence into the organization. Journal of Business Research, 120, 262–273. https://doi.org/10.1016/j.jbusres.2020.07.045

Marko, J., Neagu, D., & Anand, P. (2025). Examining inclusivity: The use of AI and diverse populations in health and social care: A systematic review. BMC Medical Informatics and Decision Making, 25, 284. https://doi.org/10.1186/s12911-025-02884-1

Martin, S., Beecham, E., Kursumovic, E., Armstrong, R., Cook, T., Déom, N., Kane, A., Moniz, S., Soar, J., & Vindrola-Padros, C. (2024). Comparing human vs. machine-assisted analysis to develop a new approach for big qualitative data analysis. medRxiv. https://doi.org/10.1101/2024.07.16.24310275

Mateus, S. C., & Lira, Y. (2025). Colaboração humano–IA: Desafios e oportunidades na investigação qualitativa. Ludomedia. https://ludomedia.org/colaboracao-humano-ia/

Melo, L. B., Sanches, T., Iglesias, C. D. (2024). Tendências da utilização do ChatGPT no Ensino Superior e impacto nas Bibliotecas Académicas. In C. G. Silva, J. Revez, L. Corujo (Eds.). (2024). Diálogos na Ciência da Informação = Diálogos en Ciencia de la Información: Atas do XIV EDICIC, Universidade de Lisboa. (pp. .837-844). Faculdade de Letras, 1-3 de julho de 2024. Lisboa: Centro de Estudos Clássicos, Colibri; Costa Rica: EDICIC. https://doi.org/10.51427/10451/64777

Nemorin, S., Vlachidis, A., Ayerakwa, H., & Andriotis, P. (2023). AI hyped? A horizon scan of discourse on artificial intelligence in education (AIED) and development. Learning, Media and Technology, 48(1), 38–51. https://doi.org/10.1080/17439884.2022.2095568

Paiva, R. S., Costa, A. P., & Reis, L. P. (2025). ChatGPT como catalisador do pensamento crítico e criativo. Práxis Educativa, 20, e24247, 1–23. https://doi.org/10.5212/PraxEduc.v.20.24247.007

Perkins, M., & Roe, J. (2024). Generative AI tools in academic research: Applications and implications for qualitative and quantitative research methodologies. arXiv. https://doi.org/10.48550/arXiv.2408.06872

Peters, U., & Carman, M. (2024). Cultural bias in explainable AI research: A systematic analysis. Journal of Artificial Intelligence Research, 79, 329–358. https://doi.org/10.1613/jair.1.14888

Pikhart, M., & Klimova, B. (2025). A qualitative study on ethical issues related to the use of AI-driven technologies in foreign language learning. Scientific Reports, 15, 13741. https://doi.org/10.1038/s41598-025-13741-6

Pinho, M. I. G. de, Costa, A. P. D., & Pinho, C. G. de. (2025). Ethical and responsible use of GenAI in research context. Práxis Educativa, 20, e25388. https://doi.org/10.5212/PraxEduc.v.20.25388.057

Prescott, M. R., Yeager, S., Ham, L., Rivera Saldana, C. D., Serrano, V., Narez, J., Paltin, D., Delgado, J., Moore, D. J., & Montoya, J. (2024). Comparing the efficacy and efficiency of human and generative AI: Qualitative thematic analyses. JMIR AI, 3(1), e54482. https://doi.org/10.2196/54482

Rodrigues dos Anjos, J., de Souza, M. G., Serrano de Andrade Neto, A., & Campello de Souza, B. (2024). Uma análise do uso de IA generativa como investigadora em pesquisas qualitativas em educação científica. Revista Pesquisa Qualitativa, 12(30), 01–29. https://doi.org/10.33361/RPQ.2024.v.12.n.30.724

Roe, J., & Perkins, M. (2024). Generative AI and agency in education: A critical scoping review and thematic analysis. arXiv. https://doi.org/10.48550/arXiv.2411.00631

Silveira, F. A., Lopes, E., Carrilho, I. A., Ramos, T. O., & Guadelupe, S. R. (2025). Ferramentas de IA generativa na educação: Um estudo qualitativo com estudantes de doutoramento sobre práticas, ética e impacto académico. RE@D – Revista de Educação a Distância e Elearning, 8(2). https://doi.org/10.34627/redvol8iss2e202514

Stahl, B., & Eke, D. (2024). The ethics of ChatGPT: Exploring the ethical issues of an emerging technology. International Journal of Information Management, 74, 102700. https://doi.org/10.1016/j.ijinfomgt.2023.102700

Sun, H., Kim, M., Kim, S., & Choi, L. (2025). A methodological exploration of generative artificial intelligence (AI) for efficient qualitative analysis on hotel guests’ delightful experiences. International Journal of Hospitality Management, 116, 103974. https://doi.org/10.1016/j.ijhm.2024.103974

Turobov, A., Coyle, D., & Harding, V. (2024). Using ChatGPT for thematic analysis. arXiv. https://doi.org/10.48550/arXiv.2405.08828

UNESCO. (2024). Guia para a IA generativa na educação e na pesquisa (T. M. L. Cardoso & V. C. Marques, Trads.; L. Carvalho, M. L. M. Bueno e Silva, Rev.). Paris: Organização das Nações Unidas para a Educação, a Ciência e a Cultura. (Obra original publicada em 2023 como Guidance for generative AI in education and research). https://unesdoc.unesco.org/ark:/48223/pf0000390241

Van Dijk, S., Brusse-Keizer, M., Bucsán, C., Van Der Palen, J., Doggen, C., & Lenferink, A. (2023). Artificial intelligence in systematic reviews: Promising when appropriately used. BMJ Open, 13(9), e072254. https://doi.org/10.1136/bmjopen-2023-072254

Wang, Y., Carpenter, Z., Swiecki, Z., & Shaffer, D. (2025). Qualitative parameter triangulation: A conceptual and methodological framework for event-based temporal models. In Proceedings of the 15th International Learning Analytics and Knowledge Conference (pp. 1–11). https://doi.org/10.1145/3706468.3706538

Wheldon, C., & McKee, R. (2025). AI-empowered qualitative data analysis. CommonHealth, 3(1), 1–14. https://doi.org/10.15367/vd6f8w75

Wilder, C., & Calderone, S. (2025). Empowering educational leadership research with generative AI. Impacting Education: Journal on Transforming Professional Practice, 10(1), 34–48. https://doi.org/10.5195/ie.2025.489