Mixed methods, mixed tools

The use of computer software for integrated qualitative and quantitative analysis

Authors

  • Anna Kuznik Uniwersytet Wrocławski
  • Joan Miquel Verd Universitat Autònoma de Barcelona
  • Christian Olalla-Soler Universitat Autònoma de Barcelona

DOI:

https://doi.org/10.1558/jrds.32360

Keywords:

Mixed methods, quantitative translation, Camtasia, EdEt, Translation Studies

Abstract

We report on how two different software programs (Camtasia and EdEt) were used in the process of data conversion from qualitative to quantitative format. This process, known as quantitative translation of data, can be considered a specific kind of mixed methods analysis. We show the methodological and technical limits of the programs and the possibilities they offer for quantitative translation. We reflect on the role these software packages played in the different stages of data collection and data analysis of the studies described. Finally, we delve into the methodological and epistemological criticisms of the use of software for qualitative data analysis, concluding that they are meaningful warnings to avoid a misuse of software but do not apply when researchers adopt an interpretive approach in which they actively participate in the development and testing of categories.

Author Biographies

  • Anna Kuznik, Uniwersytet Wrocławski

    A graduate in French Studies from the Jagiellonian University of Cracow (Uniwersytet Jagielloński w Krakowie) in Poland, she was awarded a European PhD in Translation and Intercultural Studies by the Autonomous University of Barcelona (Universitat Autònoma de Barcelona) in Spain. A member of the PACTE research group since 2005, she has worked in the Department of Romance Studies (Instytut Filologii Romańskiej) of the University of Wrocław (Uniwersytet Wrocławski) in Poland since 2011. Certified translator of French and Spanish in Poland. Recent papers: “La traduction comme travail: perspectives croisées en ergonomie, sociologie et traductologie” (ILCEA [En Ligne], 27/2016, 16 pages); “Work content of in-house translators in small and medium-sized industrial enterprises. Observing real work situations” (JoSTrans. The Journal of Specialised Translation, Issue 25, January 2016, 213-231); and “How to define good professional translators and interpreters: Applying the behavioural approach to studying competences in the field of translation studies"(Across Languages and Cultures, 16(1), 2015, 1-27, with Amparo Hurtado Albir).

  • Joan Miquel Verd, Universitat Autònoma de Barcelona

    Joan Miquel Verd is Associate Professor in the Department of Sociology at the Autonomous University of Barcelona (Universitat Autònoma de Barcelona . UAB). Doctor in Sociology (2002), He is BA in Business and Economics (1996) and BA in Political Science and Sociology (1994). He is the director of the Centre for Sociological Research on Daily Life and Work (Centre d’Estudis Sociològics sobre la Vida Quotidiana i el Treball - QUIT) since 2013 and member of the Institute for Labor Studies (IET) since its founding in 2011. His main research interests are the analysis of social networks, youth labour trajectories and the connections between social protection and employment. Methodologically his work focuses on qualitative text analysis, mixed methods and computer assisted qualitative data analysis. His most recent publications are the book (2016) Introducción a la investigación cualitativa. Fases métodos y técnicas (with Carlos Lozares), published by Síntesis and the article (2016) “Employment instability and economic crisis in Spain: what are the elements that make a difference in the trajectories of younger adults?”(with Martí López-Andreu), published in European Societies.

  • Christian Olalla-Soler, Universitat Autònoma de Barcelona

    Christian Olalla-Soler earned a Degree in Translation and Interpreting at the Universitat Autònoma de Barcelona and in Teaching of Spanish as a Foreign Language at the University of Valencia. He is currently working on his PhD dissertation entitled The cultural competence of the translator and its acquisition. Since 2012 he is member of the research group PACTE (Process of Acquisition of Translation Competence and. Evaluation). His research interests come within the following fields of research: translator and interpreter training, interculturality and ideology; cognitive processes in translation and interpreting, and empirical research methodology in translation and interpreting studies. He is member of the European Association of Methodology. Recent publications: “Procedures for assessing the acquisition of cultural competence in translator training” (The Interpreter and Translator Trainer, with Amparo Hurtado Albir, 2016, 10(3), 1-25), “Más allá del aula: El papel de la Asociación Española Universitaria de Traductores e Intérpretes en Formación” (Onomázein, 2015, 31(1), 52-65), and “An experimental study into the acquisition of cultural competence in translator training. Research design and methodological issues” (Translation and Interpreting, 2015, 7(1), 86-110).

References

Bazeley, P. (2010). Computer-assisted integration of Mixed Methods data sources and analyses. In A. Tashakkori and Ch. Teddlie (Eds) SAGE Handbook of Mixed Methods in Social and Behavioral Research (2nd Edn), 431–467. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781506335193.n18

Berelson, B. (1971). Content Analysis in Communication Research. New York: Hafner Publishing Company.

Bericat, E. (1998). La integración de los métodos cuantitativo y cualitativo en la investigación social. Barcelona: Ariel.

Bieli?ski, J., Iwi?ska, K. and Rosi?ska-Kordasiewicz, A (2007). Analiza danych jako?ciowych przy u?yciu programów komputerowych. ASK 16, 8–114.

Blaikie, N. W. H. (1991). A critique of the use of triangulation in social research. Quality and Quantity 25, 115–136. https://doi.org/10.1007/BF00145701

Boyatzis, R. E. (1998). Transforming Qualitative Information: Thematic Analysis and Code Development. Thousand Oaks, CA: Sage.

Creswell, J. W. and Plano-Clark, V. L. (2011). Designing and Conducting Mixed Methods Research (2nd Edn). Thousand Oaks, CA: Sage.

Denzin, N. K. and Lincoln, Y. S (2011). Introduction. The discipline and practice of qualitative research. In N. K. Denzin and Y. S. Lincoln, The Sage Handbook of Qualitative Research. 1–19 Thousand Oaks, CA: Sage.

Ehrensberger-Dow, M. and Massey, G. (2008). Exploring translation competence by triangulating empirical data. Norwich Papers 16, 1–20.

Ehrensberger-Dow, M. and Massey, G. (2014). Cognitive ergonomic issues in professional translation. In J. W. Schwieter and A. Ferreira (Eds) The Development of Translation Competence: Theories and Methodologies from Psycholinguistics and Cognitive Science, 58–86. Cambridge: Cambridge Scholars Publishing.

Fàbregues, S. (2015). La conceptualización y operacionalización de la calidad de la investigación basada en métodos mixtos. Un estudio de casos múltiples de cuatro disciplinas. Doctoral thesis. Departamento de Sociología. Universidad Autónoma de Barcelona.

Fielding, J. and Fielding, N. (2008). Synergy and synthesis: Integrating qualitative and quantitative data. In P. Alasuutari, L. Bickman and J. Brannen (Eds) The SAGE Handbook of Social Research Methods, 555--571. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781446212165.n33

Fielding, N. (2012). Triangulation and Mixed Methods designs: Data integration with new research technologies. Journal of Mixed Methods Research 6 (2), 124–136. https://doi.org/10.1177/1558689812437101

García-Álvarez, E., López-Sintas, J. and Samper-Martínez, A. (2015). The social network gamer’s experience of play: A Netnography of Restaurant City on Facebook. Games and Culture 20, 1–21. ttps://doi.org/10.1177/1555412015595924

Gibbs, G. R. (2007) Media Review: Atlas.ti software to assist with the qualitative analysis of data. Journal of Mixed Methods Research 1, 103–104. https://doi.org/10.1177/2345678906291490

Giozza, M. (2013). La investigación en traducción orientada al proceso. LyCE Estudios 6, 93–118.

Hurtado Albir, A. (Ed.) (in press). Researching Translation Competence by PACTE Group. Amsterdam: John Benjamins.

Kaliszewska, I. (2009). Wspomagana komputerowo analiza wywiadów etnograficznych i tekstów folkloru. In P. Grochowski and G. Ga?carczyk (Eds) Folklor w dobie Internetu, 197–203. Toru?: Wydawnictwo Naukowe Uniwersytetu Miko?aja Kopernika.

Kaliszewska, I. (2008). Editor for Ethnographers (EdEt) and Advanced Qualitative Queries (AQQ) (Power Point presentation). Workshop presented at SAIC 2008. Seminario avanzado de investigación cualitativa: Estrategias de diseño y análisis de datos, orgenised by Centre d’Estudis i de Recerca d’Humanitats de la Universitat Autònoma de Barcelona, led by Jordi López Sintas, Universitat Autònoma de Barcelona, 07-11/07/2008.

Koetting, J. R. (1984). Foundations of Naturalistic Inquiry: Developing a Theory Base for Understanding Individual Interpretations of Reality. Paper presented at the Annual Meeting of the Association for Educational Communications and Technology (Dallas, TX, January 20-24, 1984).

Kuznik, A. (2015). Étudiants polonais de langue et civilisation françaises et leur avenir professionnel. In E. Skibi?ska, R. Solová and K. Gostkowska (Eds) Vingt cinq ans après – Traduire dans une Europe en reconfiguration, 289–309. Paris: Orizons.

Kuznik, A. (2010). El contenido de los puestos de trabajo de los traductores. El caso de los traductores internos en las empresas de traducción de Barcelona, Doctoral thesis. Universitat Autònoma de Barcelona, URI TDX: <http://tdx.cat/handle/10803/5279> (published version 2012. Saarbrücken: AV Akademikerverlag GmbH & Co. KG/ Editorial Académica Española).

Kuznik, A. (in press). Use of Instrumental Resources. In A. Hurtado Albir (Ed.) Researching Translation Competence by PACTE Group, 219–241, Amsterdam: John Benjamins.

Kuznik, A. and Olalla-Soler, C. (in press). Results of PACTE Group’s experimental research on translation competence acquisition. The acquisition of the instrumental sub-competence. Across Languages and Cultures 19 (1).

Kuznik, A. and Little, V. (in press). Domaines économiques et axes d’employabilité des philologues français et des traducteurs en Pologne. Méta: journal des traducteurs, 62(1).

Lincoln, Y. S. and Guba, E. G. (1985). Naturalistic Inquiry. Beverly Hills, CA: Sage.

López-Sintas, J., Rojas de Francisco, L. and García-Álvarez, E. (2015). The nature of leisure revisited: An interpretation of digital leisure. Journal of Leisure Research. 47 (1): 79–101.

Mertens, D. M., Bazeley, P., Bowleg, L., Fielding, N., Maxwell, J., Molina-Azorin, J. F., and Niglas, K. (2016). The Future of Mixed Methods: A Five Year Projection to 2020. Mixed Methods International Research Association [Retrieved on 16 October 2016 from https://mmira.wildapricot.org].

Miles, M. B. and Huberman, A. M. (1994). Qualitative Data Analysis. An Expanded Sourcebook (2nd Ed.). Thousand Oaks, CA: Sage.

Olalla-Soler, C. (2015). An experimental study into the acquisition of cultural competence in translator training: Research design and methodological issues. The International Journal for Translation & Interpreting Research 7 (1), 86–110.

Onwuegbuzie, A. J. and Teddlie, C. (2003). A framework for analyzing data in mixed methods research. In A. Tashakkori and C. Teddlie (Eds) Handbook of Mixed Methods in Social and Behavioral Research, 351–383. Thousand Oaks, CA: Sage.

PACTE (2001). La Competencia traductora y su adquisición. Quaderns. Revista de Traducció 6, 39–45 (authors in alphabetical order: A. Beeby, L. Berenguer, D. Ensinger, O. Fox, A. Hurtado Albir, N. Martínez Melis, W. Neunzig, M. Orozco, M. Presas; principal researcher: A. Hurtado Albir).

PACTE (2002a). Una investigación empírico-experimental sobre la adquisición de la competencia traductora. In A. Alcina Caudet and S. Gamero Pérez (Eds) La traducción científico-técnica y la terminología en la sociedad de la información, 125–138. Castellón de la Plana: Publicacions de la Universitat Jaume I (authors in alphabetical order: A. Beeby, M. Fernández, O. Fox, A. Hurtado Albir, N. Martínez Melis, W. Neunzig, M. Orozco, M. Presas, P. Rodríguez-Inés; principal researcher: A. Hurtado Albir).

PACTE (2002b). Exploratory tests in a study of translation competence. Conference Interpretation and Translation 4 (2), 41–69 (authors in alphabetical order: A. Beeby, M. Fernández, O. Fox, A. Hurtado Albir, W. Neunzig, M. Orozco, M. Presas, P. Rodríguez-Inés, L. Romero; principal researcher: A. Hurtado Albir).

PACTE (2003). Building a Translation Competence Model. In A. Fabio (Ed.) Triangulating Translation: Perspectives in Process Oriented Research, 43–66. Amsterdam: John Benjamins (authors in alphabetical order: A. Beeby, M. Fernández, O. Fox, A. Hurtado Albir, W. Neunzig, M. Presas, P. Rodríguez-Inés. L. Romero; principal researcher: A. Hurtado Albir). https://doi.org/10.1075/btl.45.06pac

PACTE (2005a). Primeros resultados de un experimento sobre la Competencia Traductora. In Actas del II Congreso Internacional de la AIETI (Asociación Ibérica de Estudios de Traducción e Interpretación) ‘Información y documentación’, 573–587. Madrid: Publicaciones de la Universidad Pontificia Comillas (authors in alphabetical order: A. Beeby, M. Fernández, O. Fox, A. Hurtado Albir, I. Kozlova, W. Neunzig, M. Presas, P. Rodríguez-Inés, L. Romero; principal researcher: A. Hurtado Albir).

PACTE (2005b). Investigating translation competence: Conceptual and methodological issues. Meta 50 (2): 609–619 (authors in alphabetical order: A. Beeby, M. Fernández, O. Fox, A. Hurtado Albir, I. Kozlova, W. Neunzig, M. Presas, P. Rodríguez-Inés, L. Romero; principal researcher: A. Hurtado Albir). https://doi.org/10.7202/011004ar

PACTE (2008). First results of a translation competence experiment: ‘Knowledge of Translation’ and ‘Efficacy of the Translation Process’. In J. Kearns (Ed.) Translator and Interpreter Training. Issues, Methods and Debates, 104–126, London: Continuum (authors in alphabetical order: A. Beeby, M. Fernández, O. Fox, A. Hurtado Albir, I. Kozlova, A. Kuznik, W. Neunzig, P. Rodríguez-Inés. L. Romero; principal researcher: A. Hurtado Albir).

PACTE (2014). First results of PACTE Group’s experimental research on translation competence acquisition: The acquisition of declarative knowledge of translation. MonTI. Monografías de Traducción e Interpretación special issue 1, 85–115 (authors in alphabetical order: A. Beeby, L. Castillo, O. Fox, A. Galán-Mañas, A. Hurtado Albir, A. Kuznik, G. Massana, W. Neunzig, C. Olalla-Soler, P. Rodríguez-Inés, L. Romero, M. Taffarel, S. Wimmer; principal researcher: A. Hurtado Albir).

PACTE (2015). Results of PACTE’s experimental research on the acquisition of translation competence: The acquisition of declarative and procedural knowledge in translation. The Dynamic Translation Index. Translation Spaces 4 (1), 29–53 (authors in alphabetical order: A. Beeby, L. Castillo, O. Fox, A. Galán-Mañas, A. Hurtado Albir, A. Kuznik, G. Massana, W. Neunzig, C. Olalla-Soler, P. Rodríguez-Inés, L. Romero; principal researcher: A. Hurtado Albir). https://doi.org/10.1075/ts.4.1.02bee

PACTE (in press a). Developing the research design. In A. Hurtado Albir (Ed.) Researching Translation Competence by PACTE Group, 63–79. Amsterdam: John Benjamins (authors in alphabetical order: A. Beeby, O. Fox, A. Hurtado Albir, A. Kuznik, W. Neunzig, P. Rodriguez-Inés, L. Romero, S. Wimmer; principal researcher: A. Hurtado Albir).

PACTE (in press b). Experiment design. In A. Hurtado Albir (Ed.) Researching Translation Competence by PACTE Group, 81–96. Amsterdam: John Benjamins (authors in alphabetical order: A. Beeby, O. Fox, A. Hurtado Albir, A. Kuznik, W. Neunzig, P. Rodriguez-Inés, L. Romero, S. Wimmer; principal researcher: A. Hurtado Albir).

PACTE (in press c). Decision-making. In A. Hurtado Albir (Ed.) Researching Translation Competence by PACTE Group, 191–210. Amsterdam: John Benjamins (authors in alphabetical order: A. Beeby, O. Fox, A. Hurtado Albir, A. Kuznik, W. Neunzig, P. Rodriguez-Inés, L. Romero, S. Wimmer; principal researcher: A. Hurtado Albir).

PACTE (in press d). Efficacy of the translation process. In A. Hurtado Albir (Ed.) Researching Translation Competence by PACTE Group, 211–218. Amsterdam: John Benjamins (authors in alphabetical order: A. Beeby, O. Fox, A. Hurtado Albir, A. Kuznik, W. Neunzig, P. Rodriguez-Inés, L. Romero, S. Wimmer; principal researcher: A. Hurtado Albir).

PACTE (in press e). Appendix VI. Decision-making. In A. Hurtado Albir (Ed.) Researching Translation Competence by PACTE Group 373. Amsterdam: John Benjamins (authors in alphabetical order: A. Beeby, O. Fox, A. Hurtado Albir, A. Kuznik, W. Neunzig, P. Rodriguez-Inés, L. Romero, S. Wimmer; principal researcher: A. Hurtado Albir).

Tashakkori, A. and Teddlie, C. (1998). Mixed Methodology. Combining Quantitative and Qualitative Approaches. Thousand Oaks, CA: Sage.

TREC (2015a). Home/Inicio. Retrieved on 24 October 2016 from http://pagines.uab.cat/trec/

TREC (2015b). Resources/Recursos. Retrieved on 24 October 2016 from http://pagines.uab.cat/trec/content/resources-recursos

TREC (2015c). MovEs II: Traducción y Creatividad [MovEs II: Translation and Creativity]. Retrieved on 24 October 2016 from http://pagines.uab.cat/trec/content/moves-ii-traducci%C3%B3n-y-creatividad-moves-ii-translation-and-creativity

TREC (2015d). Conceptualización y evaluación de la creatividad en traducción: aplicaciones docentes y profesionales [Conceptualising and assessing translational creativity: teaching and professional implications]. Retrieved on 24 October 2016 from http://pagines.uab.cat/trec/content/conceptualizaci%C3%B3n-y-evaluaci%C3%B3n-de-la-creatividad-en-traducci%C3%B3n-aplicaciones-docentes-y

Verd, J. M. and López, P. (2008). La eficiencia teórica y metodológica de los diseños multimétodo. Empiria. Revista de Metodología de Ciencias Sociales16, 13–42. https://doi.org/10.5944/empiria.16.2008.1388

Verd, J. M. and Lozares, C. (2016). Introducción a la investigación cualitativa. Fases, métodos y técnicas. Madrid: Síntesis.

Weber, R. P. (1985). Basic Content Analysis. Beverly Hills, CA: Sage.

Published

2016-12-30

Issue

Section

Articles

How to Cite

Kuznik, A., Verd, J. M., & Olalla-Soler, C. (2016). Mixed methods, mixed tools: The use of computer software for integrated qualitative and quantitative analysis. Journal of Research Design and Statistics in Linguistics and Communication Science, 3(1), 76-109. https://doi.org/10.1558/jrds.32360