14/05/2022
Credibility
Guba and Lincoln (1989) claimed that the credibility of a study is determined when coresearchers or readers are confronted with the experience, they can recognize it. Credibility addresses the “fit” between respondents’ views and the researcher’s representation of them (Tobin & Begley, 2004). Lincoln and Guba (1985) suggested a number of techniques to address credibility including activities such as prolonged engagement, persistent observation, data collection triangulation, and researcher triangulation. They also recommended peer debriefing to provide an external check on the research process, which may therefore increase credibility, as well as examining referential adequacy as a means to check preliminary findings and interpretations against the raw data. Credibility can also be operationalized through the process of member checking to test the findings and interpretations with the participants (Lincoln & Guba, 1985).
Transferability
Transferability refers to the generalizability of inquiry. In qualitative research, this concerns only to case-to-case transfer (Tobin & Begley, 2004). The researcher cannot know the sites that may wish to transfer the findings; however, the researcher is responsible for providing thick descriptions, so that those who seek to transfer the findings to their own site can judge transferability (Lincoln & Guba, 1985).
Dependability
To achieve dependability, researchers can ensure the research process is logical, traceable, and clearly documented (Tobin & Begley, 2004). When readers are able to examine the research process, they are better able to judge the dependability of the research (Lincoln & Guba, 1985). One way that a research study may demonstrate dependability is for its process to be audited (Koch, 1994), which will be discussed in further detail below.
Confirmability
Confirmability is concerned with establishing that the researcher’s interpretations and findings are clearly derived from the data, requiring the researcher to demonstrate how conclusions and interpretations have been reached (Tobin & Begley, 2004). According to Guba and Lincoln (1989), confirmability is established when credibility, transferability, and dependability are all achieved. Koch (1994) recommended researchers include markers such as the reasons for theoretical, methodological, and analytical choices throughout the entire study, so that others can understand how and why decisions were made.
Audit Trails
An audit trail provides readers with evidence of the decisions and choices made by the researcher regarding theoretical and methodological issues throughout the study, which requires a clear rationale for such decisions (Koch, 1994). Sandelowski (1986) stated that a study and its findings are auditable when another researcher can clearly follow the decision trail. Furthermore, Koch (1994) argued that another researcher with the same data, perspective, and situation could arrive at the same or comparable, but not contradictory, conclusions. Keeping records of the raw data, field notes, transcripts, and a reflexive journal can help researchers systemize, relate, and cross reference data, as well as ease the reporting of the research process are all means of creating a clear audit trail (Halpren, 1983).
Reflexivity Is Central to the Audit Trail
Researchers are encouraged to keep a self-critical account of the research process, including their internal and external dialogue (Tobin & Begley, 2004). A reflexive journal can be used by researchers to record to document the daily logistics of the research, methodological decisions, and rationales and to record the researcher’s personal reflections of their values, interests, and insights information about self (the human instrument; Lincoln & Guba, 1985).
Toward a Step-by-Step Approach for Conducting a Trustworthy Thematic Analysis
From a thorough examination of our experiences with qualitative analysis, we have attempted to outline a practical and effective procedure for conducting thematic analysis that aims to meet the trustworthiness criteria outlined by Lincoln and Guba (1985). In qualitative research, the process of data collection, data analysis, and report writing is not always distinct steps; they are often interrelated and occur simultaneously throughout the research process (Creswell, 2007). Because data collection and data analysis may happen concurrently, it is important to identify that the data analysis process may not be entirely distinguishable from the actual data (Thorne, 2000). Although thematic analysis as documented by Braun and Clarke (2006) will be presented here as a linear, six-phased method, it is actually an iterative and reflective process that develops over time and involves a constant moving back and forward between phases. Table 1 highlights how researchers may address Lincoln and Guba’s (1985) criteria for trustworthiness during each phase of thematic analysis.
Table
Table 1. Establishing Trustworthiness During Each Phase of Thematic Analysis.
Table 1. Establishing Trustworthiness During Each Phase of Thematic Analysis.
View larger version
Exemplar Study
In 2014, we began Phase 1 of a 5-year mixed methods case study of nine SCNs in Alberta, Canada. SCNs connect stakeholders across health systems—including patients and families, health-care professionals, researchers, the government, and professional organizations—to identify health and system needs and to develop plans to address those needs using quality improvement initiatives with best evidence. In collaboration with our knowledge users and decision makers, we aimed to understand what made these networks effective, including how networks engaged their stakeholders and what knowledge translation and engagement looked like across their initiatives.
This study was approved by the University of Calgary Conjoint Health Research Ethics Board REB13-0783/0781. Interviewees provided both written and verbal consent to participate. Our study built on a smaller pilot study and guiding conceptual framework that included a modified input–process–output team effectiveness model (Mathieu, Maynard, Rapp, & Gilson, 2008), knowledge translation (Graham et al., 2006), and stakeholder engagement (see Figure 1). The qualitative data in Phase 1 consisted of 71 documents, 117 interview transcripts from exploratory interviews, and 15 observation field notes. Initial codes were generated deductively based on our pilot study, prior research, and conceptual framework. Codes were first fit into a preexisting coding framework to provide detailed analysis of aspects of the data we were most interested in exploring. This variable-oriented strategy (Miles, Huberman, & Saldana, 2014) also facilitated cross-case analysis of the data during later stages of analysis. Phase 1 has been completed (Norris, Hecker, Rabatach, Noseworthy, & White, 2017; Norris, White, Nowell, Mrklas, & Stelfox, 2017). Phase 2 data are currently undergoing analysis, while data collection for Phase 3 has begun.
figure
Figure 1. Study conceptual framework.
Phase 1: Familiarizing Yourself With Your Data
Description
Qualitative data come in various forms including recorded observations, focus groups, texts, documents, multimedia, public domain sources, policy manuals, and photographs (Thorne, 2000). Textual data may also include field notes from participant observations, reflexive journal entries, and stories and narratives (Crabtree & Miller, 1999). Qualitative researchers may triangulate different data collection modes to increase the probability that the research findings and interpretations will be found credible (Lincoln & Guba, 1985). Regardless of the form of data collection, archiving all records of the raw data provides an audit trail and a benchmark against which later data analysis and interpretations can be tested for adequacy (Halpren, 1983; Lincoln & Guba, 1985).
If data were collected through interactive means, researchers will come to the analysis with some prior knowledge of the data and possibly some initial analytic interests or thoughts. Documenting these thoughts during data collection may mark the beginning of data analysis, as researchers may note initial analysis thoughts, interpretations, and questions (Tuckett, 2005). Regardless of who collected the data, it is vital that researchers immerse themselves with the data to familiarize themselves with the depth and breadth of the content (Braun & Clarke, 2006).
The volume, complexity, and varied formats of qualitative data (e.g., audio recordings, transcriptions, documents, and field notes) often lack consistent structure; however, all are useful and imperative for conducting a comprehensive analysis (Dey, 1993). To become immersed in the data involves the repeated reading of the data in an active way searching for meanings and patterns. Braun and Clarke (2006) recommended that researchers read through the entire data set at least once before beginning coding, as ideas and identification of possible patterns may be shaped as researchers become familiar with all aspects of their data.
Researchers are encouraged to engage with the analysis as a faithful witness to the accounts in the data, being honest and vigilant about their own perspectives, preexisting thoughts and beliefs, and developing theories (Starks & Trinidad, 2007). Researchers can document their theoretical and reflective thoughts that develop through immersion in the data, including their values, interests, and growing insights about the research topic (Lincoln & Guba, 1985; Sandelowski, 1995). During this phase, researchers may also make notes about ideas for coding that can be returned to in subsequent phases (Lincoln & Guba, 1985).