There is a highly instructive symposium on "Veil of Ignorance" #ProcessTracing in the new @APSAtweets QMMR publication https://t.co/nxqEQ9HaRz There is lots to say ab it. For now, I want to focus on whether (causal) qualitative research has a problem w/ confirmation bias that 1/
needs to be addressed.
In short, Veil of Ignorance process tracing aims to blindfold the data collectors and analysts to the hypotheses to reduce risk of confirmation bias.
Proposal receives a lot of criticism by all respondents, partly for valid reasons, partly not, IMO 2/
If there was no bigger issue with confirmation bias, there would not be much benefit in talking about blinding in qualitative research.
As Beach notes, the intro to the symposium does not present evidence that bias is a problem. This is correct, but there is also no evidence 3/
that confirmation bias is not a problem. It's an absence of evidence situation with regard to comprehensive, direct evidence, i.e. from verification studies of qualitative research (for studies that are built on an epistemology for which the idea of verification makes sense). 4/
However, I'd say there is circumstantial evidence that confirmation bias is a problem.
1) Evidence for confirmation bias in quantitative research: The developments around #OpenScience and transparency in quantitative research in different disciplines present diverse evidence 5/