5.2 KiB
| title | chunk | source | category | tags | date_saved | instance |
|---|---|---|---|---|---|---|
| Pragmatic validity | 1/2 | https://en.wikipedia.org/wiki/Pragmatic_validity | reference | science, encyclopedia | 2026-05-05T10:02:54.708020+00:00 | kb-cron |
Pragmatic validity in research looks to a different paradigms from more traditional, (post)positivistic research approaches. It tries to ameliorate problems associated with the rigour-relevance debate, and is applicable in all kinds of research streams. Simply put, pragmatic validity looks at research from a prescriptive-driven perspective. Solutions to problems that actually occur in the complex and highly multivariate field of practice are developed in a way that, while valid for a specific situation, need to be adjusted according to the context in which they are to be applied. The term "validity" is often seen as a sort catch-all for the question whether the knowledge claims resulting from research are warranted. The confusion might arise from the mingling of the terms 'internal validity' and 'external validity', where the former refers to proof of a causal link between a treatment and effect, and the latter is concerned with generalizability. (In this discussion I maintain the term 'generalizability' rather than external validity mainly to avoid any possible confusion between the two terms.) During this discussion I consider that validity is reflected in the question, "did we measure the right thing?", or, in other words, can the researcher prove that the effect he observed was actually a result of the cause? Positivistic research approaches this question in a different way than pragmatic research, which is based in a different paradigm. Design Science Research is one example of research firmly situated in a pragmatic perspective.
== Validity in (post)positivist research == Postpositivist research typically strives to numerically report upon empirical observations made within a controlled environment in order to arrive at a universal truth about a causal effect between a limited number of variables. This statement relates what much of the epistemology of Positivistic science is based on: isolating singular variables in order to come to a conclusion that is free of context. Laboratory experiments and quantitative models are the preferred methods for observing and reporting. These are considered to rule out any rival plausible explanations and thus help to guarantee validity.
== Validity in pragmatic research == Validity in prescription-driven research is approached in different ways than descriptive research. The first difference deals with what some researchers call 'messy situations' (Brown 1992; Collins, Joseph, and Bielaczuc 2004). A messy situation is a real-life, a highly multivariate one is where independent variables cannot be minimized nor completely accounted for. In explanatory science, experiments are in controlled laboratories, where variables can be minimalized. The complex nature of a real-life intervention means that the success or failure (effect) of the intervention may be difficult to conclusively link to the intervention itself (cause). This aspect of knowledge claims from science is seen as extremely problematic for positivist scientists looking for explanations. However, scientists using a pragmatic paradigm respond to this concept in two ways; first by questioning the value of research carried out in a controlled situation (Brown 1992; Hodkinson 2004; Kelly and Lesh 2000; Perrin 2000; Susman and Evered 1978; Walker and Evers 1999; Zaritsky et al. 2003) and secondly, by looking at causal effects through a different perspective. The use of the phrase of Pragmatic Validity was first discussed in Worren, Moore & Elliott (2002), who contrasted it with Scientific Validity. This ideas has been taken up in the management literature to a considerable degree. Many social science researchers assert that testing interventions in controlled laboratory settings is hardly feasible and not a reflection of the real world. For them, real-life settings are needed in order to produce worthwhile research artifacts. These artifacts are validated by the adoption rate of the practitioners within the community of practice associated with the field. Nowotny (2000) calls knowledge that has been validated by the multidisciplinary community of practice 'socially robust', meaning that it has been developed in (and for) contexts outside the laboratory and can be used by practitioners. In the following statement, Cook (1983) refers to the well-known educational researcher Cronbach about multivariate causal interdependency and validity, and the need for understanding the complexity of the situation being researched.
Lawful statements of causation require full knowledge of this system of variables so that total prediction of the outcome can be achieved. From his belief in the systemic organization of causal connections and the utility of causal explanations of this type, Cronbach questions whether the experimentalists' isolation and manipulation of a small set of specific causal agents is sensitive to the real nature of causal agency, which depends on complex patterns of influence between multiple events and also involves characteristics of respondents, settings and times (p.78).