How political biases sometimes yield invalid research

I have been forwarded the essay below which originated from José L. Duarte, a Graduate Student in the Department of Psychology (Social Psychology Program) of Arizona State University. E-mail: jose.duarte@asu.edu. It's a lot like what I used to write for the journals in the now distant days when I took social science research seriously. It is an excellent critique of what goes on all the time among academic psychologists and sociologists. I therefore reproduce it below.

I hope Mr Duarte likes flipping burgers at McDonald's because I am fairly sure the essay will end his academic career. I wrote my critiques when I already had tenure.

I have myself made sweeping criticisms of work by John Jost. See here -- JR

I've followed with interest the controversy stemming from Jon Haidt's address at SPSP. One issue that has not been discussed is how the political biases of the field have severely undermined some of the research. I propose that we have a serious problem. Most research in social psychology does not touch on politics and has no obvious political implications. However, some of the research in sub-fields like political psychology and attitudes has deviated sharply from valid scientific methods. Researchers sometimes embed ideological assumptions into their hypotheses, constructs, and measures, in ways that make their studies invalid or even meaningless. Regrettably, I can't properly make my point without evaluating the work of noted social psychologists. I'm willing to do so here, and in future settings, because a) I think this is a serious problem for the field – these biases may ultimately weaken our very standing as a science, and b) these practices have gone unchecked for years, and a frank and open consideration of them is long overdue.

My first example of the phenomenon is the Napier and Jost (2008) Psych Science article "Why Are Conservatives Happier Than Liberals?"

In this article, the authors want to show that conservatives are happier than liberals because they "rationalize inequality" (by which they mean economic or financial inequality, such as unequal incomes). This is already an unanswerable research question. Why? To rationalize is to explain away an uncomfortable reality, often by making excuses for it. It is dissonance reduction. Thus, a basic precondition for conservatives to rationalize economic inequality is that economic inequality be uncomfortable for them. However, economic inequality is particularly uncomfortable only for leftists. Conservative ideology does not feature economic inequality as an injustice or a problem to be solved. (Libertarians are also largely unconcerned about it.) Therefore it's logically impossible for conservatives to rationalize it, since they aren't particularly bothered by it. (Jost's own data confirm that conservatives are relatively unconcerned about economic inequality.) A research program centered on conservative "rationalization" of something that only liberals care deeply about has no apparent way forward.

So how did the authors conduct the research? In Study 2, they operationalized the rationalization of inequality with a one-item measure: 1 (hard work doesn’t generally bring success—it’s more a matter of luck) to 10 (in the long run, hard work usually brings a better life). High ratings on this item were cast as rationalization of inequality. In other words, the authors took endorsement of the efficacy of hard work and called it rationalization, then plugged it in as a mediator between conservatism and happiness (note that this belief about the efficacy of hard work is a constituent conservative belief – we might find that other conservative beliefs work just as well as "mediators" here) . There was no attempt (in either study) to capture or measure any actual process of rationalization – they simply applied the label to conservatives for endorsing this standard conservative view on hard work. (It may be worth noting here that hard work actually does pay off, as I assume anyone who has mentored graduate students can attest – this is observationally self-evident and supported by massive amounts of data. So people are being labeled as rationalizers for simply endorsing an obviously true statement.)

Since no process of rationalization was exposed in Studies 1 or 2, and since it makes no sense that people who don't have a serious problem with economic inequality could be accused of rationalizing it, the article's results are essentially meaningless. The data don't tell us anything related to the hypotheses. This is what I mean by a lack a validity – the data do not represent the construct, and given the nature of this construct, it's unlikely that any data could. This research is a scientific non-sequitur: From (1) Conservatives are happier than liberals, and (2) Conservatives believe that hard work pays off, we conclude (3) Conservatives are happier than liberals because they rationalize inequality. Our only way out is if we treat the following statement as an objective fact: Economic inequality is unjust. If we treat this ideological claim as a fact, as a description of reality, then we might assume that all people are motivated to rationalize such economic inequality as exists in their communities, and proceed from there. But of course we cannot take this ideological claim as fact. It's a philosophical position held by one particular political ideology, and many people would disagree with it. Social scientists are in no position to ratify the truth or falsity of such philosophical positions.

In other work, Jost uses words like legitimize or justify, in addition to rationalize. The question might be something like "how do conservatives legitimize the status quo system?" All of these verbs are ideologically loaded, and the questions which rest on them are not answerable by social science. To ask why anyone legitimizes the status quo is to presume that the status quo is unjust and thus requires legitimization, rationalization, or justification. This assumption is fully an ideological/philosophical assumption, and has no place, nor any real utility, in framing scientific research.

Here are some analogous research questions: Why do liberals legitimize gay marriage? Are liberals less happy than conservatives because they rationalize abortion? These are exactly the same sorts of questions, and fully as invalid as the above. They presume that gay marriage is wrong and needs to be legitimized, or that abortion is wrong and must therefore be an object of rationalization. But of course, liberals don't grant that gay marriage or abortion are wrong, so there is nothing for them to legitimize or rationalize. A research program thus framed would have nowhere to go. If a scientist presented research framed by these conservatively-biased, loaded questions, we would immediately recognize it as scientifically invalid. But framed from a leftist perspective, such loaded questions have escaped scrutiny.

The field should discard ideologically-loaded constructs like these – constructs that have no scientific meaning because they rest on ideological assumptions, rather than observable facts.

A second example of how research is framed in biased ways: If we look at the Jost lab website, we find that many of the researchers frame their research around leftist ideological assumptions. To take just one example, Irina Feygina describes her research as focused on "the effect of motivation to justify the socioeconomic system on denial of environmental problems, such as ecological destruction and global warming, and resistance to implementing imperative pro-environmental changes to the status quo."

This is alarming. Social psychologists know what the imperative "pro-environmental" changes are? How? When did we discover the correct human values and ideals, or imperative policy reforms? Environmentalism is a political ideology, and as such it rests on various philosophical assumptions and values (e.g. a conception of the natural world as sacred; a view of human activities as unnatural; resources as static and collectively-owned; and a propensity to value the preservation of status quo ecologies more highly than some increment of human prosperity). Reasonable people might embrace or reject environmentalism, in whole or in part, for any number of reasons. We cannot treat environmentalism as self-evidently correct, any more than we can treat conservatism or Kantianism as self-evidently correct.

Imagine if a researcher focused her research on "resistance to imperative pro-Christian changes to the status quo", or "resistance to imperative pro-business changes to the status quo". I assume you get my point. We should not be in the business of investigating why people "resist" the truth of our personal ideologies, and a researcher so motivated will likely struggle to maintain an appropriate scientific posture.

I offer a principle from all this: If a research question requires that one assume that a particular ideology or value system is factually true, then that research question is invalid. Stated differently, if a research question has no meaning unless we assume that a given political ideology is factually true, then that research question is invalid (and cannot be meaningfully answered).

Critical to any science is the generation of testable hypotheses. The practices I've highlighted above will consistently yield untestable hypotheses, because they rest on the assumption that liberalism is true, which will never be testable. It is, after all, a question of values and value judgments, which are not subject to empirical validation (at least not by our methods). Modesty requires that we allow for the possibility that reasonable people might embrace values that differ from our own. Notably, researchers who employ such ideologically loaded hypotheses are very likely to find what they are looking for. For example, suppose I wanted to show that conservatives are happier because they "rationalize" war. Mirroring the Napier and Jost method, all I would have to do is ask conservatives if they think some countries are a threat to the USA, and label their affirmative responses as "rationalization of war". I would plug it in as a mediator between conservatism and happiness, which would likely work out. I could then publish my findings in a journal, concluding that conservatives are happier than liberals because they rationalize war, and garner some good media coverage. Apparently, no one would stop me. But would I respect myself in the morning? No, because such an article would have no standing as a work of science, and its conclusions would be completely unsupported by the data.

Among the sciences, social science operates with the most flexibility in constructs, methods, and measurement. This makes us especially vulnerable to bias (see John Ioannidis' work for more on this). I think we should be vigilant, ambitious, and idealistic about keeping our science clean. I assume nothing but the best of intentions on the part of the researchers I've critiqued, and I don't at all enjoy publicly critiquing them. Nevertheless, I submit that the issues I've raised here are not minor -- these are serious violations of the valid practice of social science. Our credibility and even our very standing as a science are at issue, and will be questioned by politicians, taxpayers, and scientists in other fields if these practices continue. Admittedly, this sort of validity issue has not been well-elaborated in our training or the literature. Yet I'm confident most researchers will agree that what I've offered here is a straightforward extension of construct validity and the features of testable hypotheses. The biases at issue represent a (correctable) blind spot in our field, and an unsurprising one, given the large overrepresentation of liberals.

*****************************

The Australian experience of socialized medicine

Jeremy Sammut

According to the Prime Minister, when Australians look at the debate that has raged in the US over ‘Obamacare’, they wonder what on earth Americans are going on about. Because here in this country, we know that ‘Medicare works’.

For many people this will ring true. Medicare is widely considered to be symbol of national equity. The sentiment is that in a wealthy country like Australia, no one should go without health care due to disadvantage, nor be bankrupted by medical bills. This is fair enough as far as it goes. But whether Medicare actually ‘works’ for those who most need assistance to access health services is another question altogether.

Yet, speaking from experience, if you dare to raise any doubts about the ‘jewel in the crown’ of Australian social democracy, you will provoke every ‘true believer’ in the land. Question the wisdom of Medicare in any way, shape, or form, and you are guaranteed to provoke the following loaded response, which is calculated to kill any debate about health reform stone dead. “If we change Medicare, Australia will end up like America with people dying out front of the hospital.”

Yet there is a factual reply that confounds the popular, Michael Moore-esque, conceit.

That reply is that Medicare now kills more Australians than the national road toll. An estimated 1500 avoidable deaths occur each year due delayed emergency treatment. The facts are that one third of emergency patients have to wait longer than eight hours before gaining admission to a bed, because public hospital bed numbers have been cut by one third since the start of Medicare.

This situation has been rightly dubbed the ‘hospital crisis’, and it includes the avoidable deaths that are caused by long waiting times for elective surgery. The truth is that thousands of Australian are dying each year because of long waits to get into overcrowded public hospitals.

What this illustrates are the systemic problems with Medicare.

When Medicare was introduced in 1984, Australians were told it would be all so simple and equitable: each Australian would pay a levy on their income according to their means, and receive treatment according to their needs. The reality is that an inverse care law applies under the scheme, which means patients with the greatest health needs receive the least responsive services.

This is the result of Medicare operating as what health economists describe as a ‘reverse insurance’ system. Medicare provides GP and other medical services on demand on a fee-for-service basis. All consultations and tests are either bulk billed or eligible for a rebate under the Medical Benefits Scheme. The MBS budget is uncapped and is funded entirely by the Federal Government.

This means Medicare is fundamentally flawed in principle. No sound health insurance system should cover minor medical costs from the first dollar spent because this inevitably leads to overuse and waste. Because consumers face either no charge or lower charges, unnecessary consultations and tests are encouraged. The MBS is a political ‘sacred cow’ for this very reason: Australians are in love with bulk billing because they can go to the doctor for ‘free’ whenever they like.

What isn’t understood is that the ever-increasing and open-ended cost of the MBS has led to funding and service imbalances in the hospital sector. To offset MBS spending, the Federal Government has always limited its financial exposure to the cost of public hospital care by giving the states only capped hospital grants.

The predictable response by financially over-stretched state governments has been to impose blunt expenditure controls in the public hospital system including massive cuts to bed numbers.

The result is that many Australians with serious health needs requiring hospital care do not receive timely treatment due to the tight ‘caps’ on hospital funding that federal and state governments both use to limit the cost of our ‘free’ health system.

The perverse outcome is that Medicare leaves people over-entitled at the least serious end of the health care spectrum, while the cost of the most serious, most expensive illnesses are inadequately covered.

If Australians are serious about the fabled ‘fair go’, then the view we should take is that Medicare fails to live up to the national ethos. Medicare means that even the well and worried receive unrestricted, subsidised doctor visits, while the sickest patients languish in the hospital queues that are the daily reality around the country.

Before banging on about the evils of the US health system, Australians would be better off admitting that the way Medicare ‘works’ is deeply inequitable.

SOURCE

*********************

ELSEWHERE

GA: Obamabots seize execution drug on weak pretext: "The Drug Enforcement Administration confirmed Tuesday that the agency seized the state of Georgia's supply of a key lethal injection drug because of questions about how the stockpile was imported to the U.S. DEA spokesman Chuvalo Truesdell said he didn't know if other states' supplies of sodium thiopental were being collected."

Guatemalans sue US for deliberately spreading illness in 1940s experiment -- under a Democrat (Truman) administraion: "A lawsuit was filed Monday in a US district court on behalf of 700 Guatemalan soldiers, mental health patients, and orphans secretly experimented on from 1946 to 1948. An apology is not enough for Guatemalans deliberately infected with syphilis by a US medical team in the 1940s. Five months after the American taxpayer-funded medical experiment came to light, victims have brought a class-action lawsuit against the US government seeking compensation for resulting health problems. The experiments were “both unprecedented and unequivocally impermissible in the United States and throughout the civilized world,” the complaint states."

How Dems & bureaucrats use tragedy to hold taxpayers to ransom: "The New York Times thinks that Republican budget cuts are dangerous. Thus the headline in Monday’s edition: 'GOP Cuts Could Hit Tsunami Warning System, Foes Say.' ... Yikes! Are Republicans really so irresponsible, to the point of near legislative manslaughter? Answer: no, they are not"

My Twitter.com identity: jonjayray. My Facebook page is also accessible as jonjayray (In full: http://www.facebook.com/jonjayray). For more blog postings from me, see TONGUE-TIED, EDUCATION WATCH INTERNATIONAL, GREENIE WATCH, POLITICAL CORRECTNESS WATCH, GUN WATCH, FOOD & HEALTH SKEPTIC, AUSTRALIAN POLITICS, IMMIGRATION WATCH INTERNATIONAL, EYE ON BRITAIN and Paralipomena

List of backup or "mirror" sites here or here -- for readers in China or for everyone when blogspot is "down" or failing to update. Email me here (Hotmail address). My Home Pages are here (Academic) or here (Pictorial) or here (Personal)

****************************

The Big Lie of the late 20th century was that Nazism was Rightist. It was in fact typical of the Leftism of its day. It was only to the Right of Stalin's Communism. The very word "Nazi" is a German abbreviation for "National Socialist" (Nationalsozialist) and the full name of Hitler's political party (translated) was "The National Socialist German Workers' Party" (In German: Nationalsozialistische Deutsche Arbeiterpartei)

****************************