Meaningful Use: The Elephant IS In The Room

Comparative Effectiveness:  a  comparison of the impact of different options that are available for treating a given  medical condition for a particular set of patients. Such studies may compare  similar treatments, such as competing drugs, or they may analyze very different  approaches, such as surgery and drug therapy. The analysis may focus only on the relative medical benefits and risks of each option, or it may go on to weigh both the costs and the benefits of those options.


I am afraid that by focusing so much on HITECH and on the definition of Meaningful Use and Certification on this blog we have been missing on the most important part of the “ARRA” stimulus package , the initial $1.1 bn. funding of Comparative Effectiveness Research (CER) to be spent by Sep. 2010. Specifically some of the $400 millions to be used at the discretion of  the DHHS Secretary that must be allocated to encourage the development and use of clinical registries, clinical data networks, and other forms of electronic health data that can be used to generate or obtain outcomes data. It certainly looks like the national  implementation of EHRs may become fully intertwined with CER.

The minimum definition of “Meaningful Use” as defined in ARRA includes e-prescribing, electronic exchange of medical information and interoperability. These are also the necessary elements to start implementing a national CER strategy.  There is just too much at stake this time to think it won’t happen.

e-Patients should become informed about the potential impact of CER for future care. Please read the summary of the “Listening Session of the Federal Coordinating Council for Comparative Effectiveness Research” from April 14, 2009 to get a better understanding why we, the patients & patient groups, must get directly involved in helping to develop the CER private/public infrastructure & activities.

The Administration’s Real Focus: CER

Peter Orszag, White House Budget Director, produced a study on CER (“Research on the Comparative Effectiveness of Medical Treatments“)  when he was director of the Congressional Budget Office (CBO).  He held that position during 2007 and 2008, where he emerged as a forceful advocate of controlling entitlement spending and improving the effectiveness of the health system. His current position puts him in the center of the Obama administration’s health policy circle.  Twice this week he has spoken about CER. First in an NPR interview on May 12:

Some of the cost-saving measures discussed by the coalition representatives involve computerizing medical records and coordinating care, but other initiatives are more controversial — including the use of comparative effectiveness research in patient care.

A few months ago, as part of ARRA there was controversy over the use of CER and yesterday at the meeting with the President the incoming head of the AMA and the representative of the pharmaceutical industry both embraced CER.”

This was followed by an opinion piece in the Wall Street Journal:

How can we move toward a high-quality, lower-cost system? There are four key steps:

  1. health information technology, because we can’t improve what we don’t measure;
  2. more research into what works and what doesn’t, so doctors don’t recommend treatments that don’t improve health;…

Why is this so significant? What follows are a few quotes from the 2007 CBO document produced under his supervision:

[..]The rate at which health care costs grow relative to income is the most important determinant of the country’s long-term fiscal balance; it exerts a significantly larger influence on the budget over the long term than other commonly cited factors, such as the aging of the population or the coming retirement of the baby-boom generation. Rising health care costs represent a challenge not only for the federal government but also for private payers.

In addition, because federal health insurance programs play such a large role in financing  medical care and account for such a large share of the budget, the federal government itself has an interest in generating evaluations of the effectiveness of different approaches to health care.

[..]Generating evidence that compares treatments is what research on “comparative effectiveness” does.

Orszag may have been the CER main proponent until now but there is clearly a concerted effort by the administration to ramp up public mentions of CER. During the Senate hearings on her confirmation, HHS Secretary nominee, Kansas Gov. Kathleen Sebelius, spoke of her support for the use of electronic medical records as a way of data mining patient information:

EHR data is crucial to conduct “comparative effectiveness research [CER] to provide information on the relative strengths and weaknesses of alternative medical interventions to health providers and consumers.”

AHRQ (Agency for Healthcare Research and Quality) is the lead agency of the federal government doing CER since 2005 and has been allocated $300 million for CER. Carolyn M. Clancy, M.D., Director of AHRQ has been speaking about CER for a long while. In a 2007 congressional testimony she said:

I would like to mention briefly the role of health IT, which will make it easier for researchers to gather information for their research and for users of research findings to get information in real time when they need it.  The health care system’s growing investments in health IT provide us with an unprecedented opportunity for redefining the possibilities of observational studies, accelerating and targeting the uptake of relevant information, and providing feedback to the biomedical enterprise itself.

Health IT will make it possible for research to answer the pressing questions facing the health care system more quickly and efficiently.  In the future, health IT will provide us with the vehicle for transforming our health services research enterprise so that we can evaluate the effectiveness of interventions and treatments in real time as a byproduct of providing care.

Why The push To Use CER?

There are so many more clinical options now than ever before, with new products and services flowing into the market, that questions about evidence of effectiveness, quality, and value have reached unparalleled intensity.

Until now most medical evidence has been derived from randomized controlled trials (RCT). However, there is growing recognition that most questions relevant to everyday clinical practice cannot be addressed by RCTs. There is a real need to devise other means of creating evidence in a timely manner. There is clearly a major interest by many to extract evidence from electronic health records (EHR) data and use that evidence to conduct CER studies. Integrated systems like Geisinger or Kaiser Permanente have not been waiting for Federal funding to start conducting such studies.

For Kaiser, “the goal is to figure out under what circumstances is a given therapy best for certain patients“. To achieve that, a team of pharmacists, doctors and other researchers have been conducting CER, “scouring the globe” for data on how well medications, devices and procedures work. To date, most of the comparative effectiveness research has focused on drug therapy. Research it has conducted on various cholesterol-lowering drugs, for example, has led Kaiser to recommend that its clinicians prescribe generic simvastatin as a first-line treatment for patients with heart disease or diabetes. If that doesn’t work, the dose is doubled. If that doesn’t get the patient’s cholesterol under control, the guidelines suggest adding other drugs.

By its own estimates Kaiser, using data from the CER, has saved so far:

  • $70 million on treatments for high blood pressure,
  • $80 million on antidepressants and
  • about $100 million on cholesterol-lowering medicines.

And now it is expanding the CE program, using an in-house joint registry database with details about replacement hips, knees, and other similar surgical procedures. Clinicians and their patients can consult the database to help them decide which device is most appropriate, given each patient’s age and level of activity. A risk calculator tells patients what they can expect in terms of likelihood of infection and replacement joint failure based on Kaiser’s experience with a particular device. There is at least one clear advantage for this database. Before the registry, clinicians were getting the bulk of their information from vendors and manufacturers’ representatives.

The Public View On EHR/CER

A recent NPR/Kaiser Family Foundation poll shows that the American public is surprisingly more positive about the potentials of EHRs than most professionals. People already are familiar with computerized information and accept its risks.

People do their banking. They certainly do shopping these days by electronic means, and so in any of those cases you find people concerned about their privacy, but people are still doing it. They see enough of an upside for the convenience.

Mollyann Brodie, director of Kaiser Family Foundation’s Public Opinion and Survey Research program (, 4/22).

It may be that the public is unaware of the kind of data mining that is already one with their financial information. It puts to shame any potential use of EHR data for CER! Read the NY Times article “What Does Your Credit-Card Company Know About You?”

When it comes to CER this poll also found that

  • a majority of U.S. adults (55%) would trust a panel of experts from an independent scientific organization to make recommendations about which treatments should be covered by insurers, but
  • fewer people (41%) would trust if the panel’s experts are described as being “appointed by the federal government.”

Mollyann Brodie said that people are concerned that their physicians would not have control over their health decisions.

People are really trusting of their individual doctors, and a lot of experts might say that that’s, you know, misplaced trust, that the doctors don’t have all the information they need. But it is the individual doctors that the public most trusts to make these decisions.

That corresponds to the data from the Pew Internet Project.

So, one thing is clear: the way comparative effectiveness research is framed is critical to how it is likely to be received. If it is seen as simply another attempt by payers to control costs, doctors, patients and the public at large are likely to resist the concept.

Although the final text of ARRA removed earlier drafts references to comparative cost-effectiveness we can be quite certain that this will come back. Comparative cost-effectiveness analysis, brings economics into the equation and seeks to establish which of several therapeutic strategies is capable of achieving a given therapeutic goal at the least-cost strategy. No wonder it has had such forceful opposition from most professional medical societies and the pharmaceutical industry!

You can be sure that we haven’t seen yet the big fight over healthcare reform. And you can be sure it will be directly related with the implementation of CER and it’s use to help us decide what procedures should be used to treat patients, individually, locally or nationally.


Posted in: general | medical records | policy issues | reforming hc | trends & principles




19 Responses to “Meaningful Use: The Elephant IS In The Room”

  1. “Meaningful Use: The Elephant IS In The Room”, my take on CER & EHR

  2. Gilles,
    Excellent post! Thanks for raising the profile of CER & health content in general. My experience is with the content — i.e. information — part of IT, and I’ve observed the evolution of “evidence-based medicine” (EBM) for many years. Most medical publishers are moving up the value chain from publishing journal articles and medical textbook to providing EBM decision support systems that rely on technology as much as content. I remember quoting Nancy McKinstry, CEO of Wolters Kluwer, when she said that they were hiring more programmers than editorial staff to bolster their IT capabilities, and that was about 3 years ago. Why don’t we hear more about Health IT vendors that want to learn more about content/data that flows through their systems?

    CER and EBM are closely related and both enabled by digital content. For now, most EBM & CER is based on RCTs (I looked over one recent very long CER study on arthritis of the knee on AHRQ’s site: ), but as you point out, with more digital content being generated via EHRs and disease registries, more comprehensive studies will be possible. How they will be used & regulated is an open question.

    You’ve provided a great jumping off point to generate discussion of CER and EBM in your post. I’m working on an article related to this topic this week. I’ll post a link here and on Twitter (@janicemccallum) when it’s completed.

    Also, you may find it amusing that one of the working titles I have for our fall Health Content conference is: “Health Content: The Meaning in Meaningful Use”.

  3. SusannahFox says:

    RT @gfry “Meaningful Use: The Elephant IS In The Room”, my take on CER & EHR

  4. Howard Luks says:

    I personally believe that CER will be utilized to ration care… we’ll see.

  5. @hjluks Interesting that you think too many tests R done but do not like CER. KP has very positive experience withe CER

  6. […] of each option, or it may go on to weigh both the costs and the benefits of those options.” Article Gilles Frydman,, 18 May […]

  7. ePatientDave says:

    RT @gfry “Meaningful Use: The Elephant IS In The Room”, my take on CER & EHR << lots to chew on here

  8. SusannahFox says:

    RT @gfry "Meaningful Use: The Elephant IS In The Room", my take on CER & EHR

  9. Cindy Throop says:

    Yep RT ePatientDave @gfry “Meaningful Use: The Elephant IS In The Room”, my take on CER & EHR << lots to chew on here

  10. @healthythinker The W. Post article never mentions CER by name. I did:

  11. Wendy says:

    Dear Gilles,

    I just returned from a summit on rare disorders in DC and this was a topic of great concern. 70% of the medication prescribed for patients with rare disorders are prescribed off-label and because of insurance limitations many of these diseases may not be properly identified in databases. The discussion centered around how to change the process for getting new therapies through the FDA when having a two armed multi-thousand person study is not possible. All of this without compromising the safety and efficacy of the therapies. With patients with rare disorders comprising upwards of 30 million people this is a big issue.

    One quote from an FDA spokesman I particularity liked was that most of the science we have learned about how the body works we have learned from studying patients with rare disorders. It is at this end of the spectrum that innovation happens. It would not be good for anyone if comparative effectiveness ends up compromising or even worse stifling innovation.

  12. RT @gfry "Meaningful Use: The Elephant IS In The Room", my take on CER & EHR << lots to chew on here

  13. RT @gfry “Meaningful Use: The Elephant IS In The Room”, my take on CER & EHR << lots to chew on here

  14. nyhto says:

    RT @gfry "Meaningful Use: The Elephant IS In The Room", my take on CER & EHR << lots to chew on here

  15. Jamie says:

    I believe i understand why patients have much more hope than professionals regarding EHR implementation and advantages.

    From outside of Health IT, our jobs IN Health IT look really simple. I mean, it’s obvious to EVERYONE that there should be a computer on everyone’s desk, right?

    Sure. Everyone else but doctors, nurses, and technicians that have their hands full with delivering care. If they scrimped on that part, we always hear about it. Additionally people are willing to accept ‘risks’ when they are just that general — when you get into the specifics of incorrect data, coding, data sources, and possible injury — are they really willing to accept the REAL risks? How about the case in Virginia where someone held a prescription data file hostage — would you feel OK if your information was compromised? Or would you turn on the very system that you gave the go ahead? These are the questions that professionals in my field face (and honestly they are questions that keep me up late at night worrying about).

    What I’m concerned about ARE definitions like meaningful use. For instance — interoperability sounds REALLY good, the actualities of implementing it are extremely complex. You would need to arrive at a national data standard, adhere to it, and make everyone else adhere to it, too. Would this include private clinics? Who would be required to adhere to it, and how would it be monitored? It’s hard to get one system to talk to another via HL7, much less introduce every other system in the United States.

    I can make databases talk to each other — the art comes in making them not say four letter words. For healthcare, it’s not that we are lacking technology. We are lacking people with implementation experience, and we are lacking an overall focus on real standards, and not just cute catchphrases.

    I really believe in what I do, and I really want it to make patient care better. Part of my concern about overall data sharing comes from physicians themselves — often, THEY want to ‘own’ that data, when in reality it is a joint ownership — where the patient has a huge stake. And, it’s easy to sign a form consenting to research without even realizing it during the intake process.

    This is a really great look at what the future holds, but I would be much more likely to buy into the concept of CER if data in ONE CLINIC could be absolutely clean 100% of the time — and that is simply not the case. Then you add in all the EHR flavors, all the people who use it — and you end up with a field very difficult to standardize.

    The current reporting standardization that you see in place is normally met by extreme amounts of data transformation, and usually a large scale amount of registrars and other FTE’s that have to get the data into that format. . .

    Anyway, just a few thoughts from my lunch break. . .

  16. […] » Meaningful Use: The Elephant IS In The Room | […]

  17. John Kaphal says:

    Greater coordinated care can be achieved by interfacing the EMR system with hospital
    clinical applications, resulting in a more complete care assessment and reduced
    critical errors.Hence it must be implemented.

  18. Eddy Mertens says:

    Not sure if you know this or not butyour blog doesnt load properly when using opera. thought I should let you know

  19. So rather than write a long winded reply in the comments section, I thought i would do a short blog.

Leave a Reply