Skip to Main Content

HS 1363: Intro to Public Health

Research vs Not Research Evidence vs Not Evidence

How to Evaluate Information Resources

 

When evaluating information, look for these things:

  • Accuracy
    • Where did the information come from? Do other information sources say the same thing? Confirm
    • Peer-Reviewed?
    • Are sources cited? Are those sources up-to-date?
  • Authority
    • Is the author identified by name? Does the author have credentials in the subject area of the topic? (College degree? Certification?) 
    • Does the author have training as well as real experience in the area of the topic? (Work history)
    • Does the author provide contact information? Email? Physical Address?
    • Where is the information published? (geographic location, web address domain)
  • Relevance
    • Does the information source provide information directly about the topic? (pieces of info are not taken out of context)
    • Are all sides of an issue addressed?
    • What audience is the information source targeting? (children, adults, professionals)
  • Currency
    • Is the information timely or stale?
    • What is the date of publication? When was the last update? No date? Don't Use!
    • Are links functional?
    • Are facts listed in the text still correct?
    • How old is too old for your topic? Is your topic evolving quickly?
  • Purpose
    • Is the information informing, teaching, selling, persuading, or entertaining?
    • Does the information provide facts, opinions, or propaganda?
    • Is the author's point of view objective? impartial?
    • Can you identify the author's political, ideological, cultural, religious, institutional, or personal biases?
  1. Is the journal credible (not predatory)? Check Ulrich's Periodicals database.
  2. Is the journal peer-reviewed or refereed? Check Ulrich's Periodicals database.
  3. Is the author identified?
  4. Are the author's credentials shared?
  5. What is the date of publication?
  6. Knowing the article publication cycle takes 6-18 months, are cited resources timely?
  7. Is the article well written? Scholarly? Academic? Who is the target audience?
  8. Are sources cited? Are citations accurate? Is the citation style followed correctly?
  9. Does the article offer all necessary information? Nothing missing?
  10. Does the author correctly follow the steps indicated by the research method? Ex. If an RCT, is method of randomization explained?
  11. Do the results make sense? Are statistics displayed in a meaningful way or are they a jumble? Do the stats add up?
  12. Are the conclusions reasonable?
  1. Who is the publisher? Is the book self-published or published by a recognized publisher?
  2. Does the book have an ISBN?
  3. Who is the author? Are the author's credentials shared? 
  4. What is the publication date? The publication cycle for a book is approximately 2 years. Is the information current up to 2 years?
  5. Is the Table of Contents comprehensive?  Are issues or subtopic areas missing?
  6. Are sources cited?
  7. Is an index provided?

 

  1. Who owns the website? Who is responsible for the website? (FDA, CDC, TWU, etc.)
  2. Is the author of the webpage text identified? Are credentials provided?
  3. What is the date of publication of the text or the last date updated? (not the same as last date updated for the entire website)
  4. Do links work?
  5. Are citations provided? Do citations follow appropriate citation style? Are citations accurate

QUESTIONS to challenge you:

Is Ivermectin horse medicine?   

Answer: Think Background Information

  • Is Ivermectin useful in human medicine?
  • Where did the label "horse medicine" label come from?
    • Was that person a veterinarian?
    • Was that person a human medicine doctor?
  • Is the label accurate?
  • Does the label 'horse medicine' mislead? Why?

WHAT IS THE REAL QUESTION?

Is Ivermectin an effective therapeutic for COVID-19?

ANSWER: Check original research studies, not books, not websites, not expert opinion.

  1. Check research studies post 2020.
  2. Check background on viral infection process from date of infection to resolution of infection. 
  3. Check research method used. Are all steps followed? Are all details explicitly stated?
  4. Check dosage and administration. (per age, weight, etc.)
  5. Check number of participants
  6. Check number of drop outs.
  7. Check stats. Do they add up? Do they make sense? Are they presented effectively?

Do masks prevent airborne transmission of respiratory viruses?

ANSWER:

  1. Use research studies, not books, not websites, not expert opinion.
  2. Check journal source.
  3. Check research method. Was the method performed correctly?
  4. Check statistics. Do they add up? Do they make sense?
  5. Read CAREFULLY for what is said and not said in the conclusion.
  6. Check for "strength of evidence."
  • High-quality international resources.
  • High-quality research methodology.
  • Highly qualified researchers with credentials, training, and experience.
  • Large data set so results are generalizable to the world.
  • Research shows no difference in outcome with wearing a mask or not wearing a mask.

This study does NOT say masks work.

This study does NOT say masks do not work.

Evidence strength at this moment in time is weak.