INT 111 College Foundations: Evaluating Information

When considering information you need to first determine if the information is legitimate and authoritative; for this you need to determine the source of the information, as well as their background and reputation. Further, you should consider the reason the source of the information provided the information -- this can help you determine if the information is objective (free of opinion) or biased. As you consider the information, it is also a good habit to look for factual errors, spelling, and grammar errors - hints that can provide clues relating to the expertise of the author(s).

Once you understand these facets of the information you can consider other aspects, including when the information was published - up-to-date information is often required/preferred for personal decisions and research projects.

In addition, information is usually prepared with an audience in mind, based on education level and/or the purpose of information - for example, a brief overview for general information for a general audience versus in-depth scholarly research for professionals, etc.

These criteria can help guide you through the evaluation process:

Authority

• Who provided the information?  Is the name of the source of the information provided?  If so, are credentials provided?
• Is the source considered an expert in the field?
• If the information is published, has it been published by a reputable organization or publisher?
• Is the work self-published? (Via a blog or by a "vanity press" - one that will publish anything for a fee.) While self-publication does not automatically mean the work is not authoritative, it is essential that the researcher be able to identify the author and have enough information about the author to establish their authority.

Here are a few generalizations relating to this criteria:
(Keeping in mind that for this and other criteria there are always exceptions)

• University presses publish high quality materials.
• Information found on .gov websites is usually considered authoritative.
• Professional organizations and associations are generally considered authoritative publishers of information relating to their professions.
• Major newspapers and news sites on the Internet (CNN, NPR, Fox, NBC, etc.) are usually considered authoritative in relation to the what, when, where, aspects of news stories. There can be bias in relation to the why something happened or explaining the implications, etc.
  
  A news organization's ownership will help form its editorial stance and in turn can influence what news stories receive the most coverage, which aspects of causes and/or implications to concentrate on, etc.
  
  For example: A decision is made to stop construction of a pipeline. One news organization might inform the audience of this and follow up with an environmental expert voicing their support for the decision while outlining the benefits to wildlife and the environment. On a competing network, the same information relating to construction ceasing is provided, followed by an interview with a pipeline employee who is losing their job.

See the Scope criteria for some related information on authorship authority for different types of publications.

See the Objectivity criteria for additional information on bias.

Accuracy

Closely related to authority, you also need to consider how accurate the information is and how well it is presented and documented.

• If you have any knowledge of the subject, does the content seem accurate?  If you do not have knowledge of the content, look at different sources and compare the content.
• Are sources cited in a bibliography?
• Are there obvious spelling or grammar errors?
• Does the information correspond with what you have learned from other sources?
• Are sources primary or secondary?

Objectivity

• If the page relates to a controversial topic, are both sides of the argument represented evenly?
• Many biased pages will feature strongly worded statements, providing "facts" which may or may not be supported by evidence and documentation – if sources are documented often it is useful to locate the documented sources and draw your own conclusions about the issue.
• What is the purpose of the information?
  
  Example: You are researching the best children's car seat to purchase. Would the company creating their advertisement for their own product include information about injuries children have sustained due to the design of their seat? If the information is designed to sell something, negative information about the product or service will likely not be provided.
   

Here are a few generalizations relating to this criteria:
(Keeping in mind that for this and other criteria there are always exceptions)

• Discerning bias and taking it into account is one of the most important aspects of thinking critically about sources of information.
• Locating sources with bias does not mean that you should not use them in your research, but you do need to understand that different groups of people will have different views on topics and often these views will often cause groups or authors to present information in ways that support their own viewpoints.
• Ideally, you should try to locate sources from multiple points of view on controversial topics and after weighing the arguments and looking at cited evidence yourself you will form your own conclusions about the topic.

Currency

• When was the information actually written?
• When was it last updated?
• If the source is an Internet page, how current are the links?

Scope

• Is the coverage in-depth or superficial?  A topic overview or an in-depth investigation into one aspect of a larger topic?
• Who is the intended audience? Subject experts with advanced college degrees or elementary school children?  Be sure to use an appropriate source.

Here are a few generalizations relating to this criteria:
(Keeping in mind that for this and other criteria there are always exceptions)

• Newspapers, some magazines, Internet news sources, etc. are generally written for the general public. With a 10th grade reading level or so, most people can read and understand the content.
• With the above "general readership" sources, one week a reporter is writing about one topic and the next week he or she will be writing about something else.  In that sense, the authorship as well as the readership is general.
• For scholarly journal sources, the authorship is very much subject specific - the author(s) will have advanced degrees relating to the topic as will  the editors of the journal.  Many of the readers of the articles will have degrees relating to the topic as well.

How do you evaluate sources provided by AI tools?

Answer:  In same way you evaluate information obtained by any means. You determine the authority and accuracy of the information, as well as the date of publication, any bias related to the authors or source of information, confirm the intended audience for the content. etc.

There is one major aspect that is different though - be aware that some AI tools will make up or "hallucinate" sources!

If a tool does suggest specific sources to you be sure to confirm (fact-check) them. There have been cases when a hallucinated article citation includes author and/or article and publication information that is close to a real source. Confirm the validity of sources by searching for them in Primo and/or our library databases. A librarian can help you with this.

For this reason, use of AI tools as a means of searching for sources is not recommended - use the tools and resources provided by the JCC Library for that!

In general, how reliable are the ideas / outlines and other information provided by AI tools?

Answer: The output of an AI tool is only as good as the information it has used to generate the content. As we all know, information authority, accuracy, and bias varies widely. Be aware that many AI tools post disclaimers relating to their output, for example:

ChatGPT: Per: https://openai.com/policies/terms-of-use/

Accuracy. Artificial intelligence and machine learning are rapidly evolving fields of study. We are constantly working to improve our Services to make them more accurate, reliable, safe, and beneficial. Given the probabilistic nature of machine learning, use of our Services may, in some situations, result in Output that does not accurately reflect real people, places, or facts. 

When you use our Services you understand and agree:

• Output may not always be accurate. You should not rely on Output from our Services as a sole source of truth or factual information, or as a substitute for professional advice.

• You must evaluate Output for accuracy and appropriateness for your use case, including using human review as appropriate, before using or sharing Output from the Services.

• You must not use any Output relating to a person for any purpose that could have a legal or material impact on that person, such as making credit, educational, employment, housing, insurance, legal, medical, or other important decisions about them. 

• Our Services may provide incomplete, incorrect, or offensive Output that does not represent OpenAI’s views. If Output references any third party products or services, it doesn’t mean the third party endorses or is affiliated with OpenAI.
   

Microsoft Copilot: Per FAQs https://www.microsoft.com/en-us/microsoft-copilot/learn?form=MG0AUO&OCID=MG0AUO#faq

"Copilot aims to base all its responses on reliable sources - but AI can make mistakes, and third-party content on the internet may not always be accurate or reliable. Copilot will sometimes misrepresent the information it finds, and you may see responses that sound convincing but are incomplete, inaccurate, or inappropriate. Use your own judgment and double check the facts before making decisions or taking action based on Copilot’s responses."

How can you identify photos and images generated by AI?

Generative AI can produce very convincing fake images and photographs. The International Association of Better Business Bureaus offers these suggestions for recognizing AI-generated images and videos:

• Consider the context in which the image is offered. Are you being pressured to take immediate action? Is the context political and does it seem someone is trying to make you angry or emotional?  Is the image part of a message relating to a friend or loved one? Don't respond until you contact that person to determine if it is a legitimate message.
• Look closely at the details. Zoom in on a high-resolution image and look for inconsistencies in the image such as missing or incomplete features.
• Examine physical traits of people closely. AI can create asymetric faces, as well as people with too many/too few teeth, fingers, etc. It can also produce images of people with disproportionately sized feet, hands, ears, etc.
• Uneven textures or glossy appearances. Look for airbrushed looking backgrounds and/or backgrounds with random blurriness or textures.
• Shadows, flickers, blurs, etc. Look for uneven/inconsistent shadows, flickers of light in only one part of a video, blurs, etc.
• Look for body language that is unnatural in videos.
• Listen to the audio in videos closely. Listen for inappropriate background noises, sentences that sound unnatural, etc.
• Verify the Source. Attempt to learn who originally provided/published/shared the image or video. If it is shocking or sensational and if you see it on social media, locate information about the content on mainstream media. If it is not covered in the mainstream press it is likely fake news supported by fake images and videos. A reverse image search may help you by searching for all the websites where the image has been shared.

"BBB Tip: How to Identify AI in Photos and Video." Better Business Bureau.

     The International Association of Better Business Bureaus, 2024,

     bbb.org/all/spot-a-scam/how-to-identify-ai.