Accessibility Statement Skip Navigation
  • Why PRWeb
  • How It Works
  • Who Uses It
  • Pricing
  • Login
  • GDPR
  • Create a Free Account
Return to PRWeb homepage
  • News
  • Resources
  • Contact
When typing in this field, a list of search results will appear and be automatically updated as you type.

Searching for your content...

No results found. Please change your search terms and try again.
  • News in Focus
      • Browse News Releases

      • All News Releases
      • Multimedia Gallery

      • All Multimedia
      • All Photos
      • All Videos
  • Business & Money
      • Auto & Transportation

      • Aerospace, Defense
      • Air Freight
      • Airlines & Aviation
      • Automotive
      • Maritime & Shipbuilding
      • Railroads and Intermodal Transportation
      • Supply Chain/Logistics
      • Transportation, Trucking & Railroad
      • Travel
      • Trucking and Road Transportation
      • View All Auto & Transportation

      • Business Technology

      • Blockchain
      • Broadcast Tech
      • Computer & Electronics
      • Computer Hardware
      • Computer Software
      • Data Analytics
      • Electronic Commerce
      • Electronic Components
      • Electronic Design Automation
      • Financial Technology
      • High Tech Security
      • Internet Technology
      • Nanotechnology
      • Networks
      • Peripherals
      • Semiconductors
      • View All Business Technology

      • Entertain­ment & Media

      • Advertising
      • Art
      • Books
      • Entertainment
      • Film and Motion Picture
      • Magazines
      • Music
      • Publishing & Information Services
      • Radio & Podcast
      • Television
      • View All Entertain­ment & Media

      • Financial Services & Investing

      • Accounting News & Issues
      • Acquisitions, Mergers and Takeovers
      • Banking & Financial Services
      • Bankruptcy
      • Bond & Stock Ratings
      • Conference Call Announcements
      • Contracts
      • Cryptocurrency
      • Dividends
      • Earnings
      • Earnings Forecasts & Projections
      • Financing Agreements
      • Insurance
      • Investments Opinions
      • Joint Ventures
      • Mutual Funds
      • Private Placement
      • Real Estate
      • Restructuring & Recapitalization
      • Sales Reports
      • Shareholder Activism
      • Shareholder Meetings
      • Stock Offering
      • Stock Split
      • Venture Capital
      • View All Financial Services & Investing

      • General Business

      • Awards
      • Commercial Real Estate
      • Corporate Expansion
      • Earnings
      • Environmental, Social and Governance (ESG)
      • Human Resource & Workforce Management
      • Licensing
      • New Products & Services
      • Obituaries
      • Outsourcing Businesses
      • Overseas Real Estate (non-US)
      • Personnel Announcements
      • Real Estate Transactions
      • Residential Real Estate
      • Small Business Services
      • Socially Responsible Investing
      • Surveys, Polls and Research
      • Trade Show News
      • View All General Business

  • Science & Tech
      • Consumer Technology

      • Artificial Intelligence
      • Blockchain
      • Cloud Computing/Internet of Things
      • Computer Electronics
      • Computer Hardware
      • Computer Software
      • Consumer Electronics
      • Cryptocurrency
      • Data Analytics
      • Electronic Commerce
      • Electronic Gaming
      • Financial Technology
      • Mobile Entertainment
      • Multimedia & Internet
      • Peripherals
      • Social Media
      • STEM (Science, Tech, Engineering, Math)
      • Supply Chain/Logistics
      • Wireless Communications
      • View All Consumer Technology

      • Energy & Natural Resources

      • Alternative Energies
      • Chemical
      • Electrical Utilities
      • Gas
      • General Manufacturing
      • Mining
      • Mining & Metals
      • Oil & Energy
      • Oil and Gas Discoveries
      • Utilities
      • Water Utilities
      • View All Energy & Natural Resources

      • Environ­ment

      • Conservation & Recycling
      • Environmental Issues
      • Environmental Policy
      • Environmental Products & Services
      • Green Technology
      • Natural Disasters
      • View All Environ­ment

      • Heavy Industry & Manufacturing

      • Aerospace & Defense
      • Agriculture
      • Chemical
      • Construction & Building
      • General Manufacturing
      • HVAC (Heating, Ventilation and Air-Conditioning)
      • Machinery
      • Machine Tools, Metalworking and Metallurgy
      • Mining
      • Mining & Metals
      • Paper, Forest Products & Containers
      • Precious Metals
      • Textiles
      • Tobacco
      • View All Heavy Industry & Manufacturing

      • Telecomm­unications

      • Carriers and Services
      • Mobile Entertainment
      • Networks
      • Peripherals
      • Telecommunications Equipment
      • Telecommunications Industry
      • VoIP (Voice over Internet Protocol)
      • Wireless Communications
      • View All Telecomm­unications

  • Lifestyle & Health
      • Consumer Products & Retail

      • Animals & Pets
      • Beers, Wines and Spirits
      • Beverages
      • Bridal Services
      • Cannabis
      • Cosmetics and Personal Care
      • Fashion
      • Food & Beverages
      • Furniture and Furnishings
      • Home Improvement
      • Household, Consumer & Cosmetics
      • Household Products
      • Jewelry
      • Non-Alcoholic Beverages
      • Office Products
      • Organic Food
      • Product Recalls
      • Restaurants
      • Retail
      • Supermarkets
      • Toys
      • View All Consumer Products & Retail

      • Entertain­ment & Media

      • Advertising
      • Art
      • Books
      • Entertainment
      • Film and Motion Picture
      • Magazines
      • Music
      • Publishing & Information Services
      • Radio & Podcast
      • Television
      • View All Entertain­ment & Media

      • Health

      • Biometrics
      • Biotechnology
      • Clinical Trials & Medical Discoveries
      • Dentistry
      • FDA Approval
      • Fitness/Wellness
      • Health Care & Hospitals
      • Health Insurance
      • Infection Control
      • International Medical Approval
      • Medical Equipment
      • Medical Pharmaceuticals
      • Mental Health
      • Pharmaceuticals
      • Supplementary Medicine
      • View All Health

      • Sports

      • General Sports
      • Outdoors, Camping & Hiking
      • Sporting Events
      • Sports Equipment & Accessories
      • View All Sports

      • Travel

      • Amusement Parks and Tourist Attractions
      • Gambling & Casinos
      • Hotels and Resorts
      • Leisure & Tourism
      • Outdoors, Camping & Hiking
      • Passenger Aviation
      • Travel Industry
      • View All Travel

  • Policy & Public Interest
      • Policy & Public Interest

      • Advocacy Group Opinion
      • Animal Welfare
      • Congressional & Presidential Campaigns
      • Corporate Social Responsibility
      • Domestic Policy
      • Economic News, Trends, Analysis
      • Education
      • Environmental
      • European Government
      • FDA Approval
      • Federal and State Legislation
      • Federal Executive Branch & Agency
      • Foreign Policy & International Affairs
      • Homeland Security
      • Labor & Union
      • Legal Issues
      • Natural Disasters
      • Not For Profit
      • Patent Law
      • Public Safety
      • Trade Policy
      • U.S. State Policy
      • View All Policy & Public Interest

  • People & Culture
      • People & Culture

      • Aboriginal, First Nations & Native American
      • African American
      • Asian American
      • Children
      • Diversity, Equity & Inclusion
      • Hispanic
      • Lesbian, Gay & Bisexual
      • Men's Interest
      • People with Disabilities
      • Religion
      • Senior Citizens
      • Veterans
      • Women
      • View All People & Culture

  • Hamburger menu
  • Cision PRWeb provides efficient communication tools to continuously engage with target audiences across multiple online channels
  • Create a Free Account
    • ALL CONTACT INFO
    • Contact Us


      11AM ET Sunday – 8PM ET Friday

  • Send a Release
  • Sign up
  • Log in
  • Resources
  • RSS
  • GDPR
  • News in Focus
    • Browse All News
    • Multimedia Gallery
  • Business & Money
    • Auto & Transportation
    • Business Technology
    • Entertain­ment & Media
    • Financial Services & Investing
    • General Business
  • Science & Tech
    • Consumer Technology
    • Energy & Natural Resources
    • Environ­ment
    • Heavy Industry & Manufacturing
    • Telecomm­unications
  • Lifestyle & Health
    • Consumer Products & Retail
    • Entertain­ment & Media
    • Health
    • Sports
    • Travel
  • Policy & Public Interest
  • People & Culture
    • People & Culture
  • Send a Release
  • Sign up
  • Log in
  • Resources
  • RSS
  • GDPR
  • Send a Release
  • Sign up
  • Log in
  • Resources
  • RSS
  • GDPR
  • Send a Release
  • Sign up
  • Log in
  • Resources
  • RSS
  • GDPR

Artificial Intelligence-Generated Scientific Literature May Contain Fabricated Sources and Incorrect Information Study Finds


News provided by

The American Academy of Allergy, Asthma & Immunology (AAAAI)

Nov 14, 2023, 14:00 ET

Share this article

Share toX

Share this article

Share toX

AAAAI
AAAAI

After being prompted for the creation of scientific articles, more than 40% of the sources cited by the chatbot were fabricated according to research from JACI: In Practice, an official journal of the AAAAI.

MILWAUKEE, Wiss., Nov. 14, 2023 /PRNewswire-PRWeb/ -- Artificial intelligence has the potential to create scientific medical literature and reviews in the future, but current AI technology has been shown to produce inaccurate information with fabricated references according to new research from The Journal of Allergy and Clinical Immunology: In Practice (JACI: In Practice), an official journal of the American Academy of Allergy, Asthma & Immunology (AAAAI).

Researchers at Penn State College of Medicine tasked a chatbot, generative pre-trained transformer (GPT-4), with a series of complex prompts to create two 1,000-word scientific mini-review articles on the topics of hereditary angioedema (HAE) and eosinophilic esophagitis (EoE), with the intention of evaluating the factual accuracy of output, appropriateness of language, and contents included in the AI-created review articles. Upon examination, the mini-reviews were found to include some cases of potential plagiarism, inaccurate information and fabricated references, suggesting that the AI-generated content lacked depth and did not appear to be the result of an analytical process.

Despite being provided instruction to utilize scientific references, more than 40% of cited sources were fabricated.

Post this

Researchers critically appraised the chatbot min-review papers using a modified Joanna Briggs Institute (JBI) assessment tool and found that the language and structure of the reviews appeared clearly presented and articulated, however, the AI chatbot failed to fully utilize the 1,000-word prompt limit, creating reviews with only 653 words and 805 words. Similarly, despite being provided instruction to utilize scientific references, more than 40% of cited sources were fabricated. Forty-six percent of the articles cited for the HAE mini-review and 47% of those cited for the EoE mini-review did not exist. Of the remaining references, 31% were real but did not include the information that was cited by the AI chatbot. Of the legitimate references, 85% were freely available and only two required a subscription, suggesting bias in the completed reviews.

According to the study, "The basis of a strong scientific review article is the quality of sources used to aggregate data, and therefore this is a glaring fault and shortcoming of the AI which makes it an unreliable source for review article generation."

Plagiarism was another area of concern for researchers. Though the two mini-reviews in the study passed grammar checks, plagiarism checks identified 16% plagiarism in the HAE review article, and 24% in the EoE review article. Upon careful examination of the plagiarized sentences, the plagiarism was found primarily in reference to well-established information and therefore, may not represent an actual case of plagiarism. Additional research is needed to determine AI capabilities surrounding the creation of original articles.

"The ability of artificial intelligence to synthesize and summarize medical literature holds the potential for changing the landscape of scientific writing. However, at its current nascent stage, it carries a risk of distributing fabricated information and can very well overlook critical information necessary for the readers of medical journals especially when addressing specialized topics such as allergic and immunologic disorders," says Taha Al-Shaikhly, MBChB, FAAAAI, corresponding author for the study.

While there is limited research on this topic, there is concern that AI could be used to generate false research in a convincing manner with nonexistent data. This research is a necessary step in better understanding new tools in scientific research and can hopefully inform future efforts to distinguish between artificially generated and human literature. Additional, expanded research will be valuable to understand and utilize AI in scientific literature according to the study.

Read the full study.

The American Academy of Allergy, Asthma & Immunology (AAAAI) is the leading membership organization of more than 7,100 allergists, asthma specialists, clinical immunologists, allied health professionals and other professionals with a special interest in the research and treatment of allergic and immunologic diseases. Established in 1943, the AAAAI has more than 7,100 members in the United States, Canada and 72 other countries and is the go-to resource for patients living with allergies, asthma and immune deficiency disorders.

Media Contact

Candace Archie, The American Academy of Allergy, Asthma & Immunology (AAAAI), (414) 272-6071, [email protected], aaaai.org

SOURCE The American Academy of Allergy, Asthma & Immunology (AAAAI)

Modal title

Contact PRWeb

  • 11AM ET Sunday – 8PM ET Friday
  • Contact Us

About PRWeb

  • About PRWeb
  • Partners
  • Partnership Programs
  • Editorial Guidelines
  • Resources

Why PRWeb

  • Why PRWeb
  • How It Works
  • Who Uses It
  • Pricing

Accounts

  • Create a Free Account
  • Log in
  • Contact Us

Do not sell or share my personal information:

  • Submit via [email protected] 
  • Call Privacy toll-free: 877-297-8921

Contact Cision

Products

About

My Services
  • All News Releases
  • Online Member Center
  • ProfNet
Cision Distribution Helpline
888-776-0942
  • Legal
  • Site Map
  • RSS
  • Cookie Settings
Copyright © 2025 Cision US Inc.