“AI might disregard a drug candidate that would have worked, direct researchers toward an ineffective treatment, conceal a genuine biological effect, or make a nonexistent disease mechanism look like a discovery.”

ScienceAlert / Mastodon · Generative AI fabricates species in citizen science platforms, threatens research integrity

“Most of the time, the problem is not about comparing a hallucination and a genuine biological discovery side by side. It is more about real data having been corrupted by hallucination along the course of the complex computational (genAI-aided) workflow that makes it possible to turn raw signals acquired with complex biotechnologies into biologically valid descriptions of molecular mechanisms.”

ScienceAlert / Mastodon · Generative AI fabricates species in citizen science platforms, threatens research integrity

“I have never thought about that so far, but I guess it is possible to have hallucinations that lead to genuine discoveries.”

ScienceAlert / Mastodon · Generative AI fabricates species in citizen science platforms, threatens research integrity