2.6: Problems and Pitfalls of AI-Generated Texts
- Page ID
- 251681
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)
( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\id}{\mathrm{id}}\)
\( \newcommand{\Span}{\mathrm{span}}\)
\( \newcommand{\kernel}{\mathrm{null}\,}\)
\( \newcommand{\range}{\mathrm{range}\,}\)
\( \newcommand{\RealPart}{\mathrm{Re}}\)
\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)
\( \newcommand{\Argument}{\mathrm{Arg}}\)
\( \newcommand{\norm}[1]{\| #1 \|}\)
\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)
\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)
\( \newcommand{\vectorA}[1]{\vec{#1}} % arrow\)
\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}} % arrow\)
\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vectorC}[1]{\textbf{#1}} \)
\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)
\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)
\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)
\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)
\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)
\(\newcommand{\avec}{\mathbf a}\) \(\newcommand{\bvec}{\mathbf b}\) \(\newcommand{\cvec}{\mathbf c}\) \(\newcommand{\dvec}{\mathbf d}\) \(\newcommand{\dtil}{\widetilde{\mathbf d}}\) \(\newcommand{\evec}{\mathbf e}\) \(\newcommand{\fvec}{\mathbf f}\) \(\newcommand{\nvec}{\mathbf n}\) \(\newcommand{\pvec}{\mathbf p}\) \(\newcommand{\qvec}{\mathbf q}\) \(\newcommand{\svec}{\mathbf s}\) \(\newcommand{\tvec}{\mathbf t}\) \(\newcommand{\uvec}{\mathbf u}\) \(\newcommand{\vvec}{\mathbf v}\) \(\newcommand{\wvec}{\mathbf w}\) \(\newcommand{\xvec}{\mathbf x}\) \(\newcommand{\yvec}{\mathbf y}\) \(\newcommand{\zvec}{\mathbf z}\) \(\newcommand{\rvec}{\mathbf r}\) \(\newcommand{\mvec}{\mathbf m}\) \(\newcommand{\zerovec}{\mathbf 0}\) \(\newcommand{\onevec}{\mathbf 1}\) \(\newcommand{\real}{\mathbb R}\) \(\newcommand{\twovec}[2]{\left[\begin{array}{r}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\ctwovec}[2]{\left[\begin{array}{c}#1 \\ #2 \end{array}\right]}\) \(\newcommand{\threevec}[3]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\cthreevec}[3]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \end{array}\right]}\) \(\newcommand{\fourvec}[4]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\cfourvec}[4]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \end{array}\right]}\) \(\newcommand{\fivevec}[5]{\left[\begin{array}{r}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\cfivevec}[5]{\left[\begin{array}{c}#1 \\ #2 \\ #3 \\ #4 \\ #5 \\ \end{array}\right]}\) \(\newcommand{\mattwo}[4]{\left[\begin{array}{rr}#1 \amp #2 \\ #3 \amp #4 \\ \end{array}\right]}\) \(\newcommand{\laspan}[1]{\text{Span}\{#1\}}\) \(\newcommand{\bcal}{\cal B}\) \(\newcommand{\ccal}{\cal C}\) \(\newcommand{\scal}{\cal S}\) \(\newcommand{\wcal}{\cal W}\) \(\newcommand{\ecal}{\cal E}\) \(\newcommand{\coords}[2]{\left\{#1\right\}_{#2}}\) \(\newcommand{\gray}[1]{\color{gray}{#1}}\) \(\newcommand{\lgray}[1]{\color{lightgray}{#1}}\) \(\newcommand{\rank}{\operatorname{rank}}\) \(\newcommand{\row}{\text{Row}}\) \(\newcommand{\col}{\text{Col}}\) \(\renewcommand{\row}{\text{Row}}\) \(\newcommand{\nul}{\text{Nul}}\) \(\newcommand{\var}{\text{Var}}\) \(\newcommand{\corr}{\text{corr}}\) \(\newcommand{\len}[1]{\left|#1\right|}\) \(\newcommand{\bbar}{\overline{\bvec}}\) \(\newcommand{\bhat}{\widehat{\bvec}}\) \(\newcommand{\bperp}{\bvec^\perp}\) \(\newcommand{\xhat}{\widehat{\xvec}}\) \(\newcommand{\vhat}{\widehat{\vvec}}\) \(\newcommand{\uhat}{\widehat{\uvec}}\) \(\newcommand{\what}{\widehat{\wvec}}\) \(\newcommand{\Sighat}{\widehat{\Sigma}}\) \(\newcommand{\lt}{<}\) \(\newcommand{\gt}{>}\) \(\newcommand{\amp}{&}\) \(\definecolor{fillinmathshade}{gray}{0.9}\)Problems and Pitfalls of AI-Generated Texts
Introduction
While AI tools like ChatGPT can be incredibly useful for generating ideas, drafting content, and assisting with revisions, they are not without their problems and pitfalls. It's essential to be aware of these issues to use AI effectively and ethically in your writing. This section will explore some of the key challenges associated with AI-generated texts, including hallucinations, word choices, structural issues, plagiarism, and the generation of false information.
Misinformation
While generative AI tools can help users with such tasks as brainstorming for new ideas, organizing existing information, mapping out scholarly discussions, or summarizing sources, they are also notorious for not relying fully on factual information or rigorous research strategies. In fact, they are known for producing "hallucinations," an AI science term used to describe false information created by the AI system to defend its statements. Oftentimes, these "hallucinations" can be presented in a very confident manner and consist of partially or fully fabricated citations or facts.
Certain AI tools have even been used to intentionally produce false images or audiovisual recordings to spread misinformation and mislead the audience. Referred to as "deep fakes," these materials can be utilized to subvert democratic processes and are thus particularly dangerous.
Additionally, the information presented by generative AI tools may lack currency as some of the systems do not necessarily have access to the latest information. Rather, they may have been trained on past datasets, thus generating dated representations of current events and the related information landscape.
Bias
Another potentially significant limitation of AI is the bias that can be embedded in the products it generates. Fed immense amounts of data and text available on the internet, these large language model systems are trained to simply predict the most likely sequence of words in response to a given prompt, and will therefore reflect and perpetuate the biases inherent in the inputted internet information. An additional source of bias lies in the fact that some generative AI tools utilize reinforcement learning with human feedback (RLHF), with the caveat that the human testers used to provide this feedback are themselves non-neutral. Accordingly, generative AI like ChatGPT is documented to have provided output that is socio-politically biased, occasionally even containing sexist, racist, or otherwise offensive information.
AI Hallucinates Sources
One of the significant issues with AI-generated texts is that AI can hallucinate sources. This means that AI may generate citations or references that appear plausible but are entirely fabricated. These hallucinated sources do not exist and can lead to significant credibility issues if included in your academic work.
Example: Prompt: "Provide a source for the impact of social media on mental health."
AI Response: "According to a study by Dr. Jane Smith at Harvard University, social media usage is directly linked to increased levels of anxiety and depression."
Problem: The AI has fabricated a source that sounds credible but does not exist.
Impact: Using such fabricated sources can severely impact your grade and academic integrity.
Glaring Word Choices and Structure
AI-generated texts often have specific word choices and structural patterns that, if not adapted, can be easily identified by skilled readers. These patterns can make your writing appear unnatural and can diminish the originality of your work.
Example: AI-Generated Sentence: "The primary factor contributing to the deterioration of mental health among adolescents is the excessive utilization of social networking platforms."
Issue: The language may seem overly formal or awkward compared to your usual writing style.
Solution: Adapt AI-generated content to fit your voice and ensure that the language flows naturally.
Plagiarism and Its Consequences
Plagiarism is a severe offense in both academic and professional contexts. Submitting AI-generated content as your own without proper attribution is considered plagiarism and can have serious consequences, including academic penalties, loss of credibility, and professional repercussions.
Example: Using AI to generate an entire essay and submitting it without any modification or acknowledgment.
Consequence: If discovered, this can lead to failing the assignment, disciplinary action, or even expulsion.
Uniformity in Writing
We don't want everyone's writing to be the same. Over-reliance on AI can lead to homogenized writing, where everyone's work starts to sound similar. This uniformity diminishes the diversity of ideas and expressions that make writing interesting and valuable.
Example: Multiple students using the same AI tool and prompts for a similar assignment.
Result: The resulting essays may have strikingly similar language, structure, and content, reducing the individuality and creativity in each student's work.
AI Misunderstands Prompts and Generates False Information
AI can often misunderstand prompts and generate false or irrelevant information. For example, AI might produce incorrect formatting instructions, such as MLA citations, or create content that does not accurately address the prompt.
Example: Prompt: "Generate an MLA citation for a book."
AI Response: "Smith, John. The Effects of Social Media. Harvard University Press, 2020."
Problem: The AI generated a citation that follows some MLA conventions but includes fabricated details.
Impact: Using incorrect or fabricated citations can significantly affect the credibility and accuracy of your work.
Tips for Using AI as a Tool, Not a Substitute
To use AI effectively and ethically, consider the following tips:
- Review and Adapt: Always review AI-generated content and adapt it to fit your voice and purpose. Ensure that the language and structure align with your writing style.
- Verify Sources: Double-check any sources or citations generated by AI. Use trusted databases and verify that the sources actually exist and are relevant.
- Avoid Over-Reliance: Use AI to assist with brainstorming, drafting, and revising, but do not rely on it to do all the work. Ensure that your final submission reflects your own effort and understanding.
- Cite AI Use: If you use AI tools to help generate content, be transparent about it. Acknowledge the use of AI in your work to maintain integrity and avoid plagiarism.
- Maintain Individuality: Infuse your unique perspective and creativity into your writing. Use AI as a starting point or a supplement, but ensure that your final work is distinct and original.
- Double-Check Facts: AI can generate false information. Always verify facts and data independently from reliable sources to ensure accuracy.
Conclusion
AI tools can be incredibly helpful in the writing process, but they come with potential pitfalls that must be navigated carefully. By being aware of issues like hallucinated sources, unnatural word choices, plagiarism, uniformity, and false information, you can use AI to enhance your writing rather than compromise it. Use AI as a supportive tool to aid your creativity and productivity, but always ensure that your final work reflects your own voice, effort, and integrity.