The Rational ModerateSearch

AI, Governance

Artificial Intelligence: Between Promise and Peril

AI is becoming infrastructure. Here’s what it can actually do today, the benefits worth pursuing, the risks we can’t ignore, and the rules that keep progress from turning into damage.

Checked The full check
  • 9 claims
  • 9 match a source
  • 0 need one
  • 0 unreachable

9 of 9 claims match a source

Claim by claim: what the check found
Each claim in this article and whether it matches a source, checked September 28, 2026
ClaimFinding
Stanford HAI AI Index Report 2025 covers capability, investment, adoption, policy and incidents, with public dataMatches a source
NIST AI Risk Management Framework (AI RMF 1.0), January 2023Matches a source
UK NCSC, "The near-term impact of AI on the cyber threat," January 24, 2024Matches a source
Verizon 2025 Data Breach Investigations ReportMatches a source
AI can help attackers with more convincing phishing, faster malware iteration, automated reconnaissance and vulnerability discoveryMatches a source
AI can help defendersMatches a source
AI is already used for protein structure predictionMatches a source
AI is already used for materials discoveryMatches a source
AI systems trained on historical data can encode and amplify biasMatches a source
Split illustration: "Benefits" shows a doctor explaining a chart to a parent and child, "Risks" shows a deepfake warning
Illustration

Executive summary

AI is not magic, and it is not a moral force. It is a multiplier.

Used well, it can raise productivity, expand access to expertise, and accelerate science.

Used carelessly, it can scale scams, misinformation, discrimination, and job disruption faster than institutions can adapt.

This piece treats both as real. Promise and peril are both real. The outcome depends on choices we make now.


Introduction: the technology that changes everything

AI did not arrive as a single invention. It arrived as a capability stack.

First came narrow prediction systems that could classify images, spot patterns in text, and recommend products. Then came large models that could write, summarize, translate, code, and interact.

What changed was not just performance. It was interface. When AI became conversational, it became usable by non-specialists.

That is why the AI debate has become confusing so quickly. People are trying to answer two different questions at once:

  • What is AI actually good at today?
  • What happens when those capabilities are applied everywhere?

This piece keeps the frame simple.

AI is a multiplier. A multiplier can create value fast. It can also create damage fast. The question is not whether AI will matter. The question is whether the benefits diffuse broadly, and whether the risks are contained.

What AI can actually do today

The best way to cut through hype is to describe AI in terms of tasks.

Today’s systems are especially strong at language, pattern recognition, and generating plausible outputs. That combination can be extraordinarily useful, and occasionally dangerous.

Language and communication

AI systems can now:

  • Draft and edit text quickly.
  • Summarize long documents and extract key points.
  • Translate between languages with useful accuracy.
  • Help structure arguments, plans, and outlines.
  • Provide “good enough” first-pass customer support.

A realistic way to think about this is not that AI “replaces writing.” It reduces the time cost of producing a first draft, and it makes revision faster.

Visual and creative work

Generative models can create images and design variations at high speed.

In many contexts, the value is not that the output is perfect. The value is that iteration is cheap.

For design, advertising, prototyping, and internal mockups, that changes how the work gets done.

For trust and verification, it is destabilizing, because the default assumption that “video is evidence” is no longer safe.

Problem-solving and analysis

AI is increasingly used for:

  • Code completion, debugging, and documentation.
  • Data cleaning and basic analysis.
  • Search and synthesis across large corpora.
  • Drafting spreadsheets, scripts, and simple models.

But there is a trap: the same system that can be impressively helpful can also be confidently wrong. AI can produce plausible nonsense. It can also hide uncertainty.

The practical implication is that AI is best deployed where:

  • errors are easy to detect,
  • humans can verify outputs,
  • and the system’s failures are not catastrophic.

What AI still cannot do well

Despite impressive outputs, current systems often struggle with:

  • Reasoning that holds up in genuinely novel situations.
  • Reliable long-horizon planning.
  • Knowing what they do not know.
  • Causal claims and scientific inference without careful guardrails.

The safest posture is to treat AI as an assistant, not as an authority.

What AI can actually do today, and the catch
AreaWhat AI can doThe catch
Language and communicationDraft and edit text, summarize long documents, translate, structure arguments, and give first-pass customer support.It reduces the time cost of a first draft and makes revision faster; it does not replace writing.
Visual and creative workCreate images and design variations at high speed, so iteration is cheap.For trust and verification it is destabilizing: the assumption that video is evidence is no longer safe.
Problem-solving and analysisCode completion and debugging, data cleaning and basic analysis, search and synthesis, and drafting spreadsheets, scripts, and simple models.It can be confidently wrong and hide uncertainty. It is best where errors are easy to detect, humans can verify outputs, and failures are not catastrophic.
What it still cannot do wellSound reasoning in novel situations, reliable long-horizon planning, knowing what it does not know, and causal claims without careful guardrails.Treat AI as an assistant, not as an authority.

The promise: real benefits worth pursuing

If AI remained a novelty, it would not matter. The reason it matters is that it is starting to function like infrastructure.

Infrastructure changes the production possibilities of an economy.

The benefits are not hypothetical. Many are already visible.

Productivity and economic output

Most work is not a single creative act. It is a chain of small tasks.

AI can reduce the cost of:

  • drafting,
  • searching,
  • summarizing,
  • formatting,
  • triaging,
  • and routine analysis.

That looks like “small” savings, until you apply it across millions of workers and thousands of processes.

The near-term productivity story is not that AI replaces the entire job. It is that it changes the unit economics of knowledge work.

Healthcare and clinical support

The high-upside uses of AI in healthcare are narrow and specific.

AI can:

  • assist with imaging interpretation,
  • help triage and documentation,
  • reduce administrative burden,
  • and help clinicians access relevant information faster.

The promise is not that AI becomes a doctor. The promise is that the average clinician becomes more effective, and that access to expertise becomes less scarce.

Education and tutoring

Education is constrained by attention.

In a world where every student could get personalized feedback and practice, learning becomes more elastic.

AI tutoring will not solve education on its own. But it can expand practice opportunities, provide explanations in different styles, and help teachers manage workload.

Scientific acceleration

AI is already used for:

  • protein structure prediction,
  • materials discovery [5],
  • and rapid hypothesis generation.

The biggest gains here are likely to come from combining domain expertise with AI tools, not from replacing scientists.

Accessibility

Many AI features are accessibility features.

Real-time captioning, image description, summarization, translation, and speech support are not luxuries. They change who can participate.

The promise: benefits worth pursuing
AreaWhat AI can doThe realistic promise
ProductivityReduce the cost of drafting, searching, summarizing, formatting, triaging, and routine analysis.Not replacing the entire job, but changing the unit economics of knowledge work.
HealthcareAssist with imaging interpretation, help triage and documentation, reduce administrative burden, and help clinicians find relevant information faster.Not AI as a doctor, but a more effective average clinician and less scarce expertise.
EducationExpand practice opportunities, explain in different styles, and help teachers manage workload.AI tutoring will not solve education on its own.
ScienceProtein structure prediction, materials discovery [5], and rapid hypothesis generation.The biggest gains likely come from combining domain expertise with AI tools, not from replacing scientists.
AccessibilityReal-time captioning, image description, summarization, translation, and speech support.These are not luxuries. They change who can participate.

The peril: real risks we cannot ignore

The risks are not science fiction. They are practical.

The most important question is not whether any single risk exists. It is whether multiple risks compound, faster than institutions adapt.

Job disruption (near-term and most certain)

It is tempting to ask “how many jobs disappear.” That is usually the wrong framing.

The better question is: which tasks become cheaper, and who currently does those tasks?

AI is not just automating physical routine work. It is automating routine cognitive work.

That affects:

  • call centers,
  • basic content production,
  • scheduling and coordination,
  • entry-level analysis,
  • compliance documentation,
  • and many administrative roles.

The danger is not that work disappears overnight.

The danger is that career ladders weaken. Entry-level roles are often where people learn. If those roles shrink, training becomes harder, and inequality rises.

Misinformation, deepfakes, and trust collapse

When content is cheap, the bottleneck becomes attention.

AI makes it possible to generate persuasive content at scale.

That includes:

  • scams,
  • synthetic personas,
  • deepfake media,
  • and targeted disinformation.

The long-run harm here is not one viral video. It is that people stop believing anything.

Once trust collapses, the cost of verification rises everywhere.

Bias and discrimination

AI systems learn patterns from historical data.

That can be valuable. It can also encode and amplify bias.

In high-stakes domains like:

  • hiring,
  • lending,
  • housing,
  • education,
  • and criminal justice,

bias is not a philosophical issue. It is material harm.

The policy lesson is that “we used an algorithm” is not an excuse. It is a reason to demand audits, monitoring, and redress.

Privacy erosion

Modern surveillance does not require a human watching you. It requires inference.

AI can infer:

  • identity,
  • preference,
  • intent,
  • and vulnerability,

from scattered traces.

The risk is not only the collection of data. It is what can be derived from data that was never meant to be sensitive.

Concentration of power

AI has scale economics:

  • data,
  • compute,
  • talent,
  • and distribution.

That tends to produce concentration.

If the benefits of AI accrue primarily to a small number of firms and investors, the political economy becomes brittle.

A world where productivity rises but wages stagnate is not stable.

Cybersecurity and dual-use

AI can help defenders.

It can also help attackers:

  • more convincing phishing,
  • faster malware iteration,
  • automated reconnaissance,
  • and vulnerability discovery.

The near-term result is not a single “AI cyber apocalypse.” It is more pressure on already-strained security systems.

The peril: risks we cannot ignore
RiskWhat it looks likeWhy it matters
Job disruptionAutomation of routine cognitive work: call centers, basic content production, scheduling, entry-level analysis, compliance documentation, and many administrative roles.Career ladders weaken. If entry-level roles shrink, training becomes harder, and inequality rises.
Misinformation and deepfakesScams, synthetic personas, deepfake media, and targeted disinformation, generated at scale.People stop believing anything, and the cost of verification rises everywhere.
Bias and discriminationPatterns learned from historical data, applied in hiring, lending, housing, education, and criminal justice.Material harm, and a reason to demand audits, monitoring, and redress.
Privacy erosionInference of identity, preference, intent, and vulnerability from scattered traces.The risk is what can be derived from data that was never meant to be sensitive.
Concentration of powerScale economics in data, compute, talent, and distribution.If the benefits accrue mainly to a small number of firms and investors, the political economy becomes brittle.
Cybersecurity and dual-useMore convincing phishing, faster malware iteration, automated reconnaissance, and vulnerability discovery.More pressure on already-strained security systems. (UK National Cyber Security Centre)

The jobs question: who wins, who loses

The historical pattern is that technology changes the composition of work.

But two things make this transition feel different:

  • The affected tasks are cognitive.
  • The diffusion speed is faster.

Most vulnerable

  • Routine cognitive work.
  • Entry-level white-collar tasks.
  • Work that is mostly text transformation.

Most protected (for now)

  • Work requiring physical presence and judgment.
  • Roles built on trust and human relationships.
  • Jobs where liability and verification are central.

The transition problem

Even if “new jobs appear,” the path between old work and new work is not automatic.

Retraining has costs.

Geography matters.

And social identity is tied to work.

A successful transition requires policy choices.

For individuals

  • Learn the tools enough to supervise them.
  • Build skills that AI complements: judgment, domain expertise, communication, and leadership.
  • Treat career resilience as a core asset.

For businesses

  • Deploy AI where failure modes are bounded.
  • Keep humans in the loop for high-stakes decisions.
  • Audit for bias and monitor outcomes over time.
  • Invest in retraining rather than treating workers as disposable.

For policymakers

This is the heart of the piece.

Policy is not about “stopping AI.” It is about shaping incentives so that:

  • safety is rewarded,
  • bias is detected and corrected,
  • consumers have redress,
  • workers have transition support,
  • and benefits diffuse beyond owners of capital.

The baseline governance toolkit is not exotic:

  • standards,
  • audits,
  • documentation,
  • security requirements,
  • and accountability.

The hard part is enforcement and institutional capacity.

The optimistic case

AI could make societies richer and healthier.

If productivity gains fund training, safety nets, and public goods, the transition can be managed.

If verification and provenance systems improve faster than deception, trust can be preserved.

The pessimistic case

If institutions move slowly while AI diffuses quickly, several dynamics can compound:

  • job polarization,
  • scam and misinformation floods,
  • concentrated economic power,
  • and trust collapse.

That is not guaranteed.

But it is plausible.

Two ways the transition can go
The optimistic caseThe pessimistic case
AI could make societies richer and healthier.If institutions move slowly while AI diffuses quickly, several dynamics can compound.
If productivity gains fund training, safety nets, and public goods, the transition can be managed.Job polarization and concentrated economic power.
If verification and provenance systems improve faster than deception, trust can be preserved.Scam and misinformation floods, and trust collapse.

What will not work

  • Pretending AI will go away.
  • Treating the debate as a culture war.
  • Outsourcing public accountability to private firms.
  • Assuming markets will internalize harms quickly.

Conclusion: agency in the age of AI

AI is a tool, not a destiny.

The point of this piece is not to be optimistic or pessimistic.

It is to be practical.

We should pursue the benefits that are real.

We should contain the risks that are real.

And we should not confuse speed with inevitability.

What matters most is whether we build rules and institutions that keep progress from turning into damage.


Sources