brianletort.ai
← Library

Be My Eyes

Verified evidenceCreator to judge

Conversational multimodal visual assistance through Be My AI

A blind or low-vision user can get immediate, private scene descriptions before choosing human assistance.

Engineering design · Global

Collections: Human still decides · Negative results

An editorial scene for Be My Eyes contrasts contacts a sighted volunteer or trusted person and shares a camera view. with captures an image and asks be my ai for a description or follow-up detail. in the conversational multimodal visual assistance through be my ai workflow.

Executive brief

The operating-model shift, in one view.

Accessibility value comes from giving the user control over when AI is sufficient and when a human is needed.

AI value · Demonstrated task scope in user study

Verified

Fourteen users described Be My AI support across personal and social contexts.

Qualitative study; no causal time-saving or safety metric.

Before

Contacts a sighted volunteer or trusted person and shares a camera view. → Describes the visual scene and answers follow-up questions.

After

Captures an image and asks Be My AI for a description or follow-up detail. → Evaluates the answer and either acts, reprompts, or escalates to a human for high-stakes or uncertain tasks.

Human boundary

The user decides whether to trust, reprompt, or escalate; humans retain action decisions.

Why it matters

A blind or low-vision user can get immediate, private scene descriptions before choosing human assistance.

How the work changed

Before

How the work ran before the change.

  1. Step 1 of 2

    Blind or low-vision user

    Contacts a sighted volunteer or trusted person and shares a camera view.

    ControlUser explains intent and decides whether to act.

  2. Step 2 of 2

    Human assistant

    Describes the visual scene and answers follow-up questions.

    ControlUser judgment.

What changed

A blind or low-vision user can get immediate, private scene descriptions before choosing human assistance.

Decision rightHuman moves from creator to judge

After

How the same work runs now.

  1. Step 1 of 2

    User

    Captures an image and asks Be My AI for a description or follow-up detail.

  2. Step 2 of 2

    User

    Evaluates the answer and either acts, reprompts, or escalates to a human for high-stakes or uncertain tasks.

Process model built from the published workflow evidence for Be My Eyes. Every step, actor, and control appears in full below.
Every step, actor, and control

Exception path

Users compensate for hallucinations or misunderstood context and intent through spatial memory, auditory cues, personal judgment, reprompting, orientation and mobility skills, or human assistance.

Work removed

  • Routine requests to sighted volunteers for many household, spatial, and social descriptions

Decision authority

The user decides whether to trust, reprompt, or escalate; humans retain action decisions.

Before

  1. 01

    Blind or low-vision user

    Contacts a sighted volunteer or trusted person and shares a camera view.

    Control: User explains intent and decides whether to act.

  2. 02

    Human assistant

    Describes the visual scene and answers follow-up questions.

    Control: User judgment.

After

  1. 01

    User

    Captures an image and asks Be My AI for a description or follow-up detail.

    Control: User controls framing, prompting, and use.

  2. 02

    User

    Evaluates the answer and either acts, reprompts, or escalates to a human for high-stakes or uncertain tasks.

    Control: Human escalation remains available.

Work that left the path

  • Routine requests to sighted volunteers for many household, spatial, and social descriptions

Human role before

Sighted volunteers supplied first-line visual interpretation.

Human role after

Users independently frame questions and judge outputs; human volunteers handle uncertainty and consequential tasks.

AI roleDecision mode: advisory perception. Describes images and answers visual questions; it does not safely navigate or make high-stakes decisions.

Outcomes

Demonstrated task scope in user study

Verified

Visual interpretation commonly required sighted assistance.Fourteen users described Be My AI support across personal and social contexts.

CHI 2025 qualitative study. · 14 visually impaired Be My AI users plus analysis of image descriptions.

Qualitative study; no causal time-saving or safety metric.

Observed failure modes

Verified

Human assistants can clarify intent and context interactively.The study identified hallucinations, misinterpretations of social contexts, styles, and human identities, and failures to grasp or act on user intent.

CHI 2025 study. · 14 interviews plus image descriptions from participants and social media.

Small purposive sample; limitations may change with model updates.

What leaders can reuse

Anti-pattern

Positioning probabilistic image description as safe navigation or identity verification.

Questions

  1. 01Which tasks are explicitly out of scope?
  2. 02How quickly can users reach a human?
  3. 03How are hallucinations communicated accessibly?

Portability conditions

  • Accessible interface
  • Human fallback
  • Clear high-stakes limits
  • Rapid model-quality monitoring

Reputation risk

medium

Evidence and authority

What the public record supports.

Watch · updated

Watch status: verify the cited source and deployment condition before reusing this case.

1 peer reviewed; publication outcomes are verified.

Bundle 1.0.0 · reviewed 2026-08-23 · stable ID d8b354365bb9e260

Related transformations

More in Engineering design

Sources

Read the evidence, freshness, caveat, and version policy.