brianletort.ai
← Library

Justice Connect

Company-reportedIntake redesignedHuman quality loop

Free-text legal-problem classification

People seeking legal help should describe their problem, not diagnose its legal category before they can ask for help.

Customer service · Australia

Collections: Human still decides · Queue eliminated

An editorial scene for Justice Connect contrasts selects a legal category from a fixed list, often choosing the wrong area or 'something else'. with describes the legal problem in ordinary language without selecting an area of law. in the free-text legal-problem classification workflow.

Executive brief

The operating-model shift, in one view.

Justice Connect moved legal classification out of the applicant's form and into the intake system, while keeping a non-AI route and an expert loop for exceptions and retraining.

AI value · 'Something else' selections during intake

Company-reported

9% among users offered the classifier

JusticeBench reports the operator's staged comparison. The retained non-AI path strengthens the comparison, but no independent statistical evaluation was published.

Before

Selects a legal category from a fixed list, often choosing the wrong area or 'Something else'. → Manually reclassifies uncategorized and misclassified applications. → Reviews the referral and redirects matters that do not match its expertise or mandate.

After

Describes the legal problem in ordinary language without selecting an area of law. → Maps the free-text description to likely legal categories and confidence scores for routing. → Reviews edge cases and works from cleaner, pre-categorized applications. → Compare model classifications with expert judgments and feed…

Human boundary

The model proposes intake categories and routing. People may use the non-AI path, and humans retain review of edge cases and all legal-service decisions.

Why it matters

Move classification burden off the requester and into the intake system; keep experts on exceptions and model governance.

This case is company-reported. Use it for the operating-model shift; do not treat the numbers as independently measured.

How the work changed

Before

How the work ran before the change.

  1. Step 1 of 3

    Help-seeker

    Selects a legal category from a fixed list, often choosing the wrong area or 'Something else'.

    ControlThe applicant must understand the legal nature of the problem.

  2. Step 2 of 3

    Intake staff

    Manually reclassifies uncategorized and misclassified applications.

    ControlHuman triage and service eligibility rules.

  3. Step 3 of 3

    Referral partner

    Reviews the referral and redirects matters that do not match its expertise or mandate.

    ControlPartner-specific service criteria.

What changed

People seeking legal help should describe the problem, not diagnose its legal category before they can ask for help.

Decision rightAI classifies; experts govern exceptions

After

How the same work runs now.

  1. Step 1 of 4

    Help-seeker

    Describes the legal problem in ordinary language without selecting an area of law.

    ControlDisclosure, opt-out, and a retained non-AI path.

  2. Step 2 of 4

    Legal-problem classifier

    Maps the free-text description to likely legal categories and confidence scores for routing.

    ControlThe model classifies and routes; it does not provide legal advice.

  3. Step 3 of 4

    Intake staff

    Reviews edge cases and works from cleaner, pre-categorized applications.

    ControlHuman review remains available for uncertain or consequential cases.

  4. Step 4 of 4

    Pro bono legal experts

    Compare model classifications with expert judgments and feed disagreements into refinement and retraining.

    ControlStanding expert-review loop.

Process model built from the published workflow evidence for Justice Connect. Every step, actor, and control appears in full below.
Every step, actor, and control

Exception path

Users can opt out to a non-AI route. Low-confidence or consequential edge cases receive human intake review, while expert disagreement is recorded for model refinement.

Work removed

  • Requiring help-seekers to identify their own area of law
  • Broad manual re-triage of 'Something else' and misclassified applications
  • Referral roundabouts caused by mismatched intake categories

Decision authority

The model proposes intake categories and routing. People may use the non-AI path, and humans retain review of edge cases and all legal-service decisions.

Before

  1. 01

    Help-seeker

    Selects a legal category from a fixed list, often choosing the wrong area or 'Something else'.

    Control: The applicant must understand the legal nature of the problem.

  2. 02

    Intake staff

    Manually reclassifies uncategorized and misclassified applications.

    Control: Human triage and service eligibility rules.

  3. 03

    Referral partner

    Reviews the referral and redirects matters that do not match its expertise or mandate.

    Control: Partner-specific service criteria.

After

  1. 01

    Help-seeker

    Describes the legal problem in ordinary language without selecting an area of law.

    Control: Disclosure, opt-out, and a retained non-AI path.

  2. 02

    Legal-problem classifier

    Maps the free-text description to likely legal categories and confidence scores for routing.

    Control: The model classifies and routes; it does not provide legal advice.

  3. 03

    Intake staff

    Reviews edge cases and works from cleaner, pre-categorized applications.

    Control: Human review remains available for uncertain or consequential cases.

  4. 04

    Pro bono legal experts

    Compare model classifications with expert judgments and feed disagreements into refinement and retraining.

    Control: Standing expert-review loop.

Work that left the path

  • Requiring help-seekers to identify their own area of law
  • Broad manual re-triage of 'Something else' and misclassified applications
  • Referral roundabouts caused by mismatched intake categories

Human role before

Applicants had to self-diagnose their legal category, while intake staff manually repaired misclassification and referral partners absorbed mismatched referrals.

Human role after

Applicants describe the problem in plain language; intake staff handle exceptions; legal experts govern model quality through ongoing adjudication.

AI roleClassifies a free-text description into legal-issue categories with confidence scores for routing and resource suggestions; it does not generate advice or determine entitlement.

Outcomes

'Something else' selections during intake

Company-reported

23% among users on the retained non-AI path9% among users offered the classifier

Staged rollout, initially to about 30% and then about 50% of users · Justice Connect's production online Intake Tool

JusticeBench reports the operator's staged comparison. The retained non-AI path strengthens the comparison, but no independent statistical evaluation was published.

What leaders can reuse

Move classification burden off the requester and into the intake system; keep experts on exceptions and model governance.

Anti-pattern

Automating intake while forcing every user onto the new path removes the comparison group and hides whether routing actually improved.

Questions

  1. 01Are requesters being asked to classify a problem they do not yet understand?
  2. 02Which cases require a human route regardless of model confidence?
  3. 03How does expert disagreement reach retraining and control changes?

Portability conditions

  • A representative corpus of past requests
  • Domain experts willing to label and adjudicate examples
  • A retained human route for uncertain or consequential cases
  • Clear separation between routing and advice

Reputation risk

low

Evidence and authority

What the public record supports.

Current · updated

1 independent, 1 primary; publication outcomes are reported.

Bundle 1.0.0 · reviewed 2026-08-23 · stable ID 88bf4a45891fbb14

Related transformations

More in Customer service

Sources

Read the evidence, freshness, caveat, and version policy.