Apache Pulsar
Real-time ingestion of complaints and case updates. Configurable retention keeps sensitive data short-lived, and Pulsar Functions anonymize or redact personal data before long-term storage.
ArthaShield Technology Architecture
ArthaShield makes compliance decisions with a typed decision model instead of a general-purpose LLM — on a compliance-first, privacy-by-design Apache data foundation.
No general-purpose LLM in the decision path.
Complaints stream in; personal data is anonymized or redacted before long-term storage.
Explainable NLP extracts products, channels and issues into structured state.
Jev answers typed questions against that state — a label plus a calibrated confidence. Never free text.
Plain code maps the decision to an action. Low confidence goes to a human.
Every decision is logged before the response; access is role-based and monitored.
Routing a complaint is a classification, not a conversation. With a general-purpose LLM you build a prompt, parse free text back into a label, hope it's a valid one — and pay full LLM cost and latency every time.
Jev can only return one of the options it was given. No parsing step, and no chance of an invalid label.
Every answer carries a confidence, so code decides when to act automatically and when to escalate — no costly "second opinion" call.
System One models are built for high-volume structured classification — exactly the workload of routing every complaint.
State, question, typed answer, code action, log entry. Every step can be shown to a regulator — what was decided, and why.
One call, five questions, answered in parallel: a choice across six routing decisions, and four yes/no probabilities that become the reason codes.
| Jev decides | When | Code then does |
|---|---|---|
| LOW_RISK | Minor issue, low amount, no repeat pattern | AUTO_CLOSE_STANDARD |
| MEDIUM_RISK | Some risk signals, none severe | ASSIGN_TO_SUPPORT_QUEUE |
| HIGH_RISK | Multiple strong risk signals together | PRIORITY_QUEUE_REVIEW |
| FRAUD_REVIEW | Strong combined signals of unauthorized activity | SEND_TO_FRAUD_INVESTIGATION |
| COMPLIANCE_REVIEW | Regulatory, disclosure, mis-selling or data-privacy issue | SEND_TO_COMPLIANCE_TEAM |
| HUMAN_REVIEW | Ambiguous or insufficient signals | ESCALATE_TO_HUMAN_REVIEWER |
Each is an independent probability, included at 0.5 or above.
If Jev's confidence is below 0.6, code overrides the decision to HUMAN_REVIEW and adds LOW_MODEL_CONFIDENCE. Ordinary application logic — not a second model call.
The data layer prioritizes scalability, explainability, data minimization, and regulatory auditability using proven Apache open-source technologies.
Real-time ingestion of complaints and case updates. Configurable retention keeps sensitive data short-lived, and Pulsar Functions anonymize or redact personal data before long-term storage.
Tokenization, sentence segmentation, part-of-speech tagging, named entities (products, channels, issues) and chunking — deterministic, explainable pipelines that integrate naturally with Java BFSI stacks.
Built on Apache Spark under Apache 2.0, with transformer models such as BERT and T5 — for semantic similarity, complaint deduplication, and contextual analysis across large datasets.
Text analysis, indexing and retrieval — fast search, relevance scoring, and historical case lookup across complaints and regulatory records.
Columnar storage with Snappy/Gzip compression and dictionary/RLE encoding, so only necessary fields are stored and processed — supporting FD, GDPR, and DPDP compliance.
Centralized access control, authorization policies, and immutable audit logs — complaint and case data access is role-based, monitored, and regulator-ready.
Distributed clustering and classification of complaints and cases across millions of records — operating on distributed, aggregated datasets so patterns are found without unnecessary exposure of raw personal data.
Personal data is minimized, anonymized early, and retained only for justified regulatory or operational purposes.
Chosen over alternatives such as NLTK or spaCy for long-term sustainability, vendor neutrality, and regulatory acceptance.
Each decision is an independent module with its own evaluation set — KYC, fraud, regulatory and agent-routing decisions can be added and rolled out one by one, without touching the ones already live.