Seeing the unseen: The role of anomaly detection in IAM

Uncover hidden signals in data to protect customers, build trust and safeguard identity at scale.

How does seeing the unseen signals in data protect customers and build trust?

In today’s digital world, identity is the foundation of trust between consumers and financial institutions. As fraudsters become more sophisticated, traditional rule-based defenses are no longer enough. This is where anomaly detection steps in, but the focus is not on simple real-time alerts on service-level failures. Instead, deep, analytics-driven insights help detect what isn’t triggering, what’s silently failing or what’s subtly shifting under the surface.

This post is for tech professionals looking to solve security problems with data analytics. Advanced anomaly detection can safeguard identity at scale. This is achieved not just by blocking fraud, but by preserving trust, optimizing user journeys and ensuring systems perform as intended.

From reactive to proactive: The new role of anomaly detection

Most fraud systems were built to be reactive. They respond to what’s happening right now, such as suspicious transactions or failed logins. But what about when something stops happening? This is not just noise; it’s a signal. Anomaly detection helps teams see what’s changed, even if it isn’t triggering a traditional alert.

Consider these signals:

  • A fraud rule that all of a sudden stops executing
  • A once-popular verification method that sees a steep drop in usage
  • A surge in identity verification success rates that seems too good to be true
  • An unexpected increase in abandonment rates during onboarding flows
  • A spike in selection rates for a low-friction path that’s suddenly favored by users

The data behind the detection

At its core, anomaly detection is about comparing the present to the past and asking, What’s different? This requires looking beyond single events and into trends across systems. These patterns often point to underlying issues like integration gaps, misrouted data, product misconfigurations or new attack vectors.

Key patterns to watch for include:

  • Verification volumes: Are multifactor authentication or document checks dropping unexpectedly?
  • Success rate surges: Is an ID check now passing 99% of the time even though baseline is 82%?
  • Abandonment rate spikes: Are users dropping off after being challenged to complete a second factor authentication, or is a user experience issue the reason for abandonment?
  • Dormant rules: Have critical risk controls stopped firing?

Machine learning adds context and confidence

A big challenge with anomaly detection is separating real risk from random fluctuations. That’s where machine learning (ML) shines. ML helps build behavioral baselines for users, devices and even entire systems. It doesn’t just detect that something changed—it understands how unusual that change is.

ML models bring in contextual intelligence like the time of day, user segment, geography and device type to reduce noise and focus on meaningful change. For example:

  • A spike in success rates may be normal for returning users but not for new ones.
  • Increased abandonment during identity verification might be more concerning if it aligns with a mobile OS update.
  • A fraud rule that hasn’t fired for three days could be an integration issue or a sign that attackers have learned to bypass it.
Chart depicting the process of anomaly detection as it pertains to reviewing data sources. During scalable ML orchestration, ML models read data and detect anomalies. During output streaming and reporting, a record of all detected anomalies is generated and systems immediately trigger alerts for team awareness and urgent responses.

Change point detection: Spotting what’s slipping

Not all fraud happens overnight. Some of the most damaging attacks start with subtle, gradual shifts in behavior, a pattern known as “drift.”

That’s where change point detection comes in. It helps identify when user behavior or system performance starts to evolve in small but consistent ways. Think of it as trend analysis for security. Catching small changes early can prevent more serious downstream issues.

Validating intent meets execution (I=E) at scale

Beyond just detecting security anomalies, these techniques are crucial for validating that system intent aligns with actual execution. In complex identity ecosystems, it’s easy for subtle discrepancies to emerge between how a system is designed to behave and how it truly operates in production. Anomaly detection provides the continuous, real-time audit needed for I=E validation at scale.

For instance:

  • Expected user journeys: If the intent is for 90% of users to complete onboarding within five steps, anomaly detection can flag sudden drops in completion rates or unexpected diversions from the intended path. This highlights potential friction points, broken integrations or even new attack vectors exploiting workflow gaps.
  • Policy enforcement: If a new policy intends to block transactions from specific regions, anomaly detection can confirm that no such transactions are slipping through. A sudden, unexpected success rate for transactions from a restricted region would be a clear I=E failure.
  • System health and performance: Anomaly detection on metrics like API response times, database query failures or even CPU utilization can reveal when system execution deviates from intended performance baselines. This ensures that the underlying infrastructure is reliably supporting the intended identity processes.
  • Rule coverage and efficacy: The silent fraud rule discussed earlier is a prime example of an I=E failure. The intent is for the rule to catch a specific type of fraud; if it stops firing, the execution is no longer matching the intent, indicating a potential bypass or system misconfiguration.

By continuously monitoring these signals and detecting deviations, anomaly detection transforms into a powerful tool for ensuring that identity security systems are not just preventing fraud; they are also behaving precisely as intended, thereby validating I=E across the entire identity life cycle.

The hidden power of abandonment rates

Abandonment rates are often seen as a product or user experience concern, but they’re just as valuable for security teams. When users drop off, it’s a signal that can indicate friction, fear or even fraud deterrence. With anomaly detection, abandonment becomes a first-class signal, not an afterthought.

User abandonment can provide valuable insights into system performance and potential security issues. Consider the following scenarios:

  • New verification method: A sudden increase in abandonment rates following the introduction of a new verification method may indicate usability issues or technical glitches.
  • Bot activity: A recurring pattern of bots failing at a challenge step and then disappearing suggests automated attacks or attempts to bypass security measures.
  • Regional login issues: Users frequently “bouncing” at the login stage from a specific region could point to connection throttling, device ID rejections or other localized access problems.

Making it all work: The data foundation

Anomalies cannot be detected without the proper data to back it up. Think of it as building the nervous system for identity infrastructure.

This foundation requires:

  • Unified identity telemetry: Consolidate logs, metadata and behavioral data into a single observability layer.
  • Metric observability: Monitor success rates, rule fire counts and abandonment rates over time and segmented by risk.
  • Automated governance: Employ ML to audit rule coverage, detect blind spots and highlight erratic signals.

Trust is the real output

Ultimately, anomaly detection isn’t just about catching fraud. It’s about building systems that earn and maintain customer trust. When customers encounter seamless and secure identity experiences that adapt and improve, confidence grows. Catching fraud early and fixing user experience issues preemptively is trust in action.

The future of this field is predictive. Instead of just spotting issues after they occur, systems would use artificial intelligence (AI) and historical patterns to predict potential threats, and as these threats materialize, AI agents would adjust policies in real time to optimize friction and security. These self-improving systems would provide appropriate defense against the emerging threats from threat actors that use GenAI to commit fraud.

Final thoughts

Anomaly detection is a critical capability for modern identity security. In a world where threats are quiet and systems are complex, the organizations that can see the unseen will be the ones that lead with both security and trust.


This blog was co-authored by Ranjith Goud Karvanga, Sr. Manager, Data Analysis and COF Tech & EPX, and Arpan Srivastava, Director, Data Analytics and COF Tech & EPX

Ranjith is a distinguished expert in data analytics, machine learning and cloud-based technologies, boasting over 10 years of experience spearheading innovation within the banking and financial services sector. He has overseen impactful initiatives spanning credit card systems, risk events and customer identity, delivering innovative solutions in fraud detection, customer verification and AI-driven decision systems. This has been achieved through his proficiency in generative AI and scalable analytics. He has consistently enhanced enterprise capabilities in risk mitigation and strategic data utilization, translating intricate data into actionable, business-critical outcomes. Arpan is a high-impact data leader with 20 years of experience transforming data into a strategic asset for growth and product innovation. With deep expertise in data technologies, analytics and identity and access management, he architects and leads the high-performing teams that build scalable, data-driven decision systems that self-optimize. Arpan’s background, spanning application development to sophisticated analytical systems, provides a rare ability to bridge technical execution with strategic vision. He specializes in untangling complex data environments to create secure and reliable assets that directly fuel product innovation and deliver measurable business value.

Related Content

Software Engineering
Article | February 22, 2024 |6 min read