Migrating to Microsoft Sentinel: Beware of Ingestion Volumes

Microsoft Sentinel is an easy sell internally. With native Azure integration, a large detection content library, and tight coupling with the Microsoft security stack most enterprises already run, it’s a natural choice. But the business case that got budget approved usually assumes ingestion costs stay under control, and Sentinel's consumption-based pricing means every unnormalized, noisy, duplicate log you send it is a recurring cost, not a one-time migration expense. Getting this migration right is less about Sentinel's capabilities and more about what's feeding it.

The Real Challenge Isn't Sentinel — It's What You're Sending It

Sentinel is built on Azure Monitor Log Analytics, and its detection content increasingly assumes data normalized to the Advanced Security Information Model (ASIM) — a schema that, like Google's UDM or Palo Alto's XDM, only delivers value if your raw logs are actually mapped into it correctly. Traditionally, ASIM normalization happens via KQL parsers at query time, over whatever table the raw data already landed in; Microsoft has more recently added ingestion-time transformation through Data Collection Rules, which lets teams normalize before storage instead of after. Either way, left unmanaged, most migrations run into the same handful of problems:

  • Table sprawl and manual mapping. Sentinel routes data into specific tables based on source type, and getting each source into the right table, in the right format — whether you normalize at query time or ingestion time — is typically a manual, per-source mapping exercise that doesn't scale past a few dozen log sources.
  • Redundant fields inflating ingestion volume. Many log sources — firewalls especially — send substantial redundant or low-value payload alongside the fields that actually matter for detection. In Sentinel's per-GB pricing model, that redundancy is a direct, ongoing cost, not just an operational annoyance.
  • Repeated enrichment inside the SIEM. Enriching data with geolocation, asset context, or identity tags after ingestion, rather than before, means paying to index information you could have attached once, upstream, for far less.
  • No easy way to test before committing. Because Sentinel bills on ingested volume, teams are often reluctant to run a genuinely thorough parallel validation against their legacy SIEM — the double-ingestion cost feels prohibitive, so validation gets rushed.

None of these are Sentinel problems exactly — they're data pipeline problems that show up as a Sentinel bill.

How an Autonomous Data Layer Changes the Sentinel Math

Axoflow's premise is to solve these problems before data ever reaches Sentinel's ingestion endpoint, using a pipeline that classifies, normalizes, and routes automatically rather than requiring hand-built mapping per source.

  • Automatic table mapping. AxoRouter classifies incoming logs and routes each one to the correct Sentinel table in the expected format, without manual field-mapping work per source — turning a linear, source-by-source task into a configuration you set once.
  • Volume reduction before ingestion, not after. By parsing and normalizing in the pipeline, Axoflow identifies which fields and values actually matter for detection, correlation, and compliance, and drops the rest. Firewall log streams are commonly cited as one of the highest-redundancy sources; the exact reduction will vary by source and environment, so it's worth validating against your own traffic rather than assuming a fixed percentage.
  • Enrich once, not per query. Geolocation tags, asset context, and identity metadata get attached upstream, once, rather than being recomputed or re-referenced inside Sentinel every time a query runs.
  • Dynamic, policy-based routing. High-value, high-context events go into Sentinel for search and detection; verbose or low-value telemetry can be routed to a cheaper storage tier instead, without losing the ability to rehydrate it later if an investigation needs it.
  • Cheap, thorough parallel validation. Because Axoflow filters and normalizes before delivery, you can mirror the same reduced, curated stream to both your legacy SIEM and Sentinel during migration without doubling ingestion costs the way a raw-log mirror would.
  • Visibility into what's actually driving your bill. Pipeline-level metrics show exactly which sources, event types, and transformation stages contribute the most to ingestion volume, so you can tune filters with evidence instead of guesswork.

In a published case study, a large U.S. healthcare company running a Splunk-based pipeline used Axoflow to cut log storage costs by roughly 30% and reduce mean time to resolve data-quality issues by around 85%, largely by gaining visibility into which sources and fields were driving volume. Results on a Sentinel migration specifically will depend on your source mix and existing normalization maturity — treat vendor figures as a starting point for your own pilot, not a guarantee.

Why Open Source and Open Standards Matter for a Sentinel Migration

Migrating to Sentinel is also a good moment to ask whether your collection layer is portable or whether it's quietly becoming Microsoft-specific in ways that will complicate the next migration. Axoflow's approach is built to avoid that trap.

  • AxoSyslog, Axoflow's open-source fork of syslog-ng, forms the collection backbone. It's maintained by Balázs Scheidler, the original creator of syslog-ng, and his team — not a closed, proprietary forwarder tied to a single cloud vendor.
  • OpenTelemetry support means you can standardize collection on an open, vendor-neutral protocol rather than committing to Azure-specific agents for every source type.
  • Standard delivery protocols. Data reaches Sentinel's HTTP collector using open, well-understood transport rather than a black-box connector, and the same normalized data can be sent to Azure Monitor / Log Analytics directly when that's the better fit.
  • Schema transparency. Because normalization to ASIM-compatible structure happens in an open pipeline layer, your team can see and control exactly how each field gets mapped — useful for detection engineering, and essential if you ever need to explain your data lineage for an audit.
  • No re-lock-in. The same data layer that feeds Sentinel today can just as easily feed Google SecOps, Cortex XSIAM, Splunk, or a data lake tomorrow, because the collection and normalization logic doesn't belong to any single SIEM vendor.

That portability is the practical meaning of "open standards" in a migration context: it's not a checkbox; it's what keeps this migration from being the last time your organization has real leverage over its own security data.

Best Practices for a Microsoft Sentinel Migration

  1. Model your ingestion cost before you migrate, not after the first invoice. Estimate per-source volume and identify the highest-volume, lowest-value sources early.
  2. Push normalization and table mapping upstream of Sentinel where practical. Manual, per-source mapping doesn't scale and creates technical debt from day one.
  3. Attack redundant fields and duplicate events before ingestion. This is usually the single largest cost lever available, and it's controllable independent of Sentinel's pricing.
  4. Enrich data once, upstream, rather than repeatedly inside Sentinel. Recomputing context at query time is expensive and unnecessary.
  5. Run a genuine parallel validation against your legacy SIEM. Reduce cost risk by mirroring a curated, filtered stream rather than raw logs, so double-running is actually affordable.
  6. Use dynamic routing to keep only high-value data in hot Sentinel storage. Route verbose or low-value telemetry to cheaper tiers with rehydration available on demand.
  7. Favor open collection protocols over proprietary, Azure-specific agents. This keeps your future migration options open and reduces vendor dependency.
  8. Instrument ingestion continuously, not just during migration. Ongoing visibility into what's driving volume prevents cost creep after go-live.
  9. Validate ASIM/table mapping against real detection content. Confirm your highest-priority detections actually fire correctly against normalized data before decommissioning the legacy SIEM.

Sentinel's value is real, but it's only as good as the discipline applied to what reaches it. Get the data layer right, and Sentinel becomes a cost-efficient, high-fidelity detection platform instead of a line item that grows faster than your security budget.

Follow Our Progress!

We are excited to be realizing our vision above with a full Axoflow product suite.

Sign Me Up
This button is added to each code block on the live site, then its parent is removed from here.

Fighting data Loss?

Balázs Scheidler

Book a free 30-min consultation with syslog-ng creator Balázs Scheidler

Recent Posts

Migrating to Google SecOps: Building a Data Foundation That Doesn't Lock You In Twice
Migrating to Palo Alto Cortex XSIAM: Solving the "Getting Data In" Problem
ASD's ACSC Best Practices for Event Logging and Threat Detection: What the 9-Country Advisory Means for Your SOC