From the Emergency Services edition of October 16, 2026
CatBoost on GOES ABI beats the operational GOES FDC fire product on F1 by 0.16–0.38 and exposes near-zero nighttime FDC recall
Ben-Gurion University / Weizmann Institute authors (Asaf Vanunu, Boaz Nadler, Arnon Karnieli) · Wildfire detection from geostationary satellites (academic preprint) · United States, Mexico and Canada evaluation regions; GOES ABI coverage
- Publisher
- arXiv (cs.CV) preprint 2610.01994
- Original publication
- 2026-10-01
- Source retrieved
- 2026-10-17
What happened
arXiv preprint 2610.01994 (submitted Oct 1, 2026) trains a CatBoost gradient-boosting model on thousands of GOES ABI images and over 300,000 matching VIIRS fire detections, then evaluates across five regions. The CatBoost model achieved F1 scores 0.16 to 0.38 higher than the operational GOES Fire Detection and Characterization (FDC) product in all regions, with higher precision and recall inside and outside the training area. Of 51 historical fires, CatBoost detected 26 before both VIIRS and GOES FDC versus six earlier FDC detections. Nighttime FDC recall was very low (~0.03), while CatBoost maintained useful nighttime detection. Why now: first detailed ML-versus-GOES-FDC comparison not yet in the archive, and it complements the Oct 15 AI4Fire LLM critique with measured GEO detection baselines after agencies continue expanding AI wildfire cameras.
Why it matters
Gives state wildfire and emergency-management programs a concrete comparator: any new GEO/ML fire product should beat GOES FDC on daytime and nighttime F1 and on early-detection share before replacing operational alerts.
Evidence and measured results
Preprint with large labeled GOES/VIIRS datasets and regional transfer tests; not peer reviewed; VIIRS-only reference.
Limitations and uncertainty
Preprint; North America–centric; ABI coarse resolution misses many small VIIRS fires; CatBoost only; no live ECC integration study.
Put this evidence to work
Lighthouse Advisory interpretation, grounded in this source. Enriched 2026-10-16; this does not change the original publication date. Each role follows the same checklist so takeaways compare across sources.
Sales
Role takeaway
- Customer problem
- Agencies lack published proof that new ML GEO fire detectors beat the operational GOES FDC, especially at night.
- Stakeholders
- State wildfire intelligence lead
- GACC / geographic coordination
- Emergency management GIS
- Research partner
- Procurement
- Discovery questions
- Do you measure nighttime recall separately?
- What is your early-detection comparator today?
- Who verifies satellite alerts before dispatch?
- Value hypothesis
- ML detectors that beat FDC on F1 and early detection could reduce missed night fires if human verification remains in the loop.
- Potential engagement
- Shadow evaluation of an ML GEO detector against FDC on a state's recent fire season.
- Unsupported claims
- Operational replacement of FDC
- Global transferability
- Lives or acres saved
Pre-sales engineering
Role takeaway
- Fit
- Offline/online ML fire detection on GOES ABI as a comparator or complement to FDC.
- Architecture and integration
- ABI MCMI/ACM ingest → feature extraction (bands + Fire Index context) → CatBoost inference → alert queue with human verify → ECC/CAD.
- Prerequisites
- ABI data access
- Labeled evaluation set
- Night/day split scoring
- Verification staffing
- Constraints
- Preprint evidence
- Coarse 2 km ABI pixels
- VIIRS label dependence
- Security
- Protect training/label pipelines; log model versions feeding any operational alert.
- Proof of value
- F1 vs FDC by region and by night/day
- Early-detection share on held-out fires
- False-alarm sample review
Delivery
Role takeaway
- Work
- Run a shadow-mode comparison against FDC before changing alert SOP.
- Dependencies
- Satellite data feed
- Wildfire intel analysts
- ECC alert policy owners
- IT/ML ops
- Ownership
- Wildfire intelligence or geographic coordination analytics lead.
- Skills and adoption
- Analysts learn night/day metric reading and buffer-based spatial matching.
- Governance checkpoints
- Baseline FDC comparison sign-off
- Nighttime performance gate
- Human-verify SOP before auto-alert
- Acceptance criteria
- F1 exceeds FDC by agreed margin day and night
- Documented early-detection gain on sample fires
- False-alarm rate within agreed bound
- Risks
- Overtrust in preprint metrics
- Missed small fires from coarse ABI
- Alert fatigue if FP rise
Implementation considerations
Lighthouse Advisory interpretation across the operating dimensions a public-sector buyer must settle before this evidence becomes a design. Each note answers the question under its heading for this specific source.
Architecture and integration
What must connect, and where does the AI sit in the workflow?
Operational adoption would need ABI ingest, cloud masking, model serving at CONUS cadence and a human verification path before dispatch.
Governance
Who approves, reviews and stays accountable for outcomes?
Procurement and research partners should require night/day split metrics and early-detection comparisons against the incumbent FDC, not headline accuracy alone.
Security and privacy
What data, permissions and controls need testing?
Satellite fire products are less privacy-sensitive than cameras, but model and label pipelines still need integrity controls to avoid poisoned training data.
Accessibility and workforce
Who is affected, and what skills or accommodations follow?
Shifts some detection labor to analysts verifying ML alerts; no workforce study in the paper.
Procurement
What should contracts, pricing and exit terms secure?
Require vendors to publish night/day F1 and early-detection comparisons against FDC on independent regions.
Operating model
Which teams own the service once it runs?
Supports shadow-mode ML detection beside FDC with humans still authorizing dispatch-relevant alerts.
Publication history
- 2026-10-16Emergency Services · Issue 403 resources
Stable resource ID: arxiv-2610-01994-catboost-goes-fdc-wildfire-detection-20261001