{"resourceId":"arxiv-2610-01994-catboost-goes-fdc-wildfire-detection-20261001","versions":[{"version":"external-412beee1cccf57083c9ac855ce28dc4db3f71c52f6b98838f50ee9ec571618f4","resource":{"id":"arxiv-2610-01994-catboost-goes-fdc-wildfire-detection-20261001","title":"CatBoost on GOES ABI beats the operational GOES FDC fire product on F1 by 0.16–0.38 and exposes near-zero nighttime FDC recall","organization":"Ben-Gurion University / Weizmann Institute authors (Asaf Vanunu, Boaz Nadler, Arnon Karnieli)","sector":"Wildfire detection from geostationary satellites (academic preprint)","geography":"United States, Mexico and Canada evaluation regions; GOES ABI coverage","publishedAt":"2026-10-01","publicationDate":"2026-10-01","eventDate":null,"sourceName":"arXiv (cs.CV) preprint 2610.01994","sourceLabel":"Comparing a gradient boosting algorithm to the GOES FDC for wildfire detection","sourceUrl":"https://arxiv.org/abs/2610.01994","evidenceClass":"academic-research","outcomeClass":"mixed","topics":["developers-agents","infrastructure","data-security","governance-procurement","knowledge-work"],"finding":"arXiv preprint 2610.01994 (submitted Oct 1, 2026) trains a CatBoost gradient-boosting model on thousands of GOES ABI images and over 300,000 matching VIIRS fire detections, then evaluates across five regions. The CatBoost model achieved F1 scores 0.16 to 0.38 higher than the operational GOES Fire Detection and Characterization (FDC) product in all regions, with higher precision and recall inside and outside the training area. Of 51 historical fires, CatBoost detected 26 before both VIIRS and GOES FDC versus six earlier FDC detections. Nighttime FDC recall was very low (~0.03), while CatBoost maintained useful nighttime detection. Why now: first detailed ML-versus-GOES-FDC comparison not yet in the archive, and it complements the Oct 15 AI4Fire LLM critique with measured GEO detection baselines after agencies continue expanding AI wildfire cameras.","sledRelevance":"Gives state wildfire and emergency-management programs a concrete comparator: any new GEO/ML fire product should beat GOES FDC on daytime and nighttime F1 and on early-detection share before replacing operational alerts.","evidence":"Preprint with large labeled GOES/VIIRS datasets and regional transfer tests; not peer reviewed; VIIRS-only reference.","architectureImplications":"Operational adoption would need ABI ingest, cloud masking, model serving at CONUS cadence and a human verification path before dispatch.","governanceImplications":"Procurement and research partners should require night/day split metrics and early-detection comparisons against the incumbent FDC, not headline accuracy alone.","securityPrivacyImplications":"Satellite fire products are less privacy-sensitive than cameras, but model and label pipelines still need integrity controls to avoid poisoned training data.","caveats":"Preprint; North America–centric; ABI coarse resolution misses many small VIIRS fires; CatBoost only; no live ECC integration study.","streamIds":["emergency-services"],"roles":{"sales":"This paper lets you challenge wildfire-detection vendors: show daytime and nighttime F1 against GOES FDC, plus early-detection share on a held-out fire set. Position ML GEO detection as an upgrade path with verification, not a camera replacement. This evidence does not support claims of operational deployment, lives saved or global transfer beyond the tested regions.","engineering":"Engineering work is pairing ABI features and Fire Index context with a boosted-tree detector, then scoring against FDC and VIIRS with a spatial buffer. Proof of value must split night and day and report early-detection deltas on named incidents. Plan for human verification before any auto-alert to dispatch.","delivery":"Delivery should treat FDC as the incumbent baseline in an A/B or shadow mode: run CatBoost-class detections alongside FDC, sample false alarms, and only then change ECC alert rules. Ownership sits with the wildfire intelligence or GACC analytics lead. Acceptance criteria below are proposals, not observed results."},"roleDetails":{"sales":{"customerProblem":"Agencies lack published proof that new ML GEO fire detectors beat the operational GOES FDC, especially at night.","stakeholders":["State wildfire intelligence lead","GACC / geographic coordination","Emergency management GIS","Research partner","Procurement"],"discoveryQuestions":["Do you measure nighttime recall separately?","What is your early-detection comparator today?","Who verifies satellite alerts before dispatch?"],"valueHypothesis":"ML detectors that beat FDC on F1 and early detection could reduce missed night fires if human verification remains in the loop.","potentialEngagement":"Shadow evaluation of an ML GEO detector against FDC on a state's recent fire season.","unsupportedClaims":["Operational replacement of FDC","Global transferability","Lives or acres saved"]},"engineering":{"fit":"Offline/online ML fire detection on GOES ABI as a comparator or complement to FDC.","architectureIntegration":"ABI MCMI/ACM ingest → feature extraction (bands + Fire Index context) → CatBoost inference → alert queue with human verify → ECC/CAD.","prerequisites":["ABI data access","Labeled evaluation set","Night/day split scoring","Verification staffing"],"constraints":["Preprint evidence","Coarse 2 km ABI pixels","VIIRS label dependence"],"security":"Protect training/label pipelines; log model versions feeding any operational alert.","proofOfValue":["F1 vs FDC by region and by night/day","Early-detection share on held-out fires","False-alarm sample review"]},"delivery":{"work":"Run a shadow-mode comparison against FDC before changing alert SOP.","dependencies":["Satellite data feed","Wildfire intel analysts","ECC alert policy owners","IT/ML ops"],"ownership":"Wildfire intelligence or geographic coordination analytics lead.","skillsAdoption":"Analysts learn night/day metric reading and buffer-based spatial matching.","governanceCheckpoints":["Baseline FDC comparison sign-off","Nighttime performance gate","Human-verify SOP before auto-alert"],"acceptanceCriteria":["F1 exceeds FDC by agreed margin day and night","Documented early-detection gain on sample fires","False-alarm rate within agreed bound"],"risks":["Overtrust in preprint metrics","Missed small fires from coarse ABI","Alert fatigue if FP rise"]}},"retrievedAt":"2026-10-16T22:00:30-05:00","enrichedAt":"2026-10-16T22:00:30-05:00","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Shifts some detection labor to analysts verifying ML alerts; no workforce study in the paper.","procurementImplications":"Require vendors to publish night/day F1 and early-detection comparisons against FDC on independent regions.","operatingModelImplications":"Supports shadow-mode ML detection beside FDC with humans still authorizing dispatch-relevant alerts.","sourceVerification":{"responseId":"curl-arxiv-2610-01994-abs-html-2026-10-16","openedUrl":"https://arxiv.org/abs/2610.01994","referenceExcerpt":"The CatBoost model achieved F1 scores that were 0.16 to 0.38 higher than the GOES FDC in all regions.","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}