๐Ÿ“‹ Case Study

PJM Interconnection Forecast Audit Trail Implementation

Failed FERC audit due to missing provenance for model version deployed during June 2023 heatwave event

๐Ÿ—๏ธ Project Overview

1.4 GW distributed solar + storage portfolio across PA/NJ/DE

๐ŸŽฏ Challenge

Failed FERC audit due to missing provenance for model version deployed during June 2023 heatwave event

๐Ÿ”ง Design Approach

W3C PROV-O metadata pipeline integrated with MLflow and Apache Atlas; automated timestamped capture of training data lineage, hyperparameters, and ISO submission logs

๐Ÿ“ Design Diagram

Raw Sensor DataPROV-OMLflow TrackingApache AtlasISO Submission LogsProvenance Graph Depth: 7 hopsAudit Log Retention: 36 monthsFERC Audit FailureJune 2023 HeatwaveW3C PROV-O Metadata PipelineAutomated Timestamped Capture

AI-generated project design illustration

๐Ÿ“ Key Calculations

Provenance Graph Depth

max(hops from raw sensor โ†’ ISO submission)
Result: 7 hops
Meets FERC 888 ยง222.12(b) traceability requirement

Audit Log Retention

retention_months = max(36, 12 ร— forecast_horizon_years)
Result: 36 months
Exceeds FERC minimum retention

๐Ÿ“Š Results

Passed PJM Forensic Audit Cycle Q3 2024; zero non-conformities; enabled automated evidence export for FERC Form 6Q

๐Ÿ’ก Lessons Learned

  • โ€ขAll timestamps must be synced to NIST UTC via PTPv2 โ€” GPS clocks insufficient
  • โ€ขEvery ISO submission payload must embed PROV-O hash in HTTP header

โœ… Key Takeaways

  • 1All timestamps must be synced to NIST UTC via PTPv2 โ€” GPS clocks insufficient
  • 2Every ISO submission payload must embed PROV-O hash in HTTP header