π Lesson 6
D4
Quantile Regression Forests for Solar Power Intervals
Quantile Regression Forests are a machine learning method that predicts not just a single solar power value, but a whole range of possible values β like 'thereβs a 90% chance power will be between 120 kW and 280 kW' β helping engineers plan for uncertainty.
π― Learning Objectives
- β Explain how Quantile Regression Forests differ from standard regression forests in probabilistic forecasting
- β Apply QRF to generate 5thβ95th percentile solar power prediction intervals using Python scikit-learn and quantile-forest library
- β Analyze forecast calibration using pinball loss and coverage rate metrics on real PV plant data
- β Design a QRF-based uncertainty-aware dispatch strategy for grid-connected solar farms
π Why This Matters
Solar power is inherently variable β clouds, aerosols, and sensor drift introduce irreducible uncertainty. Traditional point forecasts (e.g., '245 kW at 13:00') mislead grid operators and cause costly over-reservation or under-commitment. QRF delivers *prediction intervals* β rigorously calibrated ranges that quantify risk β enabling robust energy trading, battery scheduling, and contingency planning. In ISO markets like CAISO and ERCOT, regulatory penalties now apply for poor forecast reliability; QRF directly supports compliance with FERC Order No. 2222 and NERC PRC-004-2.
π Core Principles
QRF operates in three conceptual layers: (1) Ensemble foundation β like random forests, it grows many decision trees on bootstrapped data with randomized feature splits; (2) Leaf-level quantile estimation β instead of averaging targets in leaves, each leaf retains all observed y-values from training samples that reach it, forming an empirical CDF; (3) Quantile aggregation β for a new input x, QRF collects all y-values across matching leaves of all trees, then computes the desired quantile (e.g., Ο = 0.05 or 0.95) from this pooled distribution. Critically, QRF captures *heteroscedasticity*: wider intervals appear naturally during high-uncertainty conditions (e.g., sunrise/sunset, broken cloud regimes), unlike Gaussian-assumption models.
π Quantile Prediction Interval
The Ο-th quantile prediction for input x is computed as the Ο-quantile of the multiset of target values stored across all leaf nodes reached by x in the forest. This is a non-parametric, data-driven estimate β no distributional assumptions required.
Empirical Quantile Estimate
q_Ο(x) = inf{y β β : (1/N) Ξ£α΅’ββα΄Ί I(y_i β€ y) β₯ Ο}Computes the Ο-th quantile of the multiset of observed target values {y_i} associated with input x across all trees.
Variables:
| Symbol | Name | Unit | Description |
|---|---|---|---|
| q_Ο(x) | Ο-th conditional quantile | kW | Predicted solar power value such that P(Y β€ q_Ο(x) | X = x) = Ο |
| y_i | Observed power values in matching leaves | kW | All historical power measurements assigned to leaves traversed by x |
| Ο | Quantile level | dimensionless | Target probability level (e.g., 0.05 for lower bound) |
Typical Ranges:
90% prediction interval: [0.05, 0.95]
Operational reserve sizing: [0.10, 0.90]
π‘ Worked Example
Problem: A 100-tree QRF is trained on 30 days of 15-min solar power data from a 5 MW PV plant. For a test sample x (cloud optical depth = 12.4, DNI = 682 W/mΒ², hour = 14:30), x reaches leaves containing the following 100 observed power values (kW): [187, 192, ..., 276] β sorted list of 100 values. Compute the 5th and 95th percentile prediction interval.
1.
Step 1: Sort the 100 leaf values in ascending order (already done).
2.
Step 2: Compute index for Ο = 0.05 β floor((0.05 Γ (100 + 1)) β 1) = floor(5.05 β 1) = 4 β 5th value = 194 kW.
3.
Step 3: Compute index for Ο = 0.95 β floor((0.95 Γ 101) β 1) = floor(95.95 β 1) = 94 β 95th value = 269 kW.
4.
Step 4: Verify interval width (75 kW) aligns with typical midday variability for this plant (Β±12β15% of rated capacity).
Answer:
The 90% prediction interval is [194 kW, 269 kW], which falls within the expected Β±13% band (195β285 kW) for this 5 MW plant under partial cloud cover.
ποΈ Real-World Application
At the 120 MWac Solar Star project (Kern County, CA), QRF was deployed in 2023 as part of the ISO-certified forecasting stack. Using 10-min SCADA, sky camera, and Numerical Weather Prediction (NWP) inputs, QRF reduced the 90% interval mean absolute width by 22% compared to Gaussian process regression while improving coverage rate from 83% to 91.4% β meeting CAISOβs PFR-2 reliability threshold. The model directly informed real-time battery charge/discharge setpoints, reducing curtailment by 7.3 GWh annually.
π§ Interactive Calculator
π§ Open AI-Augmented Renewable Forecasting Infrastructure Calculatorπ Case Connection
π CAISO Zone 12 Solar Ramp Event Mitigation
Unpredicted cloud-edge ramp rates exceeding 150 MW/min causing reserve shortfalls
π Hawaii Island Microgrid Solar Forecast Hardening
Volcanic haze and trade-wind cloud variability caused 30β50% forecast error spikes during monsoon season