Weather-JEPA North-Star Project Management Plan
Document status: Governing project plan
Version: 1.0
Date: July 26, 2026
Project: Weather-JEPA
License target: Apache License 2.0
Primary development platform: Apple M2 Mac Studio, 32 GB unified memory
Primary framework: PyTorch with Apple Metal Performance Shaders (MPS) support
1. Purpose of This Document
This document is the authoritative management, research, architecture, data, and engineering plan for Weather-JEPA. It is intended to prevent the project from becoming a collection of attractive notebooks, incomparable experiments, and retrospective explanations of decisions that were never actually documented.
Every major project artifact should trace to this plan:
- research questions;
- mathematical definitions;
- model architecture;
- dataset versions and transformations;
- experiment configurations;
- evaluation criteria;
- software requirements;
- AI risk controls;
- publication claims;
- milestone and release decisions.
The plan is a living document, but it is not casual documentation. Changes to a governing requirement must be recorded in the decision log, linked to evidence, and reflected in the version history. Convenience is not evidence. A result that appears promising is also not evidence that the protocol should be rewritten around it.
Part I — Mission, Scope, and Governance
2. Mission
Weather-JEPA will investigate whether reconstruction-free joint-embedding predictive learning can produce transferable, dynamically useful, uncertainty-aware representations of the atmosphere under accessible computational constraints.
The project’s ultimate purpose is to contribute knowledge that may improve the anticipation and characterization of hazardous weather and thereby support forecasting systems that protect human life.
Weather-JEPA is not an operational warning system. It will not issue public forecasts, emergency instructions, evacuation guidance, or claims of operational readiness. Its contribution is upstream: reproducible evidence about atmospheric representation learning, forecast behavior, uncertainty, and failure.
3. Vision
Build an open, scientifically disciplined atmospheric world-model research platform that:
- learns multiscale representations of atmospheric states;
- compares JEPA learning fairly against direct forecasting and masked reconstruction;
- evaluates both ordinary forecast skill and hazard-relevant behavior;
- exposes uncertainty and failure rather than decorating deterministic output with confidence language;
- runs meaningful experiments on prosumer hardware;
- publishes code, configurations, negative results, and methodological limitations;
- remains useful as an educational resource and a foundation for later research.
4. Governing Principles
4.1 Protect Life, Do Not Perform Safety Theater
The public-safety goal governs model evaluation, documentation, and claims. It does not authorize exaggeration. A global RMSE reduction is not equivalent to a saved life. A useful research result must be connected carefully to the forecasting and warning chain.
4.2 Scientific Rigor Over Novelty
The project will not claim to be the first atmospheric world model, the first learned weather model, the first stochastic atmospheric model, or the first self-supervised weather model. Novelty must be stated narrowly and supported by a current literature review.
4.3 Compare Objectives, Not Bundles of Changes
The primary causal question concerns the learning objective. The supervised, masked-autoencoder, and JEPA systems must therefore share the same backbone, input data, output resolution, parameter budget, optimization budget, and evaluation protocol wherever technically possible.
Changing the backbone, data volume, augmentation, optimizer, and objective simultaneously may produce a good model. It does not produce a clean answer.
4.4 Reproducibility Is a Product Requirement
A result is incomplete until another person can identify:
- the exact code;
- the configuration;
- the data snapshot;
- the random seeds;
- the environment;
- the hardware;
- the training duration;
- the evaluation procedure;
- the generated artifacts.
4.5 Negative Results Are Deliverables
A JEPA objective that fails to outperform masked reconstruction under matched conditions is still a useful result. The project will not quietly remove failed experiments from the historical record.
4.6 Compute Limits Are Experimental Conditions
The M2 Mac Studio is not an embarrassing substitute for an institutional cluster. It defines a deliberate research regime: representation quality per unit of memory, data, energy, and training time.
4.7 No Operational Claims Without Operational Evidence
Weather-JEPA outputs must be labeled research-only until independently validated against appropriate observations, compared with operational baselines, tested prospectively, reviewed by domain experts, and deployed within an accountable warning institution.
5. Project Scope
5.1 In Scope
- ERA5- and WeatherBench 2-compatible atmospheric data pipelines;
- regional and selected global/coarse-resolution experiments;
- multilevel, multivariable atmospheric state encoding;
- deterministic supervised forecasting baseline;
- masked autoencoder baseline;
- reconstruction-free JEPA training;
- multihorizon latent prediction;
- latent and decoded rollout evaluation;
- representation transfer tasks;
- calibrated probabilistic extensions after deterministic stability;
- event-aware evaluation for selected hazards;
- reproducible software and public documentation;
- educational visualizations and technical communication.
5.2 Out of Scope for Initial Releases
- replacement of operational numerical weather prediction;
- public warning issuance;
- global kilometer-scale modeling;
- full coupled atmosphere–ocean–land–cryosphere simulation;
- training billion-parameter foundation models;
- claiming physical discovery solely from latent visualization;
- unrestricted real-time deployment;
- human-impact prediction without appropriate social and exposure data;
- causal attribution of weather or climate events.
5.3 Deferred Scope
The following may enter only after formal phase-gate approval:
- satellite radiance ingestion;
- radar and station observation assimilation;
- ocean, soil, vegetation, or chemistry coupling;
- neural data assimilation;
- diffusion or flow-based probabilistic latent prediction;
- multimodal language interfaces;
- real-time forecast feeds;
- distributed training on external accelerators.
6. Research Questions
RQ1 — Representation Quality
Under matched architecture, data, parameter count, and optimization budget, does reconstruction-free JEPA pretraining produce atmospheric representations that transfer more effectively than supervised forecasting or masked reconstruction?
RQ2 — Forecast Skill
Does the JEPA representation improve deterministic forecast skill across variables, vertical levels, regions, spatial scales, and lead times?
RQ3 — Dynamical Stability
Do JEPA-trained latent states support more stable multistep rollouts than baseline representations, as measured by error growth, spectral drift, variance collapse, and decoded physical plausibility?
RQ4 — Robustness
Are JEPA representations more robust to missing variables, noisy inputs, masked regions, temporal gaps, seasonal shifts, and held-out extreme events?
RQ5 — Hazard Relevance
Do JEPA representations improve the detection, classification, tracking, intensity estimation, or uncertainty characterization of selected hazardous phenomena?
RQ6 — Compute Efficiency
What representation and forecast performance can be achieved per parameter, training hour, gigabyte of peak memory, and unit of processed data on prosumer hardware?
RQ7 — Probabilistic Utility
After deterministic stability is established, can a probabilistic latent predictor generate calibrated, spatially coherent alternative futures without smoothing high-impact possibilities into a convenient average?
7. Primary Hypotheses
- H1: JEPA pretraining will improve linear-probe and few-shot transfer performance over direct supervision and masked reconstruction.
- H2: JEPA pretraining will preserve large-scale dynamical structure better during rollout, particularly at medium lead times.
- H3: Masked reconstruction will outperform JEPA on some fine-scale reconstruction tasks because it is explicitly optimized to reproduce values.
- H4: JEPA benefits will be largest for tasks driven by synoptic and cross-variable organization rather than exact local texture.
- H5: A deterministic JEPA will not by itself solve forecast uncertainty; explicit probabilistic modeling will remain necessary.
- H6: Compute-constrained experiments can identify objective-level effects even when absolute forecast skill remains below institutional models.
Hypotheses may be rejected. The project is not obliged to protect them from data.
8. Governance and Decision Rights
8.1 Roles
For the current single-researcher phase, one person may hold multiple roles, but the responsibilities remain distinct.
| Role | Responsibility |
|---|---|
| Principal Investigator | Scientific direction, claims, ethics, publication approval |
| Project Manager | Milestones, scope, dependencies, risk register, release gates |
| Data Engineer | Acquisition, validation, transformation, lineage, storage |
| ML Research Engineer | Model implementation, training, evaluation |
| Software Engineer | Packaging, testing, CI, releases, security |
| Reviewer | Independent challenge of methods, metrics, and claims |
| Communications Lead | Public documentation and educational content |
8.2 Required Records
The repository will maintain:
- Architecture Decision Records (
docs/adr/); - Research Decision Records (
docs/rdr/); - dataset manifests;
- model cards;
- data cards;
- experiment cards;
- risk register;
- issue tracker;
- release notes;
- change log;
- literature ledger;
- claim-evidence matrix.
8.3 Change Control
A change requires an ADR or RDR when it affects:
- research questions;
- mathematical objective;
- architecture family;
- dataset definition;
- train/validation/test boundaries;
- primary metrics;
- release criteria;
- safety or security controls;
- licensing;
- publication claims.
Each decision record must contain context, alternatives, evidence, decision, consequences, and reversal conditions.
Part II — Mathematical Specification
9. Atmospheric State Definition
Let the atmospheric state at time (t) be
[ \mathbf{X}_t \in \mathbb{R}^{C \times L \times H \times W}, ]
where:
- (C) is the number of dynamic variables;
- (L) is the number of vertical levels;
- (H) and (W) are latitude and longitude dimensions.
Surface and static fields may be represented separately:
[ \mathbf{S}_t \in \mathbb{R}^{C_s \times H \times W}, \qquad \mathbf{B} \in \mathbb{R}^{C_b \times H \times W}. ]
A training sample contains a context window of (K) atmospheric states:
[ \mathcal{C}t = {\mathbf{X}{t-(K-1)\Delta t}, \ldots, \mathbf{X}_t}, ]
and one or more prediction horizons
[ \mathcal{H} = {h_1, h_2, \ldots, h_m}. ]
The initial temporal resolution is six hours, matching common global forecast evaluation practice and controlling dataset volume. Higher-frequency experiments require a separate decision record.
10. Normalization
For variable (c), level (l), and optionally calendar stratum (s), standardized values are
[ \widetilde{X}{t,c,l,i,j} = \frac{X{t,c,l,i,j} - \mu_{c,l,s}}{\sigma_{c,l,s}+\epsilon}. ]
The default is training-split-only climatological statistics. Validation or test data must never influence normalization parameters.
Alternative transforms may be required:
- log or signed-log transforms for precipitation-like variables;
- bounded transforms for humidity fractions;
- circular encoding for calendar features;
- latitude-aware area weights;
- robust scaling for heavy-tailed variables.
Every transformation must be invertible or explicitly documented as lossy.
11. Spatial Weighting
Global grid-cell area varies with latitude. Field losses and metrics will therefore use weights
[ w_i = \frac{\cos(\phi_i)}{\frac{1}{H}\sum_{k=1}^{H}\cos(\phi_k)}, ]
where (\phi_i) is latitude. Regional experiments may use uniform weighting or a documented area-preserving scheme.
12. Tokenization and Patching
The input state is partitioned into spatial or spatiotemporal patches. For patch size (P_h \times P_w), the number of horizontal tokens is
[ N = \frac{H}{P_h}\frac{W}{P_w}. ]
Vertical structure may be represented by one of three governed alternatives:
- Level-as-channel: simple and memory efficient, but weakly explicit;
- Level tokens: each variable-level patch becomes a token;
- Factorized vertical encoder: horizontal patching followed by vertical attention or mixing.
The initial reference architecture will use factorized vertical mixing because it balances physical explicitness and workstation memory.
13. Context Encoder
The context encoder maps visible atmospheric context to latent tokens:
[ \mathbf{Z}^{(c)}t = f{\theta}(M_c \odot \mathcal{C}_t, \mathbf{S}_t, \mathbf{B}, \mathbf{e}_t), ]
where:
- (M_c) is the context mask;
- (\mathbf{e}_t) contains positional, calendar, horizon, and variable/level embeddings;
- (f_\theta) is the trainable context encoder.
14. Target Encoder
The target encoder maps uncorrupted or selectively masked target states to latent targets:
[ \mathbf{Z}^{(y)}{t+h} = f{\xi}(\mathbf{X}{t+h}, \mathbf{S}{t+h}, \mathbf{B}, \mathbf{e}_{t+h}). ]
Its parameters are updated by exponential moving average:
[ \xi \leftarrow \tau \xi + (1-\tau)\theta, ]
where (\tau) follows a governed schedule approaching one during training.
The target encoder does not receive gradients from the predictor loss.
15. JEPA Predictor
The predictor estimates target embeddings from context embeddings, mask tokens, and forecast-horizon conditioning:
[ \widehat{\mathbf{Z}}^{(y)}{t+h} = g{\psi}(\mathbf{Z}^{(c)}_t, M_y, \mathbf{q}_h), ]
where (M_y) identifies target blocks and (\mathbf{q}_h) encodes forecast horizon.
The predictor must support the following target families:
- spatial blocks;
- vertical slices;
- cross-variable targets;
- future-time targets;
- multiscale targets;
- combined targets.
A target-family ablation is mandatory. “JEPA” is not a sufficiently precise experimental condition unless the masking and target geometry are specified.
16. Core JEPA Loss
For target token set (\mathcal{T}), the basic latent prediction loss is
[ \mathcal{L}{\text{JEPA}} = \frac{1}{|\mathcal{T}|} \sum{k \in \mathcal{T}} \left| \widehat{\mathbf{z}}_k - \operatorname{sg}(\mathbf{z}^{(y)}_k) \right|_p, ]
where (\operatorname{sg}) denotes stop-gradient and (p\in{1,2}) is selected by experiment.
Cosine distance may be evaluated:
[ \mathcal{L}_{\cos} = 1- \frac{\widehat{\mathbf{z}}_k^\top \mathbf{z}^{(y)}_k} {|\widehat{\mathbf{z}}_k|_2|\mathbf{z}^{(y)}_k|_2+\epsilon}. ]
17. Collapse Diagnostics and Regularization
Latent collapse must be measured, not assumed absent. Diagnostics include:
- per-dimension variance;
- effective rank;
- token covariance;
- mean pairwise cosine similarity;
- singular-value spectrum;
- representation uniformity;
- downstream probe performance.
If necessary, the project may introduce variance and covariance terms:
[ \mathcal{L}{\text{var}} = \frac{1}{d}\sum{j=1}^{d}\max(0, \gamma-\sqrt{\operatorname{Var}(Z_j)+\epsilon}), ]
[ \mathcal{L}{\text{cov}} = \frac{1}{d}\sum{i\neq j}\operatorname{Cov}(Z)_{ij}^{2}. ]
The total loss becomes
[ \mathcal{L} = \lambda_J \mathcal{L}{\text{JEPA}} + \lambda_V \mathcal{L}{\text{var}} + \lambda_C \mathcal{L}{\text{cov}} + \lambda_P \mathcal{L}{\text{physical}}. ]
Regularizers may not be added merely because a training curve is unattractive. Their necessity must be demonstrated by diagnostics.
18. Supervised Forecasting Baseline
The supervised baseline predicts physical fields directly:
[ \widehat{\mathbf{X}}{t+h} = d{\omega}(f_{\theta}(\mathcal{C}_t), h). ]
A latitude-weighted normalized error may be used:
[ \mathcal{L}{\text{sup}} = \sum{c,l}\alpha_{c,l} \frac{\sum_{i,j} w_i (\widehat{X}{c,l,i,j}-X{c,l,i,j})^2} {\sum_{i,j}w_i}, ]
where (\alpha_{c,l}) prevents high-variance variables from dominating the objective.
19. Masked Autoencoder Baseline
The masked autoencoder predicts raw masked values:
[ \widehat{\mathbf{X}}{M} = d{\omega}(f_{\theta}(M_c\odot\mathbf{X})), ]
[ \mathcal{L}{\text{MAE}} = \frac{1}{|M_y|}\sum{k\in M_y} \left|\widehat{\mathbf{x}}_k-\mathbf{x}_k\right|_2^2. ]
Mask ratios and geometries must match the JEPA target protocol as closely as the objectives allow.
20. Multistep Rollout
Two rollout modes will be distinguished:
- Decoded autoregression: predicted physical fields are re-encoded;
- Latent autoregression: predicted latent states are advanced directly.
For latent transition operator (F_\psi):
[ \widehat{\mathbf{Z}}{t+(n+1)\Delta t} = F\psi(\widehat{\mathbf{Z}}{t+n\Delta t}, \mathbf{q}{\Delta t}). ]
Rollout evaluation must detect:
- mean drift;
- variance collapse or explosion;
- spectral distortion;
- loss of fronts and gradients;
- unphysical extrema;
- regional phase errors;
- decoder accumulation error.
21. Probabilistic Extension
Probabilistic modeling is a later phase. The deterministic model must first demonstrate stable training and rollout.
Candidate formulations include:
- Gaussian latent distribution with learned diagonal or low-rank covariance;
- mixture density predictor;
- conditional latent diffusion;
- conditional flow matching;
- ensemble perturbation model;
- quantile or expectile heads for selected hazards.
A generic probabilistic predictor estimates
[ p_\psi(\mathbf{Z}{t+h}\mid\mathbf{Z}{\le t}, h). ]
A model will not be called probabilistic merely because dropout is enabled at inference.
22. Physical Diagnostics and Constraints
Initial releases will prefer diagnostics over strong constraints. Candidate diagnostics include:
- mass-weighted global means;
- total-column moisture proxies;
- geostrophic consistency proxies;
- hydrostatic ordering diagnostics;
- divergence and vorticity spectra;
- kinetic-energy spectra;
- temporal tendency distributions;
- boundedness and positivity checks.
Physical penalties may be introduced only when the represented variables support a defensible calculation. The project will not claim exact conservation from an incomplete state vector.
Part III — Proposed Architecture
23. Reference Architecture: Weather-JEPA v1
23.1 Architectural Objective
The reference architecture must be large enough to learn meaningful cross-variable and multiscale structure, but small enough for repeatable experiments on 32 GB unified memory.
23.2 High-Level Flow
ERA5 / WeatherBench-compatible state
|
v
Validation -> normalization -> temporal windowing
|
v
Variable/level embeddings + static fields + calendar features
|
v
Spatial patch embedding
|
v
Factorized vertical-variable mixer
|
v
Multiscale context encoder -------------------------.
| |
v v
JEPA predictor + horizon query EMA target encoder
| |
'-------------- latent loss -----------------'
|
+--> optional decoder --> physical fields
|
+--> probes / classifiers / hazard heads
23.3 Input Modules
- dynamic pressure-level variables;
- dynamic surface variables;
- static fields such as orography, land-sea mask, latitude, longitude;
- cyclical time-of-year and time-of-day features;
- forecast-horizon embedding;
- variable identity embedding;
- pressure-level embedding.
23.4 Encoder
The initial encoder will use a hierarchical transformer or hybrid convolution-transformer design with:
- patch embedding;
- local or windowed attention at fine scales;
- downsampling stages for synoptic and planetary context;
- factorized mixing across variables and pressure levels;
- residual connections;
- pre-normalization;
- stochastic depth only if justified by overfitting evidence.
A pure global-attention transformer is not the default because its memory bill would arrive before its scientific contribution.
23.5 Target Encoder
The target encoder mirrors the context encoder and is updated by EMA. It receives target fields without the context corruption applied to the online encoder.
23.6 Predictor
The predictor is intentionally narrower than the encoder and includes:
- projected context tokens;
- learnable target-mask tokens;
- spatial, vertical, variable, scale, and horizon embeddings;
- transformer blocks or cross-attention blocks;
- projection to target latent dimension.
23.7 Decoder
The decoder is not the center of the JEPA objective, but it is required for physical evaluation. It should be lightweight and shared across compared objectives where possible.
Decoder options:
- patch-expansion transformer;
- U-Net-like convolutional decoder;
- multiscale feature pyramid decoder.
23.8 Downstream Heads
- linear probe;
- shallow nonlinear probe;
- cyclone-event classifier;
- atmospheric-regime classifier;
- anomaly score head;
- missing-variable reconstruction head;
- probabilistic hazard head in later phases.
23.9 Initial Parameter Tiers
| Tier | Approximate parameters | Purpose |
|---|---|---|
| Micro | 1–5 million | pipeline and loss verification |
| Small | 10–30 million | objective comparison and ablation |
| Medium | 40–100 million | final workstation-scale experiments |
| Large | >100 million | only after profiling and explicit approval |
The project will scale only after the smaller tier passes its scientific gate. A larger failed experiment is not automatically more informative.
23.10 Precision and Memory
- Prefer
float32for correctness validation. - Evaluate
float16orbfloat16only where MPS kernels are stable. - Use gradient accumulation for effective batch size.
- Use activation checkpointing after profiling.
- Stream data rather than loading complete archives.
- Avoid silent CPU fallback; log device placement.
- Record peak resident memory and accelerator memory estimates.
Part IV — Data Management Plan
24. Authoritative Data Sources
24.1 ERA5
ERA5 is the primary research dataset because it provides a coherent, long-duration, global reanalysis with pressure-level and single-level variables. It is a model-assimilation product, not direct observation, and this limitation must remain visible in all claims.
24.2 WeatherBench 2
WeatherBench 2 provides an open, like-for-like evaluation framework, reference datasets, baseline forecasts, and established metrics. Weather-JEPA should preserve compatibility wherever practical rather than inventing a private benchmark on which it is conveniently undefeated.
24.3 Independent Observational Data
Later hazard evaluation may use:
- tropical cyclone best-track data;
- station observations;
- radiosondes;
- satellite products;
- radar-derived precipitation;
- official event catalogs.
Each external source requires a data card, license review, temporal coverage audit, and alignment procedure.
25. Initial Variable Set
The initial state should remain scientifically useful but computationally manageable.
25.1 Pressure-Level Variables
- geopotential (
z); - temperature (
t); - zonal wind (
u); - meridional wind (
v); - specific humidity (
q).
25.2 Initial Pressure Levels
Recommended v1 levels:
- 1000 hPa;
- 925 hPa;
- 850 hPa;
- 700 hPa;
- 500 hPa;
- 300 hPa;
- 250 hPa;
- 200 hPa;
- 100 hPa.
This set captures boundary-layer, lower-tropospheric, midlevel, jet-level, upper-tropospheric, and lower-stratospheric structure while limiting channel count. A seven-level reduced configuration may be used for early experiments; a 13-level configuration may enter after the pipeline is stable.
25.3 Surface and Near-Surface Variables
Initial candidates:
- mean sea-level pressure;
- 2 m temperature;
- 10 m zonal and meridional wind;
- total column water vapor;
- accumulated precipitation, with careful temporal semantics;
- surface pressure.
25.4 Static Variables
- orography;
- land-sea mask;
- latitude;
- longitude represented cyclically;
- optional soil or vegetation climatology in later phases.
26. Spatial Domains and Resolutions
26.1 Development Domain
A regional domain will be used for initial end-to-end testing. Candidate regions should contain varied dynamics and sufficient hazardous events. The exact bounding box requires an ADR.
26.2 Reference Resolution
Initial experiments should use 1.5° or 1.0° resolution. A 0.25° global archive is valuable as source data but is not the default training grid on 32 GB hardware.
26.3 Scale Progression
- synthetic tensors;
- tiny geographic subset;
- regional coarse resolution;
- regional moderate resolution;
- global coarse resolution;
- expanded global or regional high resolution only after profiling.
27. Temporal Coverage and Splits
A provisional chronology is:
- Training: 1979–2017;
- Validation: 2018–2019;
- Test: 2020–2022;
- Prospective or untouched challenge set: 2023 onward, subject to data maturity and evaluation design.
Exact years may change based on dataset availability, but the following are mandatory:
- no random frame-level splitting;
- no overlap of context windows across split boundaries;
- no normalization using validation or test statistics;
- entire events and storm lifecycles remain within one split;
- an untouched final test set is evaluated only at declared release gates.
28. Data Pipeline
CDS / WeatherBench source
-> immutable raw archive
-> checksum and metadata validation
-> coordinate normalization
-> variable and unit validation
-> regridding
-> temporal alignment
-> derived-variable generation
-> training-statistic computation
-> normalized Zarr stores
-> sample index manifests
-> DataLoader / DataPipe
29. Storage Format
- Zarr is the preferred training format.
- Xarray is the primary labeled-array interface.
- Chunking must align with access patterns: time-major for sample streaming, with manageable variable and spatial chunks.
- Compression settings must be benchmarked against CPU overhead.
- Raw data remain immutable.
- Derived data receive semantic dataset versions.
30. Data Contracts
Every variable must declare:
- canonical name;
- source name;
- units;
- coordinate system;
- vertical coordinate;
- valid range;
- missing-value semantics;
- accumulation or instantaneous meaning;
- transformation;
- normalization statistics;
- provenance;
- license;
- known issues.
Pipeline code must validate contracts before training.
31. Data Quality Checks
Required checks include:
- dimension and coordinate consistency;
- monotonically ordered time;
- expected six-hour cadence;
- duplicate timestamps;
- missing timesteps;
- NaN and fill-value rates;
- unit consistency;
- plausible physical ranges;
- accumulation resets;
- longitude convention;
- latitude orientation;
- pressure-level ordering;
- regridding artifacts;
- checksum verification;
- split leakage.
32. Data Lineage and Versioning
Each processed dataset receives:
- dataset semantic version;
- source retrieval date;
- source DOI or identifier;
- manifest of files and checksums;
- processing code commit;
- configuration hash;
- schema version;
- training-statistics artifact;
- data card.
Large data will not be stored directly in Git. Manifests, small fixtures, and acquisition scripts will be versioned.
33. Data Ethics and Licensing
Weather and reanalysis data are generally less personally sensitive than human-subject data, but the project will still:
- honor source licenses and attribution;
- document geographic and observational coverage limitations;
- avoid implying equal data quality across regions;
- disclose reanalysis dependence;
- avoid presenting model outputs as official forecasts;
- document any later integration of population or vulnerability data as a separate ethical scope.
Part V — Development Sequence and Phase Gates
34. Stage 0 — Repository and Environment Foundation
Objectives
Create a reliable project skeleton before model experimentation.
Work
- initialize repository;
- add Apache 2.0 license;
- define Python version;
- create package and environment files;
- configure linting, formatting, type checking, testing, and CI;
- add contribution, security, and citation files;
- establish documentation site;
- create ADR/RDR templates;
- create experiment schema;
- record hardware baseline.
Exit Gate
- clean environment installs from scratch;
- unit tests pass locally and in CI;
- MPS smoke test passes;
- repository structure approved;
- no secrets in history.
35. Stage 1 — Research Specification
Objectives
Freeze the initial scientific question and comparison protocol.
Work
- finalize problem statement;
- finalize purpose statement;
- convert research questions to measurable hypotheses;
- register primary metrics and ablations;
- define claim-evidence matrix;
- define stopping and failure rules;
- update literature ledger.
Exit Gate
- every research question maps to data, model, metric, and decision criterion;
- novelty language is defensible;
- baseline comparison is technically feasible.
36. Stage 2 — Data Prototype
Objectives
Build a trustworthy small-scale pipeline.
Work
- download a small ERA5 subset;
- implement coordinate and unit normalization;
- regrid;
- create Zarr store;
- compute training-only statistics;
- implement sample windows and masks;
- produce data-quality report;
- create visual sanity checks.
Exit Gate
- one batch can be traced to source values;
- inverse normalization reconstructs expected values;
- no split leakage;
- loader sustains acceptable throughput;
- data card complete.
37. Stage 3 — Synthetic Mathematical Verification
Objectives
Verify architecture and losses on controlled systems before blaming the atmosphere.
Work
Train micro-models on:
- advection fields;
- rotating Gaussian vortices;
- Lorenz-96 or similar chaotic systems;
- coupled multivariable waves;
- masked spatial and temporal targets.
Exit Gate
- losses decrease as expected;
- EMA target update verified;
- collapse diagnostics operational;
- horizon conditioning works;
- rollouts expose known synthetic dynamics;
- numerical gradient and shape tests pass.
38. Stage 4 — Persistence and Climatology Baselines
Objectives
Establish non-neural reference skill.
Work
- persistence forecast;
- climatology forecast;
- seasonal climatology;
- linear tendency baseline;
- optional simple convolutional baseline.
Exit Gate
All learned models must be evaluated against these baselines. A neural network that cannot beat persistence at short lead times has not earned a more poetic description.
39. Stage 5 — Shared Backbone
Objectives
Implement the architecture used by all primary objectives.
Work
- patch embedding;
- variable/level embeddings;
- factorized mixer;
- multiscale encoder;
- decoder;
- horizon conditioning;
- checkpointing;
- deterministic seed handling;
- profiling.
Exit Gate
- identical encoder can train under all three objectives;
- parameter counts are matched within declared tolerance;
- memory and throughput baselines recorded;
- forward/backward tests pass.
40. Stage 6 — Supervised Forecast Baseline
Objectives
Establish direct forecasting performance.
Work
- single-step forecast;
- multihorizon direct forecast;
- autoregressive rollout;
- field-level metrics;
- spectral diagnostics;
- failure plots.
Exit Gate
- beats simple baselines on primary variables;
- stable enough for matched comparison;
- training recipe frozen.
41. Stage 7 — Masked Autoencoder Baseline
Objectives
Measure reconstruction-based representation learning.
Work
- spatial masking;
- vertical masking;
- variable masking;
- temporal masking;
- decoder reconstruction;
- fine-tuning and linear probing.
Exit Gate
- reconstruction performance validated;
- representations evaluated using the same probe protocol planned for JEPA;
- mask geometry documented.
42. Stage 8 — Weather-JEPA v1
Objectives
Implement reconstruction-free latent prediction.
Work
- EMA target encoder;
- target-block generation;
- predictor;
- latent loss;
- collapse diagnostics;
- spatial, vertical, cross-variable, and future targets;
- probe evaluation;
- optional physical decoder.
Exit Gate
- no evidence of collapse;
- reproducible convergence across multiple seeds;
- transfer tasks run end to end;
- matched baseline comparison complete.
43. Stage 9 — Controlled Objective Comparison
Objectives
Answer the central research question.
Controls
Hold constant:
- dataset version;
- split;
- backbone;
- parameter tier;
- optimizer family;
- number of processed samples or tokens;
- wall-clock budget where feasible;
- evaluation code;
- random seed set;
- probe architecture.
Deliverables
- preregistered comparison table;
- confidence intervals or seed variability;
- compute-normalized results;
- negative result analysis;
- statistical and practical significance discussion.
Exit Gate
A conclusion is permitted only when comparison integrity is demonstrated.
44. Stage 10 — Latent Dynamics and Rollout
Objectives
Test whether learned representations support stable atmospheric evolution.
Work
- one-step latent transition;
- multistep latent rollout;
- decoded rollout;
- teacher forcing versus free rollout;
- scheduled sampling only as an ablation;
- drift and spectral diagnostics;
- horizon-specific versus shared predictors.
Exit Gate
- rollout behavior characterized across lead times;
- instability modes documented;
- no claim of physical fidelity based solely on visual plausibility.
45. Stage 11 — Transfer and Robustness
Tasks
- atmospheric regime classification;
- missing-variable prediction;
- anomaly retrieval;
- few-shot event classification;
- seasonal transfer;
- geographic transfer;
- noise and missing-data stress tests;
- held-out event analysis.
Exit Gate
At least one transfer task must be evaluated without full encoder fine-tuning.
46. Stage 12 — Hazard-Focused Evaluation
Initial Hazard Candidates
- tropical cyclones;
- atmospheric rivers;
- blocking events;
- extreme precipitation environments;
- high-wind synoptic systems.
Required Metrics
Event metrics depend on the task and may include:
- probability of detection;
- false-alarm ratio;
- critical success index;
- precision-recall area;
- track error;
- intensity error;
- timing error;
- reliability and Brier score;
- object displacement and structure metrics.
Exit Gate
Hazard claims must be based on event-level verification, not inference from global field scores.
47. Stage 13 — Probabilistic Weather-JEPA
Entry Requirements
- deterministic JEPA is stable;
- uncertainty target is defined;
- baseline ensemble or probabilistic model exists;
- calibration metrics are implemented.
Work
- probabilistic latent head or generative predictor;
- ensemble generation;
- spread-skill analysis;
- calibration;
- multivariate coherence;
- rare-event evaluation.
Exit Gate
- probabilistic system beats or meaningfully complements deterministic baseline;
- ensemble diversity is not merely noise;
- calibration and sharpness are reported together.
48. Stage 14 — Scaling and Optimization
Scaling follows evidence, not impatience.
Work
- profile bottlenecks;
- optimize data loading;
- mixed precision;
- gradient checkpointing;
- compile or graph optimization where stable;
- larger domain, resolution, variables, or parameters one dimension at a time;
- energy and compute reporting.
Exit Gate
Each scale increase must identify the scientific question it enables.
49. Stage 15 — External Reproduction and Release
Work
- clean-room installation test;
- reproduce a flagship result from released code;
- model card;
- data card;
- benchmark report;
- archived checkpoint;
- DOI release where feasible;
- limitations and safety statement;
- paper and public documentation.
Exit Gate
A release is complete only when the published result can be recreated from documented artifacts.
Part VI — Evaluation Framework
50. Field-Level Metrics
- latitude-weighted RMSE;
- mean absolute error;
- anomaly correlation coefficient;
- bias;
- variable- and level-specific scores;
- regional scores;
- lead-time curves;
- climatology-relative skill.
Metrics must be reported separately by variable and level before aggregation.
51. Scale and Structure Metrics
- power spectral density;
- kinetic-energy spectrum where valid;
- gradient magnitude distribution;
- structural similarity used cautiously;
- object-based displacement and deformation;
- variance by spatial scale;
- temporal tendency distribution;
- frontal sharpness proxies.
52. Probabilistic Metrics
- continuous ranked probability score;
- Brier score;
- reliability diagrams;
- rank histograms;
- spread-skill relationship;
- energy score;
- ignorance or log score where numerically appropriate;
- probability integral transform diagnostics.
53. Representation Metrics
- frozen linear probes;
- k-nearest-neighbor retrieval;
- few-shot performance;
- full fine-tuning performance;
- sample efficiency curves;
- centered kernel alignment across objectives;
- effective rank;
- temporal neighborhood preservation;
- clustering stability;
- cross-variable predictability;
- latent sensitivity to perturbations.
54. Compute Metrics
- parameters;
- trainable parameters;
- processed samples and tokens;
- wall-clock training time;
- inference latency;
- peak memory;
- storage footprint;
- data-loader throughput;
- approximate energy use where measurable;
- performance per training hour and per million parameters.
55. Statistical Reporting
- use multiple seeds for primary comparisons;
- report mean, standard deviation, and confidence intervals where feasible;
- distinguish statistical from operational significance;
- avoid significance testing on highly autocorrelated grid cells as though each were an independent meteorological universe;
- use block bootstrap, event bootstrap, or year-level resampling when appropriate;
- define the unit of analysis explicitly.
56. Success Criteria
Weather-JEPA v1 will be considered scientifically successful if it achieves at least one of the following under fair comparison:
- materially better frozen-probe or few-shot transfer;
- more stable latent rollout;
- improved robustness under missing or corrupted inputs;
- improved hazard-event representation or prediction;
- equivalent skill at materially lower compute;
- a well-supported negative result that clarifies when JEPA is not advantageous.
Absolute superiority on every forecast metric is not required.
Part VII — AI Engineering Standards
57. AI Risk Management
The project will adapt the NIST AI Risk Management Framework functions:
- Govern: assign responsibilities, define claims, maintain risk and decision records;
- Map: document context, intended use, affected stakeholders, limitations, and misuse;
- Measure: evaluate validity, reliability, robustness, security, transparency, and uncertainty;
- Manage: prioritize risks, implement controls, monitor releases, and retire unsafe artifacts.
58. Model Documentation
Every released model requires a model card containing:
- model purpose;
- architecture;
- training objective;
- data and time period;
- geographic and variable coverage;
- intended uses;
- prohibited uses;
- evaluation results;
- hazard-event results;
- uncertainty behavior;
- limitations;
- compute requirements;
- ethical and safety considerations;
- license and citation;
- version and checksum.
59. Training Standards
- all hyperparameters reside in versioned configuration files;
- seeds are recorded;
- deterministic settings are enabled where practical and nondeterminism documented;
- training interruptions and resumed checkpoints are logged;
- gradient norms, loss components, learning rate, throughput, and memory are tracked;
- NaN/Inf guards stop corrupted training;
- checkpoints include optimizer, scheduler, scaler, and data-state metadata;
- target-encoder EMA state is checkpointed;
- evaluation occurs through versioned code, not ad hoc notebook cells.
60. Experiment Integrity
- assign immutable experiment IDs;
- log code commit and dirty-tree status;
- prohibit changing test evaluation after viewing final-test results without declaring a new test cycle;
- separate exploratory and confirmatory experiments;
- register primary metrics before confirmatory runs;
- preserve failed runs and reasons;
- do not select seeds post hoc;
- compare equivalent compute budgets;
- report all primary outcomes, not only favorable ones.
61. Robustness and Safety Testing
Required stress tests include:
- missing variables;
- missing spatial regions;
- temporal gaps;
- additive noise;
- distribution shifts;
- seasonal and geographic transfer;
- extreme-value inputs;
- corrupted metadata;
- unit or level mismatch detection;
- out-of-distribution scoring;
- silent failure detection.
62. Explainability Standards
Interpretability artifacts may include attention maps, latent projections, probes, and sensitivity analyses, but:
- attention is not automatically explanation;
- PCA or UMAP clusters are not physical discoveries;
- latent directions require independent validation;
- explanations must be stable across seeds and samples;
- public graphics must disclose preprocessing and projection choices.
63. Responsible Claims
Public statements must distinguish:
- training performance;
- validation performance;
- held-out test performance;
- retrospective event analysis;
- prospective performance;
- operational readiness.
Prohibited language includes “predicts disasters,” “saves lives,” “understands weather,” or “replaces meteorologists” unless the evidence genuinely supports the exact claim. The project goal may be to protect life; the model does not receive moral credit in advance.
Part VIII — Data Engineering Standards
64. Data Architecture Standards
- immutable raw layer;
- validated intermediate layer;
- curated training layer;
- explicit schemas;
- idempotent processing;
- resumable downloads;
- checksums;
- partitioned processing;
- documented chunking;
- no hidden manual edits;
- clear separation between source and derived variables.
65. Reproducible Data Builds
A data build must be recreatable using:
- source identifiers;
- retrieval scripts;
- configuration;
- environment;
- processing commit;
- manifest;
- checksums;
- transformation log.
66. Validation and Observability
The pipeline will emit machine-readable reports for:
- files processed;
- timestamps covered;
- variables and levels;
- missingness;
- range violations;
- duplicate records;
- output chunks;
- compression ratio;
- processing duration;
- warnings and failures.
67. Leakage Prevention
- fit all statistics on training data only;
- split before generating overlapping samples;
- ensure no event crosses splits;
- prevent target times from appearing in training context;
- isolate final challenge set;
- test sample indices automatically;
- document any pretrained external model and its data overlap risk.
68. Data Security
Although public atmospheric data dominate the project:
- credentials remain in environment variables or OS keychain;
.envfiles are ignored;- least-privilege API tokens are used;
- dependency and artifact sources are verified;
- downloaded archives are checksummed;
- write permissions to raw data are restricted after ingestion;
- backups follow a defined retention policy.
Part IX — Software Engineering Standards
69. Repository Structure
weather-jepa/
├── README.md
├── LICENSE
├── CITATION.cff
├── SECURITY.md
├── CONTRIBUTING.md
├── CHANGELOG.md
├── pyproject.toml
├── configs/
│ ├── data/
│ ├── model/
│ ├── objective/
│ ├── train/
│ └── experiment/
├── docs/
│ ├── architecture/
│ ├── adr/
│ ├── rdr/
│ ├── standards/
│ ├── tutorials/
│ └── project-management/
├── src/weather_jepa/
│ ├── data/
│ ├── models/
│ ├── objectives/
│ ├── training/
│ ├── evaluation/
│ ├── hazards/
│ ├── visualization/
│ └── utils/
├── scripts/
├── tests/
│ ├── unit/
│ ├── integration/
│ ├── regression/
│ └── fixtures/
├── experiments/
├── reports/
├── figures/
├── notebooks/
└── papers/
70. Python Standards
- supported Python versions declared explicitly;
- PEP 8-compatible formatting via an automated formatter;
- static linting;
- type hints for public APIs and core modules;
- docstrings for public objects;
- no wildcard imports;
- no training logic buried only in notebooks;
- pure functions for transforms where practical;
- structured logging rather than ungoverned
printstatements; - exceptions include actionable context;
- tensor shapes documented.
71. Configuration Standards
- configuration-driven runs;
- hierarchical config composition permitted;
- every run saves resolved configuration;
- no hard-coded local paths;
- environment-specific settings separated from scientific settings;
- configuration schema validated before execution;
- config hash included in experiment metadata.
72. Testing Pyramid
Unit Tests
- normalization;
- masks;
- patching and unpatching;
- coordinate transforms;
- loss functions;
- EMA update;
- metrics;
- shape invariants;
- checkpoint serialization.
Integration Tests
- raw subset to Zarr;
- Zarr to batch;
- one training step;
- checkpoint resume;
- evaluation report generation;
- CPU and MPS smoke tests.
Regression Tests
- fixed tiny dataset and seed;
- expected loss range;
- metric tolerances;
- artifact schema;
- model parameter count;
- no unintended architecture changes.
Scientific Tests
- identity or persistence cases;
- known synthetic dynamics;
- latitude weighting;
- conservation diagnostic sanity;
- temporal leakage checks.
73. Continuous Integration
CI must run:
- formatting check;
- linting;
- type checking;
- unit tests;
- small integration tests;
- security and dependency scanning;
- documentation build;
- package build.
MPS-specific tests may run locally if hosted CI lacks Apple hardware, but their results must be recorded before release.
74. Version Control
- protected
mainbranch; - short-lived feature branches;
- pull requests for substantive changes even in a solo project when practical;
- conventional or otherwise standardized commit messages;
- squash or curated history for clarity;
- no large binaries in ordinary Git history;
- release tags follow semantic versioning;
- experiments reference exact commit hashes.
75. Code Review Checklist
A change is reviewed for:
- correctness;
- scientific validity;
- data leakage;
- shape and unit assumptions;
- tests;
- performance;
- security;
- documentation;
- backward compatibility;
- reproducibility;
- effect on claims.
76. Secure Software Development
The project will adapt the NIST Secure Software Development Framework:
- prepare the organization and repository;
- protect code, credentials, artifacts, and releases;
- produce well-secured software through review and testing;
- identify and respond to vulnerabilities.
Controls include:
- dependency pinning or lock files;
- automated vulnerability scans;
- secret scanning;
- signed or checksummed releases where feasible;
- minimal privileges;
- input validation;
- safe deserialization practices;
- avoidance of untrusted pickle checkpoints;
- documented vulnerability reporting;
- software bill of materials for releases when feasible.
77. Performance Engineering
Performance changes require measurement.
Track:
- loader throughput;
- accelerator utilization proxies;
- CPU utilization;
- memory pressure and swapping;
- kernel fallback;
- compile time;
- step time;
- checkpoint I/O;
- evaluation latency.
Optimization order:
- correctness;
- measurement;
- data pipeline;
- tensor shapes and unnecessary copies;
- precision;
- checkpointing;
- architecture scaling.
Part X — Experiment and Artifact Management
78. Experiment Naming
Recommended format:
WJ-{stage}-{objective}-{domain}-{resolution}-{tier}-{date}-{sequence}
Example:
WJ-S08-JEPA-NATL-1deg-SMALL-20260815-003
79. Experiment Card
Each experiment records:
experiment_id:
status:
hypothesis:
research_question:
code_commit:
config_hash:
dataset_version:
split_version:
model_version:
objective:
parameter_count:
seed:
hardware:
start_time:
end_time:
processed_samples:
peak_memory:
primary_metrics:
secondary_metrics:
artifacts:
failures:
conclusion:
next_action:
80. Artifact Retention
Retain permanently:
- released checkpoints;
- flagship experiment configs;
- final metrics;
- figures used publicly;
- data manifests;
- cards and reports;
- negative-result summaries.
Intermediate checkpoints may follow a storage policy, but deletion must not make a published result irreproducible.
81. Claim-Evidence Matrix
Every public claim should map to:
| Claim | Experiment(s) | Dataset | Metric | Comparator | Uncertainty | Limitation | |—|—|—|—|—|—|—|
No evidence row, no claim.
Part XI — Risk Register
82. Scientific Risks
| Risk | Probability | Impact | Mitigation | Trigger |
|---|---|---|---|---|
| JEPA offers no advantage | Medium | Medium | Publish controlled negative result; identify task boundaries | Baselines consistently match or exceed JEPA |
| Latent collapse | Medium | High | Diagnostics, EMA tuning, target design, regularization | Effective rank or variance degrades |
| Forecast smoothing | High | High | Spectral and event metrics; probabilistic extension | Extremes and gradients underrepresented |
| Reanalysis imitation mistaken for atmospheric understanding | High | High | Independent observations and transfer tests | Good ERA5 score, poor external validation |
| Hazard sample scarcity | High | Medium | Event catalogs, longer chronology, bootstrap, focused domains | Unstable event metrics |
| Metric overfitting | Medium | High | Preregister primary metrics, untouched challenge set | Repeated tuning on test results |
83. Engineering Risks
| Risk | Probability | Impact | Mitigation |
|---|---|---|---|
| MPS unsupported operations | Medium | Medium | Device tests, fallbacks, profiling, architecture alternatives |
| Memory exhaustion | High | High | Small tiers, patching, accumulation, checkpointing |
| Data-download or storage limits | High | Medium | Regional subsets, staged retrieval, compression, manifests |
| Pipeline bottleneck | Medium | High | Chunk benchmarking, prefetching, cached indices |
| Environment drift | Medium | Medium | Lock files, containers where feasible, CI |
| Corrupted checkpoints | Low | High | Checksums, atomic writes, backup policy |
84. Governance and Communication Risks
| Risk | Probability | Impact | Mitigation |
|---|---|---|---|
| Scope creep | High | High | Phase gates, backlog triage, non-goals |
| Inflated novelty | Medium | High | Literature ledger and reviewer challenge |
| Public misunderstanding | Medium | High | Research-only labels, limitations, careful language |
| Cherry-picking | Medium | High | Registered metrics and complete result tables |
| Documentation decay | High | Medium | Documentation included in definition of done |
Part XII — Milestones and Deliverables
85. Major Milestones
| Milestone | Deliverable | Governing Gate |
|---|---|---|
| M0 | Repository foundation | CI and environment reproducible |
| M1 | Research specification | Questions map to measurable protocol |
| M2 | Data pipeline v1 | Validated, versioned, leakage-free data |
| M3 | Synthetic verification | Mathematical implementation validated |
| M4 | Non-neural baselines | Persistence and climatology established |
| M5 | Shared backbone | Objective-compatible architecture |
| M6 | Supervised baseline | Stable direct forecast model |
| M7 | MAE baseline | Reconstruction representation baseline |
| M8 | Weather-JEPA v1 | Non-collapsed latent training |
| M9 | Objective comparison | Central research result |
| M10 | Rollout study | Latent stability characterized |
| M11 | Transfer study | Robustness and probe evidence |
| M12 | Hazard evaluation | Event-level evidence |
| M13 | Probabilistic prototype | Calibrated alternative futures |
| M14 | Public research release | Reproducible code, cards, paper |
86. Definition of Done
A work item is done only when:
- acceptance criteria pass;
- code is reviewed;
- tests pass;
- documentation is updated;
- data and model versions are recorded;
- artifacts are linked;
- risks and limitations are documented;
- result is reproducible;
- public communication, if any, matches the evidence.
A notebook that ran once is not done. It is an anecdote with cells.
Part XIII — Documentation and Publication Plan
87. Living Documentation
The project documentation site will include:
- project overview;
- research questions;
- architecture;
- mathematics;
- data guide;
- experiment registry;
- benchmark dashboard;
- negative results;
- tutorials;
- API documentation;
- roadmap;
- ethics, limitations, and safety;
- release history.
88. Public Education
Public posts may explain:
- pressure levels;
- reanalysis;
- forecast uncertainty;
- latent representations;
- masking strategies;
- error metrics;
- calibration;
- atmospheric dynamics;
- experimental failures;
- compute constraints.
Educational communication must not reveal test results before the experiment record is complete or transform exploratory findings into settled conclusions.
89. Publication Sequence
- technical project documentation;
- benchmark and objective-comparison report;
- preprint if evidence warrants;
- conference or workshop submission;
- expanded journal manuscript;
- hazard-specific paper only after adequate event validation.
90. Required Scholarly Artifacts
- updated literature review;
- problem and purpose statements;
- preregistered analysis plan;
- methods document;
- data card;
- model cards;
- experiment appendix;
- reproducibility checklist;
- limitations and broader-impact statement.
Part XIV — Initial Backlog
91. Immediate Next Actions
Research
- draft final problem statement;
- draft final purpose statement;
- convert RQs into measurable acceptance criteria;
- create literature ledger;
- create claim-evidence matrix.
Repository
- initialize
weather-jepa; - add Apache 2.0;
- create package skeleton;
- add CI and quality tools;
- add ADR/RDR templates;
- add this north-star plan.
Data
- choose initial geographic domain;
- confirm initial variables and pressure levels;
- estimate storage requirements;
- retrieve one month of ERA5;
- build a validated Zarr prototype;
- benchmark chunks and loader throughput.
Modeling
- implement synthetic advection dataset;
- implement patching and mask generator;
- implement micro context/target encoders;
- verify EMA;
- implement collapse diagnostics;
- implement persistence and climatology metrics.
Project Management
- create milestone board;
- create risk register issues;
- establish weekly review cadence;
- define release numbering;
- record first ADRs.
Part XV — Weekly Operating Rhythm
92. Weekly Research Cycle
Plan
- select one primary question;
- define experiment and acceptance criteria;
- confirm data and compute budget.
Build
- implement smallest valid change;
- add tests;
- run smoke experiment.
Measure
- execute controlled run;
- generate standard report;
- inspect failures and data quality.
Review
- compare against registered criteria;
- update risk and decision logs;
- determine continue, modify, stop, or scale.
Communicate
- update documentation;
- publish an accurate progress summary when appropriate;
- identify next week’s dependency.
93. Weekly Status Template
# Weekly Weather-JEPA Review — YYYY-MM-DD
## Objective
## Work Completed
## Evidence Generated
## Metrics
## Problems and Failures
## Decisions
## Risks
## Documentation Updated
## Public Communication
## Next Week
Part XVI — Source and Standards Basis
94. Governing External References
The plan should be reviewed against the current versions of the following:
- WeatherBench 2 benchmark framework and paper;
- ERA5 and Copernicus Climate Data Store documentation;
- NIST AI Risk Management Framework;
- NIST Secure Software Development Framework;
- the Weather-JEPA doctoral literature review;
- primary papers for baseline architectures and objectives.
95. Verified Reference Links
- Rasp, S., et al. (2024). WeatherBench 2: A benchmark for the next generation of data-driven global weather models. Journal of Advances in Modeling Earth Systems. DOI: 10.1029/2023MS004019.
- Copernicus Climate Data Store. ERA5 hourly data on pressure levels from 1940 to present.
- European Centre for Medium-Range Weather Forecasts. ECMWF Reanalysis v5 (ERA5).
- National Institute of Standards and Technology. AI Risk Management Framework.
- National Institute of Standards and Technology. Secure Software Development Framework.
Part XVII — Final Governing Statement
Weather-JEPA will be judged by the quality of its evidence, not the confidence of its branding. The project will proceed from validated data to verified mathematics, from simple baselines to controlled objective comparisons, from deterministic stability to probabilistic uncertainty, and from aggregate scores to hazard-relevant evaluation.
The project’s north star is the protection of human life. That principle requires ambition, but it also requires restraint. A model that is fast, visually impressive, and poorly calibrated near dangerous weather is not a partial success merely because the latent space makes an attractive figure. Weather-JEPA will therefore publish what works, what fails, what remains uncertain, and exactly how each conclusion was reached.
Appendix A — Phase-Gate Checklist
[ ] Scientific question defined
[ ] Acceptance criteria registered
[ ] Dataset version frozen
[ ] Split leakage tests pass
[ ] Baselines implemented
[ ] Code commit recorded
[ ] Config resolved and archived
[ ] Multiple seeds completed where required
[ ] Compute and memory recorded
[ ] Primary and secondary metrics reported
[ ] Hazard metrics included where relevant
[ ] Failure analysis completed
[ ] Data/model/experiment cards updated
[ ] Claims linked to evidence
[ ] Limitations documented
[ ] Reproduction performed
[ ] Release approved
Appendix B — Architecture Decision Record Template
# ADR-XXXX: Decision Title
## Status
Proposed | Accepted | Superseded | Rejected
## Context
## Decision Drivers
## Considered Options
## Decision
## Consequences
## Evidence
## Reversal Conditions
## Related Experiments
Appendix C — Research Decision Record Template
# RDR-XXXX: Research Decision
## Research Question
## Hypothesis
## Design
## Primary Metrics
## Controls
## Evidence
## Decision
## Threats to Validity
## Follow-up
Appendix D — Release Checklist
[ ] Version and tag created
[ ] Changelog complete
[ ] License review complete
[ ] Dependency scan passes
[ ] Tests pass
[ ] Clean installation verified
[ ] Flagship result reproduced
[ ] Checkpoint checksum published
[ ] Dataset manifest published
[ ] Model card published
[ ] Data card published
[ ] Safety and limitations statement published
[ ] Citation metadata published
[ ] Documentation site updated