# SVET Index Improvenet Stage 2

Saved: 2026-08-27
Updated: 2026-08-28

This is the plan and current status for moving all 16 SVET Metrics toward daily
records. It keeps the user's requested title spelling: "Improvenet".

## Goal

Build one fixed daily record for each SVET Metric.

Do it one Metric at a time.

Keep `mvp-0.1` as the official score until a later owner-approved method change.

Status on 2026-08-28: all 16 Metrics have daily records. Troops also has a
separate `mvp-2.1` GDELT daily proxy record. The next source upgrade is
`mvp-2.2 Staple daily oil proxy`.

## Token Rule

Full stats are saved in the archive.

The Telegram post gets only a small stats pack.

Extra Metric stats rotate by day. If all fit under the token and character
limits, all can be used. If not, only today’s slice is used in the post and the
rest stays in the log.

## Steps

| Step | Metric | Daily Record Now | Current Status | Next Improvement |
|---|---|---|---|---|
| `mvp-1.1` | Superior | Daily F10.7 solar flux | implemented; current or lagged by provider date | NOAA/SWPC cross-check |
| `mvp-1.2` | Verities | Daily Wikimedia pageviews | implemented with lag note | GDELT attention source |
| `mvp-1.3` | Evolution | Daily NASA POWER temperature anomaly | implemented with revision note | NOAA/GHCN station panel |
| `mvp-1.4` | Transformations | Daily GDACS/WHO hazard/outbreak counts | implemented with hazard/outbreak split | ReliefWeb count |
| `mvp-1.5` | Structure | Daily Wikimedia politics/institution pageviews | implemented with lag note | GDELT politics/election share |
| `mvp-1.6` | Voice | Daily Crossref science metadata count | implemented; current or lagged by provider date | OpenAlex or Semantic Scholar check |
| `mvp-1.7` | Empiric | Daily Wikimedia culture breadth | implemented with lag note | GDELT GKG/theme breadth |
| `mvp-2.1` | Troops | Official UCDP record plus GDELT conflict proxy | proxy-active; official UCDP can still be delayed or missing | review proxy performance before any official switch |
| `mvp-2.2` | Staple | Daily record from monthly World Bank commodity baseline | implemented, but monthly cadence limits daily Pulse | add daily WTI/oil proxy from EIA or FRED |
| `mvp-1.10` | Venture | SEC quarterly bulk Form D baseline | implemented, but delayed by quarterly source cadence | current EDGAR Form D operating-company parser |
| `mvp-1.11` | Emotions | Daily TSA passenger data | implemented; current or lagged by provider date | retail/food-service activity |
| `mvp-1.12` | Thrills | Daily OFR FSI | implemented with business-day cadence | VIX stress check |
| `mvp-1.13` | System | Daily DefiLlama TVL | implemented; current or lagged by provider date | direct chain-level TVL basket |
| `mvp-1.14` | Vision | Daily Coinbase BTC | implemented; current or lagged by provider date | ETH or crypto breadth source |
| `mvp-1.15` | Execution | Daily record from monthly Census BFS baseline | implemented, but monthly cadence limits daily Pulse | weekly HBA record, carried daily |
| `mvp-1.16` | Trust | SEC quarterly bulk Form D baseline | implemented, but delayed by quarterly source cadence | current EDGAR pooled-fund Form D parser |

## Sources And Improvement Ideas

| Metric | Current Source | Better Next Source |
|---|---|---|
| Superior | [Natural Resources Canada/NRC solar flux](https://www.spaceweather.gc.ca/forecast-prevision/solar-solaire/solarflux/sx-en.php) | NOAA/SWPC cross-check if enough history is available |
| Verities | [Wikimedia Pageviews](https://doc.wikimedia.org/generated-data-platform/aqs/analytics-api/reference/page-views.html) | GDELT attention query after terms check |
| Evolution | [NASA POWER Daily API](https://power.larc.nasa.gov/docs/services/api/temporal/daily/) | NOAA/GHCN station anomaly panel |
| Transformations | [GDACS](https://www.gdacs.org/Documents/2025/GDACS_API_quickstart_v2.pdf) and [WHO DON](https://www.who.int/emergencies/disease-outbreak-news) | ReliefWeb disaster-report count after terms check |
| Structure | [Wikimedia Pageviews](https://doc.wikimedia.org/generated-data-platform/aqs/analytics-api/reference/page-views.html) | GDELT politics/election event share |
| Voice | [Crossref REST API](https://www.crossref.org/documentation/retrieve-metadata/rest-api/) | OpenAlex or Semantic Scholar second source |
| Empiric | [Wikimedia Pageviews](https://doc.wikimedia.org/generated-data-platform/aqs/analytics-api/reference/page-views.html) | GDELT GKG/theme breadth |
| Troops | [UCDP](https://ucdp.uu.se/apidocs/) | GDELT DOC conflict-pressure proxy |
| Staple | [World Bank Commodity Markets](https://www.worldbank.org/en/research/commodity-markets) | EIA WTI daily price or FRED oil daily proxy |
| Venture | [SEC Form D datasets](https://www.sec.gov/data-research/sec-markets-data/form-d-data-sets) | current EDGAR Form D feed parser |
| Emotions | [TSA passenger volumes](https://www.tsa.gov/travel/passenger-volumes) | Census retail/food-service activity |
| Thrills | [OFR FSI](https://www.financialresearch.gov/financial-stress-index/) | VIX as second market-stress check |
| System | [DefiLlama API docs](https://github.com/DefiLlama/api-docs/blob/main/llms-pro.txt) | direct chain-level TVL basket |
| Vision | [Coinbase Exchange docs](https://docs.cdp.coinbase.com/exchange/introduction/welcome) | ETH or crypto breadth source |
| Execution | [Census BFS](https://www.census.gov/econ/bfs/index.html) | weekly HBA via Census/FRED |
| Trust | [SEC Form D datasets](https://www.sec.gov/data-research/sec-markets-data/form-d-data-sets) | current EDGAR pooled-fund Form D parser |

## Result

Stage 2 daily records are complete: every Metric has daily records.

Daily, weekly and monthly graphs can be built from those records.

Graphs must show whether a value is fresh, lagged, carried forward, delayed or
missing. Proxy-active records must be labeled separately from official score
records.