generated from mathias/template-go-web
feat: project setup — research structure, specs, decisions, conventions #1
@@ -0,0 +1,36 @@
|
||||
# Data
|
||||
|
||||
Raw and processed FX data is **gitignored** — never committed.
|
||||
|
||||
## Download: DUKASCopy G10 tick data
|
||||
|
||||
Use the provided fetch task:
|
||||
|
||||
```bash
|
||||
task data:fetch # downloads raw tick data → data/raw/
|
||||
task data:process # resamples to hourly OHLCV + features → data/processed/
|
||||
task data:validate # gap detection, outlier report, regime coverage check
|
||||
```
|
||||
|
||||
## Expected structure (local only)
|
||||
|
||||
```
|
||||
data/
|
||||
raw/ G10 pairs, tick OHLCV, 2003–present (gitignored)
|
||||
processed/ Hourly log-returns, rolling HV, VIX-merged (gitignored)
|
||||
cache/ Intermediate artefacts (gitignored)
|
||||
config.yaml Download configuration (committed)
|
||||
```
|
||||
|
||||
## Pairs
|
||||
|
||||
EUR/USD, GBP/USD, USD/JPY, USD/CHF, AUD/USD, USD/CAD, NZD/USD, EUR/GBP, EUR/JPY, EUR/CHF
|
||||
|
||||
## Splits
|
||||
|
||||
| Split | Date range | Purpose |
|
||||
|---|---|---|
|
||||
| Train | 2008-01-01 – 2022-12-31 | Model training only |
|
||||
| Held-out test | 2023-01-01 – 2023-12-31 | Final evaluation — do not open until evaluation |
|
||||
|
||||
**Training cutoff is hard: 2023-01-01. No post-2022 data informs any design decision.**
|
||||
Reference in New Issue
Block a user