1.7 KiB
git diff HEAD~1..HEAD -- piker/storage/__init__.py piker/storage/nativedb.py piker/storage/marketstore/__init__.py
Added an incremental storage update contract. NativeDB now validates canonical numeric OHLCV data, serializes writers both actor-locally and through cancellable filesystem locks, merges with incoming-wins seam resolution, regenerates contiguous indexes, reopens and validates a same-directory temporary parquet, fsyncs it, atomically replaces the target, fsyncs the directory, and publishes cache only after replacement.
NativeDB indexing ignores lock and crash-left temporary files. MarketStore uses its non-duplicate write mode for incremental updates.
git diff HEAD~1..HEAD -- piker/tsp/_history.py
Separated full provider deltas from capacity-truncated SHM pushes. Backfill persists before SHM mutation, publishes bounded notifications, and delays latest-frame publication until the concurrent pre-update storage snapshot completes.
git diff HEAD~1..HEAD -- tests/test_storage_nativedb.py tests/test_history_backfill.py
Added deterministic coverage for merge preservation, conflict policy, atomic failures, reopened-candidate validation, cache consistency, schema and timestamp invariants, contiguous index regeneration, separate series, stale temp indexing, cancellable file-lock contention, full provider-delta persistence, latest-frame ordering, and bounded notification teardown.
Verification generated with the patch:
- deterministic analysis/backfill/storage set: 31 passed
- Ruff: passed
git diff --check: passed- final adversarial review: no findings