pf_app
Go to file
Paul Trowbridge 2ee0d18f2e Fix large dataset loading in Forecast view
- Switch server Arrow encoding from tableFromJSON (row objects) to
  tableFromArrays (column arrays) — cuts peak Node heap 3-5x for large
  datasets by avoiding one JS object per row
- Remove unused pf.log JOIN from data endpoint; forecast rows only
- Load Perspective viewer with direct table reference instead of worker
  Server object — fixes "No Table attached" error on large datasets where
  named-table registry lookup raced against WASM initialization
- Pre-emptively clean up stale named table in worker registry before
  creating, eliminating the "already exists" retry path that silently
  swallowed errors (finally ran but flash never fired)
- Strip cfg.table from restore configs since table is loaded by reference
- Throttle progress bar updates to 100ms intervals (was every chunk)
- Persist load errors until dismissed; add console.error for devtools

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-21 20:52:47 -04:00
lib Reference offsets, edit visual cues, todo updates 2026-04-29 11:08:49 -04:00
public Add UX mockup and update spec with navigation direction 2026-04-25 14:56:29 -04:00
routes Fix large dataset loading in Forecast view 2026-05-21 20:52:47 -04:00
setup_sql Add per-source default Perspective layout 2026-04-29 22:31:23 -04:00
ui Fix large dataset loading in Forecast view 2026-05-21 20:52:47 -04:00
.env.example Initial commit — pivot forecast application 2026-04-01 07:59:05 -04:00
.gitignore Scaffold React/Vite/Tailwind UI with 3-step Setup → Baseline → Forecast flow 2026-04-25 16:28:45 -04:00
CLAUDE.md Add CLAUDE.md project instructions and license field to package.json 2026-05-02 20:47:15 -04:00
install.sh Initial commit — pivot forecast application 2026-04-01 07:59:05 -04:00
package-lock.json Fix forecast data load and add byte-progress UI 2026-04-28 19:51:39 -04:00
package.json Add CLAUDE.md project instructions and license field to package.json 2026-05-02 20:47:15 -04:00
pf_perspective_options.md Document Perspective architecture options 2026-04-28 20:21:19 -04:00
pf_spec.md Spec: add OR filter groups, raw_where escape hatch, and Arrow IPC streaming for large datasets 2026-04-27 22:50:02 -04:00
pf_ux_mockup.md Add UX mockup and update spec with navigation direction 2026-04-25 14:56:29 -04:00
pf.sh Add pf.sh — interactive deployment and service management script 2026-05-02 20:58:39 -04:00
server.js Fix forecast data load and add byte-progress UI 2026-04-28 19:51:39 -04:00
todo.md Reference offsets, edit visual cues, todo updates 2026-04-29 11:08:49 -04:00