pf_app
Go to file
Paul Trowbridge a6e6efd36e Switch /data endpoint to Arrow IPC stream with pg cursor batching
Server streams rows from a pg cursor in 10k-row batches, building Arrow
record batches incrementally and piping them as chunked HTTP response —
Node.js heap stays bounded regardless of dataset size.

Client fetches as arrayBuffer() and loads directly into Perspective worker
(native Arrow path, no JSON deserialization). X-Row-Count header drives
a non-blocking banner for datasets >= 500k rows. validCols now derived
from col_meta rather than from row keys.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-27 22:57:47 -04:00
lib Fix Forecast pivot row click, buildWhere, and add resizable panel 2026-04-25 20:21:13 -04:00
public Add UX mockup and update spec with navigation direction 2026-04-25 14:56:29 -04:00
routes Switch /data endpoint to Arrow IPC stream with pg cursor batching 2026-04-27 22:57:47 -04:00
setup_sql Initial commit — pivot forecast application 2026-04-01 07:59:05 -04:00
ui Switch /data endpoint to Arrow IPC stream with pg cursor batching 2026-04-27 22:57:47 -04:00
.env.example Initial commit — pivot forecast application 2026-04-01 07:59:05 -04:00
.gitignore Scaffold React/Vite/Tailwind UI with 3-step Setup → Baseline → Forecast flow 2026-04-25 16:28:45 -04:00
install.sh Initial commit — pivot forecast application 2026-04-01 07:59:05 -04:00
package-lock.json Switch /data endpoint to Arrow IPC stream with pg cursor batching 2026-04-27 22:57:47 -04:00
package.json Switch /data endpoint to Arrow IPC stream with pg cursor batching 2026-04-27 22:57:47 -04:00
pf_spec.md Spec: add OR filter groups, raw_where escape hatch, and Arrow IPC streaming for large datasets 2026-04-27 22:50:02 -04:00
pf_ux_mockup.md Add UX mockup and update spec with navigation direction 2026-04-25 14:56:29 -04:00
server.js Scaffold React/Vite/Tailwind UI with 3-step Setup → Baseline → Forecast flow 2026-04-25 16:28:45 -04:00