Compare commits

..

36 Commits

Author SHA1 Message Date
890f10cbab Catch order status changes via an open-order hot set
Hold/release rewrites OCRH.DCSTAT and DCHREA without touching any date
column, so no watermark could see it. A full-table row diff of LGDAT.OCRH
vs cms.ocrh (468,823 rows both sides) found 168 drifted rows, 0 missing,
0 extra -- and 159 of them changed with no date moving at all (checked
dcudat/dcodat/dccdat/dcmdat/dchdat/dcxdat/dcsdat/dcmxdt). 155 of the
drifts were DCSTAT, 4 DCHREA.

Every drifted row was still open (DCSTAT in A/N/H/B); none had reached
'C'. Only ~2,044 of 468,823 orders are open, so re-pulling the whole open
set each run is cheap and catches 100% of the observed drift. Applied to
ocrh and to the two modules that read its changed-set, ocri and ocrs.

Result: drift 168 -> 11 rows, DCSTAT 155 -> 3.

No invoice-driven branch: tested against LGDAT.OCRHT (CMS's header change
log, keyed DC3TMSP-leading via logical OCRHTX1) over the live watermark
window -- 1,107 headers changed, 65 missed by the date branches, 0 missed
by dates+open, and a 5- or 30-day invoiced-orders branch added exactly 0.
Closing an order writes dcudat/dccdat, so the date window covers the flip.

Also evaluated LGDAT.OCRIT (the order-line change log) as a replacement
for the open-order branch and rejected it: at the live 8-day watermark it
reports 0 changed orders not already caught, at ~12x the predicate cost,
and its lower row count means it declines to pull 18k lines the open set
would -- safe only if CMS's logging is complete, which is unverified.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-11 11:02:57 -04:00
7921ebb7e1 Add README
Summary, install, then a fuller description starting with the tech stack.
Points at SPEC.md for architectural rationale rather than restating it, so
the two don't drift.

Also documents `pipekit export` / `pipekit apply`, which round-trip the
driver/connection/module/group config to text files and were missing from
CLAUDE.md.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-07 02:31:04 -04:00
002de48bba Make reconcile.py work against SQL Server / linked-server sources
reconcile.py was written against the DB2 LGDAT modules and broke four
different ways on the first GP module (sop30200):

- detect_source_from's regex handled at most a two-part name, so
  CHG.dbo.SOP30200 truncated to CHG.dbo -> "Invalid object name".
  Now matches 1-4 parts, including [bracketed] and "quoted" forms.

- Even fully qualified, that table only exists behind the GPSERVER
  linked server. Detect the module's OPENQUERY wrapper and push the
  aggregate through it, so the scan runs remotely and one row comes
  back instead of 1.6M rows crossing the link.

- OPENQUERY caps its passthrough string at 8000 chars and 291 metrics
  overran it. Split the metric list into chunks that fit and CROSS JOIN
  them back into one row; alias columns c0..cN since OPENQUERY rejects
  unnamed result columns (msg 8155). EXEC(@sql) AT has no such cap but
  needs RPC Out, which GPSERVER has disabled.

- Two dialect bugs that would hit any SQL Server source: T-SQL SUM(int)
  stays int and overflowed at 2^31 where Postgres promotes to bigint,
  and T-SQL has no LENGTH. Added Driver.sum_expression /
  length_expression with mssql overrides -- integer types cast to
  BIGINT (decimals left alone so scale isn't lost), LENGTH -> LEN.

--super-quick and --quick now run clean end to end. Full depth is
syntax-checked only; it wasn't run against the server.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-07 02:25:24 -04:00
e5c1ed37f4 updates 2026-08-06 15:39:22 -04:00
38e490aaaf Add CMS→pipekit migration plan doc
Scope, decisions (dest schema cms.*, fresh DB2 introspection, one table
per cutover), module recipe, and the remaining backlog.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-05 15:48:45 -04:00
0db719c835 Add reconcile.py --super-quick and derived-column support
--super-quick compares only COUNT(*) and COUNT(DISTINCT merge_key) —
seconds on multi-million-row tables, enough to catch missing/duplicated
rows but blind to changed values.

Also fix derived merge keys: columns_json source_name can hold a SQL
expression (e.g. SUBSTR(GGKEY,1,9)), which must be emitted verbatim
rather than quoted as an identifier (SQL0206) or re-transformed.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-05 15:48:45 -04:00
560056c39c Add Bucket 2 CMS incremental modules (6 tables)
Watermarked incremental syncs for qcrh, qcri, qtnote, iprcct, icstt, methh,
ported from the legacy /opt/sync merge logic. Rows initially backfilled from
lgdat; columns match the cms.* dest (lgdat subset), pulled from DB2.

Merge keys: qcrh dcord#, qcri ddord#, qtnote ggkey, iprcct tadate,
icstt jhdate (legacy INSERT..ON CONFLICT -> keyed delete+insert),
methh composite anpart,anplnt (legacy DELETE WHERE EXISTS).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-27 22:17:39 -04:00
85c2295f63 Keep status pills on one line (white-space: nowrap)
Two-word statuses like "never ran" wrapped the module-list row.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-27 12:33:48 -04:00
a9742c8a38 Sync sqlserver connection default_dest_schema to gp
Export reconciliation: the db has default_dest_schema=gp for the sqlserver
connection (GP tables land in gp.*); bring the config file in line.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-27 12:33:48 -04:00
6a3ac0e436 Add Bucket 1 CMS→pipekit modules (41 tables)
Full-reload modules for the CMS/DB2 tables migrated off /opt/sync, landing
in cms.*. Columns introspected fresh from DB2 (QSYS2.SYSCOLUMNS). Three large
tables use incremental merge ported from the legacy sync instead of full
reload: iprcctn/iprccto (date watermark on t8date/t7date), ffpdglr1 (fiscal-
period watermark via rprh join, keyed on btid).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-27 12:33:48 -04:00
c073e70114 Fix _custom_sales_line_connector map: dest_names to match table
Five dest_names in the column map were junk from a crude source-name
sanitizer (ext._price, margin__, _hd_grower, ext._cost,
ext._margin_dollar) and didn't match the physical gp table's clean names
(ext_price, margin_pct, hd_grower, ext_cost, ext_margin_dollar). The load
is positional so this was harmless for years — until the new dest-table
preflight's name check started (correctly) flagging the drift and failing
the daily run. Align the map to the table.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-27 10:09:52 -04:00
515bfce37c Merge feat/dest-preflight: destination-table preflight in run path 2026-07-27 09:32:21 -04:00
72750cb57f Add destination-table preflight to the run path
The engine built staging as `LIKE dest` and merged into it without ever
checking the destination existed — a missing dest (e.g. a file-based deploy
that never went through the web wizard) failed deep in the staging step with
a raw `relation ... does not exist`.

Add `engine/dest.reconcile_dest()`, called as step 3b of run_module (after the
dry-run return, before staging):
  - missing + not create -> DestError telling the user to pass --create-dest
  - missing + create     -> CREATE SCHEMA + CREATE TABLE from the module's
                            column map
  - exists               -> fail loudly if any mapped column is absent (drift);
                            no auto-ALTER, since the positional load can't
                            tolerate a mid-table add

Expose via `pipekit run --create-dest`. Default (scheduled groups, API) is
unchanged: validate-and-fail, never silently provision.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-24 12:35:02 -04:00
921efebdae feat: cross-DB reconciliation tool
reconcile.py compares a module's live source table against its synced dest
using column-wise aggregates (COUNT/SUM/MIN/MAX/SUM(LENGTH)) — arithmetic and
ordering that DB2 for i and Postgres compute identically, so no shared hash or
byte-identical serialization is needed. Re-applies the module's per-column
source transform (default_expression) so aggregates line up when row sets
agree; exits non-zero on any divergence.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-22 15:21:17 -04:00
720ea52877 activate the ffsbglr1 2026-07-22 15:16:07 -04:00
9a11050d3b feat: show last-run duration on the groups list
groups_index attaches last_duration_s from the latest group run; groups.html
renders it as a new right-aligned duration column (— when never run).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-22 15:12:17 -04:00
3b3fe6f865 feat: module descriptions, modules-list redesign, abandoned-run sweep
Modules:
- add `description` column (schema + migration); create/update/wizard/edit
  forms and module detail all carry it

Modules list page:
- columns: name, description, groups, last run, rows, duration, status
  (dropped strategy/dest and the run/dry-run buttons)
- every column click-to-sort; description truncates single-line with ellipsis
- compact grid; restore main max-width (now 1400px)
- status pill partial is now a <span> so it sits in its own cell

Startup reliability:
- reconcile_abandoned_runs(): on boot, mark run_log/group_run rows stuck in
  `running` (left by a hard kill mid-run) as `error`, complementing the
  existing stale module-lock sweep

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-22 15:06:42 -04:00
dd9f89f4b5 feat: version-control pipeline definitions via export/apply
Add `pipekit export` / `pipekit apply` (pipekit/config_io.py) to serialise the
DB's config — drivers, connections, modules (+ columns, watermarks, hooks),
groups, schedules — to a git-trackable text tree under config/, and rehydrate
it. SQLite stays runtime state; definitions become diffable/reviewable/
revertible.

- config only: run_log/group_run/settings and per-run state columns excluded
- name-keyed refs (portable across databases); source_query in .sql sidecars;
  columns as real JSON arrays for line-by-line diffs
- newline-normalised so CRLF-vs-LF is never a spurious change
- apply is create/update by name; child collections fully synced; top-level
  deletes gated behind --prune; --dry-run prints the plan
- round-trip is identity (export -> apply --dry-run == nothing to do)

Commits the current config/ as the first baseline, capturing the freshly
populated columns_json for rm00101/rm00301/iv00101. Documented in SPEC.md.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-22 10:56:55 -04:00
4f83e8d991 feat: cancel an in-flight module run
Adds run cancellation, which had no implementation despite `cancelled`
being a declared run status.

Mechanism: API/web/scheduler runs execute as background tasks in the
service process, so `running_pid`'s PID is the service itself — killing it
is not an option. Instead, engine/cancel.py keeps an in-process registry of
run_id -> live jrunner Popen. The cancel handler (same process) terminates
that subprocess; migrate then fails and the engine records the run as
`cancelled` (not `error`) and releases the lock in its finally. Checkpoints
before migrate and before merge honor a cancel flag set between phases.

- engine/cancel.py: registry (arm/register/unregister/is_cancelled/request_cancel) + RunCancelled
- jrunner.migrate: optional proc_hook to expose the live Popen (no engine dependency)
- runner: arm, register via proc_hook, two checkpoints, classify cancelled, unregister
- POST /api/modules/{id}/cancel (extracts run_id from the lock) and POST /runs/{id}/cancel (web)
- cancel button on run detail + live fragment, shown while running
- api/app lifespan: clear stale locks (dead PID / >24h) at startup via the existing
  repo.clear_stale_locks, so a hard service kill no longer wedges `running=1`

Verified: real subprocess terminate -> status=cancelled, lock released;
endpoints return 409 (not running) / 404 (unknown) / 200 (fragment).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-10 04:06:24 -04:00
3562dfa581 merge: quote merge-key identifiers with dest dialect
Incremental merge interpolated merge-key columns raw, so a key with a
character illegal in a bare identifier (e.g. dcord#) produced
WHERE dcord# IN (...) and Postgres errored at "IN". build_merge_sql now
takes the dest driver and quotes each key via quote_identifier (clean
names stay bare, the rest wrap in the dialect's quotes).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-07 23:57:58 -04:00
0ddb636f14 jrunner: use bulk copy (-b) for Postgres dests too (COPY)
Extend the -b wiring to jdbc:postgresql: dests, so DB2->PG (and any PG-dest)
loads use jrunner's COPY FROM STDIN path instead of batched INSERTs. SQL
Server already used -b (SQLServerBulkCopy); DB2 dests stay on INSERT. Update
the CLAUDE.md bulk section accordingly.

Validated DB2->PG COPY with real types (dates -> date col, decimals ->
numeric, char) and null/empty-string fidelity.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-18 23:14:15 -04:00
f4d8cd005d docs: document add-column, bulk copy, logging, live-log collapse
Catch CLAUDE.md up to features shipped this cycle:
- post-creation "+ add column" (ALTER ADD at tail, stable column ids)
- auto bulk copy for SQL Server dests (jrunner -b) + the PG streaming note
- HTTPException + masked request-body logging
- live_log progress-tick collapse to a single updating line

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-18 22:53:12 -04:00
e9ff37a3a0 web: collapse jrunner progress ticks in live_log to a single line
jrunner prints an in-place progress counter (a bare number) every batch;
read with universal newlines, each tick became its own live_log line, so a
large load stacked thousands of numbers (a 1.27M-row INSERT left 5,073
progress lines). append_run_live_log now overwrites a trailing bare-number
line with the new tick instead of appending, keeping a single current count.
Real lines (headers, "N rows written", timestamps) aren't bare numbers and
are preserved. No jrunner change.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-18 07:52:34 -04:00
ad14d0f5c9 jrunner: use bulk copy (-b) for SQL Server destinations
Pass jrunner's -b flag when the dest JDBC URL is jdbc:sqlserver:, so SQL
Server loads stream via TDS bulk copy instead of 250-row INSERT...VALUES
round trips. Non-SQL-Server dests are unchanged. Requires the jrunner -b
support (bulk-copy branch).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-17 22:22:32 -04:00
40c00bca7b web: quote wizard source-query aliases with the source dialect
wizard_create built the generated source query's column aliases with the
DEST driver's quote_identifier, but that query runs on the SOURCE. A pg->SQL
Server module emitted "AS [col]" (SQL Server brackets) into a Postgres query,
which failed with: syntax error at or near "[". The load maps columns by
position, so the alias is cosmetic — quote it with the source dialect.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-17 15:20:30 -04:00
ea90b3f56a api: log request payload (secrets masked) on raised HTTPExceptions
Add an ASGI middleware that buffers each request body onto the scope and
replays it downstream, so the HTTPException handler can log the submitted
payload alongside the error. Fields whose name looks secret (password/pwd/
secret/token) are masked. Makes failures like the wizard 500 debuggable
against the actual call content.

Covers raised HTTPExceptions; handlers that *return* an error response are
not body-logged yet.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-17 15:20:30 -04:00
74967c1e56 jrunner: treat SQL Server's 'no result set' DDL trace as benign
run_dest_sql executes DDL via jrunner query mode (executeQuery), which demands
a ResultSet. CREATE SCHEMA/TABLE produce none, so the driver throws, jrunner
logs the trace and exits 0, and _detect_silent_failure flags it as a failure
unless the message is allowlisted. Only PG's wording was listed ("No results
were returned by the query"); SQL Server says "The statement did not return a
result set." — so pg->mssql wizard provisioning died on the first statement.
Add the SQL Server phrasing to the benign list.

Verified against the live SQL Server connection.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-17 15:20:30 -04:00
356e5f7799 api: log HTTPException responses (5xx + 4xx) to the journal
Failures surfaced via HTTPException (e.g. wizard dest-provisioning errors
raised as HTTPException(500, "dest provisioning failed: …")) were turned
into responses by FastAPI and never logged — only the access line showed,
so the real DB error went to the browser and vanished from the journal.

Register a StarletteHTTPException handler that logs 5xx at ERROR (with
exc_info, capturing the chained cause) and 4xx at WARNING, then defers to
the default handler. Also configure pipekit's logger to emit to stderr so
INFO-level records aren't dropped by uvicorn's last-resort handler.
Unhandled (non-HTTPException) errors were already logged by uvicorn.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-17 09:37:46 -04:00
7202b86210 web: add columns to an existing module's target table (Phase 0+1)
Modules' column listings were write-once at wizard time — no way to add a
column to an established sync (e.g. an RRN watermark column on a history
table) without hand-editing columns_json and ALTERing the dest by hand.

Phase 0 (groundwork):
- columns_json rows get a stable `id` (c1, c2, …) — the data-movement
  identity for future schema reconciliation (the load is positional).
- repo.update_module_columns to persist the listing.
- Driver.build_add_column_sql + Driver.column_inventory.

Phase 1 (append a column):
- "+ add column" on the module detail page -> column_form.html.
- POST /modules/{id}/columns: validates the name isn't already in the
  listing or on the table, runs ALTER TABLE … ADD COLUMN (appends at the
  tail, rows preserved), applies COMMENT ON COLUMN where supported, and
  appends to columns_json. Re-renders with an error on conflict/DDL failure.

Append-only and non-destructive; reorder/retype/drop (which can require a
table rebuild) are out of scope for this phase. Verified end-to-end against
the live PG dest on a throwaway module.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-12 10:09:12 -04:00
da0396bff9 web: add SQL-entry path to the new-module wizard
The wizard previously required picking a single source table; modules whose
entry point is arbitrary SQL (CTEs, joins, computed columns) didn't fit. Add a
"write SQL" path alongside "browse a table":

- Driver.introspect_query_columns + _zero_row_wrap discover a query's result
  columns by running it with ~no rows. Generic wrap is a derived table with
  WHERE 1=0; DB2 appends FETCH FIRST 1 ROW ONLY (DB2 for i forbids WITH inside
  a nested table expression).
- /wizard/sql + POST /wizard/sql/columns seed the column-mapping grid; dest
  types default to text (no result-set type metadata over jrunner CSV).
- wizard_step3.html grows a sql_mode branch (array-named inputs, query shown
  verbatim, no column unchecking); wizard_create branches on entry_mode.

Verified end-to-end against a live DB2 for i connection, including a top-level
CTE query.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-11 09:05:39 -04:00
e7576926ae drivers: make staging DDL dialect-aware; stop tracking pipekit.db
Add dialect-aware DDL hooks to the Driver base (create_schema_sql,
drop_table_if_exists_sql, create_like_table_sql, check_dest_table) and
implement DB2/MSSQL overrides so they can serve as merge destinations,
not just Postgres. runner.py now dispatches staging table creation
through the dest driver instead of hardcoding PG syntax.

Also untrack pipekit.db (runtime SQLite state) and add it to .gitignore.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-10 23:33:36 -04:00
f8490a2d4f deploy/cli: fix /etc/pipekit permissions so non-root group members can write secrets
- deploy.sh: set /etc/pipekit to root:pipekit 0775 and secrets.env to
  pipekit:pipekit 0640 so group members can run 'pipekit secrets set'
  without sudo
- cli.py secrets set: drop os.chown() on temp file — non-root users
  can't chown to the pipekit service user, and os.replace() preserves
  the target file's ownership anyway

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-04 13:35:06 -04:00
31135cf5be web: add session-cookie login for web UI
- New pipekit/web/auth.py: itsdangerous-signed cookie, 8hr expiry,
  auto-generates signing secret in settings table on first use
- GET/POST /login and POST /logout routes (public, no auth dependency)
- All other web routes protected via router-level require_web_auth dep
- Starlette middleware injects request.state.current_user for templates
- Topbar shows logged-in username + logout button when session active
- Reuses existing api_user/api_pass credentials and api_auth_enabled flag
- Add itsdangerous>=2.1 to requirements.txt
- Enable api_auth_enabled in config.yaml

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-04 13:21:50 -04:00
583dc16c9b web: tighten module list column widths and fix form input overflow
- Size all table columns to fit content (em-based) rather than loose percentages
- Add white-space:nowrap to groups header and last-run cells
- Sticky topbar and panel header so New Module button stays visible while scrolling
- Scope min-width:0 to label.field inputs so they don't blow past two-col grid borders

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-04 10:52:23 -04:00
ba48b2ca2b CLAUDE.md: document local time scheduling and JAVA_HOME deploy behavior
Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-03 23:51:12 -04:00
a6cc8da83f Merge branch 'localtime'
- Convert all timestamps to local time for display and scheduling
- deploy.sh: detect JAVA_HOME and inject into systemd unit at deploy time
- repo: add duration_s to get_group_run query
2026-06-03 23:49:43 -04:00
284 changed files with 54933 additions and 183 deletions

3
.gitignore vendored
View File

@ -2,7 +2,8 @@ __pycache__/
*.py[cod]
*.egg-info/
# SQLite WAL/journal artifacts — db file itself is tracked for backup.
# SQLite database and its WAL/journal artifacts — runtime state, not tracked.
pipekit.db
pipekit.db-journal
pipekit.db-wal
pipekit.db-shm

View File

@ -100,9 +100,15 @@ Passwords in connections are stored as `$VAR_NAME` references. At run time they
Each driver in `pipekit/drivers/` inherits from `base.py::Driver` and implements: `browse_fields`, `list_tables`, `list_schemas`, `get_columns`, `map_type`, `default_expression`, `quote_identifier`. The wizard UI calls `/api/introspect/*` which dispatches to the appropriate driver.
## Wizard Entry Modes
Step 1 offers two paths. **Browse a table** (`/wizard/tables` → `/wizard/columns`) is the original flow: pick one source table, introspect its columns. **Write SQL** (`/wizard/sql` → `POST /wizard/sql/columns`) starts from an arbitrary query — the source query is used verbatim and its result columns are discovered by `Driver.introspect_query_columns`, which runs the query wrapped to fetch ~no rows (`_zero_row_wrap`: derived-table + `WHERE 1=0` by default; DB2 appends `FETCH FIRST 1 ROW ONLY` since DB2 for i forbids `WITH` inside a nested table expression). Both paths land on `wizard_step3.html` (the SQL path passes `sql_mode=True`) and POST to `/wizard/create`, which branches on `entry_mode`. SQL-mode dest types default to `text` — there's no result-set type metadata over jrunner's CSV output, so the user adjusts types by hand. `columns_json` is never read at run time (the engine does `CREATE staging LIKE dest` + `SELECT *`); it only drives the dest `CREATE TABLE`.
## Module Columns
Modules store their column mapping as `columns_json` — a JSON list of dicts with keys `source_name`, `source_type`, `dest_name`, `dest_type`. The engine uses this to build the staging CREATE TABLE and the merge INSERT column lists.
Modules store their column mapping as `columns_json` — a JSON list of dicts with keys `source_name`, `source_type`, `dest_name`, `dest_type` (and a stable `id`). It drives the dest `CREATE TABLE`; the engine itself doesn't read it at run time (it does `CREATE staging LIKE dest` + `SELECT *`).
**Post-creation column add.** The module detail page's Schema panel has a "+ add column" action (`/modules/{id}/columns/new` → `POST /modules/{id}/columns`) that appends a column to an existing module: it `ALTER TABLE … ADD COLUMN`s the dest (always at the tail — the only position ALTER supports, which keeps the positional load aligned), applies a column comment where supported, and appends to `columns_json`. Each column row carries a stable `id` (`c1`, `c2`, …) — the data-movement identity for future schema reconciliation. Add is the only mutation for now; reorder/retype/drop (which can require a table rebuild) are not implemented. Driver methods: `build_add_column_sql`, `column_inventory`.
## Inline Watermark Editing
@ -116,9 +122,13 @@ Watermarks are managed inline on both the module edit form and wizard step 3 (no
Recreated on every run as `pipekit_staging.{module_name}` (DROP + CREATE, not IF NOT EXISTS). Ephemeral — exists only during the run.
## Bulk Copy
`jrunner.migrate` passes jrunner's `-b` flag when the dest is SQL Server (`jdbc:sqlserver:`) or Postgres (`jdbc:postgresql:`), so loads use the dest's native bulk path instead of batched `INSERT…VALUES`**SQL Server** via `SQLServerBulkCopy` (TDS bulk-load), **Postgres** via `COPY … FROM STDIN`. Dramatically faster on large/wide tables (a 1.27M-row SQL Server load went ~111 min → ~4 min). DB2 dests keep the INSERT path. Automatic per-dest; no module config. (Requires jrunner with `-b` support.) Note: jrunner only streams the **Postgres source** without buffering it all into memory because it sets `autoCommit(false)` on the source connection in migration mode — a PG-driver requirement for `setFetchSize` to take effect.
## Scheduler
`pipekit/scheduler.py` runs a single daemon thread (started via FastAPI lifespan in `api/app.py`). It wakes every 60 s, reads all enabled schedules, and fires `run_group` for any whose next cron occurrence has passed since `last_fired_at`. `last_fired_at` is written to the DB before the run thread is spawned — prevents double-fire if a run is slow or pipekit restarts mid-run. Uses `croniter` for cron expression evaluation.
`pipekit/scheduler.py` runs a single daemon thread (started via FastAPI lifespan in `api/app.py`). It wakes every 60 s, reads all enabled schedules, and fires `run_group` for any whose next cron occurrence has passed since `last_fired_at`. `last_fired_at` is written to the DB before the run thread is spawned — prevents double-fire if a run is slow or pipekit restarts mid-run. Uses `croniter` for cron expression evaluation. Cron expressions are evaluated in **local server time** (not UTC) — `0 4 * * *` fires at 04:00 local.
## API vs. Web
@ -128,12 +138,20 @@ Recreated on every run as `pipekit_staging.{module_name}` (DROP + CREATE, not IF
- `GET /runs/{id}/live` — HTML fragment endpoint; HTMX polls this every 2 s while status=running to show live_log + status
- `/groups/*` — group CRUD, run, live fragment; `/group-runs/{id}` — group run detail with per-module run links
## Logging
`api/app.py` configures a `pipekit` logger to stderr (→ journal) and registers a `StarletteHTTPException` handler that logs 5xx at ERROR (with traceback) and 4xx at WARNING — because FastAPI otherwise turns `HTTPException` into a response and logs nothing (failures like wizard dest-provisioning errors were invisible). A small ASGI middleware (`_RequestBodyCapture`) buffers each request body and replays it downstream so the handler can log the submitted payload on failure, with secret-looking fields (password/pwd/secret/token) masked. Covers *raised* HTTPExceptions; handlers that *return* an error response aren't body-logged.
## Live-log progress collapse
jrunner prints an in-place progress counter (a bare number) per batch; read with universal newlines each tick is its own line, so a big load would stack thousands of numbers in `live_log`. `repo.append_run_live_log` collapses them: a bare-number tick overwrites a trailing bare-number line instead of appending, keeping a single current count. Real lines (headers, "N rows written", timestamps) are preserved. (Bulk copy emits a throttled counter every 10k rows, displayed the same way.)
## Tech Stack
- Python 3.10+, FastAPI, Uvicorn, Jinja2, PyYAML, SQLite3 (stdlib), croniter
- `python-multipart` required for HTML form POSTs (not auto-installed as a FastAPI transitive dep)
- Frontend: HTMX (CDN) + vanilla JS; Alpine.js is NOT loaded despite being listed in older docs
- jrunner: separate Java tool, must be on PATH
- jrunner: separate Java tool, must be on PATH; `JAVA_HOME` must also be set — `deploy.sh` detects and injects it into the systemd unit automatically
- Runs as the `pipekit` system user; venv at `/opt/pipekit/.venv` owned by that user; secrets at `/etc/pipekit/secrets.env` (mode 0640, group pipekit)
## Full Spec

212
README.md Normal file
View File

@ -0,0 +1,212 @@
# Pipekit
A database sync tool with a web UI. A **module** defines one job — a source
query against one database, merged into a destination table on another. Pipekit
resolves watermarks, runs the extract, stages the rows, merges them, and records
what happened. Modules can be grouped, ordered, and scheduled with cron.
It is an orchestration layer over [`jrunner`](#requirements), an external Java
CLI that does all the actual JDBC work. Pipekit never talks to a remote database
directly — it shells out. What it adds is the state, history, and UI that a
directory of shell scripts can't provide: run logs with timings and row counts,
live output while a job runs, a wizard for authoring new modules, and a
scheduler.
---
## Install
### Requirements
- **Python 3.10+**
- **jrunner** on `PATH`, with `JAVA_HOME` set — the Java CLI that performs every
JDBC read and write. Install `/opt/jrunner` first; `deploy.sh` refuses to run
without it and injects the detected `JAVA_HOME` into the systemd unit.
- **sudo** — the deploy creates a system user, writes to `/etc/pipekit`, and
installs a systemd unit.
### Deploy
```bash
./deploy.sh
```
Idempotent — re-run it after any code update. It creates the `pipekit` system
user and group, adds you to that group, builds the venv at `.venv`, installs the
`/usr/local/bin/pipekit` launcher, creates `/etc/pipekit/secrets.env` (mode
0640), initialises the SQLite schema, registers a JDBC driver row for every jar
shipped with jrunner, and installs the systemd unit. It does **not** start the
service.
Then add your connection passwords and start it:
```bash
sudo pipekit secrets set MYDB_PW # prompts if the value is omitted
sudo systemctl start pipekit
```
The web UI is on `api_port` from `config.yaml`**8200** by default.
### Service management
```bash
sudo systemctl status pipekit
sudo systemctl restart pipekit # after any code change
sudo journalctl -u pipekit -f # follow logs
```
### Running outside the service
```bash
pipekit serve # host/port from config.yaml
pipekit serve --host 0.0.0.0 --port 8080 --reload # dev, auto-reload
```
### CLI
```bash
pipekit init # create/upgrade the SQLite schema
pipekit doctor # health check: config, jrunner, DB
pipekit run <module_name> # run one module synchronously
pipekit set-password <user> # HTTP Basic Auth credentials for /api/*
pipekit secrets set KEY [VALUE] # add/update a secret
pipekit secrets list # show stored keys, never values
pipekit drivers list # registered driver kinds
```
Configuration also round-trips to plain text, so modules can be diffed and
version-controlled rather than living only in the database:
```bash
pipekit export # dump drivers/connections/modules/groups to <repo>/config
pipekit apply --dry-run # print the change plan without touching the DB
pipekit apply # rehydrate from those files, matching by name
pipekit apply --prune # also delete rows absent from the files
```
### Configuration
`config.yaml` in the repo root holds the database path, jrunner path, driver
directory, API host/port, and an optional SMTP block. Two environment variables
override the defaults: `PIPEKIT_CONFIG` for the config file and
`PIPEKIT_SECRETS` for the secrets file.
---
## About the project
### Tech stack
- **Python 3.10+** — no ORM, no migrations framework, no task queue
- **FastAPI + Uvicorn** for both the JSON API and the HTML pages
- **Jinja2** templates; **HTMX** (from CDN) plus vanilla JS for interactivity.
There is no build step and no frontend toolchain. Alpine.js is named in some
older docs but is not loaded.
- **SQLite** (stdlib `sqlite3`) — a single `pipekit.db` file holds all state
- **PyYAML** for config, **croniter** for schedule evaluation
- **python-multipart** — required for HTML form POSTs; it is not a transitive
dependency of the FastAPI base wheel, and form posts return 500 without it
- **jrunner** — a separate Java tool, the only thing that speaks JDBC
Deployed as the `pipekit` system user, venv at `/opt/pipekit/.venv`, secrets at
`/etc/pipekit/secrets.env`.
### Architecture
Five layers, bottom to top:
1. **SQLite** — one file, all state
2. **`repo.py`** — every CRUD operation for every table; the only module that
touches the database
3. **`engine/`** — runs a module: acquires the lock, resolves watermarks, calls
jrunner, builds and runs the merge, fires hooks, writes the run log, releases
the lock
4. **`api/`** — JSON REST under `/api/*`, HTTP Basic Auth (except `/health`)
5. **`web/`** — HTML pages at `/`, currently unauthenticated
### Data model
- **driver** — a registered JDBC driver (kind, jar, class, URL template)
- **connection** — a named database (JDBC URL, username, password)
- **module** — one sync job: source and dest connection, source query, merge
strategy and key, column map, enabled flag, running lock
- **watermark** — a named placeholder with its own resolver SQL. The first cell
of the first row is substituted for `{watermark_name}` in the source query.
- **hook** — post-merge SQL, ordered, fired on success / failure / always
- **run_log** — immutable history: resolved SQL, merge SQL, watermark values,
stdout/stderr, timings, and the live log streamed during the run
- **grp** / **group_member** / **group_run** — named, ordered sets of modules
and their executions
- **schedule** — a cron expression bound to a group, evaluated in **local server
time**
### How a run works
```
run_module(module_id)
→ atomic UPDATE module SET running=1 WHERE running=0 # fails if already locked
→ resolve each watermark via jrunner # always live, even on dry runs
→ substitute {name} tokens into the source query
→ build the merge SQL
→ if dry_run: write the run_log and stop — no data moves
→ DROP + CREATE pipekit_staging.{module_name} # self-heals schema drift
→ jrunner migrate: source → staging # stdout streamed to live_log
→ run the merge, then the hooks in order
→ write run_log; UPDATE module SET running=0 (in finally)
```
A group run creates a `group_run` row and calls `run_module` for each enabled
member in order. It continues past individual failures — every member runs — and
the group's final status reflects the worst outcome.
Run statuses: `running`, `success`, `dry_run`, `error`, `cancelled`.
### Merge strategies
- **full**`TRUNCATE` the dest, then insert everything
- **incremental** — delete the rows matching `merge_key`, then insert. The key is
stored comma-separated and expands to a multi-column predicate.
- **append** — insert only
The staging table is recreated on every run and exists only for the duration of
that run.
### Credentials
Connection passwords are stored as `$VAR_NAME` references, never as values. They
resolve at run time from `/etc/pipekit/secrets.env`. Secrets never reach the
database, and never appear on a command line.
### Performance note
When the destination is SQL Server or Postgres, jrunner is invoked with `-b` so
the load uses the native bulk path — `SQLServerBulkCopy` over TDS, or
`COPY … FROM STDIN`. This is automatic, per-destination, with nothing to
configure, and the difference is large: one 1.27M-row SQL Server load went from
~111 minutes to ~4. DB2 destinations keep the ordinary INSERT path.
### Reconciliation
`reconcile.py` compares a module's live source against its synced destination
using column-wise aggregates — counts, sums, min/max, summed lengths. These rely
only on arithmetic and ordering, which every backend computes identically, so no
shared hash function or byte-identical row serialisation is needed.
```bash
PIPEKIT_SECRETS=/etc/pipekit/secrets.env .venv/bin/python reconcile.py <module> [--quick]
```
Three depths: the default compares every column; `--quick` drops min/max and
length sums; `--super-quick` compares only row counts, which takes seconds even
on millions of rows and still catches missing or duplicated rows. Exit status is
non-zero when anything diverges. Note that it compares whole tables against a
live source, so an incremental module will always show drift proportional to the
time since its last run.
---
## Further reading
- **`SPEC.md`** — the authoritative design document, and the rationale behind
every architectural decision here
- **`CLAUDE.md`** — orientation for AI coding agents working in this repo

47
SPEC.md
View File

@ -115,6 +115,52 @@ User was uneasy about losing filesystem browsing. Resolution: the **TUI is the
file browser**. Inspecting a module feels like `cat`, editing opens `$EDITOR`,
the module list feels like `ls`. For raw access, `sqlite3 pipekit.db` works.
## Config as code (export / apply)
The SQLite file is **runtime state**; the pipeline *definitions* it holds are
**config** and belong in version control. Without this split there is no diff,
no review, no rollback, and no DR for the definitions — a bad web-UI edit (or a
one-off script) mutates operating state with only an `updated_at` to show for
it, and `pipekit.db` is gitignored (it's ~90 MB, mostly `run_log`).
Two CLI commands bridge the gap (`pipekit/config_io.py`):
- `pipekit export` — serialise the definitions to a text tree under `config/`.
- `pipekit apply [--dry-run] [--prune]` — rehydrate the DB from that tree.
Layout (`config/`, committed to git):
```
drivers.json # driver registry
connections.json # connections — passwords are $ENV refs, not secrets
groups.json # groups + members + schedules
modules/<name>.json # one module: def + columns[] + watermarks + hooks
modules/<name>.sql # that module's source_query (sidecar → clean diffs)
```
Principles:
- **Config only.** Run history (`run_log`, `group_run`, `settings`) and per-run
state columns (`running`, `running_pid`, `running_since`,
`next_resolved_query`, timestamps) are excluded. Those go to DB backups, not
git.
- **Name-keyed, not id-keyed.** Every cross-reference (driver, connection,
module) is by natural name, so the tree is portable across databases.
- **`columns` is a real JSON array**, not the stored `columns_json` blob — so a
column-map change diffs line-by-line. SQL lives in a `.sql` sidecar for the
same reason.
- **Newlines are normalised to LF** on both sides; CRLF-vs-LF never reads as a
change.
- **`apply` is safe by default.** It creates/updates top-level rows by name and
fully syncs child collections (watermarks by name; hooks and schedules
rebuilt). Top-level rows present in the DB but absent from the files are left
alone unless `--prune` is passed. `--dry-run` prints the plan and writes
nothing.
The DB stays the source of truth for *operation*; `config/` is the source of
truth for *definition*. Round-trip is identity: `export` then `apply --dry-run`
reports "nothing to do".
## Module model
A module = one sync job. Fields:
@ -672,6 +718,7 @@ behavior.
| Decision | Choice |
|---|---|
| Storage | SQLite, single file |
| Config vs state | Definitions are version-controlled via `pipekit export`/`apply` (text tree under `config/`); `pipekit.db` holds runtime state only |
| Where SQL lives | In the database (text blobs), not files |
| Source query shape | Free text with `{watermark}` placeholders |
| Columns | Parsed from query; not separate rows; wizard auto-introspects on create |

View File

@ -1,4 +1,5 @@
database: /opt/pipekit/pipekit.db
api_auth_enabled: true
jrunner_path: /usr/local/bin/jrunner
driver_dir: /opt/pipekit/drivers/
api_host: 0.0.0.0

32
config/connections.json Normal file
View File

@ -0,0 +1,32 @@
[
{
"name": "S78030956",
"driver": "db2-jt400",
"jdbc_url": "jdbc:as400://S7830956;libraries=RLARP,LGDAT,LGPGM;block size=512",
"username": "ptrowbridg",
"password": "$DB2PW",
"default_dest_connection": "usmidsap02",
"default_dest_schema": "cms",
"notes": "None"
},
{
"name": "sqlserver",
"driver": "mssql-jdbc",
"jdbc_url": "jdbc:sqlserver://usmidsql01:1433;databaseName=Fanalysis;encrypt=false",
"username": "Pricing",
"password": "$SQLCMDPASSWORD",
"default_dest_connection": "usmidsap02",
"default_dest_schema": "gp",
"notes": "None"
},
{
"name": "usmidsap02",
"driver": "postgresql",
"jdbc_url": "jdbc:postgresql://10.0.10.40:5432/ubm",
"username": "ptrowbridge",
"password": "$PGPW",
"default_dest_connection": null,
"default_dest_schema": "None",
"notes": "None"
}
]

23
config/drivers.json Normal file
View File

@ -0,0 +1,23 @@
[
{
"name": "db2-jt400",
"kind": "db2",
"jar_file": "/opt/jrunner/jrunner/build/install/jrunner/bin/../lib/jt400-11.0.jar",
"class_name": "com.ibm.as400.access.AS400JDBCDriver",
"url_template": null
},
{
"name": "mssql-jdbc",
"kind": "mssql",
"jar_file": "/opt/jrunner/jrunner/build/install/jrunner/bin/../lib/mssql-jdbc-9.2.0.jre8.jar",
"class_name": "com.microsoft.sqlserver.jdbc.SQLServerDriver",
"url_template": null
},
{
"name": "postgresql",
"kind": "pg",
"jar_file": "/opt/jrunner/jrunner/build/install/jrunner/bin/../lib/postgresql-42.5.0.jar",
"class_name": "org.postgresql.Driver",
"url_template": null
}
]

590
config/groups.json Normal file
View File

@ -0,0 +1,590 @@
[
{
"name": "Accounts Receivable",
"members": [
{
"module": "aroht",
"run_order": 0
},
{
"module": "arop",
"run_order": 0
},
{
"module": "artrn",
"run_order": 0
},
{
"module": "rm20101",
"run_order": 0
},
{
"module": "rm30101",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "0 1 * * *",
"enabled": 1
}
]
},
{
"name": "Codes",
"members": [
{
"module": "code",
"run_order": 0
},
{
"module": "color",
"run_order": 0
},
{
"module": "colorb",
"run_order": 0
},
{
"module": "colortier",
"run_order": 0
},
{
"module": "cret",
"run_order": 0
},
{
"module": "ffcret",
"run_order": 0
},
{
"module": "glie",
"run_order": 0
},
{
"module": "irea",
"run_order": 0
},
{
"module": "macgrp",
"run_order": 0
},
{
"module": "majg",
"run_order": 0
},
{
"module": "mmgp",
"run_order": 0
},
{
"module": "mmsl",
"run_order": 0
},
{
"module": "name",
"run_order": 0
},
{
"module": "plnt",
"run_order": 0
},
{
"module": "sach",
"run_order": 0
},
{
"module": "sscc",
"run_order": 0
},
{
"module": "sy03300",
"run_order": 0
},
{
"module": "terms",
"run_order": 0
},
{
"module": "usrd",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "0 1 * * *",
"enabled": 1
}
]
},
{
"name": "Cost History",
"members": [
{
"module": "icstt",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "30 3 * * *",
"enabled": 1
}
]
},
{
"name": "Customer",
"members": [
{
"module": "adrs",
"run_order": 0
},
{
"module": "cust",
"run_order": 0
},
{
"module": "usrcust",
"run_order": 0
},
{
"module": "vend",
"run_order": 0
},
{
"module": "rm00101",
"run_order": 1
},
{
"module": "rm00301",
"run_order": 2
}
],
"schedules": [
{
"cron_expr": "0 2 * * *",
"enabled": 1
}
]
},
{
"name": "Fiscal",
"members": [
{
"module": "armasc",
"run_order": 0
},
{
"module": "coa_map",
"run_order": 0
},
{
"module": "gl00100",
"run_order": 0
},
{
"module": "gl10110",
"run_order": 0
},
{
"module": "gl10111",
"run_order": 0
},
{
"module": "gl20000",
"run_order": 0
},
{
"module": "gl30000",
"run_order": 0
},
{
"module": "gtran",
"run_order": 0
},
{
"module": "sy40100",
"run_order": 0
},
{
"module": "fgrp",
"run_order": 1
},
{
"module": "ggtp",
"run_order": 2
},
{
"module": "gldate",
"run_order": 3
},
{
"module": "gldatref",
"run_order": 4
},
{
"module": "glmt",
"run_order": 5
},
{
"module": "ffsbglr1",
"run_order": 6
},
{
"module": "mast",
"run_order": 7
}
],
"schedules": [
{
"cron_expr": "0 1 * * *",
"enabled": 1
}
]
},
{
"name": "Future",
"members": [
{
"module": "fresre",
"run_order": 0
},
{
"module": "ftcstm",
"run_order": 0
},
{
"module": "ftcstp",
"run_order": 0
},
{
"module": "ftcstr",
"run_order": 0
}
],
"schedules": []
},
{
"name": "Inventory Master",
"members": [
{
"module": "itemm",
"run_order": 0
},
{
"module": "marktable",
"run_order": 0
},
{
"module": "mkptgroup",
"run_order": 0
},
{
"module": "moldmast",
"run_order": 0
},
{
"module": "stnote",
"run_order": 0
},
{
"module": "uqf",
"run_order": 0
},
{
"module": "iv00101",
"run_order": 1
}
],
"schedules": [
{
"cron_expr": "0 1 * * *",
"enabled": 1
}
]
},
{
"name": "Inventory On Hand",
"members": [
{
"module": "binb",
"run_order": 0
},
{
"module": "iv00102",
"run_order": 0
},
{
"module": "stkb",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "50 * * * *",
"enabled": 1
}
]
},
{
"name": "Price Lists",
"members": [
{
"module": "iprca",
"run_order": 0
},
{
"module": "iprcb",
"run_order": 0
},
{
"module": "iprcbhc",
"run_order": 0
},
{
"module": "iprcc",
"run_order": 0
},
{
"module": "iprcct",
"run_order": 0
},
{
"module": "iprcctn",
"run_order": 0
},
{
"module": "iprccto",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "0 3 * * *",
"enabled": 1
}
]
},
{
"name": "Product Structure",
"members": [
{
"module": "depts",
"run_order": 0
},
{
"module": "icstm",
"run_order": 0
},
{
"module": "icstp",
"run_order": 0
},
{
"module": "icstr",
"run_order": 0
},
{
"module": "methh",
"run_order": 0
},
{
"module": "opcode",
"run_order": 0
},
{
"module": "punit",
"run_order": 0
},
{
"module": "stka",
"run_order": 0
},
{
"module": "stkmm",
"run_order": 0
},
{
"module": "stkmp",
"run_order": 0
},
{
"module": "methdm",
"run_order": 1
},
{
"module": "methdo",
"run_order": 1
},
{
"module": "methdr",
"run_order": 1
},
{
"module": "resre",
"run_order": 1
}
],
"schedules": []
},
{
"name": "Production",
"members": [
{
"module": "rprh",
"run_order": 0
},
{
"module": "ffpdglr1",
"run_order": 1
}
],
"schedules": []
},
{
"name": "Quote Review",
"members": [
{
"module": "live_quotes",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "*/15 * * * *",
"enabled": 1
}
]
},
{
"name": "Quotes",
"members": [
{
"module": "qcrs",
"run_order": 0
},
{
"module": "qcrh",
"run_order": 1
},
{
"module": "qcri",
"run_order": 2
},
{
"module": "qtnote",
"run_order": 3
}
],
"schedules": [
{
"cron_expr": "55 * * * *",
"enabled": 1
}
]
},
{
"name": "Sales Matrix",
"members": [
{
"module": "_custom_sales_line_connector",
"run_order": 0
}
],
"schedules": [
{
"cron_expr": "20 2 * * *",
"enabled": 1
}
]
},
{
"name": "Sales Transactions",
"members": [
{
"module": "sop10100",
"run_order": 0
},
{
"module": "sop10102",
"run_order": 0
},
{
"module": "sop10200",
"run_order": 0
},
{
"module": "sop30200",
"run_order": 0
},
{
"module": "sop30300",
"run_order": 0
},
{
"module": "bolh",
"run_order": 1
},
{
"module": "ocrh",
"run_order": 1
},
{
"module": "oih",
"run_order": 1
},
{
"module": "bold",
"run_order": 2
},
{
"module": "ocri",
"run_order": 2
},
{
"module": "oid",
"run_order": 2
},
{
"module": "ocrs",
"run_order": 3
},
{
"module": "ois",
"run_order": 3
}
],
"schedules": [
{
"cron_expr": "0 * * * *",
"enabled": 1
}
]
},
{
"name": "Surcharges",
"members": [
{
"module": "dsdisc",
"run_order": 0
},
{
"module": "surcharge",
"run_order": 0
},
{
"module": "surchargep",
"run_order": 0
},
{
"module": "surchgexc",
"run_order": 0
},
{
"module": "usrc",
"run_order": 0
}
],
"schedules": []
}
]

View File

@ -0,0 +1,260 @@
{
"name": "_custom_sales_line_connector",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp._custom_sales_line_connector",
"staging_table": "pipekit_staging._custom_sales_line_connector",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "Doctype",
"source_type": "VARCHAR(25)",
"dest_name": "doctype",
"dest_type": "text",
"description": null
},
{
"source_name": "Doc Num",
"source_type": "VARCHAR(21)",
"dest_name": "doc_num",
"dest_type": "text",
"description": null
},
{
"source_name": "Original Doc",
"source_type": "VARCHAR(21)",
"dest_name": "original_doc",
"dest_type": "text",
"description": null
},
{
"source_name": "Doc Date",
"source_type": "DATE",
"dest_name": "doc_date",
"dest_type": "date",
"description": null
},
{
"source_name": "Order Date",
"source_type": "DATE",
"dest_name": "order_date",
"dest_type": "date",
"description": null
},
{
"source_name": "Req Date",
"source_type": "DATE",
"dest_name": "req_date",
"dest_type": "date",
"description": null
},
{
"source_name": "Prom Date",
"source_type": "DATE",
"dest_name": "prom_date",
"dest_type": "date",
"description": null
},
{
"source_name": "Cust Num",
"source_type": "VARCHAR(15)",
"dest_name": "cust_num",
"dest_type": "text",
"description": null
},
{
"source_name": "Cust Name",
"source_type": "VARCHAR(65)",
"dest_name": "cust_name",
"dest_type": "text",
"description": null
},
{
"source_name": "Rep ID",
"source_type": "VARCHAR(15)",
"dest_name": "rep_id",
"dest_type": "text",
"description": null
},
{
"source_name": "Rep Name",
"source_type": "VARCHAR(21)",
"dest_name": "rep_name",
"dest_type": "text",
"description": null
},
{
"source_name": "Cust PO",
"source_type": "VARCHAR(21)",
"dest_name": "cust_po",
"dest_type": "text",
"description": null
},
{
"source_name": "_HD_Grower",
"source_type": "VARCHAR(5)",
"dest_name": "hd_grower",
"dest_type": "text",
"description": null
},
{
"source_name": "Origin",
"source_type": "CHAR(11)",
"dest_name": "origin",
"dest_type": "text",
"description": null
},
{
"source_name": "Address Code",
"source_type": "VARCHAR(15)",
"dest_name": "address_code",
"dest_type": "text",
"description": null
},
{
"source_name": "State",
"source_type": "VARCHAR(29)",
"dest_name": "state",
"dest_type": "text",
"description": null
},
{
"source_name": "City",
"source_type": "VARCHAR(35)",
"dest_name": "city",
"dest_type": "text",
"description": null
},
{
"source_name": "Cust Channel",
"source_type": "VARCHAR(20)",
"dest_name": "cust_channel",
"dest_type": "text",
"description": null
},
{
"source_name": "Mold ID",
"source_type": "VARCHAR(8000)",
"dest_name": "mold_id",
"dest_type": "text",
"description": null
},
{
"source_name": "Item Num",
"source_type": "VARCHAR(31)",
"dest_name": "item_num",
"dest_type": "text",
"description": null
},
{
"source_name": "Item Description",
"source_type": "VARCHAR(101)",
"dest_name": "item_description",
"dest_type": "text",
"description": null
},
{
"source_name": "Quantity",
"source_type": "NUMERIC(19,5)",
"dest_name": "quantity",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "Collection",
"source_type": "VARCHAR(100)",
"dest_name": "collection",
"dest_type": "text",
"description": null
},
{
"source_name": "Segment",
"source_type": "VARCHAR(32)",
"dest_name": "segment",
"dest_type": "text",
"description": null
},
{
"source_name": "Unit Price",
"source_type": "NUMERIC(21,5)",
"dest_name": "unit_price",
"dest_type": "numeric(21,5)",
"description": null
},
{
"source_name": "Ext. Price",
"source_type": "NUMERIC(38,7)",
"dest_name": "ext_price",
"dest_type": "numeric(38,7)",
"description": null
},
{
"source_name": "Unit Cost",
"source_type": "NUMERIC(19,5)",
"dest_name": "unit_cost",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "Ext. Cost",
"source_type": "NUMERIC(38,9)",
"dest_name": "ext_cost",
"dest_type": "numeric(38,9)",
"description": null
},
{
"source_name": "Margin Dollar",
"source_type": "NUMERIC(22,5)",
"dest_name": "margin_dollar",
"dest_type": "numeric(22,5)",
"description": null
},
{
"source_name": "Ext. Margin Dollar",
"source_type": "NUMERIC(38,7)",
"dest_name": "ext_margin_dollar",
"dest_type": "numeric(38,7)",
"description": null
},
{
"source_name": "Margin %",
"source_type": "NVARCHAR(4000)",
"dest_name": "margin_pct",
"dest_type": "text",
"description": null
},
{
"source_name": "Job Number",
"source_type": "VARCHAR(25)",
"dest_name": "job_number",
"dest_type": "text",
"description": null
},
{
"source_name": "Program",
"source_type": "VARCHAR(100)",
"dest_name": "program",
"dest_type": "text",
"description": null
},
{
"source_name": "Container",
"source_type": "VARCHAR(25)",
"dest_name": "container",
"dest_type": "text",
"description": null
},
{
"source_name": "AOP Rep",
"source_type": "VARCHAR(10)",
"dest_name": "aop_rep",
"dest_type": "text",
"description": null
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,37 @@
SELECT
RTRIM([Doctype]) AS [doctype],
RTRIM([Doc Num]) AS [doc_num],
RTRIM([Original Doc]) AS [original_doc],
[Doc Date] AS [doc_date],
[Order Date] AS [order_date],
[Req Date] AS [req_date],
[Prom Date] AS [prom_date],
RTRIM([Cust Num]) AS [cust_num],
RTRIM([Cust Name]) AS [cust_name],
RTRIM([Rep ID]) AS [rep_id],
RTRIM([Rep Name]) AS [rep_name],
RTRIM([Cust PO]) AS [cust_po],
RTRIM([_HD_Grower]) AS [hd_grower],
RTRIM([Origin]) AS [origin],
RTRIM([Address Code]) AS [address_code],
RTRIM([State]) AS [state],
RTRIM([City]) AS [city],
RTRIM([Cust Channel]) AS [cust_channel],
RTRIM([Mold ID]) AS [mold_id],
RTRIM([Item Num]) AS [item_num],
RTRIM([Item Description]) AS [item_description],
[Quantity] AS [quantity],
RTRIM([Collection]) AS [collection],
RTRIM([Segment]) AS [segment],
[Unit Price] AS [unit_price],
[Ext. Price] AS [ext_price],
[Unit Cost] AS [unit_cost],
[Ext. Cost] AS [ext_cost],
[Margin Dollar] AS [margin_dollar],
[Ext. Margin Dollar] AS [ext_margin_dollar],
RTRIM([Margin %]) AS [margin_pct],
RTRIM([Job Number]) AS [job_number],
RTRIM([Program]) AS [program],
RTRIM([Container]) AS [container],
RTRIM([AOP Rep]) AS [aop_rep]
FROM [GPSERVER].[CHG].[dbo].[_custom_sales_line_connector]

85
config/modules/ab.json Normal file
View File

@ -0,0 +1,85 @@
{
"name": "ab",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gs.ab",
"staging_table": "pipekit_staging.ab",
"merge_strategy": "full",
"merge_key": null,
"enabled": 0,
"dest_description": null,
"columns": [
{
"source_name": "Origin",
"source_type": "VARCHAR(3)",
"dest_name": "origin",
"dest_type": "text",
"description": null
},
{
"source_name": "Account",
"source_type": "VARCHAR(12)",
"dest_name": "account",
"dest_type": "text",
"description": null
},
{
"source_name": "FSPR",
"source_type": "VARCHAR(4)",
"dest_name": "fspr",
"dest_type": "text",
"description": null
},
{
"source_name": "TDATE",
"source_type": "VARCHAR(10)",
"dest_name": "tdate",
"dest_type": "text",
"description": null
},
{
"source_name": "Party",
"source_type": "VARCHAR(76)",
"dest_name": "party",
"dest_type": "text",
"description": null
},
{
"source_name": "Amount",
"source_type": "DECIMAL(18,2)",
"dest_name": "amount",
"dest_type": "numeric(18,2)",
"description": null
},
{
"source_name": "EBITDA",
"source_type": "VARCHAR(30)",
"dest_name": "ebitda",
"dest_type": "text",
"description": null
},
{
"source_name": "Project",
"source_type": "VARCHAR(53)",
"dest_name": "project",
"dest_type": "text",
"description": null
},
{
"source_name": "Clause",
"source_type": "VARCHAR(27)",
"dest_name": "clause",
"dest_type": "text",
"description": null
},
{
"source_name": "flag",
"source_type": "NVARCHAR(255)",
"dest_name": "flag",
"dest_type": "text",
"description": null
}
],
"watermarks": [],
"hooks": []
}

12
config/modules/ab.sql Normal file
View File

@ -0,0 +1,12 @@
SELECT
RTRIM([Origin]) AS [origin],
RTRIM([Account]) AS [account],
RTRIM([FSPR]) AS [fspr],
RTRIM([TDATE]) AS [tdate],
RTRIM([Party]) AS [party],
[Amount] AS [amount],
RTRIM([EBITDA]) AS [ebitda],
RTRIM([Project]) AS [project],
RTRIM([Clause]) AS [clause],
RTRIM([flag]) AS [flag]
FROM [FANALYSIS].[GS].[AB]

162
config/modules/adrs.json Normal file
View File

@ -0,0 +1,162 @@
{
"name": "adrs",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.adrs",
"staging_table": "pipekit_staging.adrs",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Address Master 6.0",
"columns": [
{
"source_name": "QZADR",
"source_type": "NUMERIC(8,0)",
"dest_name": "qzadr",
"dest_type": "numeric(8,0)",
"description": "Address Number"
},
{
"source_name": "QZNAME",
"source_type": "CHAR(30)",
"dest_name": "qzname",
"dest_type": "text",
"description": "Name"
},
{
"source_name": "QZADR1",
"source_type": "CHAR(35)",
"dest_name": "qzadr1",
"dest_type": "text",
"description": "Address 1"
},
{
"source_name": "QZADR2",
"source_type": "CHAR(35)",
"dest_name": "qzadr2",
"dest_type": "text",
"description": "Address 2"
},
{
"source_name": "QZADR3",
"source_type": "CHAR(35)",
"dest_name": "qzadr3",
"dest_type": "text",
"description": "Address 3"
},
{
"source_name": "QZADR4",
"source_type": "CHAR(35)",
"dest_name": "qzadr4",
"dest_type": "text",
"description": "Address 4"
},
{
"source_name": "QZADR5",
"source_type": "CHAR(35)",
"dest_name": "qzadr5",
"dest_type": "text",
"description": "Address 5"
},
{
"source_name": "QZADR6",
"source_type": "CHAR(35)",
"dest_name": "qzadr6",
"dest_type": "text",
"description": "Address 6"
},
{
"source_name": "QZADR7",
"source_type": "CHAR(35)",
"dest_name": "qzadr7",
"dest_type": "text",
"description": "Address 7"
},
{
"source_name": "QZADR8",
"source_type": "CHAR(35)",
"dest_name": "qzadr8",
"dest_type": "text",
"description": "Address 8"
},
{
"source_name": "QZADR9",
"source_type": "CHAR(35)",
"dest_name": "qzadr9",
"dest_type": "text",
"description": "Address 9"
},
{
"source_name": "QZADR10",
"source_type": "CHAR(35)",
"dest_name": "qzadr10",
"dest_type": "text",
"description": "Address 10"
},
{
"source_name": "QZCITY",
"source_type": "CHAR(30)",
"dest_name": "qzcity",
"dest_type": "text",
"description": "City"
},
{
"source_name": "QZPROV",
"source_type": "CHAR(3)",
"dest_name": "qzprov",
"dest_type": "text",
"description": "Province /State Code"
},
{
"source_name": "QZPOST",
"source_type": "CHAR(10)",
"dest_name": "qzpost",
"dest_type": "text",
"description": "Postal Code/ZIP"
},
{
"source_name": "QZCRYC",
"source_type": "CHAR(3)",
"dest_name": "qzcryc",
"dest_type": "text",
"description": "Country Code"
},
{
"source_name": "QZCTRY",
"source_type": "CHAR(15)",
"dest_name": "qzctry",
"dest_type": "text",
"description": "Obsoleted"
},
{
"source_name": "QZPOOL",
"source_type": "CHAR(15)",
"dest_name": "qzpool",
"dest_type": "text",
"description": "Pool Point"
},
{
"source_name": "QZPHON",
"source_type": "CHAR(15)",
"dest_name": "qzphon",
"dest_type": "text",
"description": "Phone Number"
},
{
"source_name": "QZFAX",
"source_type": "CHAR(15)",
"dest_name": "qzfax",
"dest_type": "text",
"description": "Fax Number"
},
{
"source_name": "QZEMAIL",
"source_type": "CHAR(253)",
"dest_name": "qzemail",
"dest_type": "text",
"description": "Email Address"
}
],
"watermarks": [],
"hooks": []
}

23
config/modules/adrs.sql Normal file
View File

@ -0,0 +1,23 @@
SELECT
QZADR AS qzadr,
RTRIM(QZNAME) AS qzname,
RTRIM(QZADR1) AS qzadr1,
RTRIM(QZADR2) AS qzadr2,
RTRIM(QZADR3) AS qzadr3,
RTRIM(QZADR4) AS qzadr4,
RTRIM(QZADR5) AS qzadr5,
RTRIM(QZADR6) AS qzadr6,
RTRIM(QZADR7) AS qzadr7,
RTRIM(QZADR8) AS qzadr8,
RTRIM(QZADR9) AS qzadr9,
RTRIM(QZADR10) AS qzadr10,
RTRIM(QZCITY) AS qzcity,
RTRIM(QZPROV) AS qzprov,
RTRIM(QZPOST) AS qzpost,
RTRIM(QZCRYC) AS qzcryc,
RTRIM(QZCTRY) AS qzctry,
RTRIM(QZPOOL) AS qzpool,
RTRIM(QZPHON) AS qzphon,
RTRIM(QZFAX) AS qzfax,
RTRIM(QZEMAIL) AS qzemail
FROM LGDAT.ADRS

141
config/modules/armasc.json Normal file
View File

@ -0,0 +1,141 @@
{
"name": "armasc",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.armasc",
"staging_table": "pipekit_staging.armasc",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "A/R Master Codes File - Sales Codes 6.0",
"columns": [
{
"source_name": "ZWCODE",
"source_type": "CHAR(1)",
"dest_name": "zwcode",
"dest_type": "text",
"description": "Record C"
},
{
"source_name": "ZWCOMP",
"source_type": "NUMERIC(2,0)",
"dest_name": "zwcomp",
"dest_type": "numeric(2,0)",
"description": "Company Number"
},
{
"source_name": "ZWKEY1",
"source_type": "CHAR(3)",
"dest_name": "zwkey1",
"dest_type": "text",
"description": "A/R Bank Code"
},
{
"source_name": "ZWKEY2",
"source_type": "CHAR(3)",
"dest_name": "zwkey2",
"dest_type": "text",
"description": "G/L Sales Code"
},
{
"source_name": "ZWFIL1",
"source_type": "CHAR(3)",
"dest_name": "zwfil1",
"dest_type": "text",
"description": "Fill"
},
{
"source_name": "ZWSAL#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwsal#",
"dest_type": "numeric(12,0)",
"description": "Sale G/L Account"
},
{
"source_name": "ZWELB#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwelb#",
"dest_type": "numeric(12,0)",
"description": "COS Labour"
},
{
"source_name": "ZWINV#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwinv#",
"dest_type": "numeric(12,0)",
"description": "Short Term Deferred Service Sales"
},
{
"source_name": "ZWDSC#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwdsc#",
"dest_type": "numeric(12,0)",
"description": "Discount G/L Account"
},
{
"source_name": "ZWEXB#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwexb#",
"dest_type": "numeric(12,0)",
"description": "COS Burden (Var)"
},
{
"source_name": "ZWEXM#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwexm#",
"dest_type": "numeric(12,0)",
"description": "COS Material"
},
{
"source_name": "ZWEXO#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwexo#",
"dest_type": "numeric(12,0)",
"description": "COS Other"
},
{
"source_name": "ZWFRT#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwfrt#",
"dest_type": "numeric(12,0)",
"description": "Prepaid Freight"
},
{
"source_name": "ZWDEP#",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwdep#",
"dest_type": "numeric(12,0)",
"description": "Long Term Deferred Service Sales"
},
{
"source_name": "ZWFIL2",
"source_type": "CHAR(394)",
"dest_name": "zwfil2",
"dest_type": "text",
"description": "Not Used"
},
{
"source_name": "ZWEXBF",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwexbf",
"dest_type": "numeric(12,0)",
"description": "COS Burden (Fixed)"
},
{
"source_name": "ZWWCOS",
"source_type": "NUMERIC(12,0)",
"dest_name": "zwwcos",
"dest_type": "numeric(12,0)",
"description": "Deferred Sales (Bill By Order)"
},
{
"source_name": "ZWPLNT",
"source_type": "CHAR(3)",
"dest_name": "zwplnt",
"dest_type": "text",
"description": "Plant Code"
}
],
"watermarks": [],
"hooks": []
}

20
config/modules/armasc.sql Normal file
View File

@ -0,0 +1,20 @@
SELECT
RTRIM(ZWCODE) AS zwcode,
ZWCOMP AS zwcomp,
RTRIM(ZWKEY1) AS zwkey1,
RTRIM(ZWKEY2) AS zwkey2,
RTRIM(ZWFIL1) AS zwfil1,
"ZWSAL#" AS "zwsal#",
"ZWELB#" AS "zwelb#",
"ZWINV#" AS "zwinv#",
"ZWDSC#" AS "zwdsc#",
"ZWEXB#" AS "zwexb#",
"ZWEXM#" AS "zwexm#",
"ZWEXO#" AS "zwexo#",
"ZWFRT#" AS "zwfrt#",
"ZWDEP#" AS "zwdep#",
RTRIM(ZWFIL2) AS zwfil2,
ZWEXBF AS zwexbf,
ZWWCOS AS zwwcos,
RTRIM(ZWPLNT) AS zwplnt
FROM LGDAT.ARMASC

505
config/modules/aroht.json Normal file
View File

@ -0,0 +1,505 @@
{
"name": "aroht",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.aroht",
"staging_table": "pipekit_staging.aroht",
"merge_strategy": "incremental",
"merge_key": "ascom#, ascust, asinv#",
"enabled": 1,
"dest_description": "A/R Open Receivables 6.1",
"columns": [
{
"source_name": "ASCOMP",
"source_type": "CHAR(2)",
"dest_name": "ascomp",
"dest_type": "text",
"description": "Company Code Alpha"
},
{
"source_name": "ASCUST",
"source_type": "CHAR(8)",
"dest_name": "ascust",
"dest_type": "text",
"description": "Customer Code"
},
{
"source_name": "ASINV#",
"source_type": "CHAR(15)",
"dest_name": "asinv#",
"dest_type": "text",
"description": "Invoice Number"
},
{
"source_name": "ASITYP",
"source_type": "CHAR(2)",
"dest_name": "asityp",
"dest_type": "text",
"description": "Invoice Typ"
},
{
"source_name": "ASIDAT",
"source_type": "DATE",
"dest_name": "asidat",
"dest_type": "date",
"description": "Invoice Date"
},
{
"source_name": "ASTDAT",
"source_type": "DATE",
"dest_name": "astdat",
"dest_type": "date",
"description": "Transaction Date"
},
{
"source_name": "ASDDAT",
"source_type": "DATE",
"dest_name": "asddat",
"dest_type": "date",
"description": "Due Date"
},
{
"source_name": "ASTRTP",
"source_type": "CHAR(3)",
"dest_name": "astrtp",
"dest_type": "text",
"description": "Transaction Type"
},
{
"source_name": "ASINAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "asinam",
"dest_type": "numeric(11,2)",
"description": "Invoice Amount"
},
{
"source_name": "ASDIS",
"source_type": "NUMERIC(11,2)",
"dest_name": "asdis",
"dest_type": "numeric(11,2)",
"description": "Discount Amount"
},
{
"source_name": "ASADJ",
"source_type": "NUMERIC(11,2)",
"dest_name": "asadj",
"dest_type": "numeric(11,2)",
"description": "Adjustnt Amount"
},
{
"source_name": "ASPAY",
"source_type": "NUMERIC(11,2)",
"dest_name": "aspay",
"dest_type": "numeric(11,2)",
"description": "Payment Amount"
},
{
"source_name": "ASDUAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "asduam",
"dest_type": "numeric(11,2)",
"description": "Invoice Balance"
},
{
"source_name": "ASDWO",
"source_type": "NUMERIC(11,2)",
"dest_name": "asdwo",
"dest_type": "numeric(11,2)",
"description": "Total Write-off"
},
{
"source_name": "ASDED",
"source_type": "NUMERIC(11,2)",
"dest_name": "asded",
"dest_type": "numeric(11,2)",
"description": "Total Deductions"
},
{
"source_name": "ASHLD",
"source_type": "NUMERIC(11,2)",
"dest_name": "ashld",
"dest_type": "numeric(11,2)",
"description": "Total Term Discount"
},
{
"source_name": "ASHDAT",
"source_type": "DATE",
"dest_name": "ashdat",
"dest_type": "date",
"description": "Term Discount Due date"
},
{
"source_name": "ASPDAT",
"source_type": "DATE",
"dest_name": "aspdat",
"dest_type": "date",
"description": "Last Payment Date"
},
{
"source_name": "ASCHQ#",
"source_type": "CHAR(15)",
"dest_name": "aschq#",
"dest_type": "text",
"description": "Last Cheque #"
},
{
"source_name": "ASCPAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "ascpam",
"dest_type": "numeric(11,2)",
"description": "Last Payment $"
},
{
"source_name": "ASCURA",
"source_type": "CHAR(2)",
"dest_name": "ascura",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "ASEXRT",
"source_type": "NUMERIC(11,6)",
"dest_name": "asexrt",
"dest_type": "numeric(11,6)",
"description": "Exchange Rate"
},
{
"source_name": "ASFSYR",
"source_type": "NUMERIC(2,0)",
"dest_name": "asfsyr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Year"
},
{
"source_name": "ASFSPR",
"source_type": "NUMERIC(2,0)",
"dest_name": "asfspr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Period"
},
{
"source_name": "ASBCHQ",
"source_type": "CHAR(6)",
"dest_name": "asbchq",
"dest_type": "text",
"description": "Reference Number"
},
{
"source_name": "ASTRDS",
"source_type": "CHAR(30)",
"dest_name": "astrds",
"dest_type": "text",
"description": "Transaction Description"
},
{
"source_name": "ASCOM#",
"source_type": "CHAR(2)",
"dest_name": "ascom#",
"dest_type": "text",
"description": "G/L Company Code"
},
{
"source_name": "ASARAC",
"source_type": "CHAR(10)",
"dest_name": "asarac",
"dest_type": "text",
"description": "G/L Account"
},
{
"source_name": "ASSLMN",
"source_type": "CHAR(5)",
"dest_name": "asslmn",
"dest_type": "text",
"description": "Salesman Code"
},
{
"source_name": "ASTERR",
"source_type": "CHAR(4)",
"dest_name": "asterr",
"dest_type": "text",
"description": "Territory Code"
},
{
"source_name": "ASBTCH",
"source_type": "NUMERIC(2,0)",
"dest_name": "asbtch",
"dest_type": "numeric(2,0)",
"description": "A/R Cash Batch Number"
},
{
"source_name": "ASBTAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "asbtam",
"dest_type": "numeric(11,2)",
"description": "Batch Amount"
},
{
"source_name": "ASTPST",
"source_type": "NUMERIC(11,2)",
"dest_name": "astpst",
"dest_type": "numeric(11,2)",
"description": "Total Tax"
},
{
"source_name": "ASTFST",
"source_type": "NUMERIC(11,2)",
"dest_name": "astfst",
"dest_type": "numeric(11,2)",
"description": "Total First Level"
},
{
"source_name": "ASTCST",
"source_type": "NUMERIC(11,2)",
"dest_name": "astcst",
"dest_type": "numeric(11,2)",
"description": "Total Cost"
},
{
"source_name": "ASODIS",
"source_type": "NUMERIC(11,2)",
"dest_name": "asodis",
"dest_type": "numeric(11,2)",
"description": "Order Discount"
},
{
"source_name": "ASORIN",
"source_type": "CHAR(9)",
"dest_name": "asorin",
"dest_type": "text",
"description": "Original Invoice #"
},
{
"source_name": "ASBOL#",
"source_type": "CHAR(9)",
"dest_name": "asbol#",
"dest_type": "text",
"description": "OBSOLETE"
},
{
"source_name": "ASINVN",
"source_type": "NUMERIC(9,0)",
"dest_name": "asinvn",
"dest_type": "numeric(9,0)",
"description": "Invoice Number"
},
{
"source_name": "ASBOLN",
"source_type": "NUMERIC(9,0)",
"dest_name": "asboln",
"dest_type": "numeric(9,0)",
"description": "Original BOL Number"
},
{
"source_name": "ASHQCO",
"source_type": "NUMERIC(2,0)",
"dest_name": "ashqco",
"dest_type": "numeric(2,0)",
"description": "HQ Company"
},
{
"source_name": "ASHQBT",
"source_type": "NUMERIC(2,0)",
"dest_name": "ashqbt",
"dest_type": "numeric(2,0)",
"description": "HQ Batch"
},
{
"source_name": "ASFUT1",
"source_type": "CHAR(3)",
"dest_name": "asfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT2",
"source_type": "CHAR(10)",
"dest_name": "asfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT3",
"source_type": "CHAR(10)",
"dest_name": "asfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT4",
"source_type": "CHAR(10)",
"dest_name": "asfut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT5",
"source_type": "CHAR(20)",
"dest_name": "asfut5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT6",
"source_type": "NUMERIC(15,5)",
"dest_name": "asfut6",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "ASFLG1",
"source_type": "CHAR(1)",
"dest_name": "asflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG2",
"source_type": "CHAR(1)",
"dest_name": "asflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG3",
"source_type": "CHAR(1)",
"dest_name": "asflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG4",
"source_type": "CHAR(1)",
"dest_name": "asflg4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG5",
"source_type": "CHAR(1)",
"dest_name": "asflg5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASWTCN",
"source_type": "NUMERIC(9,0)",
"dest_name": "aswtcn",
"dest_type": "numeric(9,0)",
"description": "Warranty Claim Number"
},
{
"source_name": "ASWTCD",
"source_type": "NUMERIC(3,0)",
"dest_name": "aswtcd",
"dest_type": "numeric(3,0)",
"description": "Warranty Claim Detail"
},
{
"source_name": "ASCPON",
"source_type": "CHAR(30)",
"dest_name": "ascpon",
"dest_type": "text",
"description": "Customer Purchase Order"
},
{
"source_name": "ASCRTY",
"source_type": "CHAR(1)",
"dest_name": "ascrty",
"dest_type": "text",
"description": "Use Credit Card"
},
{
"source_name": "ASSTTM",
"source_type": "NUMERIC(11,2)",
"dest_name": "assttm",
"dest_type": "numeric(11,2)",
"description": "Settle Amount"
},
{
"source_name": "ASSTTD",
"source_type": "DATE",
"dest_name": "assttd",
"dest_type": "date",
"description": "Settle Date"
},
{
"source_name": "ASTRMP",
"source_type": "NUMERIC(3,0)",
"dest_name": "astrmp",
"dest_type": "numeric(3,0)",
"description": "Terms Percentage"
},
{
"source_name": "ASSREF",
"source_type": "CHAR(30)",
"dest_name": "assref",
"dest_type": "text",
"description": "Invoice Shipment Reference"
},
{
"source_name": "ASPJNM",
"source_type": "CHAR(20)",
"dest_name": "aspjnm",
"dest_type": "text",
"description": "Project Number"
},
{
"source_name": "ASDSPR",
"source_type": "NUMERIC(15,5)",
"dest_name": "asdspr",
"dest_type": "numeric(15,5)",
"description": "Discount Percent"
},
{
"source_name": "ASFUT7",
"source_type": "CHAR(10)",
"dest_name": "asfut7",
"dest_type": "text",
"description": "Fiscal Century+ Year+Period"
},
{
"source_name": "ASFUT8",
"source_type": "CHAR(10)",
"dest_name": "asfut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT9",
"source_type": "CHAR(20)",
"dest_name": "asfut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT10",
"source_type": "CHAR(30)",
"dest_name": "asfut10",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT11",
"source_type": "CHAR(30)",
"dest_name": "asfut11",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "RRN",
"source_type": "BIGINT",
"dest_name": "src_rrn",
"dest_type": "bigint",
"description": "Source relative record number (incremental watermark)"
}
],
"watermarks": [
{
"name": "aroht_rrn",
"connection": "usmidsap02",
"resolver_sql": "SELECT COALESCE(MAX(src_rrn), 0) FROM cms.aroht",
"default_value": "0"
}
],
"hooks": []
}

72
config/modules/aroht.sql Normal file
View File

@ -0,0 +1,72 @@
SELECT
RTRIM(ASCOMP) AS ascomp,
RTRIM(ASCUST) AS ascust,
RTRIM("ASINV#") AS "asinv#",
RTRIM(ASITYP) AS asityp,
CASE WHEN ASIDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASIDAT END AS asidat,
CASE WHEN ASTDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASTDAT END AS astdat,
CASE WHEN ASDDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASDDAT END AS asddat,
RTRIM(ASTRTP) AS astrtp,
ASINAM AS asinam,
ASDIS AS asdis,
ASADJ AS asadj,
ASPAY AS aspay,
ASDUAM AS asduam,
ASDWO AS asdwo,
ASDED AS asded,
ASHLD AS ashld,
CASE WHEN ASHDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASHDAT END AS ashdat,
CASE WHEN ASPDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASPDAT END AS aspdat,
RTRIM("ASCHQ#") AS "aschq#",
ASCPAM AS ascpam,
RTRIM(ASCURA) AS ascura,
ASEXRT AS asexrt,
ASFSYR AS asfsyr,
ASFSPR AS asfspr,
RTRIM(ASBCHQ) AS asbchq,
RTRIM(ASTRDS) AS astrds,
RTRIM("ASCOM#") AS "ascom#",
RTRIM(ASARAC) AS asarac,
RTRIM(ASSLMN) AS asslmn,
RTRIM(ASTERR) AS asterr,
ASBTCH AS asbtch,
ASBTAM AS asbtam,
ASTPST AS astpst,
ASTFST AS astfst,
ASTCST AS astcst,
ASODIS AS asodis,
RTRIM(ASORIN) AS asorin,
RTRIM("ASBOL#") AS "asbol#",
ASINVN AS asinvn,
ASBOLN AS asboln,
ASHQCO AS ashqco,
ASHQBT AS ashqbt,
RTRIM(ASFUT1) AS asfut1,
RTRIM(ASFUT2) AS asfut2,
RTRIM(ASFUT3) AS asfut3,
RTRIM(ASFUT4) AS asfut4,
RTRIM(ASFUT5) AS asfut5,
ASFUT6 AS asfut6,
RTRIM(ASFLG1) AS asflg1,
RTRIM(ASFLG2) AS asflg2,
RTRIM(ASFLG3) AS asflg3,
RTRIM(ASFLG4) AS asflg4,
RTRIM(ASFLG5) AS asflg5,
ASWTCN AS aswtcn,
ASWTCD AS aswtcd,
RTRIM(ASCPON) AS ascpon,
RTRIM(ASCRTY) AS ascrty,
ASSTTM AS assttm,
CASE WHEN ASSTTD IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASSTTD END AS assttd,
ASTRMP AS astrmp,
RTRIM(ASSREF) AS assref,
RTRIM(ASPJNM) AS aspjnm,
ASDSPR AS asdspr,
RTRIM(ASFUT7) AS asfut7,
RTRIM(ASFUT8) AS asfut8,
RTRIM(ASFUT9) AS asfut9,
RTRIM(ASFUT10) AS asfut10,
RTRIM(ASFUT11) AS asfut11,
RRN(T) AS src_rrn
FROM LGDAT.AROHT T
WHERE RRN(T) > {aroht_rrn}

491
config/modules/arop.json Normal file
View File

@ -0,0 +1,491 @@
{
"name": "arop",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.arop",
"staging_table": "pipekit_staging.arop",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "A/R Open Receivables 6.1",
"columns": [
{
"source_name": "ASCOMP",
"source_type": "CHAR(2)",
"dest_name": "ascomp",
"dest_type": "text",
"description": "Company Code Alpha"
},
{
"source_name": "ASCUST",
"source_type": "CHAR(8)",
"dest_name": "ascust",
"dest_type": "text",
"description": "Customer Code"
},
{
"source_name": "ASINV#",
"source_type": "CHAR(15)",
"dest_name": "asinv#",
"dest_type": "text",
"description": "Invoice Number"
},
{
"source_name": "ASITYP",
"source_type": "CHAR(2)",
"dest_name": "asityp",
"dest_type": "text",
"description": "Invoice Typ"
},
{
"source_name": "ASIDAT",
"source_type": "DATE",
"dest_name": "asidat",
"dest_type": "date",
"description": "Invoice Date"
},
{
"source_name": "ASTDAT",
"source_type": "DATE",
"dest_name": "astdat",
"dest_type": "date",
"description": "Transaction Date"
},
{
"source_name": "ASDDAT",
"source_type": "DATE",
"dest_name": "asddat",
"dest_type": "date",
"description": "Due Date"
},
{
"source_name": "ASTRTP",
"source_type": "CHAR(3)",
"dest_name": "astrtp",
"dest_type": "text",
"description": "Transaction Type"
},
{
"source_name": "ASINAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "asinam",
"dest_type": "numeric(11,2)",
"description": "Invoice Amount"
},
{
"source_name": "ASDIS",
"source_type": "NUMERIC(11,2)",
"dest_name": "asdis",
"dest_type": "numeric(11,2)",
"description": "Discount Amount"
},
{
"source_name": "ASADJ",
"source_type": "NUMERIC(11,2)",
"dest_name": "asadj",
"dest_type": "numeric(11,2)",
"description": "Adjustnt Amount"
},
{
"source_name": "ASPAY",
"source_type": "NUMERIC(11,2)",
"dest_name": "aspay",
"dest_type": "numeric(11,2)",
"description": "Payment Amount"
},
{
"source_name": "ASDUAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "asduam",
"dest_type": "numeric(11,2)",
"description": "Invoice Balance"
},
{
"source_name": "ASDWO",
"source_type": "NUMERIC(11,2)",
"dest_name": "asdwo",
"dest_type": "numeric(11,2)",
"description": "Total Write-off"
},
{
"source_name": "ASDED",
"source_type": "NUMERIC(11,2)",
"dest_name": "asded",
"dest_type": "numeric(11,2)",
"description": "Total Deductions"
},
{
"source_name": "ASHLD",
"source_type": "NUMERIC(11,2)",
"dest_name": "ashld",
"dest_type": "numeric(11,2)",
"description": "Total Term Discount"
},
{
"source_name": "ASHDAT",
"source_type": "DATE",
"dest_name": "ashdat",
"dest_type": "date",
"description": "Term Discount Due date"
},
{
"source_name": "ASPDAT",
"source_type": "DATE",
"dest_name": "aspdat",
"dest_type": "date",
"description": "Last Payment Date"
},
{
"source_name": "ASCHQ#",
"source_type": "CHAR(15)",
"dest_name": "aschq#",
"dest_type": "text",
"description": "Last Cheque #"
},
{
"source_name": "ASCPAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "ascpam",
"dest_type": "numeric(11,2)",
"description": "Last Payment $"
},
{
"source_name": "ASCURA",
"source_type": "CHAR(2)",
"dest_name": "ascura",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "ASEXRT",
"source_type": "NUMERIC(11,6)",
"dest_name": "asexrt",
"dest_type": "numeric(11,6)",
"description": "Exchange Rate"
},
{
"source_name": "ASFSYR",
"source_type": "NUMERIC(2,0)",
"dest_name": "asfsyr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Year"
},
{
"source_name": "ASFSPR",
"source_type": "NUMERIC(2,0)",
"dest_name": "asfspr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Period"
},
{
"source_name": "ASBCHQ",
"source_type": "CHAR(6)",
"dest_name": "asbchq",
"dest_type": "text",
"description": "Reference Number"
},
{
"source_name": "ASTRDS",
"source_type": "CHAR(30)",
"dest_name": "astrds",
"dest_type": "text",
"description": "Transaction Description"
},
{
"source_name": "ASCOM#",
"source_type": "CHAR(2)",
"dest_name": "ascom#",
"dest_type": "text",
"description": "G/L Company Code"
},
{
"source_name": "ASARAC",
"source_type": "CHAR(10)",
"dest_name": "asarac",
"dest_type": "text",
"description": "G/L Account"
},
{
"source_name": "ASSLMN",
"source_type": "CHAR(5)",
"dest_name": "asslmn",
"dest_type": "text",
"description": "Salesman Code"
},
{
"source_name": "ASTERR",
"source_type": "CHAR(4)",
"dest_name": "asterr",
"dest_type": "text",
"description": "Territory Code"
},
{
"source_name": "ASBTCH",
"source_type": "NUMERIC(2,0)",
"dest_name": "asbtch",
"dest_type": "numeric(2,0)",
"description": "A/R Cash Batch Number"
},
{
"source_name": "ASBTAM",
"source_type": "NUMERIC(11,2)",
"dest_name": "asbtam",
"dest_type": "numeric(11,2)",
"description": "Batch Amount"
},
{
"source_name": "ASTPST",
"source_type": "NUMERIC(11,2)",
"dest_name": "astpst",
"dest_type": "numeric(11,2)",
"description": "Total Tax"
},
{
"source_name": "ASTFST",
"source_type": "NUMERIC(11,2)",
"dest_name": "astfst",
"dest_type": "numeric(11,2)",
"description": "Total First Level"
},
{
"source_name": "ASTCST",
"source_type": "NUMERIC(11,2)",
"dest_name": "astcst",
"dest_type": "numeric(11,2)",
"description": "Total Cost"
},
{
"source_name": "ASODIS",
"source_type": "NUMERIC(11,2)",
"dest_name": "asodis",
"dest_type": "numeric(11,2)",
"description": "Order Discount"
},
{
"source_name": "ASORIN",
"source_type": "CHAR(9)",
"dest_name": "asorin",
"dest_type": "text",
"description": "Original Invoice #"
},
{
"source_name": "ASBOL#",
"source_type": "CHAR(9)",
"dest_name": "asbol#",
"dest_type": "text",
"description": "OBSOLETE"
},
{
"source_name": "ASINVN",
"source_type": "NUMERIC(9,0)",
"dest_name": "asinvn",
"dest_type": "numeric(9,0)",
"description": "Invoice Number"
},
{
"source_name": "ASBOLN",
"source_type": "NUMERIC(9,0)",
"dest_name": "asboln",
"dest_type": "numeric(9,0)",
"description": "Original BOL Number"
},
{
"source_name": "ASHQCO",
"source_type": "NUMERIC(2,0)",
"dest_name": "ashqco",
"dest_type": "numeric(2,0)",
"description": "HQ Company"
},
{
"source_name": "ASHQBT",
"source_type": "NUMERIC(2,0)",
"dest_name": "ashqbt",
"dest_type": "numeric(2,0)",
"description": "HQ Batch"
},
{
"source_name": "ASFUT1",
"source_type": "CHAR(3)",
"dest_name": "asfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT2",
"source_type": "CHAR(10)",
"dest_name": "asfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT3",
"source_type": "CHAR(10)",
"dest_name": "asfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT4",
"source_type": "CHAR(10)",
"dest_name": "asfut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT5",
"source_type": "CHAR(20)",
"dest_name": "asfut5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT6",
"source_type": "NUMERIC(15,5)",
"dest_name": "asfut6",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "ASFLG1",
"source_type": "CHAR(1)",
"dest_name": "asflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG2",
"source_type": "CHAR(1)",
"dest_name": "asflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG3",
"source_type": "CHAR(1)",
"dest_name": "asflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG4",
"source_type": "CHAR(1)",
"dest_name": "asflg4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFLG5",
"source_type": "CHAR(1)",
"dest_name": "asflg5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASWTCN",
"source_type": "NUMERIC(9,0)",
"dest_name": "aswtcn",
"dest_type": "numeric(9,0)",
"description": "Warranty Claim Number"
},
{
"source_name": "ASWTCD",
"source_type": "NUMERIC(3,0)",
"dest_name": "aswtcd",
"dest_type": "numeric(3,0)",
"description": "Warranty Claim Detail"
},
{
"source_name": "ASCPON",
"source_type": "CHAR(30)",
"dest_name": "ascpon",
"dest_type": "text",
"description": "Customer Purchase Order"
},
{
"source_name": "ASCRTY",
"source_type": "CHAR(1)",
"dest_name": "ascrty",
"dest_type": "text",
"description": "Use Credit Card"
},
{
"source_name": "ASSTTM",
"source_type": "NUMERIC(11,2)",
"dest_name": "assttm",
"dest_type": "numeric(11,2)",
"description": "Settle Amount"
},
{
"source_name": "ASSTTD",
"source_type": "DATE",
"dest_name": "assttd",
"dest_type": "date",
"description": "Settle Date"
},
{
"source_name": "ASTRMP",
"source_type": "NUMERIC(3,0)",
"dest_name": "astrmp",
"dest_type": "numeric(3,0)",
"description": "Terms Percentage"
},
{
"source_name": "ASSREF",
"source_type": "CHAR(30)",
"dest_name": "assref",
"dest_type": "text",
"description": "Invoice Shipment Reference"
},
{
"source_name": "ASPJNM",
"source_type": "CHAR(20)",
"dest_name": "aspjnm",
"dest_type": "text",
"description": "Project Number"
},
{
"source_name": "ASDSPR",
"source_type": "NUMERIC(15,5)",
"dest_name": "asdspr",
"dest_type": "numeric(15,5)",
"description": "Discount Percent"
},
{
"source_name": "ASFUT7",
"source_type": "CHAR(10)",
"dest_name": "asfut7",
"dest_type": "text",
"description": "Fiscal Century+ Year+Period"
},
{
"source_name": "ASFUT8",
"source_type": "CHAR(10)",
"dest_name": "asfut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT9",
"source_type": "CHAR(20)",
"dest_name": "asfut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT10",
"source_type": "CHAR(30)",
"dest_name": "asfut10",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "ASFUT11",
"source_type": "CHAR(30)",
"dest_name": "asfut11",
"dest_type": "text",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

70
config/modules/arop.sql Normal file
View File

@ -0,0 +1,70 @@
SELECT
RTRIM(ASCOMP) AS ascomp,
RTRIM(ASCUST) AS ascust,
RTRIM("ASINV#") AS "asinv#",
RTRIM(ASITYP) AS asityp,
CASE WHEN ASIDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASIDAT END AS asidat,
CASE WHEN ASTDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASTDAT END AS astdat,
CASE WHEN ASDDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASDDAT END AS asddat,
RTRIM(ASTRTP) AS astrtp,
ASINAM AS asinam,
ASDIS AS asdis,
ASADJ AS asadj,
ASPAY AS aspay,
ASDUAM AS asduam,
ASDWO AS asdwo,
ASDED AS asded,
ASHLD AS ashld,
CASE WHEN ASHDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASHDAT END AS ashdat,
CASE WHEN ASPDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASPDAT END AS aspdat,
RTRIM("ASCHQ#") AS "aschq#",
ASCPAM AS ascpam,
RTRIM(ASCURA) AS ascura,
ASEXRT AS asexrt,
ASFSYR AS asfsyr,
ASFSPR AS asfspr,
RTRIM(ASBCHQ) AS asbchq,
RTRIM(ASTRDS) AS astrds,
RTRIM("ASCOM#") AS "ascom#",
RTRIM(ASARAC) AS asarac,
RTRIM(ASSLMN) AS asslmn,
RTRIM(ASTERR) AS asterr,
ASBTCH AS asbtch,
ASBTAM AS asbtam,
ASTPST AS astpst,
ASTFST AS astfst,
ASTCST AS astcst,
ASODIS AS asodis,
RTRIM(ASORIN) AS asorin,
RTRIM("ASBOL#") AS "asbol#",
ASINVN AS asinvn,
ASBOLN AS asboln,
ASHQCO AS ashqco,
ASHQBT AS ashqbt,
RTRIM(ASFUT1) AS asfut1,
RTRIM(ASFUT2) AS asfut2,
RTRIM(ASFUT3) AS asfut3,
RTRIM(ASFUT4) AS asfut4,
RTRIM(ASFUT5) AS asfut5,
ASFUT6 AS asfut6,
RTRIM(ASFLG1) AS asflg1,
RTRIM(ASFLG2) AS asflg2,
RTRIM(ASFLG3) AS asflg3,
RTRIM(ASFLG4) AS asflg4,
RTRIM(ASFLG5) AS asflg5,
ASWTCN AS aswtcn,
ASWTCD AS aswtcd,
RTRIM(ASCPON) AS ascpon,
RTRIM(ASCRTY) AS ascrty,
ASSTTM AS assttm,
CASE WHEN ASSTTD IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE ASSTTD END AS assttd,
ASTRMP AS astrmp,
RTRIM(ASSREF) AS assref,
RTRIM(ASPJNM) AS aspjnm,
ASDSPR AS asdspr,
RTRIM(ASFUT7) AS asfut7,
RTRIM(ASFUT8) AS asfut8,
RTRIM(ASFUT9) AS asfut9,
RTRIM(ASFUT10) AS asfut10,
RTRIM(ASFUT11) AS asfut11
FROM LGDAT.AROP

239
config/modules/artrn.json Normal file
View File

@ -0,0 +1,239 @@
{
"name": "artrn",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.artrn",
"staging_table": "pipekit_staging.artrn",
"merge_strategy": "incremental",
"merge_key": "lotnx",
"enabled": 1,
"dest_description": "A/R Payment Transactions 6.0",
"columns": [
{
"source_name": "LOCOMP",
"source_type": "CHAR(2)",
"dest_name": "locomp",
"dest_type": "text",
"description": "Company Code Alpha"
},
{
"source_name": "LOCUST",
"source_type": "CHAR(8)",
"dest_name": "locust",
"dest_type": "text",
"description": "Customer Code"
},
{
"source_name": "LOINV#",
"source_type": "CHAR(15)",
"dest_name": "loinv#",
"dest_type": "text",
"description": "Invoice Number"
},
{
"source_name": "LOTTYP",
"source_type": "CHAR(2)",
"dest_name": "lottyp",
"dest_type": "text",
"description": "Trans Typ"
},
{
"source_name": "LOIDAT",
"source_type": "DATE",
"dest_name": "loidat",
"dest_type": "date",
"description": "Invoice Date"
},
{
"source_name": "LOTDAT",
"source_type": "DATE",
"dest_name": "lotdat",
"dest_type": "date",
"description": "Transaction Date"
},
{
"source_name": "LOTRTP",
"source_type": "CHAR(3)",
"dest_name": "lotrtp",
"dest_type": "text",
"description": "Transaction Type"
},
{
"source_name": "LOAMT",
"source_type": "NUMERIC(11,2)",
"dest_name": "loamt",
"dest_type": "numeric(11,2)",
"description": "Amount"
},
{
"source_name": "LOCURR",
"source_type": "CHAR(2)",
"dest_name": "locurr",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "LOCHQ#",
"source_type": "CHAR(15)",
"dest_name": "lochq#",
"dest_type": "text",
"description": "Cheque #"
},
{
"source_name": "LOTRDS",
"source_type": "CHAR(30)",
"dest_name": "lotrds",
"dest_type": "text",
"description": "Transaction Description"
},
{
"source_name": "LOCOM#",
"source_type": "CHAR(2)",
"dest_name": "locom#",
"dest_type": "text",
"description": "G/L Company Code"
},
{
"source_name": "LOARAC",
"source_type": "CHAR(10)",
"dest_name": "loarac",
"dest_type": "text",
"description": "G/L Account"
},
{
"source_name": "A1",
"source_type": "CHAR(12)",
"dest_name": "a1",
"dest_type": "text",
"description": "A1"
},
{
"source_name": "LOFSYR",
"source_type": "NUMERIC(2,0)",
"dest_name": "lofsyr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Year"
},
{
"source_name": "LOFSPR",
"source_type": "NUMERIC(2,0)",
"dest_name": "lofspr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Period"
},
{
"source_name": "A2",
"source_type": "CHAR(14)",
"dest_name": "a2",
"dest_type": "text",
"description": "A2"
},
{
"source_name": "LOPCUS",
"source_type": "CHAR(8)",
"dest_name": "lopcus",
"dest_type": "text",
"description": "Chq Paid by Cust #"
},
{
"source_name": "LOCHDT",
"source_type": "DATE",
"dest_name": "lochdt",
"dest_type": "date",
"description": "Cheque Date"
},
{
"source_name": "LOMAJR",
"source_type": "CHAR(3)",
"dest_name": "lomajr",
"dest_type": "text",
"description": "Major Sales Code"
},
{
"source_name": "LOMINR",
"source_type": "CHAR(3)",
"dest_name": "lominr",
"dest_type": "text",
"description": "Minor Sales Code"
},
{
"source_name": "LOTERY",
"source_type": "CHAR(3)",
"dest_name": "lotery",
"dest_type": "text",
"description": "Territory Code"
},
{
"source_name": "LOCUSR",
"source_type": "CHAR(8)",
"dest_name": "locusr",
"dest_type": "text",
"description": "Customer Ref"
},
{
"source_name": "LOARBC",
"source_type": "CHAR(3)",
"dest_name": "loarbc",
"dest_type": "text",
"description": "A/R Bank Code"
},
{
"source_name": "LOPYBC",
"source_type": "CHAR(3)",
"dest_name": "lopybc",
"dest_type": "text",
"description": "Payment Bank code"
},
{
"source_name": "LOCRID",
"source_type": "NUMERIC(9,0)",
"dest_name": "locrid",
"dest_type": "numeric(9,0)",
"description": "Cheque RecordID"
},
{
"source_name": "LOCUEX",
"source_type": "NUMERIC(11,6)",
"dest_name": "locuex",
"dest_type": "numeric(11,6)",
"description": "Currency Exchange Rate"
},
{
"source_name": "LOTNX",
"source_type": "NUMERIC(9,0)",
"dest_name": "lotnx",
"dest_type": "numeric(9,0)",
"description": "Transaction Number"
},
{
"source_name": "LOABTH",
"source_type": "NUMERIC(2,0)",
"dest_name": "loabth",
"dest_type": "numeric(2,0)",
"description": "Adjustment Batch Number"
},
{
"source_name": "LOCBTH",
"source_type": "NUMERIC(2,0)",
"dest_name": "locbth",
"dest_type": "numeric(2,0)",
"description": "Cash Entry Batch Number"
},
{
"source_name": "LOVAMT",
"source_type": "NUMERIC(11,2)",
"dest_name": "lovamt",
"dest_type": "numeric(11,2)",
"description": "Voided Amount"
}
],
"watermarks": [
{
"name": "lotnx",
"connection": "usmidsap02",
"resolver_sql": "select max(lotnx) from cms.artrn",
"default_value": "1"
}
],
"hooks": []
}

34
config/modules/artrn.sql Normal file
View File

@ -0,0 +1,34 @@
SELECT
RTRIM(LOCOMP) AS locomp,
RTRIM(LOCUST) AS locust,
RTRIM("LOINV#") AS "loinv#",
RTRIM(LOTTYP) AS lottyp,
CASE WHEN LOIDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE LOIDAT END AS loidat,
CASE WHEN LOTDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE LOTDAT END AS lotdat,
RTRIM(LOTRTP) AS lotrtp,
LOAMT AS loamt,
RTRIM(LOCURR) AS locurr,
RTRIM("LOCHQ#") AS "lochq#",
RTRIM(LOTRDS) AS lotrds,
RTRIM("LOCOM#") AS "locom#",
RTRIM(LOARAC) AS loarac,
RTRIM(A1) AS a1,
LOFSYR AS lofsyr,
LOFSPR AS lofspr,
RTRIM(A2) AS a2,
RTRIM(LOPCUS) AS lopcus,
CASE WHEN LOCHDT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE LOCHDT END AS lochdt,
RTRIM(LOMAJR) AS lomajr,
RTRIM(LOMINR) AS lominr,
RTRIM(LOTERY) AS lotery,
RTRIM(LOCUSR) AS locusr,
RTRIM(LOARBC) AS loarbc,
RTRIM(LOPYBC) AS lopybc,
LOCRID AS locrid,
LOCUEX AS locuex,
LOTNX AS lotnx,
LOABTH AS loabth,
LOCBTH AS locbth,
LOVAMT AS lovamt
FROM LGDAT.ARTRN
WHERE LOTNX >= {lotnx}

120
config/modules/binb.json Normal file
View File

@ -0,0 +1,120 @@
{
"name": "binb",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.binb",
"staging_table": "pipekit_staging.binb",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Bin Balances 6.0",
"columns": [
{
"source_name": "LQSTKL",
"source_type": "CHAR(6)",
"dest_name": "lqstkl",
"dest_type": "text",
"description": "Stock Location"
},
{
"source_name": "LQBIN#",
"source_type": "CHAR(10)",
"dest_name": "lqbin#",
"dest_type": "text",
"description": "Bin Code"
},
{
"source_name": "LQPART",
"source_type": "CHAR(20)",
"dest_name": "lqpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "LQLOT#",
"source_type": "CHAR(15)",
"dest_name": "lqlot#",
"dest_type": "text",
"description": "Lot Number"
},
{
"source_name": "LQQTYH",
"source_type": "NUMERIC(15,5)",
"dest_name": "lqqtyh",
"dest_type": "numeric(15,5)",
"description": "Qty on hand in base unit"
},
{
"source_name": "LQBTC#",
"source_type": "NUMERIC(5,0)",
"dest_name": "lqbtc#",
"dest_type": "numeric(5,0)",
"description": "Physical Inventory Batch Number"
},
{
"source_name": "LQRDAT",
"source_type": "DATE",
"dest_name": "lqrdat",
"dest_type": "date",
"description": "Last Receipt Date"
},
{
"source_name": "LQIDAT",
"source_type": "DATE",
"dest_name": "lqidat",
"dest_type": "date",
"description": "Last Issue Date"
},
{
"source_name": "LQQTY",
"source_type": "NUMERIC(15,5)",
"dest_name": "lqqty",
"dest_type": "numeric(15,5)",
"description": "Qty on hand"
},
{
"source_name": "LQUNIT",
"source_type": "CHAR(3)",
"dest_name": "lqunit",
"dest_type": "text",
"description": "Unit of Measure"
},
{
"source_name": "LQPLNT",
"source_type": "CHAR(3)",
"dest_name": "lqplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "LQMINQ",
"source_type": "NUMERIC(15,5)",
"dest_name": "lqminq",
"dest_type": "numeric(15,5)",
"description": "Minimum Quantity"
},
{
"source_name": "LQMAXQ",
"source_type": "NUMERIC(15,5)",
"dest_name": "lqmaxq",
"dest_type": "numeric(15,5)",
"description": "Maximum Quantity"
},
{
"source_name": "LQRPLQ",
"source_type": "NUMERIC(15,5)",
"dest_name": "lqrplq",
"dest_type": "numeric(15,5)",
"description": "Replenishment Multiplier"
},
{
"source_name": "LQLEXP",
"source_type": "DATE",
"dest_name": "lqlexp",
"dest_type": "date",
"description": "Lot Expiry Date"
}
],
"watermarks": [],
"hooks": []
}

19
config/modules/binb.sql Normal file
View File

@ -0,0 +1,19 @@
SELECT
RTRIM(LQSTKL) AS lqstkl,
RTRIM("LQBIN#") AS "lqbin#",
RTRIM(LQPART) AS lqpart,
RTRIM("LQLOT#") AS "lqlot#",
LQQTYH AS lqqtyh,
"LQBTC#" AS "lqbtc#",
CASE WHEN LQRDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE LQRDAT END AS lqrdat,
CASE WHEN LQIDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE LQIDAT END AS lqidat,
LQQTY AS lqqty,
RTRIM(LQUNIT) AS lqunit,
RTRIM(LQPLNT) AS lqplnt,
LQMINQ AS lqminq,
LQMAXQ AS lqmaxq,
LQRPLQ AS lqrplq,
CASE WHEN LQLEXP IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE LQLEXP END AS lqlexp
FROM LGDAT.BINB
WHERE
LQQTY <> 0

631
config/modules/bold.json Normal file
View File

@ -0,0 +1,631 @@
{
"name": "bold",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.bold",
"staging_table": "pipekit_staging.bold",
"merge_strategy": "incremental",
"merge_key": "fgbol#",
"enabled": 1,
"dest_description": "Bill of Lading Detail 6.1",
"columns": [
{
"source_name": "FGBOL#",
"source_type": "NUMERIC(9,0)",
"dest_name": "fgbol#",
"dest_type": "numeric(9,0)",
"description": "BOL Number"
},
{
"source_name": "FGENT#",
"source_type": "NUMERIC(3,0)",
"dest_name": "fgent#",
"dest_type": "numeric(3,0)",
"description": "BOL Detail Number"
},
{
"source_name": "FGORD#",
"source_type": "NUMERIC(9,0)",
"dest_name": "fgord#",
"dest_type": "numeric(9,0)",
"description": "Customer Order Number"
},
{
"source_name": "FGITEM",
"source_type": "NUMERIC(3,0)",
"dest_name": "fgitem",
"dest_type": "numeric(3,0)",
"description": "Item Number"
},
{
"source_name": "FGPO#",
"source_type": "NUMERIC(9,0)",
"dest_name": "fgpo#",
"dest_type": "numeric(9,0)",
"description": "P/O #"
},
{
"source_name": "FGPREL",
"source_type": "NUMERIC(4,0)",
"dest_name": "fgprel",
"dest_type": "numeric(4,0)",
"description": "P/O Release #"
},
{
"source_name": "FGPITM",
"source_type": "NUMERIC(3,0)",
"dest_name": "fgpitm",
"dest_type": "numeric(3,0)",
"description": "P/O Item #"
},
{
"source_name": "FGQSHP",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgqshp",
"dest_type": "numeric(15,5)",
"description": "Shipping Quantity Base"
},
{
"source_name": "FGQSHO",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgqsho",
"dest_type": "numeric(15,5)",
"description": "Shipping Quantity OE"
},
{
"source_name": "FGCTNC",
"source_type": "CHAR(3)",
"dest_name": "fgctnc",
"dest_type": "text",
"description": "Container Code"
},
{
"source_name": "FGCTNN",
"source_type": "NUMERIC(5,0)",
"dest_name": "fgctnn",
"dest_type": "numeric(5,0)",
"description": "# of Containers"
},
{
"source_name": "FGPLTN",
"source_type": "NUMERIC(3,0)",
"dest_name": "fgpltn",
"dest_type": "numeric(3,0)",
"description": "# of Pallets"
},
{
"source_name": "FGNTWC",
"source_type": "NUMERIC(8,2)",
"dest_name": "fgntwc",
"dest_type": "numeric(8,2)",
"description": "Net Weight / Container"
},
{
"source_name": "FGGRSC",
"source_type": "NUMERIC(8,2)",
"dest_name": "fggrsc",
"dest_type": "numeric(8,2)",
"description": "Gross Weight / Container"
},
{
"source_name": "FGTARC",
"source_type": "NUMERIC(8,2)",
"dest_name": "fgtarc",
"dest_type": "numeric(8,2)",
"description": "Tare Weight / Container"
},
{
"source_name": "FGVOLC",
"source_type": "NUMERIC(8,2)",
"dest_name": "fgvolc",
"dest_type": "numeric(8,2)",
"description": "Volume per Container"
},
{
"source_name": "FGQTYC",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgqtyc",
"dest_type": "numeric(15,5)",
"description": "Quantity /Container"
},
{
"source_name": "FGWGTP",
"source_type": "NUMERIC(8,2)",
"dest_name": "fgwgtp",
"dest_type": "numeric(8,2)",
"description": "Weight of shipment"
},
{
"source_name": "FGVOLP",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgvolp",
"dest_type": "numeric(15,5)",
"description": "Volume of shipment"
},
{
"source_name": "FGLSTS",
"source_type": "CHAR(1)",
"dest_name": "fglsts",
"dest_type": "text",
"description": "Status"
},
{
"source_name": "FGPART",
"source_type": "CHAR(20)",
"dest_name": "fgpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "FGRLNO",
"source_type": "CHAR(8)",
"dest_name": "fgrlno",
"dest_type": "text",
"description": "Release Number"
},
{
"source_name": "FGINV#",
"source_type": "NUMERIC(9,0)",
"dest_name": "fginv#",
"dest_type": "numeric(9,0)",
"description": "Invoice Number"
},
{
"source_name": "FGLIN#",
"source_type": "NUMERIC(3,0)",
"dest_name": "fglin#",
"dest_type": "numeric(3,0)",
"description": "Detail Number"
},
{
"source_name": "FGORUN",
"source_type": "CHAR(3)",
"dest_name": "fgorun",
"dest_type": "text",
"description": "Order Unit"
},
{
"source_name": "FGFTAM",
"source_type": "NUMERIC(10,2)",
"dest_name": "fgftam",
"dest_type": "numeric(10,2)",
"description": "Freight Amount"
},
{
"source_name": "FGSTKL",
"source_type": "CHAR(6)",
"dest_name": "fgstkl",
"dest_type": "text",
"description": "Stock Location"
},
{
"source_name": "FGRAN#",
"source_type": "CHAR(20)",
"dest_name": "fgran#",
"dest_type": "text",
"description": "RAN Number"
},
{
"source_name": "FGCPT#",
"source_type": "CHAR(30)",
"dest_name": "fgcpt#",
"dest_type": "text",
"description": "Customer Part Number"
},
{
"source_name": "FGCNID",
"source_type": "CHAR(30)",
"dest_name": "fgcnid",
"dest_type": "text",
"description": "Shipping Container"
},
{
"source_name": "FGECHG",
"source_type": "CHAR(30)",
"dest_name": "fgechg",
"dest_type": "text",
"description": "Eng. Change Number"
},
{
"source_name": "FGCCUM",
"source_type": "NUMERIC(12,0)",
"dest_name": "fgccum",
"dest_type": "numeric(12,0)",
"description": "Current Cum Quantity"
},
{
"source_name": "FGPCUM",
"source_type": "NUMERIC(12,0)",
"dest_name": "fgpcum",
"dest_type": "numeric(12,0)",
"description": "Previous Cum Quantity"
},
{
"source_name": "FGCPO#",
"source_type": "CHAR(25)",
"dest_name": "fgcpo#",
"dest_type": "text",
"description": "Customer P/O"
},
{
"source_name": "FGCMPR",
"source_type": "CHAR(2)",
"dest_name": "fgcmpr",
"dest_type": "text",
"description": "Complete Partial"
},
{
"source_name": "FGDOCK",
"source_type": "CHAR(30)",
"dest_name": "fgdock",
"dest_type": "text",
"description": "Dock Code"
},
{
"source_name": "FGISTS",
"source_type": "CHAR(1)",
"dest_name": "fgists",
"dest_type": "text",
"description": "ASN Item Status"
},
{
"source_name": "FGSREF",
"source_type": "CHAR(20)",
"dest_name": "fgsref",
"dest_type": "text",
"description": "Shipment Reference"
},
{
"source_name": "FGCRCM",
"source_type": "CHAR(1)",
"dest_name": "fgcrcm",
"dest_type": "text",
"description": "Current/ Complete"
},
{
"source_name": "FGUSR1",
"source_type": "CHAR(20)",
"dest_name": "fgusr1",
"dest_type": "text",
"description": "Discrepancy Code"
},
{
"source_name": "FGUSR2",
"source_type": "CHAR(20)",
"dest_name": "fgusr2",
"dest_type": "text",
"description": "User Field 2"
},
{
"source_name": "FGUSR3",
"source_type": "CHAR(20)",
"dest_name": "fgusr3",
"dest_type": "text",
"description": "User Field 3"
},
{
"source_name": "FGREQ#",
"source_type": "NUMERIC(9,0)",
"dest_name": "fgreq#",
"dest_type": "numeric(9,0)",
"description": "Transfer Request#"
},
{
"source_name": "FGDREQ",
"source_type": "NUMERIC(3,0)",
"dest_name": "fgdreq",
"dest_type": "numeric(3,0)",
"description": "Transfer Req Detail#"
},
{
"source_name": "FGJITD",
"source_type": "NUMERIC(8,0)",
"dest_name": "fgjitd",
"dest_type": "numeric(8,0)",
"description": "JITDX2 Key"
},
{
"source_name": "FGUSR4",
"source_type": "CHAR(20)",
"dest_name": "fgusr4",
"dest_type": "text",
"description": "User Field 4"
},
{
"source_name": "FGUSR5",
"source_type": "CHAR(20)",
"dest_name": "fgusr5",
"dest_type": "text",
"description": "User Field 5"
},
{
"source_name": "FGFUT1",
"source_type": "CHAR(10)",
"dest_name": "fgfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUT2",
"source_type": "CHAR(10)",
"dest_name": "fgfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUT3",
"source_type": "CHAR(20)",
"dest_name": "fgfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUT4",
"source_type": "CHAR(20)",
"dest_name": "fgfut4",
"dest_type": "text",
"description": "Link IASND"
},
{
"source_name": "FGFUT5",
"source_type": "CHAR(30)",
"dest_name": "fgfut5",
"dest_type": "text",
"description": "SBI Shipment ID"
},
{
"source_name": "FGFUTA",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfuta",
"dest_type": "numeric(15,5)",
"description": "Original Qty Shipped"
},
{
"source_name": "FGFUTB",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfutb",
"dest_type": "numeric(15,5)",
"description": "1st Level BLWT Component Line #"
},
{
"source_name": "FGFUTC",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfutc",
"dest_type": "numeric(15,5)",
"description": "Per Unit Freight in Order Unit"
},
{
"source_name": "FGFUTD",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfutd",
"dest_type": "numeric(15,5)",
"description": "Handling Fee Percentage"
},
{
"source_name": "FGFUTE",
"source_type": "CHAR(3)",
"dest_name": "fgfute",
"dest_type": "text",
"description": "Toyota Manifest Shipment Counter"
},
{
"source_name": "FGFUTF",
"source_type": "CHAR(3)",
"dest_name": "fgfutf",
"dest_type": "text",
"description": "Receiving Log Line #"
},
{
"source_name": "FGFUTG",
"source_type": "CHAR(10)",
"dest_name": "fgfutg",
"dest_type": "text",
"description": "Receiving Log #"
},
{
"source_name": "FGFUTH",
"source_type": "CHAR(10)",
"dest_name": "fgfuth",
"dest_type": "text",
"description": "Toyota Manifest Shipment Truck ID"
},
{
"source_name": "FGFUTI",
"source_type": "CHAR(10)",
"dest_name": "fgfuti",
"dest_type": "text",
"description": "ATS Pick Group"
},
{
"source_name": "FGFUTJ",
"source_type": "CHAR(10)",
"dest_name": "fgfutj",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTK",
"source_type": "CHAR(20)",
"dest_name": "fgfutk",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTL",
"source_type": "CHAR(20)",
"dest_name": "fgfutl",
"dest_type": "text",
"description": "Toyota Kanban Number"
},
{
"source_name": "FGFUTM",
"source_type": "CHAR(20)",
"dest_name": "fgfutm",
"dest_type": "text",
"description": "Toyota Manifest Shipment Invoice #"
},
{
"source_name": "FGFUTN",
"source_type": "CHAR(20)",
"dest_name": "fgfutn",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTO",
"source_type": "CHAR(20)",
"dest_name": "fgfuto",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTP",
"source_type": "CHAR(1)",
"dest_name": "fgfutp",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTQ",
"source_type": "CHAR(1)",
"dest_name": "fgfutq",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTR",
"source_type": "CHAR(1)",
"dest_name": "fgfutr",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTS",
"source_type": "CHAR(1)",
"dest_name": "fgfuts",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUTT",
"source_type": "CHAR(1)",
"dest_name": "fgfutt",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGPLNT",
"source_type": "CHAR(3)",
"dest_name": "fgplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "FGBUNT",
"source_type": "CHAR(3)",
"dest_name": "fgbunt",
"dest_type": "text",
"description": "Base Unit"
},
{
"source_name": "FGRPBR",
"source_type": "CHAR(10)",
"dest_name": "fgrpbr",
"dest_type": "text",
"description": "Remit Paid by RAN"
},
{
"source_name": "FGNWFP",
"source_type": "NUMERIC(8,2)",
"dest_name": "fgnwfp",
"dest_type": "numeric(8,2)",
"description": "Net Weight"
},
{
"source_name": "FGCREL",
"source_type": "CHAR(20)",
"dest_name": "fgcrel",
"dest_type": "text",
"description": "Current Rel/Ref"
},
{
"source_name": "FGPSLP",
"source_type": "CHAR(30)",
"dest_name": "fgpslp",
"dest_type": "text",
"description": "Packing Slip"
},
{
"source_name": "FGRMID",
"source_type": "CHAR(30)",
"dest_name": "fgrmid",
"dest_type": "text",
"description": "Remit ID"
},
{
"source_name": "FGCREV",
"source_type": "CHAR(30)",
"dest_name": "fgcrev",
"dest_type": "text",
"description": "Cust Rev Number"
},
{
"source_name": "FGREFF",
"source_type": "CHAR(30)",
"dest_name": "fgreff",
"dest_type": "text",
"description": "Reference Field"
},
{
"source_name": "FGFUT6",
"source_type": "CHAR(30)",
"dest_name": "fgfut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUT7",
"source_type": "CHAR(30)",
"dest_name": "fgfut7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUT8",
"source_type": "CHAR(30)",
"dest_name": "fgfut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "FGFUT9",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfut9",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "FGFUT10",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfut10",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "FGFUT11",
"source_type": "NUMERIC(15,5)",
"dest_name": "fgfut11",
"dest_type": "numeric(15,5)",
"description": "Future Use"
}
],
"watermarks": [
{
"name": "bold_wm",
"connection": "usmidsap02",
"resolver_sql": "SELECT COALESCE(MAX(fecdat), DATE '1900-01-01') - 21 FROM cms.bolh",
"default_value": null
}
],
"hooks": []
}

97
config/modules/bold.sql Normal file
View File

@ -0,0 +1,97 @@
WITH changed AS (
SELECT "FEBOL#" FROM lgdat.bolh
WHERE (FECDAT BETWEEN '{bold_wm}' AND CURRENT_DATE)
OR (FEPDAT BETWEEN '{bold_wm}' AND CURRENT_DATE)
OR (FEDDAT BETWEEN '{bold_wm}' AND CURRENT_DATE)
OR (FEPDAT IS NULL AND FEDDAT IS NULL AND FECDAT >= CURRENT_DATE - 90 DAYS)
)
SELECT
"FGBOL#" AS "fgbol#",
"FGENT#" AS "fgent#",
"FGORD#" AS "fgord#",
FGITEM AS fgitem,
"FGPO#" AS "fgpo#",
FGPREL AS fgprel,
FGPITM AS fgpitm,
FGQSHP AS fgqshp,
FGQSHO AS fgqsho,
RTRIM(FGCTNC) AS fgctnc,
FGCTNN AS fgctnn,
FGPLTN AS fgpltn,
FGNTWC AS fgntwc,
FGGRSC AS fggrsc,
FGTARC AS fgtarc,
FGVOLC AS fgvolc,
FGQTYC AS fgqtyc,
FGWGTP AS fgwgtp,
FGVOLP AS fgvolp,
RTRIM(FGLSTS) AS fglsts,
RTRIM(FGPART) AS fgpart,
RTRIM(FGRLNO) AS fgrlno,
"FGINV#" AS "fginv#",
"FGLIN#" AS "fglin#",
RTRIM(FGORUN) AS fgorun,
FGFTAM AS fgftam,
RTRIM(FGSTKL) AS fgstkl,
RTRIM("FGRAN#") AS "fgran#",
RTRIM("FGCPT#") AS "fgcpt#",
RTRIM(FGCNID) AS fgcnid,
RTRIM(FGECHG) AS fgechg,
FGCCUM AS fgccum,
FGPCUM AS fgpcum,
RTRIM("FGCPO#") AS "fgcpo#",
RTRIM(FGCMPR) AS fgcmpr,
RTRIM(FGDOCK) AS fgdock,
RTRIM(FGISTS) AS fgists,
RTRIM(FGSREF) AS fgsref,
RTRIM(FGCRCM) AS fgcrcm,
RTRIM(FGUSR1) AS fgusr1,
RTRIM(FGUSR2) AS fgusr2,
RTRIM(FGUSR3) AS fgusr3,
"FGREQ#" AS "fgreq#",
FGDREQ AS fgdreq,
FGJITD AS fgjitd,
RTRIM(FGUSR4) AS fgusr4,
RTRIM(FGUSR5) AS fgusr5,
RTRIM(FGFUT1) AS fgfut1,
RTRIM(FGFUT2) AS fgfut2,
RTRIM(FGFUT3) AS fgfut3,
RTRIM(FGFUT4) AS fgfut4,
RTRIM(FGFUT5) AS fgfut5,
FGFUTA AS fgfuta,
FGFUTB AS fgfutb,
FGFUTC AS fgfutc,
FGFUTD AS fgfutd,
RTRIM(FGFUTE) AS fgfute,
RTRIM(FGFUTF) AS fgfutf,
RTRIM(FGFUTG) AS fgfutg,
RTRIM(FGFUTH) AS fgfuth,
RTRIM(FGFUTI) AS fgfuti,
RTRIM(FGFUTJ) AS fgfutj,
RTRIM(FGFUTK) AS fgfutk,
RTRIM(FGFUTL) AS fgfutl,
RTRIM(FGFUTM) AS fgfutm,
RTRIM(FGFUTN) AS fgfutn,
RTRIM(FGFUTO) AS fgfuto,
RTRIM(FGFUTP) AS fgfutp,
RTRIM(FGFUTQ) AS fgfutq,
RTRIM(FGFUTR) AS fgfutr,
RTRIM(FGFUTS) AS fgfuts,
RTRIM(FGFUTT) AS fgfutt,
RTRIM(FGPLNT) AS fgplnt,
RTRIM(FGBUNT) AS fgbunt,
RTRIM(FGRPBR) AS fgrpbr,
FGNWFP AS fgnwfp,
RTRIM(FGCREL) AS fgcrel,
RTRIM(FGPSLP) AS fgpslp,
RTRIM(FGRMID) AS fgrmid,
RTRIM(FGCREV) AS fgcrev,
RTRIM(FGREFF) AS fgreff,
RTRIM(FGFUT6) AS fgfut6,
RTRIM(FGFUT7) AS fgfut7,
RTRIM(FGFUT8) AS fgfut8,
FGFUT9 AS fgfut9,
FGFUT10 AS fgfut10,
FGFUT11 AS fgfut11
FROM LGDAT.BOLD
WHERE "FGBOL#" IN (SELECT "FEBOL#" FROM changed)

1296
config/modules/bolh.json Normal file

File diff suppressed because it is too large Load Diff

190
config/modules/bolh.sql Normal file
View File

@ -0,0 +1,190 @@
SELECT
"FEBOL#" AS "febol#",
RTRIM(FEBTYP) AS febtyp,
CASE WHEN FECDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE FECDAT END AS fecdat,
RTRIM(FEPIND) AS fepind,
RTRIM(FESIND) AS fesind,
RTRIM("FEBCS#") AS "febcs#",
RTRIM("FESCS#") AS "fescs#",
RTRIM(FESVND) AS fesvnd,
RTRIM(FERVND) AS fervnd,
RTRIM(FEBNME) AS febnme,
RTRIM(FEBPTC) AS febptc,
RTRIM(FEATTN) AS feattn,
RTRIM(FESNME) AS fesnme,
RTRIM(FESAD1) AS fesad1,
RTRIM(FESAD2) AS fesad2,
RTRIM(FESAD3) AS fesad3,
RTRIM(FESAD4) AS fesad4,
RTRIM(FESAD5) AS fesad5,
RTRIM(FESAD6) AS fesad6,
RTRIM(FESAD7) AS fesad7,
RTRIM(FESAD8) AS fesad8,
RTRIM(FESAD9) AS fesad9,
RTRIM(FESAD10) AS fesad10,
RTRIM(FESPTC) AS fesptc,
RTRIM(FESCTY) AS fescty,
RTRIM(FESPOV) AS fespov,
RTRIM(FESCRY) AS fescry,
CASE WHEN FESDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE FESDAT END AS fesdat,
RTRIM(FESVIA) AS fesvia,
RTRIM(FETKID) AS fetkid,
FENCTN AS fenctn,
FENETW AS fenetw,
FEGROW AS fegrow,
FETARW AS fetarw,
RTRIM(FEWTUN) AS fewtun,
RTRIM(FEDOCD) AS fedocd,
RTRIM(FEFTCD) AS feftcd,
"FEORD#" AS "feord#",
RTRIM(FESTKL) AS festkl,
FEFTAM AS feftam,
RTRIM(FEFOB) AS fefob,
RTRIM(FECARC) AS fecarc,
RTRIM(FESERC) AS feserc,
FESTME AS festme,
RTRIM(FEJITF) AS fejitf,
RTRIM("FESID#") AS "fesid#",
RTRIM(FETRPT) AS fetrpt,
RTRIM(FEBID) AS febid,
RTRIM(FESID) AS fesid,
RTRIM(FESFID) AS fesfid,
RTRIM(FEPLNT) AS feplnt,
RTRIM(FEITMC) AS feitmc,
RTRIM(FESUPP) AS fesupp,
RTRIM(FEULTD) AS feultd,
CASE WHEN FEEDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE FEEDAT END AS feedat,
FEETIM AS feetim,
CASE WHEN FEADAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE FEADAT END AS feadat,
FEATIM AS featim,
RTRIM(FETRNM) AS fetrnm,
RTRIM(FERTEG) AS ferteg,
RTRIM(FEPLPT) AS feplpt,
RTRIM(FEPLOC) AS feploc,
RTRIM(FEEQPD) AS feeqpd,
RTRIM(FEEQPI) AS feeqpi,
RTRIM(FEEQID) AS feeqid,
FEMBOL AS fembol,
RTRIM(FEPSLP) AS fepslp,
RTRIM(FEFRTB) AS fefrtb,
RTRIM(FEAIRB) AS feairb,
RTRIM(FETSPR) AS fetspr,
RTRIM(FEETRR) AS feetrr,
RTRIM(FEEXTR) AS feextr,
RTRIM(FEAETC) AS feaetc,
RTRIM(FEMTHP) AS femthp,
RTRIM(FETRNT) AS fetrnt,
RTRIM(FETRLQ) AS fetrlq,
RTRIM(FECCT) AS fecct,
RTRIM(FECCDE) AS feccde,
RTRIM(FESASN) AS fesasn,
RTRIM(FESNTF) AS fesntf,
RTRIM(FESTS) AS fests,
RTRIM(FEXMOD) AS fexmod,
RTRIM(FEATYP) AS featyp,
RTRIM(FEFLD1) AS fefld1,
RTRIM(FEFLD2) AS fefld2,
RTRIM(FEFLD3) AS fefld3,
RTRIM(FEFLD4) AS fefld4,
RTRIM(FEFLD5) AS fefld5,
RTRIM(FEFLD6) AS fefld6,
RTRIM(FEMANW) AS femanw,
RTRIM(FES204) AS fes204,
RTRIM(FEBTRP) AS febtrp,
RTRIM(FEBSTS) AS febsts,
RTRIM(FEBACK) AS feback,
RTRIM(FEBSET) AS febset,
RTRIM(FEBMOD) AS febmod,
FESKDQ AS feskdq,
RTRIM(FESKDT) AS feskdt,
FELOSQ AS felosq,
RTRIM(FELOST) AS felost,
RTRIM(FECRCM) AS fecrcm,
RTRIM(FEUSE) AS feuse,
RTRIM(FESLCS) AS feslcs,
RTRIM(FECRTY) AS fecrty,
RTRIM(FECRDT) AS fecrdt,
RTRIM("FECRD#") AS "fecrd#",
RTRIM(FEEXPR) AS feexpr,
RTRIM(FEHODR) AS fehodr,
FECRNM AS fecrnm,
RTRIM(FESHBF) AS feshbf,
RTRIM(FECLEN) AS feclen,
RTRIM(FEPLTC) AS fepltc,
RTRIM(FEFUT1) AS fefut1,
RTRIM(FEFUT2) AS fefut2,
RTRIM(FEFUT3) AS fefut3,
RTRIM(FEFUT4) AS fefut4,
RTRIM(FEFUT5) AS fefut5,
RTRIM(FEFUT6) AS fefut6,
RTRIM(FEFUT7) AS fefut7,
RTRIM(FEFUT8) AS fefut8,
RTRIM(FEFUT9) AS fefut9,
RTRIM(FEFUTA) AS fefuta,
RTRIM(FEFUTB) AS fefutb,
FEFUTC AS fefutc,
RTRIM(FEFUTD) AS fefutd,
RTRIM(FEFUTE) AS fefute,
RTRIM(FEFUTF) AS fefutf,
RTRIM(FEFUTG) AS fefutg,
RTRIM(FELDTY) AS feldty,
RTRIM(FETKST) AS fetkst,
RTRIM(FERTS) AS ferts,
RTRIM(FEFUTH) AS fefuth,
RTRIM(FEFUTI) AS fefuti,
RTRIM(FEFUTJ) AS fefutj,
RTRIM(FEFUTK) AS fefutk,
RTRIM(FEFUTL) AS fefutl,
RTRIM(FEFUTM) AS fefutm,
RTRIM(FEFUTN) AS fefutn,
RTRIM(FEFUTO) AS fefuto,
RTRIM(FEFUTP) AS fefutp,
RTRIM(FEFUTQ) AS fefutq,
RTRIM(FEFUTR) AS fefutr,
RTRIM(FEFUTS) AS fefuts,
RTRIM(FEFUTT) AS fefutt,
RTRIM(FEFUTU) AS fefutu,
RTRIM(FEFUTV) AS fefutv,
RTRIM(FEFUTW) AS fefutw,
FEFUTX AS fefutx,
FEFUTY AS fefuty,
FEFUTZ AS fefutz,
FESCNC AS fescnc,
CASE WHEN FEDDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE FEDDAT END AS feddat,
FEDTME AS fedtme,
RTRIM(FEDCMT) AS fedcmt,
RTRIM("FEMBL#") AS "fembl#",
RTRIM(FEATMZ) AS featmz,
RTRIM(FEETMZ) AS feetmz,
RTRIM(FESTMZ) AS festmz,
RTRIM(FECTMZ) AS fectmz,
RTRIM(FEPSTS) AS fepsts,
RTRIM(FETENT) AS fetent,
RTRIM(FEPQN) AS fepqn,
RTRIM(FETAMT) AS fetamt,
RTRIM(FEIBN) AS feibn,
RTRIM(FESTTP) AS festtp,
RTRIM(FESTCN) AS festcn,
RTRIM(FEEXPDT) AS feexpdt,
RTRIM(FEDLTB) AS fedltb,
RTRIM(FEPUSR) AS fepusr,
CASE WHEN FEPDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE FEPDAT END AS fepdat,
FEPTIM AS feptim,
RTRIM(FEFUT10) AS fefut10,
RTRIM(FEFUT11) AS fefut11,
RTRIM(FEFUT12) AS fefut12,
RTRIM(FEFUT13) AS fefut13,
RTRIM(FEFUT14) AS fefut14,
RTRIM(FEFUT15) AS fefut15,
RTRIM(FEFUT16) AS fefut16,
RTRIM(FEFUT17) AS fefut17,
FEFUT18 AS fefut18,
FEFUT19 AS fefut19,
FEFUT20 AS fefut20
FROM LGDAT.BOLH
WHERE
(fecdat BETWEEN '{bolh_wm}' AND CURRENT_DATE) -- new + recently-created edits
OR (fepdat BETWEEN '{bolh_wm}' AND CURRENT_DATE) -- unposted → posted flip
OR (feddat BETWEEN '{bolh_wm}' AND CURRENT_DATE) -- cancellations (Date Deleted)
OR (fepdat IS NULL AND feddat IS NULL -- live pending tail, not cancelled
AND fecdat >= CURRENT_DATE - 90 DAYS) -- ~1k rows

246
config/modules/coa_map.json Normal file
View File

@ -0,0 +1,246 @@
{
"name": "coa_map",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gs.coa_map",
"staging_table": "pipekit_staging.coa_map",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "Entity",
"source_type": "VARCHAR(3)",
"dest_name": "entity",
"dest_type": "text",
"description": null
},
{
"source_name": "Company",
"source_type": "VARCHAR(2)",
"dest_name": "company",
"dest_type": "text",
"description": null
},
{
"source_name": "Company Name",
"source_type": "VARCHAR(14)",
"dest_name": "company_name",
"dest_type": "text",
"description": null
},
{
"source_name": "Account#",
"source_type": "VARCHAR(12)",
"dest_name": "account#",
"dest_type": "text",
"description": null
},
{
"source_name": "AZTITL CHG Description",
"source_type": "VARCHAR(39)",
"dest_name": "aztitl__chg_description",
"dest_type": "text",
"description": null
},
{
"source_name": "FGRP",
"source_type": "VARCHAR(39)",
"dest_name": "fgrp",
"dest_type": "text",
"description": null
},
{
"source_name": "Department",
"source_type": "VARCHAR(24)",
"dest_name": "department",
"dest_type": "text",
"description": null
},
{
"source_name": "Department Name",
"source_type": "VARCHAR(27)",
"dest_name": "department_name",
"dest_type": "text",
"description": null
},
{
"source_name": "STMT",
"source_type": "VARCHAR(16)",
"dest_name": "stmt",
"dest_type": "text",
"description": null
},
{
"source_name": "LVL0",
"source_type": "VARCHAR(60)",
"dest_name": "lvl0",
"dest_type": "text",
"description": null
},
{
"source_name": "LVL1",
"source_type": "VARCHAR(60)",
"dest_name": "lvl1",
"dest_type": "text",
"description": null
},
{
"source_name": "LVL2",
"source_type": "VARCHAR(60)",
"dest_name": "lvl2",
"dest_type": "text",
"description": null
},
{
"source_name": "LVL3",
"source_type": "VARCHAR(35)",
"dest_name": "lvl3",
"dest_type": "text",
"description": null
},
{
"source_name": "Summary Acct",
"source_type": "VARCHAR(28)",
"dest_name": "summary_acct",
"dest_type": "text",
"description": null
},
{
"source_name": "CF Mapping",
"source_type": "VARCHAR(23)",
"dest_name": "cf_mapping",
"dest_type": "text",
"description": null
},
{
"source_name": "FS",
"source_type": "VARCHAR(2)",
"dest_name": "fs",
"dest_type": "text",
"description": null
},
{
"source_name": "Level 1",
"source_type": "VARCHAR(60)",
"dest_name": "level_1",
"dest_type": "text",
"description": null
},
{
"source_name": "Level 2",
"source_type": "VARCHAR(60)",
"dest_name": "level_2",
"dest_type": "text",
"description": null
},
{
"source_name": "Level 3",
"source_type": "VARCHAR(60)",
"dest_name": "level_3",
"dest_type": "text",
"description": null
},
{
"source_name": "Level 4",
"source_type": "VARCHAR(60)",
"dest_name": "level_4",
"dest_type": "text",
"description": null
},
{
"source_name": "D&A",
"source_type": "VARCHAR(19)",
"dest_name": "d_a",
"dest_type": "text",
"description": null
},
{
"source_name": "Addback",
"source_type": "VARCHAR(1)",
"dest_name": "addback",
"dest_type": "text",
"description": null
},
{
"source_name": "Anaplan Mapping",
"source_type": "VARCHAR(1)",
"dest_name": "anaplan_mapping",
"dest_type": "text",
"description": null
},
{
"source_name": "Anaplan D&A PE Exp.",
"source_type": "VARCHAR(1)",
"dest_name": "anaplan_d_a__pe_exp.",
"dest_type": "text",
"description": null
},
{
"source_name": "Mapping.Completion.Check",
"source_type": "VARCHAR(1)",
"dest_name": "mapping.completion.check",
"dest_type": "text",
"description": null
},
{
"source_name": "FS (Audit format)",
"source_type": "VARCHAR(2)",
"dest_name": "fs__audit_format_",
"dest_type": "text",
"description": null
},
{
"source_name": "Level 1 (Audit format)",
"source_type": "VARCHAR(41)",
"dest_name": "level_1__audit_format_",
"dest_type": "text",
"description": null
},
{
"source_name": "Level 2 (BS)",
"source_type": "VARCHAR(22)",
"dest_name": "level_2__bs_",
"dest_type": "text",
"description": null
},
{
"source_name": "IS Mapping (Audit)",
"source_type": "VARCHAR(22)",
"dest_name": "is_mapping__audit_",
"dest_type": "text",
"description": null
},
{
"source_name": "Manual Adjustment to Shua File",
"source_type": "VARCHAR(1)",
"dest_name": "manual_adjustment_to_shua_file",
"dest_type": "text",
"description": null
},
{
"source_name": "Difference in Mapping",
"source_type": "VARCHAR(1)",
"dest_name": "difference_in_mapping",
"dest_type": "text",
"description": null
},
{
"source_name": "EBITDA",
"source_type": "NVARCHAR(255)",
"dest_name": "ebitda",
"dest_type": "text",
"description": null
},
{
"source_name": "ELIM",
"source_type": "NVARCHAR(255)",
"dest_name": "elim",
"dest_type": "text",
"description": null
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,35 @@
SELECT
RTRIM([Entity]) AS entity,
RTRIM([Company]) AS company,
RTRIM([Company Name]) AS company_name,
RTRIM([Account#]) AS "account#",
RTRIM([AZTITL CHG Description]) AS aztitl__chg_description,
RTRIM([FGRP]) AS fgrp,
RTRIM([Department]) AS department,
RTRIM([Department Name]) AS department_name,
RTRIM([STMT]) AS stmt,
RTRIM([LVL0]) AS lvl0,
RTRIM([LVL1]) AS lvl1,
RTRIM([LVL2]) AS lvl2,
RTRIM([LVL3]) AS lvl3,
RTRIM([Summary Acct]) AS summary_acct,
RTRIM([CF Mapping]) AS cf_mapping,
RTRIM([FS]) AS fs,
RTRIM([Level 1]) AS level_1,
RTRIM([Level 2]) AS level_2,
RTRIM([Level 3]) AS level_3,
RTRIM([Level 4]) AS level_4,
RTRIM([D&A]) AS d_a,
RTRIM([Addback]) AS addback,
RTRIM([Anaplan Mapping]) AS anaplan_mapping,
RTRIM([Anaplan D&A PE Exp.]) AS "anaplan_d_a__pe_exp.",
RTRIM([Mapping.Completion.Check]) AS "mapping.completion.check",
RTRIM([FS (Audit format)]) AS fs__audit_format_,
RTRIM([Level 1 (Audit format)]) AS level_1__audit_format_,
RTRIM([Level 2 (BS)]) AS level_2__bs_,
RTRIM([IS Mapping (Audit)]) AS is_mapping__audit_,
RTRIM([Manual Adjustment to Shua File]) AS manual_adjustment_to_shua_file,
RTRIM([Difference in Mapping]) AS difference_in_mapping,
RTRIM([EBITDA]) AS ebitda,
RTRIM([ELIM]) AS elim
FROM [FANALYSIS].[GS].[coa_map]

43
config/modules/code.json Normal file
View File

@ -0,0 +1,43 @@
{
"name": "code",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.code",
"staging_table": "pipekit_staging.code",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "System Codes Master 6.1",
"columns": [
{
"source_name": "A2",
"source_type": "CHAR(2)",
"dest_name": "a2",
"dest_type": "text",
"description": "Record Type"
},
{
"source_name": "A9",
"source_type": "CHAR(9)",
"dest_name": "a9",
"dest_type": "text",
"description": "Key Data"
},
{
"source_name": "A30",
"source_type": "CHAR(30)",
"dest_name": "a30",
"dest_type": "text",
"description": "Description Usually"
},
{
"source_name": "A215",
"source_type": "CHAR(215)",
"dest_name": "a215",
"dest_type": "text",
"description": "Other Data"
}
],
"watermarks": [],
"hooks": []
}

6
config/modules/code.sql Normal file
View File

@ -0,0 +1,6 @@
SELECT
RTRIM(A2) AS a2,
RTRIM(A9) AS a9,
RTRIM(A30) AS a30,
RTRIM(A215) AS a215
FROM LGDAT.CODE

92
config/modules/color.json Normal file
View File

@ -0,0 +1,92 @@
{
"name": "color",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.color",
"staging_table": "pipekit_staging.color",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "color descriptions",
"columns": [
{
"source_name": "COLCODE",
"source_type": "CHAR(3)",
"dest_name": "colcode",
"dest_type": "text",
"description": "COLCODE"
},
{
"source_name": "COLDESC",
"source_type": "CHAR(20)",
"dest_name": "coldesc",
"dest_type": "text",
"description": "COLDESC"
},
{
"source_name": "COLPANT",
"source_type": "CHAR(10)",
"dest_name": "colpant",
"dest_type": "text",
"description": "COLPANT"
},
{
"source_name": "COLOREF",
"source_type": "CHAR(20)",
"dest_name": "coloref",
"dest_type": "text",
"description": "COLOREF"
},
{
"source_name": "COLFTRN",
"source_type": "CHAR(15)",
"dest_name": "colftrn",
"dest_type": "text",
"description": "COLFTRN"
},
{
"source_name": "COLSTAT",
"source_type": "CHAR(1)",
"dest_name": "colstat",
"dest_type": "text",
"description": "COLSTAT"
},
{
"source_name": "COLTIER",
"source_type": "CHAR(1)",
"dest_name": "coltier",
"dest_type": "text",
"description": "COLTIER"
},
{
"source_name": "COLGRP",
"source_type": "CHAR(1)",
"dest_name": "colgrp",
"dest_type": "text",
"description": "COLGRP"
},
{
"source_name": "COLRETL",
"source_type": "CHAR(1)",
"dest_name": "colretl",
"dest_type": "text",
"description": "COLRETL"
},
{
"source_name": "COLRGB",
"source_type": "CHAR(15)",
"dest_name": "colrgb",
"dest_type": "text",
"description": "COLRGB"
},
{
"source_name": "COLRHX",
"source_type": "CHAR(15)",
"dest_name": "colrhx",
"dest_type": "text",
"description": "COLRHX"
}
],
"watermarks": [],
"hooks": []
}

13
config/modules/color.sql Normal file
View File

@ -0,0 +1,13 @@
SELECT
RTRIM(COLCODE) AS colcode,
RTRIM(COLDESC) AS coldesc,
RTRIM(COLPANT) AS colpant,
RTRIM(COLOREF) AS coloref,
RTRIM(COLFTRN) AS colftrn,
RTRIM(COLSTAT) AS colstat,
RTRIM(COLTIER) AS coltier,
RTRIM(COLGRP) AS colgrp,
RTRIM(COLRETL) AS colretl,
RTRIM(COLRGB) AS colrgb,
RTRIM(COLRHX) AS colrhx
FROM "CMS.CUSLG".COLOR

View File

@ -0,0 +1,50 @@
{
"name": "colorb",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.colorb",
"staging_table": "pipekit_staging.colorb",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Used in UPDblendr",
"columns": [
{
"source_name": "CLPLNT",
"source_type": "CHAR(3)",
"dest_name": "clplnt",
"dest_type": "text",
"description": "CLPLNT"
},
{
"source_name": "CLCOLOR",
"source_type": "CHAR(3)",
"dest_name": "clcolor",
"dest_type": "text",
"description": "CLCOLOR"
},
{
"source_name": "CLDEPT",
"source_type": "CHAR(5)",
"dest_name": "cldept",
"dest_type": "text",
"description": "CLDEPT"
},
{
"source_name": "CLPART",
"source_type": "CHAR(20)",
"dest_name": "clpart",
"dest_type": "text",
"description": "CLPART"
},
{
"source_name": "CLPERC",
"source_type": "DECIMAL(2,0)",
"dest_name": "clperc",
"dest_type": "numeric(2,0)",
"description": "CLPERC"
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,7 @@
SELECT
RTRIM(CLPLNT) AS clplnt,
RTRIM(CLCOLOR) AS clcolor,
RTRIM(CLDEPT) AS cldept,
RTRIM(CLPART) AS clpart,
CLPERC AS clperc
FROM "CMS.CUSLG".COLORB

View File

@ -0,0 +1,29 @@
{
"name": "colortier",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.colortier",
"staging_table": "pipekit_staging.colortier",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Color Tier",
"columns": [
{
"source_name": "CLTIER",
"source_type": "CHAR(1)",
"dest_name": "cltier",
"dest_type": "text",
"description": "CLTIER"
},
{
"source_name": "CLDESC",
"source_type": "CHAR(30)",
"dest_name": "cldesc",
"dest_type": "text",
"description": "CLDESC"
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,4 @@
SELECT
RTRIM(CLTIER) AS cltier,
RTRIM(CLDESC) AS cldesc
FROM "CMS.CUSLG".COLORTIER

211
config/modules/cret.json Normal file
View File

@ -0,0 +1,211 @@
{
"name": "cret",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.cret",
"staging_table": "pipekit_staging.cret",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Currency Exchange Master 6.0",
"columns": [
{
"source_name": "B86COMN",
"source_type": "NUMERIC(2,0)",
"dest_name": "b86comn",
"dest_type": "numeric(2,0)",
"description": "Company Number"
},
{
"source_name": "B86CURC",
"source_type": "CHAR(2)",
"dest_name": "b86curc",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "B86RTTY",
"source_type": "CHAR(1)",
"dest_name": "b86rtty",
"dest_type": "text",
"description": "Rate Type"
},
{
"source_name": "B86EFYY",
"source_type": "NUMERIC(4,0)",
"dest_name": "b86efyy",
"dest_type": "numeric(4,0)",
"description": "Effective From Fiscal Year"
},
{
"source_name": "B86EFPP",
"source_type": "NUMERIC(2,0)",
"dest_name": "b86efpp",
"dest_type": "numeric(2,0)",
"description": "Effective From Fiscal Period"
},
{
"source_name": "B86EDAT",
"source_type": "DATE",
"dest_name": "b86edat",
"dest_type": "date",
"description": "Effective From Calendar Date"
},
{
"source_name": "B86SRTE",
"source_type": "NUMERIC(11,6)",
"dest_name": "b86srte",
"dest_type": "numeric(11,6)",
"description": "Currency Exchange Rate"
},
{
"source_name": "B86CUSR",
"source_type": "CHAR(10)",
"dest_name": "b86cusr",
"dest_type": "text",
"description": "Created By User"
},
{
"source_name": "B86CDAT",
"source_type": "DATE",
"dest_name": "b86cdat",
"dest_type": "date",
"description": "Date Created"
},
{
"source_name": "B86CTME",
"source_type": "TIME",
"dest_name": "b86ctme",
"dest_type": "time",
"description": "Time Created"
},
{
"source_name": "B86UUSR",
"source_type": "CHAR(10)",
"dest_name": "b86uusr",
"dest_type": "text",
"description": "Updated By User"
},
{
"source_name": "B86UDAT",
"source_type": "DATE",
"dest_name": "b86udat",
"dest_type": "date",
"description": "Date Updated"
},
{
"source_name": "B86UTME",
"source_type": "TIME",
"dest_name": "b86utme",
"dest_type": "time",
"description": "Time Updated"
},
{
"source_name": "B86FUT1",
"source_type": "CHAR(3)",
"dest_name": "b86fut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FUT2",
"source_type": "CHAR(3)",
"dest_name": "b86fut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FUT3",
"source_type": "CHAR(10)",
"dest_name": "b86fut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FUT4",
"source_type": "CHAR(10)",
"dest_name": "b86fut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FUT5",
"source_type": "CHAR(20)",
"dest_name": "b86fut5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FUT6",
"source_type": "CHAR(20)",
"dest_name": "b86fut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FUT7",
"source_type": "NUMERIC(15,5)",
"dest_name": "b86fut7",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "B86FUT8",
"source_type": "NUMERIC(15,5)",
"dest_name": "b86fut8",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "B86FUT9",
"source_type": "NUMERIC(11,6)",
"dest_name": "b86fut9",
"dest_type": "numeric(11,6)",
"description": "Future Use"
},
{
"source_name": "B86FUTA",
"source_type": "NUMERIC(11,6)",
"dest_name": "b86futa",
"dest_type": "numeric(11,6)",
"description": "Future Use"
},
{
"source_name": "B86FLG1",
"source_type": "CHAR(1)",
"dest_name": "b86flg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FLG2",
"source_type": "CHAR(1)",
"dest_name": "b86flg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FLG3",
"source_type": "CHAR(1)",
"dest_name": "b86flg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FLG4",
"source_type": "CHAR(1)",
"dest_name": "b86flg4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "B86FLG5",
"source_type": "CHAR(1)",
"dest_name": "b86flg5",
"dest_type": "text",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

30
config/modules/cret.sql Normal file
View File

@ -0,0 +1,30 @@
SELECT
B86COMN AS b86comn,
RTRIM(B86CURC) AS b86curc,
RTRIM(B86RTTY) AS b86rtty,
B86EFYY AS b86efyy,
B86EFPP AS b86efpp,
CASE WHEN B86EDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE B86EDAT END AS b86edat,
B86SRTE AS b86srte,
RTRIM(B86CUSR) AS b86cusr,
CASE WHEN B86CDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE B86CDAT END AS b86cdat,
B86CTME AS b86ctme,
RTRIM(B86UUSR) AS b86uusr,
CASE WHEN B86UDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE B86UDAT END AS b86udat,
B86UTME AS b86utme,
RTRIM(B86FUT1) AS b86fut1,
RTRIM(B86FUT2) AS b86fut2,
RTRIM(B86FUT3) AS b86fut3,
RTRIM(B86FUT4) AS b86fut4,
RTRIM(B86FUT5) AS b86fut5,
RTRIM(B86FUT6) AS b86fut6,
B86FUT7 AS b86fut7,
B86FUT8 AS b86fut8,
B86FUT9 AS b86fut9,
B86FUTA AS b86futa,
RTRIM(B86FLG1) AS b86flg1,
RTRIM(B86FLG2) AS b86flg2,
RTRIM(B86FLG3) AS b86flg3,
RTRIM(B86FLG4) AS b86flg4,
RTRIM(B86FLG5) AS b86flg5
FROM LGDAT.CRET

1611
config/modules/cust.json Normal file

File diff suppressed because it is too large Load Diff

230
config/modules/cust.sql Normal file
View File

@ -0,0 +1,230 @@
SELECT
BVCOMP AS bvcomp,
RTRIM(BVCUST) AS bvcust,
RTRIM(BVNAME) AS bvname,
RTRIM(BVADR1) AS bvadr1,
RTRIM(BVADR2) AS bvadr2,
RTRIM(BVADR3) AS bvadr3,
RTRIM(BVADR4) AS bvadr4,
RTRIM(BVADR5) AS bvadr5,
RTRIM(BVADR6) AS bvadr6,
RTRIM(BVADR7) AS bvadr7,
RTRIM(BVADR8) AS bvadr8,
RTRIM(BVADR9) AS bvadr9,
RTRIM(BVADR10) AS bvadr10,
RTRIM(BVPOST) AS bvpost,
RTRIM(BVCITY) AS bvcity,
RTRIM(BVPROV) AS bvprov,
RTRIM(BVCTRY) AS bvctry,
RTRIM(BVTELP) AS bvtelp,
RTRIM(BVBORD) AS bvbord,
RTRIM(BVPRAR) AS bvprar,
RTRIM(BVPSTE) AS bvpste,
RTRIM(BVPRCD) AS bvprcd,
RTRIM(BVPSTL) AS bvpstl,
RTRIM(BVFSTE) AS bvfste,
RTRIM(BVTXGR) AS bvtxgr,
RTRIM(BVTXRT) AS bvtxrt,
RTRIM(BVPACK) AS bvpack,
RTRIM(BVNU10) AS bvnu10,
RTRIM(BVSALM) AS bvsalm,
RTRIM(BVTERR) AS bvterr,
RTRIM(BVSNOT) AS bvsnot,
RTRIM(BVCURR) AS bvcurr,
RTRIM(BVSCOM) AS bvscom,
RTRIM(BVTYPE) AS bvtype,
RTRIM(BVCRLE) AS bvcrle,
RTRIM(BVGSTE) AS bvgste,
BVCREL AS bvcrel,
RTRIM(BVOEM) AS bvoem,
RTRIM(BVLANG) AS bvlang,
BVSHLT AS bvshlt,
RTRIM(BVINPO) AS bvinpo,
RTRIM(BVTERM) AS bvterm,
RTRIM(BVSHCL) AS bvshcl,
RTRIM(BV1B) AS bv1b,
BVDISL AS bvdisl,
RTRIM(BVARCD) AS bvarcd,
RTRIM(BVINT) AS bvint,
BVSDAY AS bvsday,
RTRIM(BVPORQ) AS bvporq,
RTRIM(BVCLAS) AS bvclas,
RTRIM(BVPSTC) AS bvpstc,
CASE WHEN BVLDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE BVLDAT END AS bvldat,
BVLINA AS bvlina,
CASE WHEN BVPDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE BVPDAT END AS bvpdat,
BVLPAA AS bvlpaa,
BVYTDS AS bvytds,
BVLYTD AS bvlytd,
BVOUTB AS bvoutb,
RTRIM(BV15) AS bv15,
RTRIM(BVDUNN) AS bvdunn,
RTRIM(BVFAX) AS bvfax,
CASE WHEN BVMDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE BVMDAT END AS bvmdat,
RTRIM(BVBILL) AS bvbill,
RTRIM(BVGSTL) AS bvgstl,
RTRIM(BV3) AS bv3,
BVLARA AS bvlara,
RTRIM(BVCONT) AS bvcont,
RTRIM(BVSUPP) AS bvsupp,
RTRIM(BVSFOR) AS bvsfor,
BVSFCP AS bvsfcp,
RTRIM(BVMFOR) AS bvmfor,
BVMFCP AS bvmfcp,
RTRIM(BVXFOR) AS bvxfor,
BVXFCP AS bvxfcp,
RTRIM(BVCARC) AS bvcarc,
RTRIM(BVSERC) AS bvserc,
RTRIM(BVSUPA) AS bvsupa,
RTRIM(BVTRDP) AS bvtrdp,
RTRIM(BVDUNS) AS bvduns,
RTRIM(BVSFID) AS bvsfid,
RTRIM(BVUSEC) AS bvusec,
RTRIM(BVSHPR) AS bvshpr,
RTRIM(BVASNY) AS bvasny,
RTRIM(BVINVY) AS bvinvy,
RTRIM(BVFLG1) AS bvflg1,
RTRIM(BVFLG2) AS bvflg2,
RTRIM(BVFLG3) AS bvflg3,
RTRIM(BVFLG4) AS bvflg4,
RTRIM(BVFLG5) AS bvflg5,
RTRIM(BVFLG6) AS bvflg6,
RTRIM(BVSUMR) AS bvsumr,
RTRIM(BVPLNT) AS bvplnt,
RTRIM(BVDOCK) AS bvdock,
RTRIM(BVLINE) AS bvline,
RTRIM(BVDROP) AS bvdrop,
RTRIM(BVTMOD) AS bvtmod,
RTRIM(BVTTYP) AS bvttyp,
RTRIM(BVEQPI) AS bveqpi,
RTRIM(BVROUT) AS bvrout,
RTRIM(BVPOOL) AS bvpool,
RTRIM(BVPOLL) AS bvpoll,
RTRIM(BVJITF) AS bvjitf,
RTRIM(BVAPLG) AS bvaplg,
RTRIM(BVAVER) AS bvaver,
RTRIM(BVUVER) AS bvuver,
RTRIM(BVFOBC) AS bvfobc,
RTRIM(BVEMAL) AS bvemal,
RTRIM(BVWEB) AS bvweb,
RTRIM(BVDDIR) AS bvddir,
RTRIM(BVFL01) AS bvfl01,
RTRIM(BVADJC) AS bvadjc,
RTRIM(BVPPCL) AS bvppcl,
CASE WHEN BVCDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE BVCDAT END AS bvcdat,
RTRIM(BVIBRQ) AS bvibrq,
RTRIM(BVORSM) AS bvorsm,
RTRIM(BVFL04) AS bvfl04,
RTRIM(BVSTAT) AS bvstat,
RTRIM(BVREAS) AS bvreas,
RTRIM(BVFL05) AS bvfl05,
RTRIM(BVFL06) AS bvfl06,
RTRIM(BVFL07) AS bvfl07,
RTRIM(BVCSERD) AS bvcserd,
RTRIM(BVFL08) AS bvfl08,
RTRIM(BVFL09) AS bvfl09,
RTRIM(BVFL10) AS bvfl10,
RTRIM(BVFL11) AS bvfl11,
RTRIM(BVFL12) AS bvfl12,
CASE WHEN BVFL13 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE BVFL13 END AS bvfl13,
CASE WHEN BVFL14 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE BVFL14 END AS bvfl14,
BVFL15 AS bvfl15,
BVFL16 AS bvfl16,
RTRIM(BVFL17) AS bvfl17,
RTRIM(BVFL18) AS bvfl18,
RTRIM(BVFL19) AS bvfl19,
RTRIM(BVFL20) AS bvfl20,
RTRIM(BVVRFKB) AS bvvrfkb,
RTRIM(BVGRPCK) AS bvgrpck,
RTRIM(BVSWAP) AS bvswap,
RTRIM(BVICON) AS bvicon,
RTRIM(BVINSP) AS bvinsp,
RTRIM(BVALS) AS bvals,
RTRIM(BVFUT2) AS bvfut2,
RTRIM(BVFUT3) AS bvfut3,
RTRIM(BVFUT4) AS bvfut4,
RTRIM(BVFUT5) AS bvfut5,
RTRIM(BVFUT6) AS bvfut6,
RTRIM(BVFUT7) AS bvfut7,
RTRIM(BVFUT8) AS bvfut8,
RTRIM(BVFUT9) AS bvfut9,
RTRIM(BVFUT10) AS bvfut10,
RTRIM(BVFUT11) AS bvfut11,
RTRIM(BVFUT12) AS bvfut12,
RTRIM(BVFUT13) AS bvfut13,
RTRIM(BVFUT14) AS bvfut14,
RTRIM(BVFUT15) AS bvfut15,
RTRIM(BVTMZN) AS bvtmzn,
BVSLT AS bvslt,
RTRIM(BVSLTU) AS bvsltu,
RTRIM(BVUPSC) AS bvupsc,
RTRIM(BVSEAL) AS bvseal,
RTRIM(BVSTRQ) AS bvstrq,
RTRIM(BVWTPT) AS bvwtpt,
RTRIM(BVINCD) AS bvincd,
RTRIM(BVWCAR) AS bvwcar,
RTRIM(BVSVPO) AS bvsvpo,
RTRIM(BVSVCT) AS bvsvct,
RTRIM(BVFSTR) AS bvfstr,
BVTRVL AS bvtrvl,
BVCTIM AS bvctim,
RTRIM(BVCUSR) AS bvcusr,
BVMTIM AS bvmtim,
RTRIM(BVMUSR) AS bvmusr,
RTRIM(BVSEBP) AS bvsebp,
RTRIM(BVWESS) AS bvwess,
RTRIM(BVFUT16) AS bvfut16,
RTRIM(BVFUT17) AS bvfut17,
RTRIM(BVFUT18) AS bvfut18,
RTRIM(BVFUT19) AS bvfut19,
RTRIM(BVFUT20) AS bvfut20,
RTRIM(BVFUT21) AS bvfut21,
RTRIM(BVFUT22) AS bvfut22,
RTRIM(BVFUT23) AS bvfut23,
RTRIM(BVFUT24) AS bvfut24,
RTRIM(BVFUT25) AS bvfut25,
RTRIM(BVFUT26) AS bvfut26,
RTRIM(BVFUT27) AS bvfut27,
RTRIM(BVFUT28) AS bvfut28,
RTRIM(BVFUT29) AS bvfut29,
RTRIM(BVFUT30) AS bvfut30,
RTRIM(BVHIN) AS bvhin,
RTRIM(BVDOCKF) AS bvdockf,
RTRIM(BVORLNF) AS bvorlnf,
RTRIM(BVCLOC) AS bvcloc,
RTRIM(BVDLRD) AS bvdlrd,
RTRIM(BVSLTT) AS bvsltt,
RTRIM(BVVSM) AS bvvsm,
RTRIM(BVMRWM) AS bvmrwm,
RTRIM(BVEDIPW) AS bvedipw,
RTRIM(BVSPUF) AS bvspuf,
RTRIM(BVSLZN) AS bvslzn,
BVHFEP AS bvhfep,
BVARGP AS bvargp,
RTRIM(BVCSPO) AS bvcspo,
BVSHPD AS bvshpd,
BVSHPT AS bvshpt,
RTRIM(BVOOSF) AS bvoosf,
RTRIM(BVSCILC) AS bvscilc,
RTRIM(BVSCICI) AS bvscici,
BVSCIGD AS bvscigd,
BVSCIGD2 AS bvscigd2,
RTRIM(BVARCOL) AS bvarcol,
RTRIM(BVDCLS) AS bvdcls,
RTRIM(BVSCHL) AS bvschl,
RTRIM(BVARSP) AS bvarsp,
RTRIM(BVACBOL) AS bvacbol,
RTRIM(BVSOSO) AS bvsoso,
RTRIM(BVRTXR) AS bvrtxr,
RTRIM(BVPODCF) AS bvpodcf,
RTRIM(BVADSSC) AS bvadssc,
RTRIM(BVPODCC) AS bvpodcc,
RTRIM(BVATFE) AS bvatfe,
RTRIM(BVVIDO) AS bvvido,
RTRIM(BVUCFS) AS bvucfs,
RTRIM(BVSISR) AS bvsisr,
RTRIM(BVNBBL) AS bvnbbl,
RTRIM(BVSITL) AS bvsitl,
RTRIM(BVSIAL) AS bvsial,
RTRIM(BVSIOE) AS bvsioe
FROM LGDAT.CUST

309
config/modules/depts.json Normal file
View File

@ -0,0 +1,309 @@
{
"name": "depts",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.depts",
"staging_table": "pipekit_staging.depts",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Department Master File 6.1",
"columns": [
{
"source_name": "AADEPT",
"source_type": "CHAR(5)",
"dest_name": "aadept",
"dest_type": "text",
"description": "Production Department Code"
},
{
"source_name": "AABLNK",
"source_type": "CHAR(8)",
"dest_name": "aablnk",
"dest_type": "text",
"description": "AABLNK"
},
{
"source_name": "AADNME",
"source_type": "CHAR(25)",
"dest_name": "aadnme",
"dest_type": "text",
"description": "Department Name"
},
{
"source_name": "AASTDR",
"source_type": "NUMERIC(8,2)",
"dest_name": "aastdr",
"dest_type": "numeric(8,2)",
"description": "Default Labour Rate"
},
{
"source_name": "AABRDR",
"source_type": "NUMERIC(8,2)",
"dest_name": "aabrdr",
"dest_type": "numeric(8,2)",
"description": "Default Fixed Burden Rate"
},
{
"source_name": "AAMACH",
"source_type": "NUMERIC(2,0)",
"dest_name": "aamach",
"dest_type": "numeric(2,0)",
"description": "Default # of Mach."
},
{
"source_name": "AABRDP",
"source_type": "NUMERIC(4,0)",
"dest_name": "aabrdp",
"dest_type": "numeric(4,0)",
"description": "Default Fixed Burden %"
},
{
"source_name": "AADFTC",
"source_type": "NUMERIC(4,2)",
"dest_name": "aadftc",
"dest_type": "numeric(4,2)",
"description": "Default Capacity"
},
{
"source_name": "AASTIM",
"source_type": "TIME",
"dest_name": "aastim",
"dest_type": "time",
"description": "Starting Time"
},
{
"source_name": "AAVBRD",
"source_type": "NUMERIC(8,2)",
"dest_name": "aavbrd",
"dest_type": "numeric(8,2)",
"description": "Default Variable Burden Rate"
},
{
"source_name": "AAFRML",
"source_type": "CHAR(6)",
"dest_name": "aafrml",
"dest_type": "text",
"description": "Draw Loc."
},
{
"source_name": "AARCVL",
"source_type": "CHAR(6)",
"dest_name": "aarcvl",
"dest_type": "text",
"description": "Receive Loc."
},
{
"source_name": "AAINSP",
"source_type": "CHAR(5)",
"dest_name": "aainsp",
"dest_type": "text",
"description": "Default Inspector Code"
},
{
"source_name": "AAPLNT",
"source_type": "CHAR(3)",
"dest_name": "aaplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "AAOSRV",
"source_type": "CHAR(1)",
"dest_name": "aaosrv",
"dest_type": "text",
"description": "Outside Service"
},
{
"source_name": "AAVBRP",
"source_type": "NUMERIC(4,0)",
"dest_name": "aavbrp",
"dest_type": "numeric(4,0)",
"description": "Default Variable Burden %"
},
{
"source_name": "AAWPDR",
"source_type": "CHAR(6)",
"dest_name": "aawpdr",
"dest_type": "text",
"description": "WIP Draw From"
},
{
"source_name": "AAWPRV",
"source_type": "CHAR(6)",
"dest_name": "aawprv",
"dest_type": "text",
"description": "WIP Receive To"
},
{
"source_name": "AAMAXH",
"source_type": "NUMERIC(3,0)",
"dest_name": "aamaxh",
"dest_type": "numeric(3,0)",
"description": "Maximum Hours /Day"
},
{
"source_name": "AAUSLF",
"source_type": "CHAR(1)",
"dest_name": "aauslf",
"dest_type": "text",
"description": "Use Labour Fixed"
},
{
"source_name": "AAUSLV",
"source_type": "CHAR(1)",
"dest_name": "aauslv",
"dest_type": "text",
"description": "Use Labour Variable"
},
{
"source_name": "AACUSR",
"source_type": "CHAR(10)",
"dest_name": "aacusr",
"dest_type": "text",
"description": "Created By User"
},
{
"source_name": "AACDAT",
"source_type": "DATE",
"dest_name": "aacdat",
"dest_type": "date",
"description": "Date Created"
},
{
"source_name": "AACTIM",
"source_type": "TIME",
"dest_name": "aactim",
"dest_type": "time",
"description": "Time Created"
},
{
"source_name": "AAUUSR",
"source_type": "CHAR(10)",
"dest_name": "aauusr",
"dest_type": "text",
"description": "Updated By User"
},
{
"source_name": "AAUDAT",
"source_type": "DATE",
"dest_name": "aaudat",
"dest_type": "date",
"description": "Date Updated"
},
{
"source_name": "AAUTIM",
"source_type": "TIME",
"dest_name": "aautim",
"dest_type": "time",
"description": "Time Updated"
},
{
"source_name": "AAFUT1",
"source_type": "CHAR(3)",
"dest_name": "aafut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFUT2",
"source_type": "CHAR(3)",
"dest_name": "aafut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFUT3",
"source_type": "CHAR(10)",
"dest_name": "aafut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFUT4",
"source_type": "CHAR(10)",
"dest_name": "aafut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFUT5",
"source_type": "CHAR(20)",
"dest_name": "aafut5",
"dest_type": "text",
"description": "Mattec Dept code"
},
{
"source_name": "AAFUT6",
"source_type": "CHAR(20)",
"dest_name": "aafut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFUT7",
"source_type": "NUMERIC(15,5)",
"dest_name": "aafut7",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "AAFLG1",
"source_type": "CHAR(1)",
"dest_name": "aaflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFLG2",
"source_type": "CHAR(1)",
"dest_name": "aaflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFLG3",
"source_type": "CHAR(1)",
"dest_name": "aaflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFLG4",
"source_type": "CHAR(1)",
"dest_name": "aaflg4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAFLG5",
"source_type": "CHAR(1)",
"dest_name": "aaflg5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "AAVCOD",
"source_type": "CHAR(2)",
"dest_name": "aavcod",
"dest_type": "text",
"description": "Visible Dept"
},
{
"source_name": "AALBPST",
"source_type": "CHAR(1)",
"dest_name": "aalbpst",
"dest_type": "text",
"description": "Auto Post Labour centric Batches"
},
{
"source_name": "AAVRPR",
"source_type": "CHAR(1)",
"dest_name": "aavrpr",
"dest_type": "text",
"description": "Vendor Reports Prod."
}
],
"watermarks": [],
"hooks": []
}

44
config/modules/depts.sql Normal file
View File

@ -0,0 +1,44 @@
SELECT
RTRIM(AADEPT) AS aadept,
RTRIM(AABLNK) AS aablnk,
RTRIM(AADNME) AS aadnme,
AASTDR AS aastdr,
AABRDR AS aabrdr,
AAMACH AS aamach,
AABRDP AS aabrdp,
AADFTC AS aadftc,
AASTIM AS aastim,
AAVBRD AS aavbrd,
RTRIM(AAFRML) AS aafrml,
RTRIM(AARCVL) AS aarcvl,
RTRIM(AAINSP) AS aainsp,
RTRIM(AAPLNT) AS aaplnt,
RTRIM(AAOSRV) AS aaosrv,
AAVBRP AS aavbrp,
RTRIM(AAWPDR) AS aawpdr,
RTRIM(AAWPRV) AS aawprv,
AAMAXH AS aamaxh,
RTRIM(AAUSLF) AS aauslf,
RTRIM(AAUSLV) AS aauslv,
RTRIM(AACUSR) AS aacusr,
CASE WHEN AACDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE AACDAT END AS aacdat,
AACTIM AS aactim,
RTRIM(AAUUSR) AS aauusr,
CASE WHEN AAUDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE AAUDAT END AS aaudat,
AAUTIM AS aautim,
RTRIM(AAFUT1) AS aafut1,
RTRIM(AAFUT2) AS aafut2,
RTRIM(AAFUT3) AS aafut3,
RTRIM(AAFUT4) AS aafut4,
RTRIM(AAFUT5) AS aafut5,
RTRIM(AAFUT6) AS aafut6,
AAFUT7 AS aafut7,
RTRIM(AAFLG1) AS aaflg1,
RTRIM(AAFLG2) AS aaflg2,
RTRIM(AAFLG3) AS aaflg3,
RTRIM(AAFLG4) AS aaflg4,
RTRIM(AAFLG5) AS aaflg5,
RTRIM(AAVCOD) AS aavcod,
RTRIM(AALBPST) AS aalbpst,
RTRIM(AAVRPR) AS aavrpr
FROM LGDAT.DEPTS

113
config/modules/dsdisc.json Normal file
View File

@ -0,0 +1,113 @@
{
"name": "dsdisc",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.dsdisc",
"staging_table": "pipekit_staging.dsdisc",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Discount codes file 6.0",
"columns": [
{
"source_name": "FADISC",
"source_type": "CHAR(3)",
"dest_name": "fadisc",
"dest_type": "text",
"description": "Discount Code"
},
{
"source_name": "FADDES",
"source_type": "CHAR(30)",
"dest_name": "faddes",
"dest_type": "text",
"description": "Discount Description"
},
{
"source_name": "FAPERC",
"source_type": "NUMERIC(8,5)",
"dest_name": "faperc",
"dest_type": "numeric(8,5)",
"description": "Default Rate"
},
{
"source_name": "FADRCR",
"source_type": "CHAR(1)",
"dest_name": "fadrcr",
"dest_type": "text",
"description": "Debit Credit"
},
{
"source_name": "FABANT",
"source_type": "CHAR(1)",
"dest_name": "fabant",
"dest_type": "text",
"description": "Rate Base"
},
{
"source_name": "FADAMT",
"source_type": "NUMERIC(13,5)",
"dest_name": "fadamt",
"dest_type": "numeric(13,5)",
"description": "Default Amount"
},
{
"source_name": "FAAPER",
"source_type": "CHAR(1)",
"dest_name": "faaper",
"dest_type": "text",
"description": "Fixed or per Unit"
},
{
"source_name": "FACRAR",
"source_type": "CHAR(1)",
"dest_name": "facrar",
"dest_type": "text",
"description": "Create A/R"
},
{
"source_name": "FACUST",
"source_type": "CHAR(8)",
"dest_name": "facust",
"dest_type": "text",
"description": "Customer Code"
},
{
"source_name": "FAARSC",
"source_type": "CHAR(3)",
"dest_name": "faarsc",
"dest_type": "text",
"description": "Sales Code"
},
{
"source_name": "FADINV",
"source_type": "NUMERIC(9,0)",
"dest_name": "fadinv",
"dest_type": "numeric(9,0)",
"description": "Discount Accumulation Inv#"
},
{
"source_name": "FAAUNT",
"source_type": "CHAR(3)",
"dest_name": "faaunt",
"dest_type": "text",
"description": "Amount Per-Unit"
},
{
"source_name": "FARTEF",
"source_type": "CHAR(1)",
"dest_name": "fartef",
"dest_type": "text",
"description": "Rate Flag"
},
{
"source_name": "FARNDD",
"source_type": "NUMERIC(2,0)",
"dest_name": "farndd",
"dest_type": "numeric(2,0)",
"description": "Rounding # of Decimals"
}
],
"watermarks": [],
"hooks": []
}

16
config/modules/dsdisc.sql Normal file
View File

@ -0,0 +1,16 @@
SELECT
RTRIM(FADISC) AS fadisc,
RTRIM(FADDES) AS faddes,
FAPERC AS faperc,
RTRIM(FADRCR) AS fadrcr,
RTRIM(FABANT) AS fabant,
FADAMT AS fadamt,
RTRIM(FAAPER) AS faaper,
RTRIM(FACRAR) AS facrar,
RTRIM(FACUST) AS facust,
RTRIM(FAARSC) AS faarsc,
FADINV AS fadinv,
RTRIM(FAAUNT) AS faaunt,
RTRIM(FARTEF) AS fartef,
FARNDD AS farndd
FROM LGDAT.DSDISC

View File

@ -0,0 +1,50 @@
{
"name": "ffcret",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ffcret",
"staging_table": "pipekit_staging.ffcret",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Master Data - currency translation rates",
"columns": [
{
"source_name": "FCUR",
"source_type": "VARCHAR(2)",
"dest_name": "fcur",
"dest_type": "text",
"description": "FCUR"
},
{
"source_name": "TCUR",
"source_type": "VARCHAR(2)",
"dest_name": "tcur",
"dest_type": "text",
"description": "TCUR"
},
{
"source_name": "RTYP",
"source_type": "VARCHAR(2)",
"dest_name": "rtyp",
"dest_type": "text",
"description": "RTYP"
},
{
"source_name": "PERD",
"source_type": "VARCHAR(4)",
"dest_name": "perd",
"dest_type": "text",
"description": "PERD"
},
{
"source_name": "RATE",
"source_type": "FLOAT",
"dest_name": "rate",
"dest_type": "double precision",
"description": "RATE"
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,7 @@
SELECT
RTRIM(FCUR) AS fcur,
RTRIM(TCUR) AS tcur,
RTRIM(RTYP) AS rtyp,
RTRIM(PERD) AS perd,
RATE AS rate
FROM RLARP.FFCRET

View File

@ -0,0 +1,162 @@
{
"name": "ffpdglr1",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ffpdglr1",
"staging_table": "pipekit_staging.ffpdglr1",
"merge_strategy": "incremental",
"merge_key": "btid",
"enabled": 1,
"dest_description": "",
"columns": [
{
"source_name": "SRCE",
"source_type": "CHAR(4)",
"dest_name": "srce",
"dest_type": "text",
"description": "SRCE"
},
{
"source_name": "WRKO",
"source_type": "VARCHAR(10)",
"dest_name": "wrko",
"dest_type": "text",
"description": "WRKO"
},
{
"source_name": "BTID",
"source_type": "INTEGER",
"dest_name": "btid",
"dest_type": "integer",
"description": "BTID"
},
{
"source_name": "ENT#",
"source_type": "INTEGER",
"dest_name": "ent#",
"dest_type": "integer",
"description": "ENT#"
},
{
"source_name": "SEQ#",
"source_type": "INTEGER",
"dest_name": "seq#",
"dest_type": "integer",
"description": "SEQ#"
},
{
"source_name": "PART",
"source_type": "VARCHAR(20)",
"dest_name": "part",
"dest_type": "text",
"description": "PART"
},
{
"source_name": "RPLN",
"source_type": "CHAR(1)",
"dest_name": "rpln",
"dest_type": "text",
"description": "RPLN"
},
{
"source_name": "PQTY",
"source_type": "DECIMAL(20,5)",
"dest_name": "pqty",
"dest_type": "numeric(20,5)",
"description": "PQTY"
},
{
"source_name": "ARSC",
"source_type": "VARCHAR(5)",
"dest_name": "arsc",
"dest_type": "text",
"description": "ARSC"
},
{
"source_name": "ADEP",
"source_type": "VARCHAR(5)",
"dest_name": "adep",
"dest_type": "text",
"description": "ADEP"
},
{
"source_name": "ACTN",
"source_type": "VARCHAR(10)",
"dest_name": "actn",
"dest_type": "text",
"description": "ACTN"
},
{
"source_name": "ACCT",
"source_type": "CHAR(12)",
"dest_name": "acct",
"dest_type": "text",
"description": "ACCT"
},
{
"source_name": "AMNT",
"source_type": "DECIMAL(20,2)",
"dest_name": "amnt",
"dest_type": "numeric(20,2)",
"description": "AMNT"
},
{
"source_name": "SRSC",
"source_type": "VARCHAR(5)",
"dest_name": "srsc",
"dest_type": "text",
"description": "SRSC"
},
{
"source_name": "RHRS",
"source_type": "DECIMAL(20,5)",
"dest_name": "rhrs",
"dest_type": "numeric(20,5)",
"description": "RHRS"
},
{
"source_name": "RCRW",
"source_type": "DECIMAL(20,5)",
"dest_name": "rcrw",
"dest_type": "numeric(20,5)",
"description": "RCRW"
},
{
"source_name": "SHRS",
"source_type": "DECIMAL(20,5)",
"dest_name": "shrs",
"dest_type": "numeric(20,5)",
"description": "SHRS"
},
{
"source_name": "SCRW",
"source_type": "DECIMAL(20,5)",
"dest_name": "scrw",
"dest_type": "numeric(20,5)",
"description": "SCRW"
},
{
"source_name": "RRAT",
"source_type": "DECIMAL(20,5)",
"dest_name": "rrat",
"dest_type": "numeric(20,5)",
"description": "RRAT"
},
{
"source_name": "RSIZ",
"source_type": "DECIMAL(20,5)",
"dest_name": "rsiz",
"dest_type": "numeric(20,5)",
"description": "RSIZ"
}
],
"watermarks": [
{
"name": "ffpdglr1_wm",
"connection": "usmidsap02",
"resolver_sql": "SELECT COALESCE(format('%L', MAX(to_char(nwfsyy,'00FM')||to_char(nwfspp,'00FM'))), '''1501''') FROM cms.rprh",
"default_value": "'1501'"
}
],
"hooks": []
}

View File

@ -0,0 +1,24 @@
SELECT
RTRIM(SRCE) AS srce,
RTRIM(WRKO) AS wrko,
BTID AS btid,
"ENT#" AS "ent#",
"SEQ#" AS "seq#",
RTRIM(PART) AS part,
RTRIM(RPLN) AS rpln,
PQTY AS pqty,
RTRIM(ARSC) AS arsc,
RTRIM(ADEP) AS adep,
RTRIM(ACTN) AS actn,
RTRIM(ACCT) AS acct,
AMNT AS amnt,
RTRIM(SRSC) AS srsc,
RHRS AS rhrs,
RCRW AS rcrw,
SHRS AS shrs,
SCRW AS scrw,
RRAT AS rrat,
RSIZ AS rsiz
FROM FANALDEV.FFPDGLR1
INNER JOIN LGDAT.RPRH ON NWBTID = BTID
WHERE DIGITS(NWFSYY)||DIGITS(NWFSPP) >= {ffpdglr1_wm}

View File

@ -0,0 +1,176 @@
{
"name": "ffsbglr1",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ffsbglr1",
"staging_table": "pipekit_staging.ffsbglr1",
"merge_strategy": "incremental",
"merge_key": "perd",
"enabled": 1,
"dest_description": "FFSBGLR1",
"columns": [
{
"source_name": "MODULE",
"source_type": "CHAR(4)",
"dest_name": "module",
"dest_type": "text",
"description": "Module"
},
{
"source_name": "BATCH",
"source_type": "CHAR(9)",
"dest_name": "batch",
"dest_type": "text",
"description": "Batch"
},
{
"source_name": "PERD",
"source_type": "CHAR(4)",
"dest_name": "perd",
"dest_type": "text",
"description": "Perd"
},
{
"source_name": "TDATE",
"source_type": "CHAR(10)",
"dest_name": "tdate",
"dest_type": "text",
"description": "Tdate"
},
{
"source_name": "PDATE",
"source_type": "CHAR(10)",
"dest_name": "pdate",
"dest_type": "text",
"description": "Pdate"
},
{
"source_name": "ACCT",
"source_type": "CHAR(12)",
"dest_name": "acct",
"dest_type": "text",
"description": "Acct"
},
{
"source_name": "AMT",
"source_type": "DECIMAL(16,6)",
"dest_name": "amt",
"dest_type": "numeric(16,6)",
"description": "Amt"
},
{
"source_name": "PROJ",
"source_type": "VARCHAR(50)",
"dest_name": "proj",
"dest_type": "text",
"description": "Proj"
},
{
"source_name": "USRN",
"source_type": "VARCHAR(50)",
"dest_name": "usrn",
"dest_type": "text",
"description": "Usrn"
},
{
"source_name": "REV",
"source_type": "VARCHAR(2)",
"dest_name": "rev",
"dest_type": "text",
"description": "Rev"
},
{
"source_name": "CUSMOD",
"source_type": "VARCHAR(50)",
"dest_name": "cusmod",
"dest_type": "text",
"description": "Cusmod"
},
{
"source_name": "CUSKEY1",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey1",
"dest_type": "text",
"description": "Cuskey1"
},
{
"source_name": "CUSKEY1D",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey1d",
"dest_type": "text",
"description": "Cuskey1d"
},
{
"source_name": "CUSKEY2",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey2",
"dest_type": "text",
"description": "Cuskey2"
},
{
"source_name": "CUSKEY2D",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey2d",
"dest_type": "text",
"description": "Cuskey2d"
},
{
"source_name": "CUSKEY3",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey3",
"dest_type": "text",
"description": "Cuskey3"
},
{
"source_name": "CUSKEY3D",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey3d",
"dest_type": "text",
"description": "Cuskey3d"
},
{
"source_name": "CUSKEY4",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey4",
"dest_type": "text",
"description": "Cuskey4"
},
{
"source_name": "CUSKEY4D",
"source_type": "VARCHAR(50)",
"dest_name": "cuskey4d",
"dest_type": "text",
"description": "Cuskey4d"
},
{
"source_name": "CUSVEND",
"source_type": "VARCHAR(50)",
"dest_name": "cusvend",
"dest_type": "text",
"description": "Cusvend"
},
{
"source_name": "CUSCUST",
"source_type": "VARCHAR(50)",
"dest_name": "cuscust",
"dest_type": "text",
"description": "Cuscust"
},
{
"source_name": "RECID",
"source_type": "VARCHAR(12)",
"dest_name": "recid",
"dest_type": "text",
"description": "Recid"
}
],
"watermarks": [
{
"name": "fspr",
"connection": "usmidsap02",
"resolver_sql": "select max(perd) from cms.ffsbglr1",
"default_value": "2601"
}
],
"hooks": []
}

View File

@ -0,0 +1,25 @@
SELECT
MODULE AS module,
BATCH AS batch,
PERD AS perd,
TDATE AS tdate,
PDATE AS pdate,
ACCT AS acct,
AMT AS amt,
PROJ AS proj,
USRN AS usrn,
REV AS rev,
CUSMOD AS cusmod,
CUSKEY1 AS cuskey1,
CUSKEY1D AS cuskey1d,
CUSKEY2 AS cuskey2,
CUSKEY2D AS cuskey2d,
CUSKEY3 AS cuskey3,
CUSKEY3D AS cuskey3d,
CUSKEY4 AS cuskey4,
CUSKEY4D AS cuskey4d,
CUSVEND AS cusvend,
CUSCUST AS cuscust,
RECID AS recid
FROM FANALDEV.FFSBGLR1
WHERE PERD >= '2702'

92
config/modules/fgrp.json Normal file
View File

@ -0,0 +1,92 @@
{
"name": "fgrp",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.fgrp",
"staging_table": "pipekit_staging.fgrp",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Financial Statement account groups 6.0",
"columns": [
{
"source_name": "BQ1COMP",
"source_type": "CHAR(2)",
"dest_name": "bq1comp",
"dest_type": "text",
"description": "Company Code Alpha"
},
{
"source_name": "BQ1LVL",
"source_type": "CHAR(1)",
"dest_name": "bq1lvl",
"dest_type": "text",
"description": "Group Level"
},
{
"source_name": "BQ1GRP",
"source_type": "CHAR(7)",
"dest_name": "bq1grp",
"dest_type": "text",
"description": "Group Code"
},
{
"source_name": "BQ1TITL",
"source_type": "CHAR(30)",
"dest_name": "bq1titl",
"dest_type": "text",
"description": "Group Title"
},
{
"source_name": "BQ1NPAG",
"source_type": "CHAR(1)",
"dest_name": "bq1npag",
"dest_type": "text",
"description": "New Page"
},
{
"source_name": "BQ1ULIN",
"source_type": "CHAR(1)",
"dest_name": "bq1ulin",
"dest_type": "text",
"description": "Underline"
},
{
"source_name": "BQ1BLIN",
"source_type": "NUMERIC(2,0)",
"dest_name": "bq1blin",
"dest_type": "numeric(2,0)",
"description": "Skip lines Before"
},
{
"source_name": "BQ1ALIN",
"source_type": "NUMERIC(2,0)",
"dest_name": "bq1alin",
"dest_type": "numeric(2,0)",
"description": "Skip lines After"
},
{
"source_name": "A1",
"source_type": "CHAR(1)",
"dest_name": "a1",
"dest_type": "text",
"description": "Old Group Level"
},
{
"source_name": "A7",
"source_type": "CHAR(7)",
"dest_name": "a7",
"dest_type": "text",
"description": "Old Group Code"
},
{
"source_name": "A40",
"source_type": "CHAR(40)",
"dest_name": "a40",
"dest_type": "text",
"description": "Old Other Data"
}
],
"watermarks": [],
"hooks": []
}

13
config/modules/fgrp.sql Normal file
View File

@ -0,0 +1,13 @@
SELECT
RTRIM(BQ1COMP) AS bq1comp,
RTRIM(BQ1LVL) AS bq1lvl,
RTRIM(BQ1GRP) AS bq1grp,
RTRIM(BQ1TITL) AS bq1titl,
RTRIM(BQ1NPAG) AS bq1npag,
RTRIM(BQ1ULIN) AS bq1ulin,
BQ1BLIN AS bq1blin,
BQ1ALIN AS bq1alin,
RTRIM(A1) AS a1,
RTRIM(A7) AS a7,
RTRIM(A40) AS a40
FROM LGDAT.FGRP

225
config/modules/fresre.json Normal file
View File

@ -0,0 +1,225 @@
{
"name": "fresre",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.fresre",
"staging_table": "pipekit_staging.fresre",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Resource equipment Master-Future costs 6.1",
"columns": [
{
"source_name": "R9DEPT",
"source_type": "CHAR(5)",
"dest_name": "r9dept",
"dest_type": "text",
"description": "Production Department Code"
},
{
"source_name": "R9RESC",
"source_type": "CHAR(5)",
"dest_name": "r9resc",
"dest_type": "text",
"description": "Resource Code"
},
{
"source_name": "R9BRDR",
"source_type": "NUMERIC(8,2)",
"dest_name": "r9brdr",
"dest_type": "numeric(8,2)",
"description": "Fixed Burden Rate"
},
{
"source_name": "R9CREW",
"source_type": "NUMERIC(2,0)",
"dest_name": "r9crew",
"dest_type": "numeric(2,0)",
"description": "Default Crew Size"
},
{
"source_name": "R9BRDP",
"source_type": "NUMERIC(4,0)",
"dest_name": "r9brdp",
"dest_type": "numeric(4,0)",
"description": "Fixed Burden %"
},
{
"source_name": "R9LABS",
"source_type": "NUMERIC(8,2)",
"dest_name": "r9labs",
"dest_type": "numeric(8,2)",
"description": "Set-up Labour Rate"
},
{
"source_name": "R9LABR",
"source_type": "NUMERIC(8,2)",
"dest_name": "r9labr",
"dest_type": "numeric(8,2)",
"description": "Run Labour Rate"
},
{
"source_name": "R9VBRD",
"source_type": "NUMERIC(8,2)",
"dest_name": "r9vbrd",
"dest_type": "numeric(8,2)",
"description": "Variable Burden Rate"
},
{
"source_name": "R9BDVP",
"source_type": "NUMERIC(4,0)",
"dest_name": "r9bdvp",
"dest_type": "numeric(4,0)",
"description": "Variable Burden %"
},
{
"source_name": "R9CDRC",
"source_type": "CHAR(10)",
"dest_name": "r9cdrc",
"dest_type": "text",
"description": "Burden Cost Driver Code"
},
{
"source_name": "R9CDRF",
"source_type": "NUMERIC(15,5)",
"dest_name": "r9cdrf",
"dest_type": "numeric(15,5)",
"description": "Driver Rate Fixed Burden"
},
{
"source_name": "R9CDRV",
"source_type": "NUMERIC(15,5)",
"dest_name": "r9cdrv",
"dest_type": "numeric(15,5)",
"description": "Driver Rate Variable Burden"
},
{
"source_name": "R9CDUM",
"source_type": "CHAR(3)",
"dest_name": "r9cdum",
"dest_type": "text",
"description": "Driver Rate Unit"
},
{
"source_name": "R9USLF",
"source_type": "CHAR(1)",
"dest_name": "r9uslf",
"dest_type": "text",
"description": "Use Labour Fixed"
},
{
"source_name": "R9USLV",
"source_type": "CHAR(1)",
"dest_name": "r9uslv",
"dest_type": "text",
"description": "Use Labour Variable"
},
{
"source_name": "R9PLNT",
"source_type": "CHAR(3)",
"dest_name": "r9plnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "R9FUT1",
"source_type": "CHAR(10)",
"dest_name": "r9fut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT2",
"source_type": "CHAR(10)",
"dest_name": "r9fut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT3",
"source_type": "CHAR(10)",
"dest_name": "r9fut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT4",
"source_type": "CHAR(20)",
"dest_name": "r9fut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT5",
"source_type": "CHAR(30)",
"dest_name": "r9fut5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT6",
"source_type": "NUMERIC(15,5)",
"dest_name": "r9fut6",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "R9FUT7",
"source_type": "CHAR(3)",
"dest_name": "r9fut7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT8",
"source_type": "CHAR(1)",
"dest_name": "r9fut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUT9",
"source_type": "CHAR(1)",
"dest_name": "r9fut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUTA",
"source_type": "CHAR(1)",
"dest_name": "r9futa",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUTB",
"source_type": "CHAR(1)",
"dest_name": "r9futb",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9FUTC",
"source_type": "CHAR(1)",
"dest_name": "r9futc",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "R9VKTR",
"source_type": "CHAR(10)",
"dest_name": "r9vktr",
"dest_type": "text",
"description": "Virtual Kanban Time-On-Hand Range Code"
},
{
"source_name": "R9VKTY",
"source_type": "CHAR(1)",
"dest_name": "r9vkty",
"dest_type": "text",
"description": "Virtual Kanban Type"
}
],
"watermarks": [],
"hooks": []
}

32
config/modules/fresre.sql Normal file
View File

@ -0,0 +1,32 @@
SELECT
RTRIM(R9DEPT) AS r9dept,
RTRIM(R9RESC) AS r9resc,
R9BRDR AS r9brdr,
R9CREW AS r9crew,
R9BRDP AS r9brdp,
R9LABS AS r9labs,
R9LABR AS r9labr,
R9VBRD AS r9vbrd,
R9BDVP AS r9bdvp,
RTRIM(R9CDRC) AS r9cdrc,
R9CDRF AS r9cdrf,
R9CDRV AS r9cdrv,
RTRIM(R9CDUM) AS r9cdum,
RTRIM(R9USLF) AS r9uslf,
RTRIM(R9USLV) AS r9uslv,
RTRIM(R9PLNT) AS r9plnt,
RTRIM(R9FUT1) AS r9fut1,
RTRIM(R9FUT2) AS r9fut2,
RTRIM(R9FUT3) AS r9fut3,
RTRIM(R9FUT4) AS r9fut4,
RTRIM(R9FUT5) AS r9fut5,
R9FUT6 AS r9fut6,
RTRIM(R9FUT7) AS r9fut7,
RTRIM(R9FUT8) AS r9fut8,
RTRIM(R9FUT9) AS r9fut9,
RTRIM(R9FUTA) AS r9futa,
RTRIM(R9FUTB) AS r9futb,
RTRIM(R9FUTC) AS r9futc,
RTRIM(R9VKTR) AS r9vktr,
RTRIM(R9VKTY) AS r9vkty
FROM LGDAT.FRESRE

267
config/modules/ftcstm.json Normal file
View File

@ -0,0 +1,267 @@
{
"name": "ftcstm",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ftcstm",
"staging_table": "pipekit_staging.ftcstm",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Future Inventory Cost - manufactured 6.0",
"columns": [
{
"source_name": "CNPART",
"source_type": "CHAR(20)",
"dest_name": "cnpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "CNLABS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnlabs",
"dest_type": "numeric(13,5)",
"description": "Labour Standard"
},
{
"source_name": "CNMATS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnmats",
"dest_type": "numeric(13,5)",
"description": "Material Standard"
},
{
"source_name": "CNBURS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnburs",
"dest_type": "numeric(13,5)",
"description": "Burden Standard"
},
{
"source_name": "CNLABA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnlaba",
"dest_type": "numeric(13,5)",
"description": "Labour Actual"
},
{
"source_name": "CNMATA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnmata",
"dest_type": "numeric(13,5)",
"description": "Material Actual"
},
{
"source_name": "CNBURA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbura",
"dest_type": "numeric(13,5)",
"description": "Burden Actual"
},
{
"source_name": "CNLABV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnlabv",
"dest_type": "numeric(13,5)",
"description": "Labour Average"
},
{
"source_name": "CNMATV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnmatv",
"dest_type": "numeric(13,5)",
"description": "Material Average"
},
{
"source_name": "CNBURV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnburv",
"dest_type": "numeric(13,5)",
"description": "Burden Average"
},
{
"source_name": "CNTPTD",
"source_type": "DECIMAL(11,0)",
"dest_name": "cntptd",
"dest_type": "numeric(11,0)",
"description": "Total Prod. To Date"
},
{
"source_name": "CNSDAT",
"source_type": "DATE",
"dest_name": "cnsdat",
"dest_type": "date",
"description": "Standard Date"
},
{
"source_name": "CNSTCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnstcs",
"dest_type": "numeric(13,5)",
"description": "Standard Cost"
},
{
"source_name": "CNACCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnaccs",
"dest_type": "numeric(13,5)",
"description": "Actual Cost"
},
{
"source_name": "CNAVCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnavcs",
"dest_type": "numeric(13,5)",
"description": "Average Cost"
},
{
"source_name": "CNSTOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnstoc",
"dest_type": "numeric(13,5)",
"description": "Other Costs (Standard)"
},
{
"source_name": "CNACOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnacoc",
"dest_type": "numeric(13,5)",
"description": "Other Costs (Actual)"
},
{
"source_name": "CNAVOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnavoc",
"dest_type": "numeric(13,5)",
"description": "Other Costs (Average)"
},
{
"source_name": "CNSQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "cnsqty",
"dest_type": "numeric(8,0)",
"description": "Standard Quantity"
},
{
"source_name": "CNAQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "cnaqty",
"dest_type": "numeric(8,0)",
"description": "Actual Quantity"
},
{
"source_name": "CNPTYP",
"source_type": "CHAR(1)",
"dest_name": "cnptyp",
"dest_type": "text",
"description": "Part Type M"
},
{
"source_name": "CNBRFS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbrfs",
"dest_type": "numeric(13,5)",
"description": "Burden Standard (Fixed)"
},
{
"source_name": "CNBRVS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbrvs",
"dest_type": "numeric(13,5)",
"description": "Burden Standard (Var)"
},
{
"source_name": "CNBRFA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbrfa",
"dest_type": "numeric(13,5)",
"description": "Burden Actual (Fixed)"
},
{
"source_name": "CNBRVA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbrva",
"dest_type": "numeric(13,5)",
"description": "Burden Actual (Var)"
},
{
"source_name": "CNBRFV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbrfv",
"dest_type": "numeric(13,5)",
"description": "Burden Average (Fixed)"
},
{
"source_name": "CNBRVV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cnbrvv",
"dest_type": "numeric(13,5)",
"description": "Burden Average (Var)"
},
{
"source_name": "CNPLNT",
"source_type": "CHAR(3)",
"dest_name": "cnplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "CNFUT1",
"source_type": "CHAR(3)",
"dest_name": "cnfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CNFUT2",
"source_type": "CHAR(10)",
"dest_name": "cnfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CNFUT3",
"source_type": "CHAR(20)",
"dest_name": "cnfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CNFUT4",
"source_type": "NUMERIC(15,0)",
"dest_name": "cnfut4",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "CNFUT5",
"source_type": "NUMERIC(15,0)",
"dest_name": "cnfut5",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "CNFLG1",
"source_type": "CHAR(1)",
"dest_name": "cnflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CNFLG2",
"source_type": "CHAR(1)",
"dest_name": "cnflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CNFLG3",
"source_type": "CHAR(1)",
"dest_name": "cnflg3",
"dest_type": "text",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

38
config/modules/ftcstm.sql Normal file
View File

@ -0,0 +1,38 @@
SELECT
RTRIM(CNPART) AS cnpart,
CNLABS AS cnlabs,
CNMATS AS cnmats,
CNBURS AS cnburs,
CNLABA AS cnlaba,
CNMATA AS cnmata,
CNBURA AS cnbura,
CNLABV AS cnlabv,
CNMATV AS cnmatv,
CNBURV AS cnburv,
CNTPTD AS cntptd,
CASE WHEN CNSDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE CNSDAT END AS cnsdat,
CNSTCS AS cnstcs,
CNACCS AS cnaccs,
CNAVCS AS cnavcs,
CNSTOC AS cnstoc,
CNACOC AS cnacoc,
CNAVOC AS cnavoc,
CNSQTY AS cnsqty,
CNAQTY AS cnaqty,
RTRIM(CNPTYP) AS cnptyp,
CNBRFS AS cnbrfs,
CNBRVS AS cnbrvs,
CNBRFA AS cnbrfa,
CNBRVA AS cnbrva,
CNBRFV AS cnbrfv,
CNBRVV AS cnbrvv,
RTRIM(CNPLNT) AS cnplnt,
RTRIM(CNFUT1) AS cnfut1,
RTRIM(CNFUT2) AS cnfut2,
RTRIM(CNFUT3) AS cnfut3,
CNFUT4 AS cnfut4,
CNFUT5 AS cnfut5,
RTRIM(CNFLG1) AS cnflg1,
RTRIM(CNFLG2) AS cnflg2,
RTRIM(CNFLG3) AS cnflg3
FROM LGDAT.FTCSTM

358
config/modules/ftcstp.json Normal file
View File

@ -0,0 +1,358 @@
{
"name": "ftcstp",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ftcstp",
"staging_table": "pipekit_staging.ftcstp",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Future Inventory Cost - Purchased Parts 6.0",
"columns": [
{
"source_name": "COPART",
"source_type": "CHAR(20)",
"dest_name": "copart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "COLUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coluc",
"dest_type": "numeric(13,5)",
"description": "Last Unit Cost"
},
{
"source_name": "COLCC",
"source_type": "NUMERIC(13,5)",
"dest_name": "colcc",
"dest_type": "numeric(13,5)",
"description": "Last Currency Cost"
},
{
"source_name": "COLFC",
"source_type": "NUMERIC(13,5)",
"dest_name": "colfc",
"dest_type": "numeric(13,5)",
"description": "Last Freight Cost"
},
{
"source_name": "COLDC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coldc",
"dest_type": "numeric(13,5)",
"description": "Last Duty Cost"
},
{
"source_name": "COL1C",
"source_type": "NUMERIC(13,5)",
"dest_name": "col1c",
"dest_type": "numeric(13,5)",
"description": "Last Multiplier-1 Cost"
},
{
"source_name": "COL2C",
"source_type": "NUMERIC(13,5)",
"dest_name": "col2c",
"dest_type": "numeric(13,5)",
"description": "Last Multiplier-2 Cost"
},
{
"source_name": "COSUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cosuc",
"dest_type": "numeric(13,5)",
"description": "Standard Unit Cost"
},
{
"source_name": "COSCC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coscc",
"dest_type": "numeric(13,5)",
"description": "Standard Currency Cost"
},
{
"source_name": "COSFC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cosfc",
"dest_type": "numeric(13,5)",
"description": "Standard Freight Cost"
},
{
"source_name": "COSDC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cosdc",
"dest_type": "numeric(13,5)",
"description": "Standard Duty Cost"
},
{
"source_name": "COS1C",
"source_type": "NUMERIC(13,5)",
"dest_name": "cos1c",
"dest_type": "numeric(13,5)",
"description": "Standard Multiplier-1 Cost"
},
{
"source_name": "COS2C",
"source_type": "NUMERIC(13,5)",
"dest_name": "cos2c",
"dest_type": "numeric(13,5)",
"description": "Standard Multiplier-2 Cost"
},
{
"source_name": "COSCR",
"source_type": "DECIMAL(11,6)",
"dest_name": "coscr",
"dest_type": "numeric(11,6)",
"description": "Standard Currency Rate"
},
{
"source_name": "COLCR",
"source_type": "DECIMAL(11,6)",
"dest_name": "colcr",
"dest_type": "numeric(11,6)",
"description": "Last Currency Rate"
},
{
"source_name": "COSDAT",
"source_type": "DATE",
"dest_name": "cosdat",
"dest_type": "date",
"description": "Standard Date"
},
{
"source_name": "COSTCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "costcs",
"dest_type": "numeric(13,5)",
"description": "Standard Cost"
},
{
"source_name": "COACCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "coaccs",
"dest_type": "numeric(13,5)",
"description": "Last Actual Cost"
},
{
"source_name": "COAVCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "coavcs",
"dest_type": "numeric(13,5)",
"description": "Average Cost"
},
{
"source_name": "COSDR",
"source_type": "NUMERIC(8,4)",
"dest_name": "cosdr",
"dest_type": "numeric(8,4)",
"description": "Standard Duty Rate"
},
{
"source_name": "COS1R",
"source_type": "NUMERIC(8,4)",
"dest_name": "cos1r",
"dest_type": "numeric(8,4)",
"description": "Standard Multiplier-1 Rate"
},
{
"source_name": "COS2R",
"source_type": "NUMERIC(8,4)",
"dest_name": "cos2r",
"dest_type": "numeric(8,4)",
"description": "Standard Multiplier-2 Rate"
},
{
"source_name": "COLDR",
"source_type": "NUMERIC(8,4)",
"dest_name": "coldr",
"dest_type": "numeric(8,4)",
"description": "Last Duty Rate"
},
{
"source_name": "COL1R",
"source_type": "NUMERIC(8,4)",
"dest_name": "col1r",
"dest_type": "numeric(8,4)",
"description": "Last Multiplier-1 Rate"
},
{
"source_name": "COL2R",
"source_type": "NUMERIC(8,4)",
"dest_name": "col2r",
"dest_type": "numeric(8,4)",
"description": "Last Multiplier-2 Rate"
},
{
"source_name": "COSQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "cosqty",
"dest_type": "numeric(8,0)",
"description": "Standard Quantity"
},
{
"source_name": "COAQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "coaqty",
"dest_type": "numeric(8,0)",
"description": "Actual Quantity"
},
{
"source_name": "COTYPE",
"source_type": "CHAR(1)",
"dest_name": "cotype",
"dest_type": "text",
"description": "Part Type R"
},
{
"source_name": "COCURR",
"source_type": "CHAR(3)",
"dest_name": "cocurr",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "COPLNT",
"source_type": "CHAR(3)",
"dest_name": "coplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "COAVUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coavuc",
"dest_type": "numeric(13,5)",
"description": "Average Unit cost"
},
{
"source_name": "COAVXC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coavxc",
"dest_type": "numeric(13,5)",
"description": "Average Xchg cost"
},
{
"source_name": "COAVDC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coavdc",
"dest_type": "numeric(13,5)",
"description": "Average Duty cost"
},
{
"source_name": "COAV1C",
"source_type": "NUMERIC(13,5)",
"dest_name": "coav1c",
"dest_type": "numeric(13,5)",
"description": "Average Multiplier-1 Cost"
},
{
"source_name": "COAV2C",
"source_type": "NUMERIC(13,5)",
"dest_name": "coav2c",
"dest_type": "numeric(13,5)",
"description": "Average Multiplier-2 Cost"
},
{
"source_name": "COAVFC",
"source_type": "NUMERIC(13,5)",
"dest_name": "coavfc",
"dest_type": "numeric(13,5)",
"description": "Average Freight cost"
},
{
"source_name": "COFUT1",
"source_type": "CHAR(3)",
"dest_name": "cofut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFUT2",
"source_type": "CHAR(10)",
"dest_name": "cofut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFUT3",
"source_type": "CHAR(20)",
"dest_name": "cofut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFUT4",
"source_type": "NUMERIC(15,0)",
"dest_name": "cofut4",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "COFUT5",
"source_type": "NUMERIC(15,0)",
"dest_name": "cofut5",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "COFLG1",
"source_type": "CHAR(1)",
"dest_name": "coflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFLG2",
"source_type": "CHAR(1)",
"dest_name": "coflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFLG3",
"source_type": "CHAR(1)",
"dest_name": "coflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFLG4",
"source_type": "CHAR(1)",
"dest_name": "coflg4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFLG5",
"source_type": "CHAR(1)",
"dest_name": "coflg5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFLG6",
"source_type": "CHAR(1)",
"dest_name": "coflg6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COFLG7",
"source_type": "CHAR(1)",
"dest_name": "coflg7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "COCRCD",
"source_type": "CHAR(3)",
"dest_name": "cocrcd",
"dest_type": "text",
"description": "Last Actual Currency"
}
],
"watermarks": [],
"hooks": []
}

51
config/modules/ftcstp.sql Normal file
View File

@ -0,0 +1,51 @@
SELECT
RTRIM(COPART) AS copart,
COLUC AS coluc,
COLCC AS colcc,
COLFC AS colfc,
COLDC AS coldc,
COL1C AS col1c,
COL2C AS col2c,
COSUC AS cosuc,
COSCC AS coscc,
COSFC AS cosfc,
COSDC AS cosdc,
COS1C AS cos1c,
COS2C AS cos2c,
COSCR AS coscr,
COLCR AS colcr,
CASE WHEN COSDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE COSDAT END AS cosdat,
COSTCS AS costcs,
COACCS AS coaccs,
COAVCS AS coavcs,
COSDR AS cosdr,
COS1R AS cos1r,
COS2R AS cos2r,
COLDR AS coldr,
COL1R AS col1r,
COL2R AS col2r,
COSQTY AS cosqty,
COAQTY AS coaqty,
RTRIM(COTYPE) AS cotype,
RTRIM(COCURR) AS cocurr,
RTRIM(COPLNT) AS coplnt,
COAVUC AS coavuc,
COAVXC AS coavxc,
COAVDC AS coavdc,
COAV1C AS coav1c,
COAV2C AS coav2c,
COAVFC AS coavfc,
RTRIM(COFUT1) AS cofut1,
RTRIM(COFUT2) AS cofut2,
RTRIM(COFUT3) AS cofut3,
COFUT4 AS cofut4,
COFUT5 AS cofut5,
RTRIM(COFLG1) AS coflg1,
RTRIM(COFLG2) AS coflg2,
RTRIM(COFLG3) AS coflg3,
RTRIM(COFLG4) AS coflg4,
RTRIM(COFLG5) AS coflg5,
RTRIM(COFLG6) AS coflg6,
RTRIM(COFLG7) AS coflg7,
RTRIM(COCRCD) AS cocrcd
FROM LGDAT.FTCSTP

330
config/modules/ftcstr.json Normal file
View File

@ -0,0 +1,330 @@
{
"name": "ftcstr",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ftcstr",
"staging_table": "pipekit_staging.ftcstr",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Future Cost Master - Transferred Parts 6.0",
"columns": [
{
"source_name": "Y3PART",
"source_type": "CHAR(20)",
"dest_name": "y3part",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "Y3PLNT",
"source_type": "CHAR(3)",
"dest_name": "y3plnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "Y3STCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3stcs",
"dest_type": "numeric(13,5)",
"description": "Standard Cost"
},
{
"source_name": "Y3ACCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3accs",
"dest_type": "numeric(13,5)",
"description": "Last Actual Cost"
},
{
"source_name": "Y3AVCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3avcs",
"dest_type": "numeric(13,5)",
"description": "Average Cost"
},
{
"source_name": "Y3SUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3suc",
"dest_type": "numeric(13,5)",
"description": "Standard Unit Cost"
},
{
"source_name": "Y3SSHR",
"source_type": "DECIMAL(9,5)",
"dest_name": "y3sshr",
"dest_type": "numeric(9,5)",
"description": "Standard S & H Rate"
},
{
"source_name": "Y3SSHC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3sshc",
"dest_type": "numeric(13,5)",
"description": "Standard S & H Cost"
},
{
"source_name": "Y3SOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3soc",
"dest_type": "numeric(13,5)",
"description": "Standard Currency Cost"
},
{
"source_name": "Y3SDAT",
"source_type": "DATE",
"dest_name": "y3sdat",
"dest_type": "date",
"description": "Standard Date"
},
{
"source_name": "Y3SQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "y3sqty",
"dest_type": "numeric(8,0)",
"description": "Standard Quantity"
},
{
"source_name": "Y3LUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3luc",
"dest_type": "numeric(13,5)",
"description": "Last Unit Cost"
},
{
"source_name": "Y3LSHC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3lshc",
"dest_type": "numeric(13,5)",
"description": "Last S & H Cost"
},
{
"source_name": "Y3LOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3loc",
"dest_type": "numeric(13,5)",
"description": "Last Currency Cost"
},
{
"source_name": "Y3AQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "y3aqty",
"dest_type": "numeric(8,0)",
"description": "Actual Quantity"
},
{
"source_name": "Y3TYPE",
"source_type": "CHAR(1)",
"dest_name": "y3type",
"dest_type": "text",
"description": "Part Type T"
},
{
"source_name": "Y3SMAT",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3smat",
"dest_type": "numeric(13,5)",
"description": "Standard Material Cost"
},
{
"source_name": "Y3SLAB",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3slab",
"dest_type": "numeric(13,5)",
"description": "Standard Labour Cost"
},
{
"source_name": "Y3SVBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3svbr",
"dest_type": "numeric(13,5)",
"description": "Standard Variable Burden Cost"
},
{
"source_name": "Y3SFBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3sfbr",
"dest_type": "numeric(13,5)",
"description": "Standard Fixed Burden Cost"
},
{
"source_name": "Y3SOTC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3sotc",
"dest_type": "numeric(13,5)",
"description": "Standard Other Cost"
},
{
"source_name": "Y3LMAT",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3lmat",
"dest_type": "numeric(13,5)",
"description": "Last Actual Material Cost"
},
{
"source_name": "Y3LLAB",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3llab",
"dest_type": "numeric(13,5)",
"description": "Last Actual Labour Cost"
},
{
"source_name": "Y3LVBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3lvbr",
"dest_type": "numeric(13,5)",
"description": "Last Actual Variable Burden Cost"
},
{
"source_name": "Y3LFBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3lfbr",
"dest_type": "numeric(13,5)",
"description": "Last Actual Fixed Burden Cost"
},
{
"source_name": "Y3LOTC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3lotc",
"dest_type": "numeric(13,5)",
"description": "Last Actual Other Cost"
},
{
"source_name": "Y3AMAT",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3amat",
"dest_type": "numeric(13,5)",
"description": "Average Material Cost"
},
{
"source_name": "Y3ALAB",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3alab",
"dest_type": "numeric(13,5)",
"description": "Average Labour Cost"
},
{
"source_name": "Y3AVBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3avbr",
"dest_type": "numeric(13,5)",
"description": "Average Variable Burden Cost"
},
{
"source_name": "Y3AFBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3afbr",
"dest_type": "numeric(13,5)",
"description": "Average Fixed Burden Cost"
},
{
"source_name": "Y3AOTC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3aotc",
"dest_type": "numeric(13,5)",
"description": "Average Other Cost"
},
{
"source_name": "Y3AUNC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3aunc",
"dest_type": "numeric(13,5)",
"description": "Average Unit Cost"
},
{
"source_name": "Y3ASHC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3ashc",
"dest_type": "numeric(13,5)",
"description": "Average S & H Cost"
},
{
"source_name": "Y3ACRC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y3acrc",
"dest_type": "numeric(13,5)",
"description": "Average Currency Cost"
},
{
"source_name": "Y3FUT1",
"source_type": "CHAR(3)",
"dest_name": "y3fut1",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "Y3FUT2",
"source_type": "CHAR(10)",
"dest_name": "y3fut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y3FUT3",
"source_type": "CHAR(20)",
"dest_name": "y3fut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y3FUT4",
"source_type": "NUMERIC(11,6)",
"dest_name": "y3fut4",
"dest_type": "numeric(11,6)",
"description": "Standard Currency Rate"
},
{
"source_name": "Y3FUT5",
"source_type": "NUMERIC(11,6)",
"dest_name": "y3fut5",
"dest_type": "numeric(11,6)",
"description": "Last Currency Rate"
},
{
"source_name": "Y3FLG1",
"source_type": "CHAR(1)",
"dest_name": "y3flg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y3FLG2",
"source_type": "CHAR(1)",
"dest_name": "y3flg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y3FLG3",
"source_type": "CHAR(1)",
"dest_name": "y3flg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y3CRCD",
"source_type": "CHAR(2)",
"dest_name": "y3crcd",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "Y3STCR",
"source_type": "NUMERIC(11,6)",
"dest_name": "y3stcr",
"dest_type": "numeric(11,6)",
"description": "Standard Currency Rate"
},
{
"source_name": "Y3LSCR",
"source_type": "NUMERIC(11,6)",
"dest_name": "y3lscr",
"dest_type": "numeric(11,6)",
"description": "Last Currency Rate"
}
],
"watermarks": [],
"hooks": []
}

47
config/modules/ftcstr.sql Normal file
View File

@ -0,0 +1,47 @@
SELECT
RTRIM(Y3PART) AS y3part,
RTRIM(Y3PLNT) AS y3plnt,
Y3STCS AS y3stcs,
Y3ACCS AS y3accs,
Y3AVCS AS y3avcs,
Y3SUC AS y3suc,
Y3SSHR AS y3sshr,
Y3SSHC AS y3sshc,
Y3SOC AS y3soc,
CASE WHEN Y3SDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE Y3SDAT END AS y3sdat,
Y3SQTY AS y3sqty,
Y3LUC AS y3luc,
Y3LSHC AS y3lshc,
Y3LOC AS y3loc,
Y3AQTY AS y3aqty,
RTRIM(Y3TYPE) AS y3type,
Y3SMAT AS y3smat,
Y3SLAB AS y3slab,
Y3SVBR AS y3svbr,
Y3SFBR AS y3sfbr,
Y3SOTC AS y3sotc,
Y3LMAT AS y3lmat,
Y3LLAB AS y3llab,
Y3LVBR AS y3lvbr,
Y3LFBR AS y3lfbr,
Y3LOTC AS y3lotc,
Y3AMAT AS y3amat,
Y3ALAB AS y3alab,
Y3AVBR AS y3avbr,
Y3AFBR AS y3afbr,
Y3AOTC AS y3aotc,
Y3AUNC AS y3aunc,
Y3ASHC AS y3ashc,
Y3ACRC AS y3acrc,
RTRIM(Y3FUT1) AS y3fut1,
RTRIM(Y3FUT2) AS y3fut2,
RTRIM(Y3FUT3) AS y3fut3,
Y3FUT4 AS y3fut4,
Y3FUT5 AS y3fut5,
RTRIM(Y3FLG1) AS y3flg1,
RTRIM(Y3FLG2) AS y3flg2,
RTRIM(Y3FLG3) AS y3flg3,
RTRIM(Y3CRCD) AS y3crcd,
Y3STCR AS y3stcr,
Y3LSCR AS y3lscr
FROM LGDAT.FTCSTR

120
config/modules/ggtp.json Normal file
View File

@ -0,0 +1,120 @@
{
"name": "ggtp",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.ggtp",
"staging_table": "pipekit_staging.ggtp",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "G/L Category Code 5.3",
"columns": [
{
"source_name": "D35GCDE",
"source_type": "CHAR(10)",
"dest_name": "d35gcde",
"dest_type": "text",
"description": "G/L Category Code"
},
{
"source_name": "D35DES1",
"source_type": "CHAR(30)",
"dest_name": "d35des1",
"dest_type": "text",
"description": "Description 1"
},
{
"source_name": "D35DES2",
"source_type": "CHAR(30)",
"dest_name": "d35des2",
"dest_type": "text",
"description": "Description 2"
},
{
"source_name": "D35DES3",
"source_type": "CHAR(30)",
"dest_name": "d35des3",
"dest_type": "text",
"description": "Description 3"
},
{
"source_name": "D35USR1",
"source_type": "CHAR(30)",
"dest_name": "d35usr1",
"dest_type": "text",
"description": "User Field 1"
},
{
"source_name": "D35USR2",
"source_type": "CHAR(30)",
"dest_name": "d35usr2",
"dest_type": "text",
"description": "User Field 2"
},
{
"source_name": "D35USR3",
"source_type": "CHAR(30)",
"dest_name": "d35usr3",
"dest_type": "text",
"description": "User Field 3"
},
{
"source_name": "D35USR4",
"source_type": "DECIMAL(15,5)",
"dest_name": "d35usr4",
"dest_type": "numeric(15,5)",
"description": "User Field 4"
},
{
"source_name": "D35USR5",
"source_type": "DECIMAL(15,5)",
"dest_name": "d35usr5",
"dest_type": "numeric(15,5)",
"description": "User Field 5"
},
{
"source_name": "D35CUSR",
"source_type": "CHAR(10)",
"dest_name": "d35cusr",
"dest_type": "text",
"description": "Created By User"
},
{
"source_name": "D35CDAT",
"source_type": "DATE",
"dest_name": "d35cdat",
"dest_type": "date",
"description": "Date Created"
},
{
"source_name": "D35CTME",
"source_type": "TIME",
"dest_name": "d35ctme",
"dest_type": "time",
"description": "Time Created"
},
{
"source_name": "D35UUSR",
"source_type": "CHAR(10)",
"dest_name": "d35uusr",
"dest_type": "text",
"description": "Updated By User"
},
{
"source_name": "D35UDAT",
"source_type": "DATE",
"dest_name": "d35udat",
"dest_type": "date",
"description": "Date Updated"
},
{
"source_name": "D35UTME",
"source_type": "TIME",
"dest_name": "d35utme",
"dest_type": "time",
"description": "Time Updated"
}
],
"watermarks": [],
"hooks": []
}

17
config/modules/ggtp.sql Normal file
View File

@ -0,0 +1,17 @@
SELECT
RTRIM(D35GCDE) AS d35gcde,
RTRIM(D35DES1) AS d35des1,
RTRIM(D35DES2) AS d35des2,
RTRIM(D35DES3) AS d35des3,
RTRIM(D35USR1) AS d35usr1,
RTRIM(D35USR2) AS d35usr2,
RTRIM(D35USR3) AS d35usr3,
D35USR4 AS d35usr4,
D35USR5 AS d35usr5,
RTRIM(D35CUSR) AS d35cusr,
CASE WHEN D35CDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE D35CDAT END AS d35cdat,
D35CTME AS d35ctme,
RTRIM(D35UUSR) AS d35uusr,
CASE WHEN D35UDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE D35UDAT END AS d35udat,
D35UTME AS d35utme
FROM LGDAT.GGTP

302
config/modules/gl00100.json Normal file
View File

@ -0,0 +1,302 @@
{
"name": "gl00100",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp.gl00100",
"staging_table": "pipekit_staging.gl00100",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "ACTINDX",
"source_type": "INT",
"dest_name": "actindx",
"dest_type": "integer",
"description": null
},
{
"source_name": "ACTNUMBR_1",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_1",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_2",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_2",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_3",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_3",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_4",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_4",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_5",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_5",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_6",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_6",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_7",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_7",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_8",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_8",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTALIAS",
"source_type": "CHAR(21)",
"dest_name": "actalias",
"dest_type": "text",
"description": null
},
{
"source_name": "MNACSGMT",
"source_type": "CHAR(67)",
"dest_name": "mnacsgmt",
"dest_type": "text",
"description": null
},
{
"source_name": "ACCTTYPE",
"source_type": "SMALLINT",
"dest_name": "accttype",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ACTDESCR",
"source_type": "CHAR(51)",
"dest_name": "actdescr",
"dest_type": "text",
"description": null
},
{
"source_name": "PSTNGTYP",
"source_type": "SMALLINT",
"dest_name": "pstngtyp",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ACCATNUM",
"source_type": "SMALLINT",
"dest_name": "accatnum",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ACTIVE",
"source_type": "TINYINT",
"dest_name": "active",
"dest_type": "smallint",
"description": null
},
{
"source_name": "TPCLBLNC",
"source_type": "SMALLINT",
"dest_name": "tpclblnc",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DECPLACS",
"source_type": "SMALLINT",
"dest_name": "decplacs",
"dest_type": "smallint",
"description": null
},
{
"source_name": "FXDORVAR",
"source_type": "SMALLINT",
"dest_name": "fxdorvar",
"dest_type": "smallint",
"description": null
},
{
"source_name": "BALFRCLC",
"source_type": "SMALLINT",
"dest_name": "balfrclc",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DSPLKUPS",
"source_type": "BINARY",
"dest_name": "dsplkups",
"dest_type": "bytea",
"description": null
},
{
"source_name": "CNVRMTHD",
"source_type": "SMALLINT",
"dest_name": "cnvrmthd",
"dest_type": "smallint",
"description": null
},
{
"source_name": "HSTRCLRT",
"source_type": "NUMERIC(19,7)",
"dest_name": "hstrclrt",
"dest_type": "numeric(19,7)",
"description": null
},
{
"source_name": "NOTEINDX",
"source_type": "NUMERIC(19,5)",
"dest_name": "noteindx",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CREATDDT",
"source_type": "DATETIME",
"dest_name": "creatddt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "MODIFDT",
"source_type": "DATETIME",
"dest_name": "modifdt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "USERDEF1",
"source_type": "CHAR(21)",
"dest_name": "userdef1",
"dest_type": "text",
"description": null
},
{
"source_name": "USERDEF2",
"source_type": "CHAR(21)",
"dest_name": "userdef2",
"dest_type": "text",
"description": null
},
{
"source_name": "PostSlsIn",
"source_type": "SMALLINT",
"dest_name": "postslsin",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PostIvIn",
"source_type": "SMALLINT",
"dest_name": "postivin",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PostPurchIn",
"source_type": "SMALLINT",
"dest_name": "postpurchin",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PostPRIn",
"source_type": "SMALLINT",
"dest_name": "postprin",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ADJINFL",
"source_type": "TINYINT",
"dest_name": "adjinfl",
"dest_type": "smallint",
"description": null
},
{
"source_name": "INFLAREV",
"source_type": "INT",
"dest_name": "inflarev",
"dest_type": "integer",
"description": null
},
{
"source_name": "INFLAEQU",
"source_type": "INT",
"dest_name": "inflaequ",
"dest_type": "integer",
"description": null
},
{
"source_name": "ACCTENTR",
"source_type": "TINYINT",
"dest_name": "acctentr",
"dest_type": "smallint",
"description": null
},
{
"source_name": "USRDEFS1",
"source_type": "CHAR(31)",
"dest_name": "usrdefs1",
"dest_type": "text",
"description": null
},
{
"source_name": "USRDEFS2",
"source_type": "CHAR(31)",
"dest_name": "usrdefs2",
"dest_type": "text",
"description": null
},
{
"source_name": "Clear_Balance",
"source_type": "TINYINT",
"dest_name": "clear_balance",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DEX_ROW_TS",
"source_type": "DATETIME",
"dest_name": "dex_row_ts",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "DEX_ROW_ID",
"source_type": "INT",
"dest_name": "dex_row_id",
"dest_type": "integer",
"description": null
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,43 @@
SELECT
[ACTINDX] AS [actindx],
RTRIM([ACTNUMBR_1]) AS [actnumbr_1],
RTRIM([ACTNUMBR_2]) AS [actnumbr_2],
RTRIM([ACTNUMBR_3]) AS [actnumbr_3],
RTRIM([ACTNUMBR_4]) AS [actnumbr_4],
RTRIM([ACTNUMBR_5]) AS [actnumbr_5],
RTRIM([ACTNUMBR_6]) AS [actnumbr_6],
RTRIM([ACTNUMBR_7]) AS [actnumbr_7],
RTRIM([ACTNUMBR_8]) AS [actnumbr_8],
RTRIM([ACTALIAS]) AS [actalias],
RTRIM([MNACSGMT]) AS [mnacsgmt],
[ACCTTYPE] AS [accttype],
RTRIM([ACTDESCR]) AS [actdescr],
[PSTNGTYP] AS [pstngtyp],
[ACCATNUM] AS [accatnum],
[ACTIVE] AS [active],
[TPCLBLNC] AS [tpclblnc],
[DECPLACS] AS [decplacs],
[FXDORVAR] AS [fxdorvar],
[BALFRCLC] AS [balfrclc],
[DSPLKUPS] AS [dsplkups],
[CNVRMTHD] AS [cnvrmthd],
[HSTRCLRT] AS [hstrclrt],
[NOTEINDX] AS [noteindx],
[CREATDDT] AS [creatddt],
[MODIFDT] AS [modifdt],
RTRIM([USERDEF1]) AS [userdef1],
RTRIM([USERDEF2]) AS [userdef2],
[PostSlsIn] AS [postslsin],
[PostIvIn] AS [postivin],
[PostPurchIn] AS [postpurchin],
[PostPRIn] AS [postprin],
[ADJINFL] AS [adjinfl],
[INFLAREV] AS [inflarev],
[INFLAEQU] AS [inflaequ],
[ACCTENTR] AS [acctentr],
RTRIM([USRDEFS1]) AS [usrdefs1],
RTRIM([USRDEFS2]) AS [usrdefs2],
[Clear_Balance] AS [clear_balance],
[DEX_ROW_TS] AS [dex_row_ts],
[DEX_ROW_ID] AS [dex_row_id]
FROM [GPSERVER].[CHG].[dbo].[GL00100]

View File

@ -0,0 +1,92 @@
{
"name": "gl00105",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp.gl00105",
"staging_table": "pipekit_staging.gl00105",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "ACTINDX",
"source_type": "INT",
"dest_name": "actindx",
"dest_type": "integer",
"description": null
},
{
"source_name": "ACTNUMBR_1",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_1",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_2",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_2",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_3",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_3",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_4",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_4",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_5",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_5",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_6",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_6",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_7",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_7",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_8",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_8",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMST",
"source_type": "CHAR(129)",
"dest_name": "actnumst",
"dest_type": "text",
"description": null
},
{
"source_name": "DEX_ROW_ID",
"source_type": "INT",
"dest_name": "dex_row_id",
"dest_type": "integer",
"description": null
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,13 @@
SELECT
[ACTINDX] AS [actindx],
RTRIM([ACTNUMBR_1]) AS [actnumbr_1],
RTRIM([ACTNUMBR_2]) AS [actnumbr_2],
RTRIM([ACTNUMBR_3]) AS [actnumbr_3],
RTRIM([ACTNUMBR_4]) AS [actnumbr_4],
RTRIM([ACTNUMBR_5]) AS [actnumbr_5],
RTRIM([ACTNUMBR_6]) AS [actnumbr_6],
RTRIM([ACTNUMBR_7]) AS [actnumbr_7],
RTRIM([ACTNUMBR_8]) AS [actnumbr_8],
RTRIM([ACTNUMST]) AS [actnumst],
[DEX_ROW_ID] AS [dex_row_id]
FROM [GPSERVER].[CHG].[dbo].[GL00105]

134
config/modules/gl10110.json Normal file
View File

@ -0,0 +1,134 @@
{
"name": "gl10110",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp.gl10110",
"staging_table": "pipekit_staging.gl10110",
"merge_strategy": "incremental",
"merge_key": "dex_row_id",
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "ACTINDX",
"source_type": "INT",
"dest_name": "actindx",
"dest_type": "integer",
"description": null
},
{
"source_name": "YEAR1",
"source_type": "SMALLINT",
"dest_name": "year1",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PERIODID",
"source_type": "SMALLINT",
"dest_name": "periodid",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Ledger_ID",
"source_type": "SMALLINT",
"dest_name": "ledger_id",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PERDBLNC",
"source_type": "NUMERIC(19,5)",
"dest_name": "perdblnc",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ACTNUMBR_1",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_1",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_2",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_2",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_3",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_3",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_4",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_4",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_5",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_5",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_6",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_6",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_7",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_7",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_8",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_8",
"dest_type": "text",
"description": null
},
{
"source_name": "ACCATNUM",
"source_type": "SMALLINT",
"dest_name": "accatnum",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DEBITAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "debitamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CRDTAMNT",
"source_type": "NUMERIC(19,5)",
"dest_name": "crdtamnt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "DEX_ROW_ID",
"source_type": "INT",
"dest_name": "dex_row_id",
"dest_type": "integer",
"description": null
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,19 @@
SELECT
[ACTINDX] AS actindx,
[YEAR1] AS year1,
[PERIODID] AS periodid,
[Ledger_ID] AS ledger_id,
[PERDBLNC] AS perdblnc,
RTRIM([ACTNUMBR_1]) AS actnumbr_1,
RTRIM([ACTNUMBR_2]) AS actnumbr_2,
RTRIM([ACTNUMBR_3]) AS actnumbr_3,
RTRIM([ACTNUMBR_4]) AS actnumbr_4,
RTRIM([ACTNUMBR_5]) AS actnumbr_5,
RTRIM([ACTNUMBR_6]) AS actnumbr_6,
RTRIM([ACTNUMBR_7]) AS actnumbr_7,
RTRIM([ACTNUMBR_8]) AS actnumbr_8,
[ACCATNUM] AS accatnum,
[DEBITAMT] AS debitamt,
[CRDTAMNT] AS crdtamnt,
[DEX_ROW_ID] AS dex_row_id
FROM [GPSERVER].[CHG].[dbo].[GL10110]

134
config/modules/gl10111.json Normal file
View File

@ -0,0 +1,134 @@
{
"name": "gl10111",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp.gl10111",
"staging_table": "pipekit_staging.gl10111",
"merge_strategy": "incremental",
"merge_key": "dex_row_id",
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "ACTINDX",
"source_type": "INT",
"dest_name": "actindx",
"dest_type": "integer",
"description": null
},
{
"source_name": "YEAR1",
"source_type": "SMALLINT",
"dest_name": "year1",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PERIODID",
"source_type": "SMALLINT",
"dest_name": "periodid",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Ledger_ID",
"source_type": "SMALLINT",
"dest_name": "ledger_id",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ACTNUMBR_1",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_1",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_2",
"source_type": "CHAR(7)",
"dest_name": "actnumbr_2",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_3",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_3",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_4",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_4",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_5",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_5",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_6",
"source_type": "CHAR(9)",
"dest_name": "actnumbr_6",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_7",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_7",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTNUMBR_8",
"source_type": "CHAR(11)",
"dest_name": "actnumbr_8",
"dest_type": "text",
"description": null
},
{
"source_name": "ACCATNUM",
"source_type": "SMALLINT",
"dest_name": "accatnum",
"dest_type": "smallint",
"description": null
},
{
"source_name": "PERDBLNC",
"source_type": "NUMERIC(19,5)",
"dest_name": "perdblnc",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "DEBITAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "debitamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CRDTAMNT",
"source_type": "NUMERIC(19,5)",
"dest_name": "crdtamnt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "DEX_ROW_ID",
"source_type": "INT",
"dest_name": "dex_row_id",
"dest_type": "integer",
"description": null
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,19 @@
SELECT
[ACTINDX] AS actindx,
[YEAR1] AS year1,
[PERIODID] AS periodid,
[Ledger_ID] AS ledger_id,
RTRIM([ACTNUMBR_1]) AS actnumbr_1,
RTRIM([ACTNUMBR_2]) AS actnumbr_2,
RTRIM([ACTNUMBR_3]) AS actnumbr_3,
RTRIM([ACTNUMBR_4]) AS actnumbr_4,
RTRIM([ACTNUMBR_5]) AS actnumbr_5,
RTRIM([ACTNUMBR_6]) AS actnumbr_6,
RTRIM([ACTNUMBR_7]) AS actnumbr_7,
RTRIM([ACTNUMBR_8]) AS actnumbr_8,
[ACCATNUM] AS accatnum,
[PERDBLNC] AS perdblnc,
[DEBITAMT] AS debitamt,
[CRDTAMNT] AS crdtamnt,
[DEX_ROW_ID] AS dex_row_id
FROM [GPSERVER].[CHG].[dbo].[GL10111]

484
config/modules/gl20000.json Normal file
View File

@ -0,0 +1,484 @@
{
"name": "gl20000",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp.gl20000",
"staging_table": "pipekit_staging.gl20000",
"merge_strategy": "incremental",
"merge_key": "dex_row_id",
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "OPENYEAR",
"source_type": "SMALLINT",
"dest_name": "openyear",
"dest_type": "smallint",
"description": null
},
{
"source_name": "JRNENTRY",
"source_type": "INT",
"dest_name": "jrnentry",
"dest_type": "integer",
"description": null
},
{
"source_name": "RCTRXSEQ",
"source_type": "NUMERIC(19,5)",
"dest_name": "rctrxseq",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "SOURCDOC",
"source_type": "CHAR(11)",
"dest_name": "sourcdoc",
"dest_type": "text",
"description": null
},
{
"source_name": "REFRENCE",
"source_type": "CHAR(31)",
"dest_name": "refrence",
"dest_type": "text",
"description": null
},
{
"source_name": "DSCRIPTN",
"source_type": "CHAR(31)",
"dest_name": "dscriptn",
"dest_type": "text",
"description": null
},
{
"source_name": "TRXDATE",
"source_type": "DATETIME",
"dest_name": "trxdate",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "TRXSORCE",
"source_type": "CHAR(13)",
"dest_name": "trxsorce",
"dest_type": "text",
"description": null
},
{
"source_name": "ACTINDX",
"source_type": "INT",
"dest_name": "actindx",
"dest_type": "integer",
"description": null
},
{
"source_name": "POLLDTRX",
"source_type": "TINYINT",
"dest_name": "polldtrx",
"dest_type": "smallint",
"description": null
},
{
"source_name": "LASTUSER",
"source_type": "CHAR(15)",
"dest_name": "lastuser",
"dest_type": "text",
"description": null
},
{
"source_name": "LSTDTEDT",
"source_type": "DATETIME",
"dest_name": "lstdtedt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "USWHPSTD",
"source_type": "CHAR(15)",
"dest_name": "uswhpstd",
"dest_type": "text",
"description": null
},
{
"source_name": "ORGNTSRC",
"source_type": "CHAR(15)",
"dest_name": "orgntsrc",
"dest_type": "text",
"description": null
},
{
"source_name": "ORGNATYP",
"source_type": "SMALLINT",
"dest_name": "orgnatyp",
"dest_type": "smallint",
"description": null
},
{
"source_name": "QKOFSET",
"source_type": "SMALLINT",
"dest_name": "qkofset",
"dest_type": "smallint",
"description": null
},
{
"source_name": "SERIES",
"source_type": "SMALLINT",
"dest_name": "series",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ORTRXTYP",
"source_type": "SMALLINT",
"dest_name": "ortrxtyp",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ORCTRNUM",
"source_type": "CHAR(21)",
"dest_name": "orctrnum",
"dest_type": "text",
"description": null
},
{
"source_name": "ORMSTRID",
"source_type": "CHAR(31)",
"dest_name": "ormstrid",
"dest_type": "text",
"description": null
},
{
"source_name": "ORMSTRNM",
"source_type": "CHAR(65)",
"dest_name": "ormstrnm",
"dest_type": "text",
"description": null
},
{
"source_name": "ORDOCNUM",
"source_type": "CHAR(21)",
"dest_name": "ordocnum",
"dest_type": "text",
"description": null
},
{
"source_name": "ORPSTDDT",
"source_type": "DATETIME",
"dest_name": "orpstddt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "ORTRXSRC",
"source_type": "CHAR(13)",
"dest_name": "ortrxsrc",
"dest_type": "text",
"description": null
},
{
"source_name": "OrigDTASeries",
"source_type": "SMALLINT",
"dest_name": "origdtaseries",
"dest_type": "smallint",
"description": null
},
{
"source_name": "OrigSeqNum",
"source_type": "INT",
"dest_name": "origseqnum",
"dest_type": "integer",
"description": null
},
{
"source_name": "SEQNUMBR",
"source_type": "INT",
"dest_name": "seqnumbr",
"dest_type": "integer",
"description": null
},
{
"source_name": "DTA_GL_Status",
"source_type": "SMALLINT",
"dest_name": "dta_gl_status",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DTA_Index",
"source_type": "NUMERIC(19,5)",
"dest_name": "dta_index",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CURNCYID",
"source_type": "CHAR(15)",
"dest_name": "curncyid",
"dest_type": "text",
"description": null
},
{
"source_name": "CURRNIDX",
"source_type": "SMALLINT",
"dest_name": "currnidx",
"dest_type": "smallint",
"description": null
},
{
"source_name": "RATETPID",
"source_type": "CHAR(15)",
"dest_name": "ratetpid",
"dest_type": "text",
"description": null
},
{
"source_name": "EXGTBLID",
"source_type": "CHAR(15)",
"dest_name": "exgtblid",
"dest_type": "text",
"description": null
},
{
"source_name": "XCHGRATE",
"source_type": "NUMERIC(19,7)",
"dest_name": "xchgrate",
"dest_type": "numeric(19,7)",
"description": null
},
{
"source_name": "EXCHDATE",
"source_type": "DATETIME",
"dest_name": "exchdate",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "TIME1",
"source_type": "DATETIME",
"dest_name": "time1",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "RTCLCMTD",
"source_type": "SMALLINT",
"dest_name": "rtclcmtd",
"dest_type": "smallint",
"description": null
},
{
"source_name": "NOTEINDX",
"source_type": "NUMERIC(19,5)",
"dest_name": "noteindx",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ICTRX",
"source_type": "TINYINT",
"dest_name": "ictrx",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ORCOMID",
"source_type": "CHAR(5)",
"dest_name": "orcomid",
"dest_type": "text",
"description": null
},
{
"source_name": "ORIGINJE",
"source_type": "INT",
"dest_name": "originje",
"dest_type": "integer",
"description": null
},
{
"source_name": "PERIODID",
"source_type": "SMALLINT",
"dest_name": "periodid",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DEBITAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "debitamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CRDTAMNT",
"source_type": "NUMERIC(19,5)",
"dest_name": "crdtamnt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ORDBTAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "ordbtamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ORCRDAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "orcrdamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "DOCDATE",
"source_type": "DATETIME",
"dest_name": "docdate",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "PSTGNMBR",
"source_type": "INT",
"dest_name": "pstgnmbr",
"dest_type": "integer",
"description": null
},
{
"source_name": "PPSGNMBR",
"source_type": "INT",
"dest_name": "ppsgnmbr",
"dest_type": "integer",
"description": null
},
{
"source_name": "DENXRATE",
"source_type": "NUMERIC(19,7)",
"dest_name": "denxrate",
"dest_type": "numeric(19,7)",
"description": null
},
{
"source_name": "MCTRXSTT",
"source_type": "SMALLINT",
"dest_name": "mctrxstt",
"dest_type": "smallint",
"description": null
},
{
"source_name": "CorrespondingUnit",
"source_type": "CHAR(5)",
"dest_name": "correspondingunit",
"dest_type": "text",
"description": null
},
{
"source_name": "VOIDED",
"source_type": "TINYINT",
"dest_name": "voided",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Back_Out_JE",
"source_type": "INT",
"dest_name": "back_out_je",
"dest_type": "integer",
"description": null
},
{
"source_name": "Back_Out_JE_Year",
"source_type": "SMALLINT",
"dest_name": "back_out_je_year",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Correcting_JE",
"source_type": "INT",
"dest_name": "correcting_je",
"dest_type": "integer",
"description": null
},
{
"source_name": "Correcting_JE_Year",
"source_type": "SMALLINT",
"dest_name": "correcting_je_year",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Original_JE",
"source_type": "INT",
"dest_name": "original_je",
"dest_type": "integer",
"description": null
},
{
"source_name": "Original_JE_Seq_Num",
"source_type": "NUMERIC(19,5)",
"dest_name": "original_je_seq_num",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "Original_JE_Year",
"source_type": "SMALLINT",
"dest_name": "original_je_year",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Ledger_ID",
"source_type": "SMALLINT",
"dest_name": "ledger_id",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Adjustment_Transaction",
"source_type": "TINYINT",
"dest_name": "adjustment_transaction",
"dest_type": "smallint",
"description": null
},
{
"source_name": "APRVLUSERID",
"source_type": "CHAR(15)",
"dest_name": "aprvluserid",
"dest_type": "text",
"description": null
},
{
"source_name": "APPRVLDT",
"source_type": "DATETIME",
"dest_name": "apprvldt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "DEX_ROW_TS",
"source_type": "DATETIME",
"dest_name": "dex_row_ts",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "DEX_ROW_ID",
"source_type": "INT",
"dest_name": "dex_row_id",
"dest_type": "integer",
"description": null
}
],
"watermarks": [
{
"name": "dex_row_id",
"connection": "usmidsap02",
"resolver_sql": "select max(dex_row_id) from gp.gl20000",
"default_value": "0"
}
],
"hooks": []
}

View File

@ -0,0 +1,69 @@
SELECT
[OPENYEAR] AS openyear,
[JRNENTRY] AS jrnentry,
[RCTRXSEQ] AS rctrxseq,
RTRIM([SOURCDOC]) AS sourcdoc,
RTRIM([REFRENCE]) AS refrence,
RTRIM([DSCRIPTN]) AS dscriptn,
[TRXDATE] AS trxdate,
RTRIM([TRXSORCE]) AS trxsorce,
[ACTINDX] AS actindx,
[POLLDTRX] AS polldtrx,
RTRIM([LASTUSER]) AS lastuser,
[LSTDTEDT] AS lstdtedt,
RTRIM([USWHPSTD]) AS uswhpstd,
RTRIM([ORGNTSRC]) AS orgntsrc,
[ORGNATYP] AS orgnatyp,
[QKOFSET] AS qkofset,
[SERIES] AS series,
[ORTRXTYP] AS ortrxtyp,
RTRIM([ORCTRNUM]) AS orctrnum,
RTRIM([ORMSTRID]) AS ormstrid,
RTRIM([ORMSTRNM]) AS ormstrnm,
RTRIM([ORDOCNUM]) AS ordocnum,
[ORPSTDDT] AS orpstddt,
RTRIM([ORTRXSRC]) AS ortrxsrc,
[OrigDTASeries] AS origdtaseries,
[OrigSeqNum] AS origseqnum,
[SEQNUMBR] AS seqnumbr,
[DTA_GL_Status] AS dta_gl_status,
[DTA_Index] AS dta_index,
RTRIM([CURNCYID]) AS curncyid,
[CURRNIDX] AS currnidx,
RTRIM([RATETPID]) AS ratetpid,
RTRIM([EXGTBLID]) AS exgtblid,
[XCHGRATE] AS xchgrate,
[EXCHDATE] AS exchdate,
[TIME1] AS time1,
[RTCLCMTD] AS rtclcmtd,
[NOTEINDX] AS noteindx,
[ICTRX] AS ictrx,
RTRIM([ORCOMID]) AS orcomid,
[ORIGINJE] AS originje,
[PERIODID] AS periodid,
[DEBITAMT] AS debitamt,
[CRDTAMNT] AS crdtamnt,
[ORDBTAMT] AS ordbtamt,
[ORCRDAMT] AS orcrdamt,
[DOCDATE] AS docdate,
[PSTGNMBR] AS pstgnmbr,
[PPSGNMBR] AS ppsgnmbr,
[DENXRATE] AS denxrate,
[MCTRXSTT] AS mctrxstt,
RTRIM([CorrespondingUnit]) AS correspondingunit,
[VOIDED] AS voided,
[Back_Out_JE] AS back_out_je,
[Back_Out_JE_Year] AS back_out_je_year,
[Correcting_JE] AS correcting_je,
[Correcting_JE_Year] AS correcting_je_year,
[Original_JE] AS original_je,
[Original_JE_Seq_Num] AS original_je_seq_num,
[Original_JE_Year] AS original_je_year,
[Ledger_ID] AS ledger_id,
[Adjustment_Transaction] AS adjustment_transaction,
RTRIM([APRVLUSERID]) AS aprvluserid,
[APPRVLDT] AS apprvldt,
[DEX_ROW_TS] AS dex_row_ts,
[DEX_ROW_ID] AS dex_row_id
FROM [GPSERVER].[CHG].[dbo].[GL20000]
WHERE [DEX_ROW_ID] > {dex_row_id}

484
config/modules/gl30000.json Normal file
View File

@ -0,0 +1,484 @@
{
"name": "gl30000",
"source_connection": "sqlserver",
"dest_connection": "usmidsap02",
"dest_table": "gp.gl30000",
"staging_table": "pipekit_staging.dbo_gl30000",
"merge_strategy": "incremental",
"merge_key": "dex_row_id",
"enabled": 1,
"dest_description": null,
"columns": [
{
"source_name": "HSTYEAR",
"source_type": "SMALLINT",
"dest_name": "hstyear",
"dest_type": "smallint",
"description": null
},
{
"source_name": "JRNENTRY",
"source_type": "INT",
"dest_name": "jrnentry",
"dest_type": "integer",
"description": null
},
{
"source_name": "RCTRXSEQ",
"source_type": "NUMERIC(19,5)",
"dest_name": "rctrxseq",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "SOURCDOC",
"source_type": "CHAR(11)",
"dest_name": "sourcdoc",
"dest_type": "text",
"description": null
},
{
"source_name": "REFRENCE",
"source_type": "CHAR(31)",
"dest_name": "refrence",
"dest_type": "text",
"description": null
},
{
"source_name": "DSCRIPTN",
"source_type": "CHAR(31)",
"dest_name": "dscriptn",
"dest_type": "text",
"description": null
},
{
"source_name": "TRXDATE",
"source_type": "DATETIME",
"dest_name": "trxdate",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "ACTINDX",
"source_type": "INT",
"dest_name": "actindx",
"dest_type": "integer",
"description": null
},
{
"source_name": "TRXSORCE",
"source_type": "CHAR(13)",
"dest_name": "trxsorce",
"dest_type": "text",
"description": null
},
{
"source_name": "POLLDTRX",
"source_type": "TINYINT",
"dest_name": "polldtrx",
"dest_type": "smallint",
"description": null
},
{
"source_name": "LASTUSER",
"source_type": "CHAR(15)",
"dest_name": "lastuser",
"dest_type": "text",
"description": null
},
{
"source_name": "LSTDTEDT",
"source_type": "DATETIME",
"dest_name": "lstdtedt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "USWHPSTD",
"source_type": "CHAR(15)",
"dest_name": "uswhpstd",
"dest_type": "text",
"description": null
},
{
"source_name": "ORGNTSRC",
"source_type": "CHAR(15)",
"dest_name": "orgntsrc",
"dest_type": "text",
"description": null
},
{
"source_name": "ORGNATYP",
"source_type": "SMALLINT",
"dest_name": "orgnatyp",
"dest_type": "smallint",
"description": null
},
{
"source_name": "QKOFSET",
"source_type": "SMALLINT",
"dest_name": "qkofset",
"dest_type": "smallint",
"description": null
},
{
"source_name": "SERIES",
"source_type": "SMALLINT",
"dest_name": "series",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ORTRXTYP",
"source_type": "SMALLINT",
"dest_name": "ortrxtyp",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ORCTRNUM",
"source_type": "CHAR(21)",
"dest_name": "orctrnum",
"dest_type": "text",
"description": null
},
{
"source_name": "ORMSTRID",
"source_type": "CHAR(31)",
"dest_name": "ormstrid",
"dest_type": "text",
"description": null
},
{
"source_name": "ORMSTRNM",
"source_type": "CHAR(65)",
"dest_name": "ormstrnm",
"dest_type": "text",
"description": null
},
{
"source_name": "ORDOCNUM",
"source_type": "CHAR(21)",
"dest_name": "ordocnum",
"dest_type": "text",
"description": null
},
{
"source_name": "ORPSTDDT",
"source_type": "DATETIME",
"dest_name": "orpstddt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "ORTRXSRC",
"source_type": "CHAR(13)",
"dest_name": "ortrxsrc",
"dest_type": "text",
"description": null
},
{
"source_name": "OrigDTASeries",
"source_type": "SMALLINT",
"dest_name": "origdtaseries",
"dest_type": "smallint",
"description": null
},
{
"source_name": "OrigSeqNum",
"source_type": "INT",
"dest_name": "origseqnum",
"dest_type": "integer",
"description": null
},
{
"source_name": "SEQNUMBR",
"source_type": "INT",
"dest_name": "seqnumbr",
"dest_type": "integer",
"description": null
},
{
"source_name": "DTA_GL_Status",
"source_type": "SMALLINT",
"dest_name": "dta_gl_status",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DTA_Index",
"source_type": "NUMERIC(19,5)",
"dest_name": "dta_index",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CURNCYID",
"source_type": "CHAR(15)",
"dest_name": "curncyid",
"dest_type": "text",
"description": null
},
{
"source_name": "CURRNIDX",
"source_type": "SMALLINT",
"dest_name": "currnidx",
"dest_type": "smallint",
"description": null
},
{
"source_name": "RATETPID",
"source_type": "CHAR(15)",
"dest_name": "ratetpid",
"dest_type": "text",
"description": null
},
{
"source_name": "EXGTBLID",
"source_type": "CHAR(15)",
"dest_name": "exgtblid",
"dest_type": "text",
"description": null
},
{
"source_name": "XCHGRATE",
"source_type": "NUMERIC(19,7)",
"dest_name": "xchgrate",
"dest_type": "numeric(19,7)",
"description": null
},
{
"source_name": "EXCHDATE",
"source_type": "DATETIME",
"dest_name": "exchdate",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "TIME1",
"source_type": "DATETIME",
"dest_name": "time1",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "RTCLCMTD",
"source_type": "SMALLINT",
"dest_name": "rtclcmtd",
"dest_type": "smallint",
"description": null
},
{
"source_name": "NOTEINDX",
"source_type": "NUMERIC(19,5)",
"dest_name": "noteindx",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ICTRX",
"source_type": "TINYINT",
"dest_name": "ictrx",
"dest_type": "smallint",
"description": null
},
{
"source_name": "ORCOMID",
"source_type": "CHAR(5)",
"dest_name": "orcomid",
"dest_type": "text",
"description": null
},
{
"source_name": "ORIGINJE",
"source_type": "INT",
"dest_name": "originje",
"dest_type": "integer",
"description": null
},
{
"source_name": "PERIODID",
"source_type": "SMALLINT",
"dest_name": "periodid",
"dest_type": "smallint",
"description": null
},
{
"source_name": "DEBITAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "debitamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "CRDTAMNT",
"source_type": "NUMERIC(19,5)",
"dest_name": "crdtamnt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ORDBTAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "ordbtamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "ORCRDAMT",
"source_type": "NUMERIC(19,5)",
"dest_name": "orcrdamt",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "DOCDATE",
"source_type": "DATETIME",
"dest_name": "docdate",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "PSTGNMBR",
"source_type": "INT",
"dest_name": "pstgnmbr",
"dest_type": "integer",
"description": null
},
{
"source_name": "PPSGNMBR",
"source_type": "INT",
"dest_name": "ppsgnmbr",
"dest_type": "integer",
"description": null
},
{
"source_name": "DENXRATE",
"source_type": "NUMERIC(19,7)",
"dest_name": "denxrate",
"dest_type": "numeric(19,7)",
"description": null
},
{
"source_name": "MCTRXSTT",
"source_type": "SMALLINT",
"dest_name": "mctrxstt",
"dest_type": "smallint",
"description": null
},
{
"source_name": "CorrespondingUnit",
"source_type": "CHAR(5)",
"dest_name": "correspondingunit",
"dest_type": "text",
"description": null
},
{
"source_name": "VOIDED",
"source_type": "TINYINT",
"dest_name": "voided",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Back_Out_JE",
"source_type": "INT",
"dest_name": "back_out_je",
"dest_type": "integer",
"description": null
},
{
"source_name": "Back_Out_JE_Year",
"source_type": "SMALLINT",
"dest_name": "back_out_je_year",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Correcting_JE",
"source_type": "INT",
"dest_name": "correcting_je",
"dest_type": "integer",
"description": null
},
{
"source_name": "Correcting_JE_Year",
"source_type": "SMALLINT",
"dest_name": "correcting_je_year",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Original_JE",
"source_type": "INT",
"dest_name": "original_je",
"dest_type": "integer",
"description": null
},
{
"source_name": "Original_JE_Seq_Num",
"source_type": "NUMERIC(19,5)",
"dest_name": "original_je_seq_num",
"dest_type": "numeric(19,5)",
"description": null
},
{
"source_name": "Original_JE_Year",
"source_type": "SMALLINT",
"dest_name": "original_je_year",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Ledger_ID",
"source_type": "SMALLINT",
"dest_name": "ledger_id",
"dest_type": "smallint",
"description": null
},
{
"source_name": "Adjustment_Transaction",
"source_type": "TINYINT",
"dest_name": "adjustment_transaction",
"dest_type": "smallint",
"description": null
},
{
"source_name": "APRVLUSERID",
"source_type": "CHAR(15)",
"dest_name": "aprvluserid",
"dest_type": "text",
"description": null
},
{
"source_name": "APPRVLDT",
"source_type": "DATETIME",
"dest_name": "apprvldt",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "DEX_ROW_TS",
"source_type": "DATETIME",
"dest_name": "dex_row_ts",
"dest_type": "timestamp",
"description": null
},
{
"source_name": "DEX_ROW_ID",
"source_type": "INT",
"dest_name": "dex_row_id",
"dest_type": "integer",
"description": null
}
],
"watermarks": [
{
"name": "dex_row_id",
"connection": "usmidsap02",
"resolver_sql": "select max(dex_row_id) from gp.gl30000",
"default_value": null
}
],
"hooks": []
}

View File

@ -0,0 +1,70 @@
SELECT
[HSTYEAR] AS hstyear,
[JRNENTRY] AS jrnentry,
[RCTRXSEQ] AS rctrxseq,
RTRIM([SOURCDOC]) AS sourcdoc,
RTRIM([REFRENCE]) AS refrence,
RTRIM([DSCRIPTN]) AS dscriptn,
[TRXDATE] AS trxdate,
[ACTINDX] AS actindx,
RTRIM([TRXSORCE]) AS trxsorce,
[POLLDTRX] AS polldtrx,
RTRIM([LASTUSER]) AS lastuser,
[LSTDTEDT] AS lstdtedt,
RTRIM([USWHPSTD]) AS uswhpstd,
RTRIM([ORGNTSRC]) AS orgntsrc,
[ORGNATYP] AS orgnatyp,
[QKOFSET] AS qkofset,
[SERIES] AS series,
[ORTRXTYP] AS ortrxtyp,
RTRIM([ORCTRNUM]) AS orctrnum,
RTRIM([ORMSTRID]) AS ormstrid,
RTRIM([ORMSTRNM]) AS ormstrnm,
RTRIM([ORDOCNUM]) AS ordocnum,
[ORPSTDDT] AS orpstddt,
RTRIM([ORTRXSRC]) AS ortrxsrc,
[OrigDTASeries] AS origdtaseries,
[OrigSeqNum] AS origseqnum,
[SEQNUMBR] AS seqnumbr,
[DTA_GL_Status] AS dta_gl_status,
[DTA_Index] AS dta_index,
RTRIM([CURNCYID]) AS curncyid,
[CURRNIDX] AS currnidx,
RTRIM([RATETPID]) AS ratetpid,
RTRIM([EXGTBLID]) AS exgtblid,
[XCHGRATE] AS xchgrate,
[EXCHDATE] AS exchdate,
[TIME1] AS time1,
[RTCLCMTD] AS rtclcmtd,
[NOTEINDX] AS noteindx,
[ICTRX] AS ictrx,
RTRIM([ORCOMID]) AS orcomid,
[ORIGINJE] AS originje,
[PERIODID] AS periodid,
[DEBITAMT] AS debitamt,
[CRDTAMNT] AS crdtamnt,
[ORDBTAMT] AS ordbtamt,
[ORCRDAMT] AS orcrdamt,
[DOCDATE] AS docdate,
[PSTGNMBR] AS pstgnmbr,
[PPSGNMBR] AS ppsgnmbr,
[DENXRATE] AS denxrate,
[MCTRXSTT] AS mctrxstt,
RTRIM([CorrespondingUnit]) AS correspondingunit,
[VOIDED] AS voided,
[Back_Out_JE] AS back_out_je,
[Back_Out_JE_Year] AS back_out_je_year,
[Correcting_JE] AS correcting_je,
[Correcting_JE_Year] AS correcting_je_year,
[Original_JE] AS original_je,
[Original_JE_Seq_Num] AS original_je_seq_num,
[Original_JE_Year] AS original_je_year,
[Ledger_ID] AS ledger_id,
[Adjustment_Transaction] AS adjustment_transaction,
RTRIM([APRVLUSERID]) AS aprvluserid,
[APPRVLDT] AS apprvldt,
[DEX_ROW_TS] AS dex_row_ts,
[DEX_ROW_ID] AS dex_row_id
FROM [GPSERVER].[CHG].[dbo].[GL30000]
WHERE
[DEX_ROW_ID] >= {dex_row_id}

351
config/modules/gldate.json Normal file
View File

@ -0,0 +1,351 @@
{
"name": "gldate",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.gldate",
"staging_table": "pipekit_staging.gldate",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "G/L Period End Dates 6.0",
"columns": [
{
"source_name": "KPCOMP",
"source_type": "NUMERIC(2,0)",
"dest_name": "kpcomp",
"dest_type": "numeric(2,0)",
"description": "Company Number"
},
{
"source_name": "KPCCYY",
"source_type": "NUMERIC(4,0)",
"dest_name": "kpccyy",
"dest_type": "numeric(4,0)",
"description": "Fiscal Year"
},
{
"source_name": "KPMAXP",
"source_type": "NUMERIC(2,0)",
"dest_name": "kpmaxp",
"dest_type": "numeric(2,0)",
"description": "Periods /Year"
},
{
"source_name": "KPSD01",
"source_type": "DATE",
"dest_name": "kpsd01",
"dest_type": "date",
"description": "Starting Date 01"
},
{
"source_name": "KPED01",
"source_type": "DATE",
"dest_name": "kped01",
"dest_type": "date",
"description": "Ending Date 01"
},
{
"source_name": "KPDY01",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy01",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD02",
"source_type": "DATE",
"dest_name": "kpsd02",
"dest_type": "date",
"description": "Starting Date 02"
},
{
"source_name": "KPED02",
"source_type": "DATE",
"dest_name": "kped02",
"dest_type": "date",
"description": "Ending Date 02"
},
{
"source_name": "KPDY02",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy02",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD03",
"source_type": "DATE",
"dest_name": "kpsd03",
"dest_type": "date",
"description": "Starting Date 03"
},
{
"source_name": "KPED03",
"source_type": "DATE",
"dest_name": "kped03",
"dest_type": "date",
"description": "Ending Date 03"
},
{
"source_name": "KPDY03",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy03",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD04",
"source_type": "DATE",
"dest_name": "kpsd04",
"dest_type": "date",
"description": "Starting Date 04"
},
{
"source_name": "KPED04",
"source_type": "DATE",
"dest_name": "kped04",
"dest_type": "date",
"description": "Ending Date 04"
},
{
"source_name": "KPDY04",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy04",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD05",
"source_type": "DATE",
"dest_name": "kpsd05",
"dest_type": "date",
"description": "Starting Date 05"
},
{
"source_name": "KPED05",
"source_type": "DATE",
"dest_name": "kped05",
"dest_type": "date",
"description": "Ending Date 05"
},
{
"source_name": "KPDY05",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy05",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD06",
"source_type": "DATE",
"dest_name": "kpsd06",
"dest_type": "date",
"description": "Starting Date 06"
},
{
"source_name": "KPED06",
"source_type": "DATE",
"dest_name": "kped06",
"dest_type": "date",
"description": "Ending Date 06"
},
{
"source_name": "KPDY06",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy06",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD07",
"source_type": "DATE",
"dest_name": "kpsd07",
"dest_type": "date",
"description": "Starting Date 07"
},
{
"source_name": "KPED07",
"source_type": "DATE",
"dest_name": "kped07",
"dest_type": "date",
"description": "Ending Date 07"
},
{
"source_name": "KPDY07",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy07",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD08",
"source_type": "DATE",
"dest_name": "kpsd08",
"dest_type": "date",
"description": "Starting Date 08"
},
{
"source_name": "KPED08",
"source_type": "DATE",
"dest_name": "kped08",
"dest_type": "date",
"description": "Ending Date 08"
},
{
"source_name": "KPDY08",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy08",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD09",
"source_type": "DATE",
"dest_name": "kpsd09",
"dest_type": "date",
"description": "Starting Date 09"
},
{
"source_name": "KPED09",
"source_type": "DATE",
"dest_name": "kped09",
"dest_type": "date",
"description": "Ending Date 09"
},
{
"source_name": "KPDY09",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy09",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD10",
"source_type": "DATE",
"dest_name": "kpsd10",
"dest_type": "date",
"description": "Starting Date 10"
},
{
"source_name": "KPED10",
"source_type": "DATE",
"dest_name": "kped10",
"dest_type": "date",
"description": "Ending Date 10"
},
{
"source_name": "KPDY10",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy10",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD11",
"source_type": "DATE",
"dest_name": "kpsd11",
"dest_type": "date",
"description": "Starting Date 11"
},
{
"source_name": "KPED11",
"source_type": "DATE",
"dest_name": "kped11",
"dest_type": "date",
"description": "Ending Date 11"
},
{
"source_name": "KPDY11",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy11",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD12",
"source_type": "DATE",
"dest_name": "kpsd12",
"dest_type": "date",
"description": "Starting Date 12"
},
{
"source_name": "KPED12",
"source_type": "DATE",
"dest_name": "kped12",
"dest_type": "date",
"description": "Ending Date 12"
},
{
"source_name": "KPDY12",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy12",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD13",
"source_type": "DATE",
"dest_name": "kpsd13",
"dest_type": "date",
"description": "Starting Date 13"
},
{
"source_name": "KPED13",
"source_type": "DATE",
"dest_name": "kped13",
"dest_type": "date",
"description": "Ending Date 13"
},
{
"source_name": "KPDY13",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy13",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD14",
"source_type": "DATE",
"dest_name": "kpsd14",
"dest_type": "date",
"description": "Starting Date 14"
},
{
"source_name": "KPED14",
"source_type": "DATE",
"dest_name": "kped14",
"dest_type": "date",
"description": "Ending Date 14"
},
{
"source_name": "KPDY14",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy14",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
},
{
"source_name": "KPSD15",
"source_type": "DATE",
"dest_name": "kpsd15",
"dest_type": "date",
"description": "Starting Date 15"
},
{
"source_name": "KPED15",
"source_type": "DATE",
"dest_name": "kped15",
"dest_type": "date",
"description": "Ending Date 15"
},
{
"source_name": "KPDY15",
"source_type": "NUMERIC(3,0)",
"dest_name": "kpdy15",
"dest_type": "numeric(3,0)",
"description": "Days in Period"
}
],
"watermarks": [],
"hooks": []
}

50
config/modules/gldate.sql Normal file
View File

@ -0,0 +1,50 @@
SELECT
KPCOMP AS kpcomp,
KPCCYY AS kpccyy,
KPMAXP AS kpmaxp,
CASE WHEN KPSD01 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD01 END AS kpsd01,
CASE WHEN KPED01 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED01 END AS kped01,
KPDY01 AS kpdy01,
CASE WHEN KPSD02 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD02 END AS kpsd02,
CASE WHEN KPED02 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED02 END AS kped02,
KPDY02 AS kpdy02,
CASE WHEN KPSD03 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD03 END AS kpsd03,
CASE WHEN KPED03 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED03 END AS kped03,
KPDY03 AS kpdy03,
CASE WHEN KPSD04 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD04 END AS kpsd04,
CASE WHEN KPED04 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED04 END AS kped04,
KPDY04 AS kpdy04,
CASE WHEN KPSD05 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD05 END AS kpsd05,
CASE WHEN KPED05 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED05 END AS kped05,
KPDY05 AS kpdy05,
CASE WHEN KPSD06 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD06 END AS kpsd06,
CASE WHEN KPED06 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED06 END AS kped06,
KPDY06 AS kpdy06,
CASE WHEN KPSD07 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD07 END AS kpsd07,
CASE WHEN KPED07 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED07 END AS kped07,
KPDY07 AS kpdy07,
CASE WHEN KPSD08 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD08 END AS kpsd08,
CASE WHEN KPED08 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED08 END AS kped08,
KPDY08 AS kpdy08,
CASE WHEN KPSD09 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD09 END AS kpsd09,
CASE WHEN KPED09 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED09 END AS kped09,
KPDY09 AS kpdy09,
CASE WHEN KPSD10 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD10 END AS kpsd10,
CASE WHEN KPED10 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED10 END AS kped10,
KPDY10 AS kpdy10,
CASE WHEN KPSD11 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD11 END AS kpsd11,
CASE WHEN KPED11 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED11 END AS kped11,
KPDY11 AS kpdy11,
CASE WHEN KPSD12 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD12 END AS kpsd12,
CASE WHEN KPED12 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED12 END AS kped12,
KPDY12 AS kpdy12,
CASE WHEN KPSD13 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD13 END AS kpsd13,
CASE WHEN KPED13 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED13 END AS kped13,
KPDY13 AS kpdy13,
CASE WHEN KPSD14 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD14 END AS kpsd14,
CASE WHEN KPED14 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED14 END AS kped14,
KPDY14 AS kpdy14,
CASE WHEN KPSD15 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPSD15 END AS kpsd15,
CASE WHEN KPED15 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE KPED15 END AS kped15,
KPDY15 AS kpdy15
FROM LGDAT.GLDATE

View File

@ -0,0 +1,64 @@
{
"name": "gldatref",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.gldatref",
"staging_table": "pipekit_staging.gldatref",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "G/L Period Dates Reference File 6.0",
"columns": [
{
"source_name": "N1COMP",
"source_type": "NUMERIC(2,0)",
"dest_name": "n1comp",
"dest_type": "numeric(2,0)",
"description": "Company Number"
},
{
"source_name": "N1CCYY",
"source_type": "NUMERIC(4,0)",
"dest_name": "n1ccyy",
"dest_type": "numeric(4,0)",
"description": "Fiscal Year"
},
{
"source_name": "N1FSPP",
"source_type": "NUMERIC(2,0)",
"dest_name": "n1fspp",
"dest_type": "numeric(2,0)",
"description": "Fiscal Period"
},
{
"source_name": "N1FSYY",
"source_type": "NUMERIC(2,0)",
"dest_name": "n1fsyy",
"dest_type": "numeric(2,0)",
"description": "Fiscal Year"
},
{
"source_name": "N1FSYP",
"source_type": "NUMERIC(4,0)",
"dest_name": "n1fsyp",
"dest_type": "numeric(4,0)",
"description": "Fiscal Year/Period"
},
{
"source_name": "N1SD01",
"source_type": "DATE",
"dest_name": "n1sd01",
"dest_type": "date",
"description": "Starting Date"
},
{
"source_name": "N1ED01",
"source_type": "DATE",
"dest_name": "n1ed01",
"dest_type": "date",
"description": "Ending Date"
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,9 @@
SELECT
N1COMP AS n1comp,
N1CCYY AS n1ccyy,
N1FSPP AS n1fspp,
N1FSYY AS n1fsyy,
N1FSYP AS n1fsyp,
CASE WHEN N1SD01 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE N1SD01 END AS n1sd01,
CASE WHEN N1ED01 IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE N1ED01 END AS n1ed01
FROM LGDAT.GLDATREF

281
config/modules/glie.json Normal file
View File

@ -0,0 +1,281 @@
{
"name": "glie",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.glie",
"staging_table": "pipekit_staging.glie",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "G/L Inventory Expense Accounts 6.1",
"columns": [
{
"source_name": "Y1PLNT",
"source_type": "CHAR(3)",
"dest_name": "y1plnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "Y1GLEC",
"source_type": "CHAR(3)",
"dest_name": "y1glec",
"dest_type": "text",
"description": "G/L Expense Code"
},
{
"source_name": "Y1INVA",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1inva",
"dest_type": "numeric(10,0)",
"description": "G/L Inventory Account"
},
{
"source_name": "Y1PRVR",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1prvr",
"dest_type": "numeric(10,0)",
"description": "G/L Price Variance"
},
{
"source_name": "Y1USVR",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1usvr",
"dest_type": "numeric(10,0)",
"description": "G/L Usage Variance"
},
{
"source_name": "Y1PADJ",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1padj",
"dest_type": "numeric(10,0)",
"description": "G/L Physical Adjustment"
},
{
"source_name": "Y1RVAL",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1rval",
"dest_type": "numeric(10,0)",
"description": "G/L Inventory Revaluation"
},
{
"source_name": "Y1INTP",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1intp",
"dest_type": "numeric(10,0)",
"description": "G/L Interplant Variance"
},
{
"source_name": "Y1FUT1",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1fut1",
"dest_type": "numeric(10,0)",
"description": "Future Use"
},
{
"source_name": "Y1FUT2",
"source_type": "CHAR(3)",
"dest_name": "y1fut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y1FUT3",
"source_type": "CHAR(10)",
"dest_name": "y1fut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y1FUT4",
"source_type": "CHAR(20)",
"dest_name": "y1fut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y1FUT5",
"source_type": "NUMERIC(15,5)",
"dest_name": "y1fut5",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "Y1FUT6",
"source_type": "NUMERIC(15,5)",
"dest_name": "y1fut6",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "Y1FLG1",
"source_type": "CHAR(1)",
"dest_name": "y1flg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y1FLG2",
"source_type": "CHAR(1)",
"dest_name": "y1flg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y1FLG3",
"source_type": "CHAR(1)",
"dest_name": "y1flg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y1FREX",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1frex",
"dest_type": "numeric(10,0)",
"description": "BOL Freight Expense Acct#"
},
{
"source_name": "Y1SREX",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1srex",
"dest_type": "numeric(10,0)",
"description": "BOL Freight Sur- charge Expense Acc#"
},
{
"source_name": "Y1FRVR",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1frvr",
"dest_type": "numeric(10,0)",
"description": "BOL Freight Variance Acct#"
},
{
"source_name": "Y1SRVR",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1srvr",
"dest_type": "numeric(10,0)",
"description": "BOL Freight Sur- charge Variance Acc#"
},
{
"source_name": "Y1NEGA",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1nega",
"dest_type": "numeric(10,0)",
"description": "Negative Inventory Adjustment"
},
{
"source_name": "Y1RPIR",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1rpir",
"dest_type": "numeric(10,0)",
"description": "Repair GL Account"
},
{
"source_name": "Y1GLM1",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1glm1",
"dest_type": "numeric(10,0)",
"description": "G/L Clearing Account for Multiplier-1"
},
{
"source_name": "Y1GLM2",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1glm2",
"dest_type": "numeric(10,0)",
"description": "G/L Clearing Account for Multiplier-2"
},
{
"source_name": "Y1CLAC",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1clac",
"dest_type": "numeric(10,0)",
"description": "Work Order Option Clearing"
},
{
"source_name": "Y1FUT7",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1fut7",
"dest_type": "numeric(10,0)",
"description": "Future Use"
},
{
"source_name": "Y1FUT8",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1fut8",
"dest_type": "numeric(10,0)",
"description": "Future Use"
},
{
"source_name": "Y1FUT9",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1fut9",
"dest_type": "numeric(10,0)",
"description": "Future Use"
},
{
"source_name": "Y1FUT10",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1fut10",
"dest_type": "numeric(10,0)",
"description": "Future Use"
},
{
"source_name": "Y1FUT11",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1fut11",
"dest_type": "numeric(10,0)",
"description": "Future Use"
},
{
"source_name": "Y1SAAC",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1saac",
"dest_type": "numeric(10,0)",
"description": "Month-End Option Serial Adj"
},
{
"source_name": "Y1BHCL",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1bhcl",
"dest_type": "numeric(10,0)",
"description": "Bill-And-Hold Clearing"
},
{
"source_name": "Y1CBMX",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1cbmx",
"dest_type": "numeric(10,0)",
"description": "Container BOM Part Expense"
},
{
"source_name": "Y1UVLB",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1uvlb",
"dest_type": "numeric(10,0)",
"description": "G/L Usage Variance Labour"
},
{
"source_name": "Y1UVFB",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1uvfb",
"dest_type": "numeric(10,0)",
"description": "G/L Usage Variance Fix Burden"
},
{
"source_name": "Y1UVVB",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1uvvb",
"dest_type": "numeric(10,0)",
"description": "G/L Usage Variance Var Burden"
},
{
"source_name": "Y1UVOTH",
"source_type": "NUMERIC(10,0)",
"dest_name": "y1uvoth",
"dest_type": "numeric(10,0)",
"description": "G/L Usage Variance Other"
}
],
"watermarks": [],
"hooks": []
}

40
config/modules/glie.sql Normal file
View File

@ -0,0 +1,40 @@
SELECT
RTRIM(Y1PLNT) AS y1plnt,
RTRIM(Y1GLEC) AS y1glec,
Y1INVA AS y1inva,
Y1PRVR AS y1prvr,
Y1USVR AS y1usvr,
Y1PADJ AS y1padj,
Y1RVAL AS y1rval,
Y1INTP AS y1intp,
Y1FUT1 AS y1fut1,
RTRIM(Y1FUT2) AS y1fut2,
RTRIM(Y1FUT3) AS y1fut3,
RTRIM(Y1FUT4) AS y1fut4,
Y1FUT5 AS y1fut5,
Y1FUT6 AS y1fut6,
RTRIM(Y1FLG1) AS y1flg1,
RTRIM(Y1FLG2) AS y1flg2,
RTRIM(Y1FLG3) AS y1flg3,
Y1FREX AS y1frex,
Y1SREX AS y1srex,
Y1FRVR AS y1frvr,
Y1SRVR AS y1srvr,
Y1NEGA AS y1nega,
Y1RPIR AS y1rpir,
Y1GLM1 AS y1glm1,
Y1GLM2 AS y1glm2,
Y1CLAC AS y1clac,
Y1FUT7 AS y1fut7,
Y1FUT8 AS y1fut8,
Y1FUT9 AS y1fut9,
Y1FUT10 AS y1fut10,
Y1FUT11 AS y1fut11,
Y1SAAC AS y1saac,
Y1BHCL AS y1bhcl,
Y1CBMX AS y1cbmx,
Y1UVLB AS y1uvlb,
Y1UVFB AS y1uvfb,
Y1UVVB AS y1uvvb,
Y1UVOTH AS y1uvoth
FROM LGDAT.GLIE

512
config/modules/glmt.json Normal file
View File

@ -0,0 +1,512 @@
{
"name": "glmt",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.glmt",
"staging_table": "pipekit_staging.glmt",
"merge_strategy": "incremental",
"merge_key": "aj4ccyy",
"enabled": 1,
"dest_description": "G/L Chart of Accounts totals for year 6.0",
"columns": [
{
"source_name": "AJ4COMP",
"source_type": "NUMERIC(2,0)",
"dest_name": "aj4comp",
"dest_type": "numeric(2,0)",
"description": "Company Number"
},
{
"source_name": "AJ4GL#1",
"source_type": "NUMERIC(4,0)",
"dest_name": "aj4gl#1",
"dest_type": "numeric(4,0)",
"description": "G/L Account#1"
},
{
"source_name": "AJ4GL#2",
"source_type": "NUMERIC(6,0)",
"dest_name": "aj4gl#2",
"dest_type": "numeric(6,0)",
"description": "G/L Account#2"
},
{
"source_name": "AJ4CCYY",
"source_type": "NUMERIC(4,0)",
"dest_name": "aj4ccyy",
"dest_type": "numeric(4,0)",
"description": "Fiscal Year CCYY"
},
{
"source_name": "AJ4TMD",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tmd",
"dest_type": "numeric(14,2)",
"description": "This Month Debit"
},
{
"source_name": "AJ4TMC",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tmc",
"dest_type": "numeric(14,2)",
"description": "This Month Credit"
},
{
"source_name": "AJ4TT01",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt01",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 1)"
},
{
"source_name": "AJ4TT02",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt02",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 2)"
},
{
"source_name": "AJ4TT03",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt03",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 3)"
},
{
"source_name": "AJ4TT04",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt04",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 4)"
},
{
"source_name": "AJ4TT05",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt05",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 5)"
},
{
"source_name": "AJ4TT06",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt06",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 6)"
},
{
"source_name": "AJ4TT07",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt07",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 7)"
},
{
"source_name": "AJ4TT08",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt08",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 8)"
},
{
"source_name": "AJ4TT09",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt09",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 9)"
},
{
"source_name": "AJ4TT10",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt10",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 10)"
},
{
"source_name": "AJ4TT11",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt11",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 11)"
},
{
"source_name": "AJ4TT12",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt12",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 12)"
},
{
"source_name": "AJ4TT13",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt13",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 13)"
},
{
"source_name": "AJ4TT14",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt14",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 14)"
},
{
"source_name": "AJ4TT15",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4tt15",
"dest_type": "numeric(14,2)",
"description": "Actual Tran. This Year (Period 15)"
},
{
"source_name": "AJ4OB01",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob01",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 1)"
},
{
"source_name": "AJ4OB02",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob02",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 2)"
},
{
"source_name": "AJ4OB03",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob03",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 3)"
},
{
"source_name": "AJ4OB04",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob04",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 4)"
},
{
"source_name": "AJ4OB05",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob05",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 5)"
},
{
"source_name": "AJ4OB06",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob06",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 6)"
},
{
"source_name": "AJ4OB07",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob07",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 7)"
},
{
"source_name": "AJ4OB08",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob08",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 8)"
},
{
"source_name": "AJ4OB09",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob09",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 9)"
},
{
"source_name": "AJ4OB10",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob10",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 10)"
},
{
"source_name": "AJ4OB11",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob11",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 11)"
},
{
"source_name": "AJ4OB12",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob12",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 12)"
},
{
"source_name": "AJ4OB13",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob13",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 13)"
},
{
"source_name": "AJ4OB14",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob14",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 14)"
},
{
"source_name": "AJ4OB15",
"source_type": "DECIMAL(14,2)",
"dest_name": "aj4ob15",
"dest_type": "numeric(14,2)",
"description": "Opening Balance (Period 15)"
},
{
"source_name": "AJ4CB01",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb01",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 1)"
},
{
"source_name": "AJ4CB02",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb02",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 2)"
},
{
"source_name": "AJ4CB03",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb03",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 3)"
},
{
"source_name": "AJ4CB04",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb04",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 4)"
},
{
"source_name": "AJ4CB05",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb05",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 5)"
},
{
"source_name": "AJ4CB06",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb06",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 6)"
},
{
"source_name": "AJ4CB07",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb07",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 7)"
},
{
"source_name": "AJ4CB08",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb08",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 8)"
},
{
"source_name": "AJ4CB09",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb09",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 9)"
},
{
"source_name": "AJ4CB10",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb10",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 10)"
},
{
"source_name": "AJ4CB11",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb11",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 11)"
},
{
"source_name": "AJ4CB12",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb12",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 12)"
},
{
"source_name": "AJ4CB13",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb13",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 13)"
},
{
"source_name": "AJ4CB14",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb14",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 14)"
},
{
"source_name": "AJ4CB15",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4cb15",
"dest_type": "numeric(12,0)",
"description": "Current Budget (Period 15)"
},
{
"source_name": "AJ4FPD1",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fpd1",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 1)"
},
{
"source_name": "AJ4FPD2",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fpd2",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 2)"
},
{
"source_name": "AJ4PER1",
"source_type": "NUMERIC(2,0)",
"dest_name": "aj4per1",
"dest_type": "numeric(2,0)",
"description": "Period 1"
},
{
"source_name": "AJ4PER2",
"source_type": "NUMERIC(2,0)",
"dest_name": "aj4per2",
"dest_type": "numeric(2,0)",
"description": "Period 2"
},
{
"source_name": "AJ4FR01",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr01",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 1)"
},
{
"source_name": "AJ4FR02",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr02",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 2)"
},
{
"source_name": "AJ4FR03",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr03",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 3)"
},
{
"source_name": "AJ4FR04",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr04",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 4)"
},
{
"source_name": "AJ4FR05",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr05",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 5)"
},
{
"source_name": "AJ4FR06",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr06",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 6)"
},
{
"source_name": "AJ4FR07",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr07",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 7)"
},
{
"source_name": "AJ4FR08",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr08",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 8)"
},
{
"source_name": "AJ4FR09",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr09",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 9)"
},
{
"source_name": "AJ4FR0A",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr0a",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 10)"
},
{
"source_name": "AJ4FR0B",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr0b",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 11)"
},
{
"source_name": "AJ4FR0C",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr0c",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 12)"
},
{
"source_name": "AJ4FR0D",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr0d",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 13)"
},
{
"source_name": "AJ4FR0E",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr0e",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 14)"
},
{
"source_name": "AJ4FR0F",
"source_type": "DECIMAL(12,0)",
"dest_name": "aj4fr0f",
"dest_type": "numeric(12,0)",
"description": "Forecast (Period 15)"
}
],
"watermarks": [
{
"name": "Fiscal",
"connection": "usmidsap02",
"resolver_sql": "SELECT '2027'",
"default_value": "None"
}
],
"hooks": []
}

73
config/modules/glmt.sql Normal file
View File

@ -0,0 +1,73 @@
SELECT
AJ4COMP AS aj4comp,
"AJ4GL#1" AS "aj4gl#1",
"AJ4GL#2" AS "aj4gl#2",
AJ4CCYY AS aj4ccyy,
AJ4TMD AS aj4tmd,
AJ4TMC AS aj4tmc,
AJ4TT01 AS aj4tt01,
AJ4TT02 AS aj4tt02,
AJ4TT03 AS aj4tt03,
AJ4TT04 AS aj4tt04,
AJ4TT05 AS aj4tt05,
AJ4TT06 AS aj4tt06,
AJ4TT07 AS aj4tt07,
AJ4TT08 AS aj4tt08,
AJ4TT09 AS aj4tt09,
AJ4TT10 AS aj4tt10,
AJ4TT11 AS aj4tt11,
AJ4TT12 AS aj4tt12,
AJ4TT13 AS aj4tt13,
AJ4TT14 AS aj4tt14,
AJ4TT15 AS aj4tt15,
AJ4OB01 AS aj4ob01,
AJ4OB02 AS aj4ob02,
AJ4OB03 AS aj4ob03,
AJ4OB04 AS aj4ob04,
AJ4OB05 AS aj4ob05,
AJ4OB06 AS aj4ob06,
AJ4OB07 AS aj4ob07,
AJ4OB08 AS aj4ob08,
AJ4OB09 AS aj4ob09,
AJ4OB10 AS aj4ob10,
AJ4OB11 AS aj4ob11,
AJ4OB12 AS aj4ob12,
AJ4OB13 AS aj4ob13,
AJ4OB14 AS aj4ob14,
AJ4OB15 AS aj4ob15,
AJ4CB01 AS aj4cb01,
AJ4CB02 AS aj4cb02,
AJ4CB03 AS aj4cb03,
AJ4CB04 AS aj4cb04,
AJ4CB05 AS aj4cb05,
AJ4CB06 AS aj4cb06,
AJ4CB07 AS aj4cb07,
AJ4CB08 AS aj4cb08,
AJ4CB09 AS aj4cb09,
AJ4CB10 AS aj4cb10,
AJ4CB11 AS aj4cb11,
AJ4CB12 AS aj4cb12,
AJ4CB13 AS aj4cb13,
AJ4CB14 AS aj4cb14,
AJ4CB15 AS aj4cb15,
AJ4FPD1 AS aj4fpd1,
AJ4FPD2 AS aj4fpd2,
AJ4PER1 AS aj4per1,
AJ4PER2 AS aj4per2,
AJ4FR01 AS aj4fr01,
AJ4FR02 AS aj4fr02,
AJ4FR03 AS aj4fr03,
AJ4FR04 AS aj4fr04,
AJ4FR05 AS aj4fr05,
AJ4FR06 AS aj4fr06,
AJ4FR07 AS aj4fr07,
AJ4FR08 AS aj4fr08,
AJ4FR09 AS aj4fr09,
AJ4FR0A AS aj4fr0a,
AJ4FR0B AS aj4fr0b,
AJ4FR0C AS aj4fr0c,
AJ4FR0D AS aj4fr0d,
AJ4FR0E AS aj4fr0e,
AJ4FR0F AS aj4fr0f
FROM LGDAT.GLMT
WHERE AJ4CCYY >= '{Fiscal}'

645
config/modules/gtran.json Normal file
View File

@ -0,0 +1,645 @@
{
"name": "gtran",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.gtran",
"staging_table": "pipekit_staging.gtran",
"merge_strategy": "append",
"merge_key": null,
"enabled": 1,
"dest_description": "G/L Transactions 6.1",
"columns": [
{
"source_name": "DKACC#",
"source_type": "NUMERIC(12,0)",
"dest_name": "dkacc#",
"dest_type": "numeric(12,0)",
"description": "G/L Account Number with Company"
},
{
"source_name": "DKFSPR",
"source_type": "NUMERIC(2,0)",
"dest_name": "dkfspr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Period"
},
{
"source_name": "DKJRTP",
"source_type": "CHAR(1)",
"dest_name": "dkjrtp",
"dest_type": "text",
"description": "Journal Type"
},
{
"source_name": "DKTDAT",
"source_type": "DATE",
"dest_name": "dktdat",
"dest_type": "date",
"description": "Transaction Date"
},
{
"source_name": "DKSRCE",
"source_type": "CHAR(2)",
"dest_name": "dksrce",
"dest_type": "text",
"description": "Transaction Source"
},
{
"source_name": "DKAMT",
"source_type": "NUMERIC(14,2)",
"dest_name": "dkamt",
"dest_type": "numeric(14,2)",
"description": "Transaction Amount"
},
{
"source_name": "DKREF#",
"source_type": "CHAR(10)",
"dest_name": "dkref#",
"dest_type": "text",
"description": "Reference Number"
},
{
"source_name": "DKREFD",
"source_type": "CHAR(30)",
"dest_name": "dkrefd",
"dest_type": "text",
"description": "Reference Description"
},
{
"source_name": "DKADDD",
"source_type": "CHAR(30)",
"dest_name": "dkaddd",
"dest_type": "text",
"description": "Additional Description"
},
{
"source_name": "DKREV",
"source_type": "CHAR(1)",
"dest_name": "dkrev",
"dest_type": "text",
"description": "Reversing Entry"
},
{
"source_name": "DKREVS",
"source_type": "CHAR(1)",
"dest_name": "dkrevs",
"dest_type": "text",
"description": "Reversing Status"
},
{
"source_name": "DKFSYR",
"source_type": "NUMERIC(2,0)",
"dest_name": "dkfsyr",
"dest_type": "numeric(2,0)",
"description": "Fiscal Century"
},
{
"source_name": "DKFSYY",
"source_type": "NUMERIC(2,0)",
"dest_name": "dkfsyy",
"dest_type": "numeric(2,0)",
"description": "Fiscal Year YY"
},
{
"source_name": "DKPOST",
"source_type": "CHAR(1)",
"dest_name": "dkpost",
"dest_type": "text",
"description": "Posted Entry Y/N"
},
{
"source_name": "DKPDAT",
"source_type": "DATE",
"dest_name": "dkpdat",
"dest_type": "date",
"description": "Posted Date"
},
{
"source_name": "DKBTC#",
"source_type": "NUMERIC(9,0)",
"dest_name": "dkbtc#",
"dest_type": "numeric(9,0)",
"description": "Batch Number"
},
{
"source_name": "DKQUAL",
"source_type": "CHAR(2)",
"dest_name": "dkqual",
"dest_type": "text",
"description": "Key Qualifier"
},
{
"source_name": "DKKEYN",
"source_type": "CHAR(20)",
"dest_name": "dkkeyn",
"dest_type": "text",
"description": "Source Key"
},
{
"source_name": "DKPART",
"source_type": "CHAR(20)",
"dest_name": "dkpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "DKPJNM",
"source_type": "CHAR(20)",
"dest_name": "dkpjnm",
"dest_type": "text",
"description": "Project Number"
},
{
"source_name": "DKQTY",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkqty",
"dest_type": "numeric(15,5)",
"description": "Quantity"
},
{
"source_name": "DKUNIT",
"source_type": "CHAR(3)",
"dest_name": "dkunit",
"dest_type": "text",
"description": "Unit of Measure"
},
{
"source_name": "DKFUT1",
"source_type": "CHAR(1)",
"dest_name": "dkfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT2",
"source_type": "CHAR(1)",
"dest_name": "dkfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT3",
"source_type": "CHAR(1)",
"dest_name": "dkfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT4",
"source_type": "CHAR(10)",
"dest_name": "dkfut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT5",
"source_type": "CHAR(10)",
"dest_name": "dkfut5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT6",
"source_type": "CHAR(20)",
"dest_name": "dkfut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT7",
"source_type": "NUMERIC(5,0)",
"dest_name": "dkfut7",
"dest_type": "numeric(5,0)",
"description": "Future Use"
},
{
"source_name": "DKFUT8",
"source_type": "CHAR(3)",
"dest_name": "dkfut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT9",
"source_type": "CHAR(3)",
"dest_name": "dkfut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT10",
"source_type": "CHAR(5)",
"dest_name": "dkfut10",
"dest_type": "text",
"description": "Journal Line #"
},
{
"source_name": "DKFUT11",
"source_type": "CHAR(5)",
"dest_name": "dkfut11",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT12",
"source_type": "CHAR(10)",
"dest_name": "dkfut12",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT13",
"source_type": "CHAR(10)",
"dest_name": "dkfut13",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT14",
"source_type": "NUMERIC(11,2)",
"dest_name": "dkfut14",
"dest_type": "numeric(11,2)",
"description": "Future Use"
},
{
"source_name": "DKFUT15",
"source_type": "NUMERIC(11,2)",
"dest_name": "dkfut15",
"dest_type": "numeric(11,2)",
"description": "Future Use"
},
{
"source_name": "DKFUT16",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkfut16",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "DKFUT17",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkfut17",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "DKFUT18",
"source_type": "CHAR(1)",
"dest_name": "dkfut18",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT19",
"source_type": "CHAR(1)",
"dest_name": "dkfut19",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT20",
"source_type": "CHAR(1)",
"dest_name": "dkfut20",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKEMCD",
"source_type": "CHAR(5)",
"dest_name": "dkemcd",
"dest_type": "text",
"description": "Employee Code"
},
{
"source_name": "DKMINS",
"source_type": "CHAR(3)",
"dest_name": "dkmins",
"dest_type": "text",
"description": "Minor Sales Code"
},
{
"source_name": "DKTERR",
"source_type": "CHAR(4)",
"dest_name": "dkterr",
"dest_type": "text",
"description": "Territory Code"
},
{
"source_name": "DKORD#",
"source_type": "NUMERIC(9,0)",
"dest_name": "dkord#",
"dest_type": "numeric(9,0)",
"description": "Customer Order Number"
},
{
"source_name": "DKBCUS",
"source_type": "CHAR(8)",
"dest_name": "dkbcus",
"dest_type": "text",
"description": "Bill-to Cust#"
},
{
"source_name": "DKLABH",
"source_type": "NUMERIC(11,2)",
"dest_name": "dklabh",
"dest_type": "numeric(11,2)",
"description": "Labour Hours"
},
{
"source_name": "DKCPYT",
"source_type": "CHAR(1)",
"dest_name": "dkcpyt",
"dest_type": "text",
"description": "was copied to another GTRAN"
},
{
"source_name": "DKCPYF",
"source_type": "CHAR(1)",
"dest_name": "dkcpyf",
"dest_type": "text",
"description": "was copied from another GTRAN"
},
{
"source_name": "DKCLSC",
"source_type": "CHAR(1)",
"dest_name": "dkclsc",
"dest_type": "text",
"description": "Class Code"
},
{
"source_name": "DKCFAN",
"source_type": "NUMERIC(12,0)",
"dest_name": "dkcfan",
"dest_type": "numeric(12,0)",
"description": "Copied-from Company & Account #"
},
{
"source_name": "DKJRNN",
"source_type": "NUMERIC(5,0)",
"dest_name": "dkjrnn",
"dest_type": "numeric(5,0)",
"description": "Journal Number"
},
{
"source_name": "DKMJSC",
"source_type": "CHAR(3)",
"dest_name": "dkmjsc",
"dest_type": "text",
"description": "Major Sales Code"
},
{
"source_name": "DKBCID",
"source_type": "NUMERIC(12,0)",
"dest_name": "dkbcid",
"dest_type": "numeric(12,0)",
"description": "Tracking ID"
},
{
"source_name": "DKBSRF",
"source_type": "CHAR(1)",
"dest_name": "dkbsrf",
"dest_type": "text",
"description": "Reconciliation Status"
},
{
"source_name": "DKRCID",
"source_type": "NUMERIC(12,0)",
"dest_name": "dkrcid",
"dest_type": "numeric(12,0)",
"description": "Record ID"
},
{
"source_name": "DKTMS",
"source_type": "TIMESTMP",
"dest_name": "dktms",
"dest_type": "text",
"description": "Date/Time Stamp"
},
{
"source_name": "DKVEND",
"source_type": "CHAR(10)",
"dest_name": "dkvend",
"dest_type": "text",
"description": "Vendor Code"
},
{
"source_name": "DKADRN",
"source_type": "NUMERIC(8,0)",
"dest_name": "dkadrn",
"dest_type": "numeric(8,0)",
"description": "OneTime Vendor#"
},
{
"source_name": "DKUSR",
"source_type": "CHAR(10)",
"dest_name": "dkusr",
"dest_type": "text",
"description": "User I.D."
},
{
"source_name": "DKWTYET",
"source_type": "NUMERIC(9,0)",
"dest_name": "dkwtyet",
"dest_type": "numeric(9,0)",
"description": "AR Month-End WTYET Key"
},
{
"source_name": "DKXRTE2",
"source_type": "NUMERIC(11,6)",
"dest_name": "dkxrte2",
"dest_type": "numeric(11,6)",
"description": "Exchange Rate 2"
},
{
"source_name": "DKXRTE3",
"source_type": "NUMERIC(11,6)",
"dest_name": "dkxrte3",
"dest_type": "numeric(11,6)",
"description": "Exchange Rate 3"
},
{
"source_name": "DKJECU",
"source_type": "CHAR(2)",
"dest_name": "dkjecu",
"dest_type": "text",
"description": "Entry Currency"
},
{
"source_name": "DKILIN",
"source_type": "NUMERIC(3,0)",
"dest_name": "dkilin",
"dest_type": "numeric(3,0)",
"description": "Invoice Line"
},
{
"source_name": "DKJREFC",
"source_type": "CHAR(20)",
"dest_name": "dkjrefc",
"dest_type": "text",
"description": "Journal Ref Code"
},
{
"source_name": "DKDKENT",
"source_type": "CHAR(30)",
"dest_name": "dkdkent",
"dest_type": "text",
"description": "Doc Link Entry Numbers"
},
{
"source_name": "DKARBTC",
"source_type": "NUMERIC(2,0)",
"dest_name": "dkarbtc",
"dest_type": "numeric(2,0)",
"description": "A/R Details Batch"
},
{
"source_name": "DKDTLP",
"source_type": "CHAR(1)",
"dest_name": "dkdtlp",
"dest_type": "text",
"description": "Detail Posting"
},
{
"source_name": "DKCFBR",
"source_type": "CHAR(1)",
"dest_name": "dkcfbr",
"dest_type": "text",
"description": "Created for Bank Stat Reconciliation"
},
{
"source_name": "DKPBTID",
"source_type": "NUMERIC(9,0)",
"dest_name": "dkpbtid",
"dest_type": "numeric(9,0)",
"description": "RPRH Batch#"
},
{
"source_name": "DKPBTID2",
"source_type": "NUMERIC(9,0)",
"dest_name": "dkpbtid2",
"dest_type": "numeric(9,0)",
"description": "PD829WH Batch#"
},
{
"source_name": "DKLBTID",
"source_type": "NUMERIC(9,0)",
"dest_name": "dklbtid",
"dest_type": "numeric(9,0)",
"description": "PD439WH Batch#"
},
{
"source_name": "DKLBTID2",
"source_type": "NUMERIC(9,0)",
"dest_name": "dklbtid2",
"dest_type": "numeric(9,0)",
"description": "LBRH Batch#"
},
{
"source_name": "DKFUT21",
"source_type": "CHAR(1)",
"dest_name": "dkfut21",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT22",
"source_type": "CHAR(1)",
"dest_name": "dkfut22",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT23",
"source_type": "CHAR(10)",
"dest_name": "dkfut23",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT24",
"source_type": "CHAR(10)",
"dest_name": "dkfut24",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT25",
"source_type": "CHAR(10)",
"dest_name": "dkfut25",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT26",
"source_type": "CHAR(20)",
"dest_name": "dkfut26",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT27",
"source_type": "CHAR(20)",
"dest_name": "dkfut27",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT28",
"source_type": "CHAR(30)",
"dest_name": "dkfut28",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT29",
"source_type": "CHAR(30)",
"dest_name": "dkfut29",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "DKFUT30",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkfut30",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "DKFUT31",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkfut31",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "DKFUT32",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkfut32",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "DKFUT33",
"source_type": "NUMERIC(15,5)",
"dest_name": "dkfut33",
"dest_type": "numeric(15,5)",
"description": "Future Use"
}
],
"watermarks": [
{
"name": "gtran_tms",
"connection": "usmidsap02",
"resolver_sql": "SELECT COALESCE(MAX(dktms), '1900-01-01 00:00:00.000000') FROM cms.gtran",
"default_value": "1900-01-01 00:00:00.000000"
}
],
"hooks": [
{
"run_order": 0,
"connection": "usmidsap02",
"sql": "-- GTRAN <-> GLMT reconciliation (reference only; hook output is not captured by pipekit).\n-- Per CLOSED account-period: SUM(cms.gtran.dkamt) should equal cms.glmt AJ4TT{period}.\n-- account = aj4comp*10^10 + aj4gl#1*10^6 + aj4gl#2 ; year = dkfsyr*100+dkfsyy ; period = dkfspr.\n-- Current (max) period excluded (in flux). Known residual: a few 2026 period-10 accounts (9352*) differ by small amounts.\nWITH gt AS (\n SELECT \"dkacc#\" acct, (dkfsyr*100+dkfsyy)::int yr, dkfspr::int period, SUM(dkamt) s\n FROM cms.gtran WHERE (dkfsyr*100+dkfsyy) BETWEEN 2000 AND 2030\n GROUP BY \"dkacc#\", (dkfsyr*100+dkfsyy)::int, dkfspr::int\n), gl AS (\n SELECT aj4comp*10000000000 + \"aj4gl#1\"*1000000 + \"aj4gl#2\" acct, aj4ccyy::int yr, v.period, v.net\n FROM cms.glmt CROSS JOIN LATERAL (VALUES\n (1,aj4tt01),(2,aj4tt02),(3,aj4tt03),(4,aj4tt04),(5,aj4tt05),(6,aj4tt06),(7,aj4tt07),(8,aj4tt08),\n (9,aj4tt09),(10,aj4tt10),(11,aj4tt11),(12,aj4tt12),(13,aj4tt13),(14,aj4tt14),(15,aj4tt15)) v(period,net)\n), recon AS (\n SELECT gt.acct, gt.yr, gt.period, gt.s gtran_sum, COALESCE(gl.net,0) glmt_net\n FROM gt LEFT JOIN gl ON gl.acct=gt.acct AND gl.yr=gt.yr AND gl.period=gt.period\n WHERE gt.yr*100+gt.period < (SELECT max(yr*100+period) FROM gt)\n AND abs(gt.s - COALESCE(gl.net,0)) > 0.005\n)\nSELECT\n (SELECT count(*) FROM gt WHERE yr*100+period < (SELECT max(yr*100+period) FROM gt)) AS closed_periods_checked,\n (SELECT count(*) FROM recon) AS mismatches,\n (SELECT COALESCE(sum(abs(gtran_sum-glmt_net)),0) FROM recon) AS total_abs_diff,\n (SELECT string_agg(acct::text||chr(47)||yr||chr(47)||period||' d='||round(gtran_sum-glmt_net,2)::text, '; ')\n FROM (SELECT * FROM recon ORDER BY abs(gtran_sum-glmt_net) DESC LIMIT 5) z) AS worst",
"run_on": "success"
}
]
}

91
config/modules/gtran.sql Normal file
View File

@ -0,0 +1,91 @@
SELECT
"DKACC#" AS "dkacc#",
DKFSPR AS dkfspr,
RTRIM(DKJRTP) AS dkjrtp,
CASE WHEN DKTDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE DKTDAT END AS dktdat,
RTRIM(DKSRCE) AS dksrce,
DKAMT AS dkamt,
RTRIM("DKREF#") AS "dkref#",
RTRIM(DKREFD) AS dkrefd,
RTRIM(DKADDD) AS dkaddd,
RTRIM(DKREV) AS dkrev,
RTRIM(DKREVS) AS dkrevs,
DKFSYR AS dkfsyr,
DKFSYY AS dkfsyy,
RTRIM(DKPOST) AS dkpost,
CASE WHEN DKPDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE DKPDAT END AS dkpdat,
"DKBTC#" AS "dkbtc#",
RTRIM(DKQUAL) AS dkqual,
RTRIM(DKKEYN) AS dkkeyn,
RTRIM(DKPART) AS dkpart,
RTRIM(DKPJNM) AS dkpjnm,
DKQTY AS dkqty,
RTRIM(DKUNIT) AS dkunit,
RTRIM(DKFUT1) AS dkfut1,
RTRIM(DKFUT2) AS dkfut2,
RTRIM(DKFUT3) AS dkfut3,
RTRIM(DKFUT4) AS dkfut4,
RTRIM(DKFUT5) AS dkfut5,
RTRIM(DKFUT6) AS dkfut6,
DKFUT7 AS dkfut7,
RTRIM(DKFUT8) AS dkfut8,
RTRIM(DKFUT9) AS dkfut9,
RTRIM(DKFUT10) AS dkfut10,
RTRIM(DKFUT11) AS dkfut11,
RTRIM(DKFUT12) AS dkfut12,
RTRIM(DKFUT13) AS dkfut13,
DKFUT14 AS dkfut14,
DKFUT15 AS dkfut15,
DKFUT16 AS dkfut16,
DKFUT17 AS dkfut17,
RTRIM(DKFUT18) AS dkfut18,
RTRIM(DKFUT19) AS dkfut19,
RTRIM(DKFUT20) AS dkfut20,
RTRIM(DKEMCD) AS dkemcd,
RTRIM(DKMINS) AS dkmins,
RTRIM(DKTERR) AS dkterr,
"DKORD#" AS "dkord#",
RTRIM(DKBCUS) AS dkbcus,
DKLABH AS dklabh,
RTRIM(DKCPYT) AS dkcpyt,
RTRIM(DKCPYF) AS dkcpyf,
RTRIM(DKCLSC) AS dkclsc,
DKCFAN AS dkcfan,
DKJRNN AS dkjrnn,
RTRIM(DKMJSC) AS dkmjsc,
DKBCID AS dkbcid,
RTRIM(DKBSRF) AS dkbsrf,
DKRCID AS dkrcid,
DKTMS AS dktms,
RTRIM(DKVEND) AS dkvend,
DKADRN AS dkadrn,
RTRIM(DKUSR) AS dkusr,
DKWTYET AS dkwtyet,
DKXRTE2 AS dkxrte2,
DKXRTE3 AS dkxrte3,
RTRIM(DKJECU) AS dkjecu,
DKILIN AS dkilin,
RTRIM(DKJREFC) AS dkjrefc,
RTRIM(DKDKENT) AS dkdkent,
DKARBTC AS dkarbtc,
RTRIM(DKDTLP) AS dkdtlp,
RTRIM(DKCFBR) AS dkcfbr,
DKPBTID AS dkpbtid,
DKPBTID2 AS dkpbtid2,
DKLBTID AS dklbtid,
DKLBTID2 AS dklbtid2,
RTRIM(DKFUT21) AS dkfut21,
RTRIM(DKFUT22) AS dkfut22,
RTRIM(DKFUT23) AS dkfut23,
RTRIM(DKFUT24) AS dkfut24,
RTRIM(DKFUT25) AS dkfut25,
RTRIM(DKFUT26) AS dkfut26,
RTRIM(DKFUT27) AS dkfut27,
RTRIM(DKFUT28) AS dkfut28,
RTRIM(DKFUT29) AS dkfut29,
DKFUT30 AS dkfut30,
DKFUT31 AS dkfut31,
DKFUT32 AS dkfut32,
DKFUT33 AS dkfut33
FROM LGDAT.GTRAN
WHERE DKTMS > '{gtran_tms}'

351
config/modules/icstm.json Normal file
View File

@ -0,0 +1,351 @@
{
"name": "icstm",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.icstm",
"staging_table": "pipekit_staging.icstm",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Inventory Costs - Manufactured parts 6.1",
"columns": [
{
"source_name": "CGPART",
"source_type": "CHAR(20)",
"dest_name": "cgpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "CGLABS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cglabs",
"dest_type": "numeric(13,5)",
"description": "Labour Standard"
},
{
"source_name": "CGMATS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgmats",
"dest_type": "numeric(13,5)",
"description": "Material Standard"
},
{
"source_name": "CGBURS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgburs",
"dest_type": "numeric(13,5)",
"description": "Burden Standard"
},
{
"source_name": "CGLABA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cglaba",
"dest_type": "numeric(13,5)",
"description": "Labour Actual"
},
{
"source_name": "CGMATA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgmata",
"dest_type": "numeric(13,5)",
"description": "Material Actual"
},
{
"source_name": "CGBURA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbura",
"dest_type": "numeric(13,5)",
"description": "Burden Actual"
},
{
"source_name": "CGLABV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cglabv",
"dest_type": "numeric(13,5)",
"description": "Labour Average"
},
{
"source_name": "CGMATV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgmatv",
"dest_type": "numeric(13,5)",
"description": "Material Average"
},
{
"source_name": "CGBURV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgburv",
"dest_type": "numeric(13,5)",
"description": "Burden Average"
},
{
"source_name": "CGTPTD",
"source_type": "DECIMAL(11,0)",
"dest_name": "cgtptd",
"dest_type": "numeric(11,0)",
"description": "Total Prod. To Date"
},
{
"source_name": "CGSDAT",
"source_type": "DATE",
"dest_name": "cgsdat",
"dest_type": "date",
"description": "Standard Date"
},
{
"source_name": "CGSTCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgstcs",
"dest_type": "numeric(13,5)",
"description": "Standard Cost"
},
{
"source_name": "CGACCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgaccs",
"dest_type": "numeric(13,5)",
"description": "Actual Cost"
},
{
"source_name": "CGAVCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgavcs",
"dest_type": "numeric(13,5)",
"description": "Average Cost"
},
{
"source_name": "CGSTOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgstoc",
"dest_type": "numeric(13,5)",
"description": "Other Costs (Standard)"
},
{
"source_name": "CGACOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgacoc",
"dest_type": "numeric(13,5)",
"description": "Other Costs (Actual)"
},
{
"source_name": "CGAVOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgavoc",
"dest_type": "numeric(13,5)",
"description": "Other Costs (Average)"
},
{
"source_name": "CGSQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "cgsqty",
"dest_type": "numeric(8,0)",
"description": "Standard Quantity"
},
{
"source_name": "CGAQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "cgaqty",
"dest_type": "numeric(8,0)",
"description": "Actual Quantity"
},
{
"source_name": "CGTYPE",
"source_type": "CHAR(1)",
"dest_name": "cgtype",
"dest_type": "text",
"description": "Part Type M"
},
{
"source_name": "CGBRFS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbrfs",
"dest_type": "numeric(13,5)",
"description": "Burden Standard Fixed"
},
{
"source_name": "CGBRVS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbrvs",
"dest_type": "numeric(13,5)",
"description": "Burden Standard Variable"
},
{
"source_name": "CGBRFA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbrfa",
"dest_type": "numeric(13,5)",
"description": "Burden Actual Fixed"
},
{
"source_name": "CGBRVA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbrva",
"dest_type": "numeric(13,5)",
"description": "Burden Actual Variable"
},
{
"source_name": "CGBRFV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbrfv",
"dest_type": "numeric(13,5)",
"description": "Burden Average Fixed"
},
{
"source_name": "CGBRVV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgbrvv",
"dest_type": "numeric(13,5)",
"description": "Burden Average Variable"
},
{
"source_name": "CGFUTS",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgfuts",
"dest_type": "numeric(13,5)",
"description": "Future Standard"
},
{
"source_name": "CGFUTA",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgfuta",
"dest_type": "numeric(13,5)",
"description": "Future Actual"
},
{
"source_name": "CGFUTV",
"source_type": "NUMERIC(13,5)",
"dest_name": "cgfutv",
"dest_type": "numeric(13,5)",
"description": "Future Average"
},
{
"source_name": "CGPLNT",
"source_type": "CHAR(3)",
"dest_name": "cgplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "CGFUT1",
"source_type": "CHAR(3)",
"dest_name": "cgfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT2",
"source_type": "CHAR(10)",
"dest_name": "cgfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT3",
"source_type": "CHAR(20)",
"dest_name": "cgfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT4",
"source_type": "NUMERIC(15,0)",
"dest_name": "cgfut4",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "CGFUT5",
"source_type": "NUMERIC(15,0)",
"dest_name": "cgfut5",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "CGFLG1",
"source_type": "CHAR(1)",
"dest_name": "cgflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFLG2",
"source_type": "CHAR(1)",
"dest_name": "cgflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFLG3",
"source_type": "CHAR(1)",
"dest_name": "cgflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT6",
"source_type": "CHAR(10)",
"dest_name": "cgfut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT7",
"source_type": "CHAR(10)",
"dest_name": "cgfut7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT8",
"source_type": "CHAR(20)",
"dest_name": "cgfut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT9",
"source_type": "CHAR(20)",
"dest_name": "cgfut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT10",
"source_type": "CHAR(30)",
"dest_name": "cgfut10",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT11",
"source_type": "CHAR(30)",
"dest_name": "cgfut11",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CGFUT12",
"source_type": "NUMERIC(15,5)",
"dest_name": "cgfut12",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "CGFUT13",
"source_type": "NUMERIC(15,5)",
"dest_name": "cgfut13",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "CGFUT14",
"source_type": "NUMERIC(15,5)",
"dest_name": "cgfut14",
"dest_type": "numeric(15,5)",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

50
config/modules/icstm.sql Normal file
View File

@ -0,0 +1,50 @@
SELECT
RTRIM(CGPART) AS cgpart,
CGLABS AS cglabs,
CGMATS AS cgmats,
CGBURS AS cgburs,
CGLABA AS cglaba,
CGMATA AS cgmata,
CGBURA AS cgbura,
CGLABV AS cglabv,
CGMATV AS cgmatv,
CGBURV AS cgburv,
CGTPTD AS cgtptd,
CASE WHEN CGSDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE CGSDAT END AS cgsdat,
CGSTCS AS cgstcs,
CGACCS AS cgaccs,
CGAVCS AS cgavcs,
CGSTOC AS cgstoc,
CGACOC AS cgacoc,
CGAVOC AS cgavoc,
CGSQTY AS cgsqty,
CGAQTY AS cgaqty,
RTRIM(CGTYPE) AS cgtype,
CGBRFS AS cgbrfs,
CGBRVS AS cgbrvs,
CGBRFA AS cgbrfa,
CGBRVA AS cgbrva,
CGBRFV AS cgbrfv,
CGBRVV AS cgbrvv,
CGFUTS AS cgfuts,
CGFUTA AS cgfuta,
CGFUTV AS cgfutv,
RTRIM(CGPLNT) AS cgplnt,
RTRIM(CGFUT1) AS cgfut1,
RTRIM(CGFUT2) AS cgfut2,
RTRIM(CGFUT3) AS cgfut3,
CGFUT4 AS cgfut4,
CGFUT5 AS cgfut5,
RTRIM(CGFLG1) AS cgflg1,
RTRIM(CGFLG2) AS cgflg2,
RTRIM(CGFLG3) AS cgflg3,
RTRIM(CGFUT6) AS cgfut6,
RTRIM(CGFUT7) AS cgfut7,
RTRIM(CGFUT8) AS cgfut8,
RTRIM(CGFUT9) AS cgfut9,
RTRIM(CGFUT10) AS cgfut10,
RTRIM(CGFUT11) AS cgfut11,
CGFUT12 AS cgfut12,
CGFUT13 AS cgfut13,
CGFUT14 AS cgfut14
FROM LGDAT.ICSTM

435
config/modules/icstp.json Normal file
View File

@ -0,0 +1,435 @@
{
"name": "icstp",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.icstp",
"staging_table": "pipekit_staging.icstp",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Inventory Cost Master - Purchased Parts 6.1",
"columns": [
{
"source_name": "CHPART",
"source_type": "CHAR(20)",
"dest_name": "chpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "CHLUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chluc",
"dest_type": "numeric(13,5)",
"description": "Last Unit Cost"
},
{
"source_name": "CHLCC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chlcc",
"dest_type": "numeric(13,5)",
"description": "Last Currency Cost"
},
{
"source_name": "CHLFC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chlfc",
"dest_type": "numeric(13,5)",
"description": "Last Freight Cost"
},
{
"source_name": "CHLDC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chldc",
"dest_type": "numeric(13,5)",
"description": "Last Duty Cost"
},
{
"source_name": "CHL1C",
"source_type": "NUMERIC(13,5)",
"dest_name": "chl1c",
"dest_type": "numeric(13,5)",
"description": "Last Multiplier-1 Cost"
},
{
"source_name": "CHL2C",
"source_type": "NUMERIC(13,5)",
"dest_name": "chl2c",
"dest_type": "numeric(13,5)",
"description": "Last Multiplier-2 Cost"
},
{
"source_name": "CHSUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chsuc",
"dest_type": "numeric(13,5)",
"description": "Standard Unit Cost"
},
{
"source_name": "CHSCC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chscc",
"dest_type": "numeric(13,5)",
"description": "Standard Currency Cost"
},
{
"source_name": "CHSFC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chsfc",
"dest_type": "numeric(13,5)",
"description": "Standard Freight Cost"
},
{
"source_name": "CHSDC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chsdc",
"dest_type": "numeric(13,5)",
"description": "Standard Duty Cost"
},
{
"source_name": "CHS1C",
"source_type": "NUMERIC(13,5)",
"dest_name": "chs1c",
"dest_type": "numeric(13,5)",
"description": "Standard Multiplier-1 Cost"
},
{
"source_name": "CHS2C",
"source_type": "NUMERIC(13,5)",
"dest_name": "chs2c",
"dest_type": "numeric(13,5)",
"description": "Standard Multiplier-2 Cost"
},
{
"source_name": "CHSCR",
"source_type": "DECIMAL(11,6)",
"dest_name": "chscr",
"dest_type": "numeric(11,6)",
"description": "Standard Currency Rate"
},
{
"source_name": "CHLCR",
"source_type": "DECIMAL(11,6)",
"dest_name": "chlcr",
"dest_type": "numeric(11,6)",
"description": "Last Currency Rate"
},
{
"source_name": "CHSDAT",
"source_type": "DATE",
"dest_name": "chsdat",
"dest_type": "date",
"description": "Standard Date"
},
{
"source_name": "CHSTCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "chstcs",
"dest_type": "numeric(13,5)",
"description": "Standard Cost"
},
{
"source_name": "CHACCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "chaccs",
"dest_type": "numeric(13,5)",
"description": "Last Actual Cost"
},
{
"source_name": "CHAVCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "chavcs",
"dest_type": "numeric(13,5)",
"description": "Average Cost"
},
{
"source_name": "CHSDR",
"source_type": "NUMERIC(8,4)",
"dest_name": "chsdr",
"dest_type": "numeric(8,4)",
"description": "Standard Duty Rate"
},
{
"source_name": "CHS1R",
"source_type": "NUMERIC(8,4)",
"dest_name": "chs1r",
"dest_type": "numeric(8,4)",
"description": "Standard Multiplier-1"
},
{
"source_name": "CHS2R",
"source_type": "NUMERIC(8,4)",
"dest_name": "chs2r",
"dest_type": "numeric(8,4)",
"description": "Standard Multiplier-2"
},
{
"source_name": "CHLDR",
"source_type": "NUMERIC(8,4)",
"dest_name": "chldr",
"dest_type": "numeric(8,4)",
"description": "Last Duty Rate"
},
{
"source_name": "CHL1R",
"source_type": "NUMERIC(8,4)",
"dest_name": "chl1r",
"dest_type": "numeric(8,4)",
"description": "Last Multiplier-1"
},
{
"source_name": "CHL2R",
"source_type": "NUMERIC(8,4)",
"dest_name": "chl2r",
"dest_type": "numeric(8,4)",
"description": "Last Multiplier-2"
},
{
"source_name": "CHSQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "chsqty",
"dest_type": "numeric(8,0)",
"description": "Standard Quantity"
},
{
"source_name": "CHAQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "chaqty",
"dest_type": "numeric(8,0)",
"description": "Actual Quantity"
},
{
"source_name": "CHTYPE",
"source_type": "CHAR(1)",
"dest_name": "chtype",
"dest_type": "text",
"description": "Part Type R"
},
{
"source_name": "CHCURR",
"source_type": "CHAR(3)",
"dest_name": "chcurr",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "CHSDWC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chsdwc",
"dest_type": "numeric(13,5)",
"description": "Standard Warehouse Cha rge"
},
{
"source_name": "CHACWC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chacwc",
"dest_type": "numeric(13,5)",
"description": "Last Warehouse Charge"
},
{
"source_name": "CHPLNT",
"source_type": "CHAR(3)",
"dest_name": "chplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "CHAVUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chavuc",
"dest_type": "numeric(13,5)",
"description": "Average Unit cost"
},
{
"source_name": "CHAVXC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chavxc",
"dest_type": "numeric(13,5)",
"description": "Average Xchg cost"
},
{
"source_name": "CHAVDC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chavdc",
"dest_type": "numeric(13,5)",
"description": "Average Duty cost"
},
{
"source_name": "CHAV1C",
"source_type": "NUMERIC(13,5)",
"dest_name": "chav1c",
"dest_type": "numeric(13,5)",
"description": "Average Multiplier-1 Cost"
},
{
"source_name": "CHAV2C",
"source_type": "NUMERIC(13,5)",
"dest_name": "chav2c",
"dest_type": "numeric(13,5)",
"description": "Average Multiplier-2 Cost"
},
{
"source_name": "CHAVFC",
"source_type": "NUMERIC(13,5)",
"dest_name": "chavfc",
"dest_type": "numeric(13,5)",
"description": "Average Freight cost"
},
{
"source_name": "CHFUT1",
"source_type": "CHAR(3)",
"dest_name": "chfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT2",
"source_type": "CHAR(10)",
"dest_name": "chfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT3",
"source_type": "CHAR(20)",
"dest_name": "chfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT4",
"source_type": "NUMERIC(15,0)",
"dest_name": "chfut4",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "CHFUT5",
"source_type": "NUMERIC(15,0)",
"dest_name": "chfut5",
"dest_type": "numeric(15,0)",
"description": "Future Use"
},
{
"source_name": "CHFLG1",
"source_type": "CHAR(1)",
"dest_name": "chflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFLG2",
"source_type": "CHAR(1)",
"dest_name": "chflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFLG3",
"source_type": "CHAR(1)",
"dest_name": "chflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFLG4",
"source_type": "CHAR(1)",
"dest_name": "chflg4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFLG5",
"source_type": "CHAR(1)",
"dest_name": "chflg5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFLG6",
"source_type": "CHAR(1)",
"dest_name": "chflg6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFLG7",
"source_type": "CHAR(1)",
"dest_name": "chflg7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHCRCD",
"source_type": "CHAR(3)",
"dest_name": "chcrcd",
"dest_type": "text",
"description": "Last Actual Currency"
},
{
"source_name": "CHFUT6",
"source_type": "CHAR(10)",
"dest_name": "chfut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT7",
"source_type": "CHAR(10)",
"dest_name": "chfut7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT8",
"source_type": "CHAR(20)",
"dest_name": "chfut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT9",
"source_type": "CHAR(20)",
"dest_name": "chfut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT10",
"source_type": "CHAR(30)",
"dest_name": "chfut10",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT11",
"source_type": "CHAR(30)",
"dest_name": "chfut11",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "CHFUT12",
"source_type": "NUMERIC(15,5)",
"dest_name": "chfut12",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "CHFUT13",
"source_type": "NUMERIC(15,5)",
"dest_name": "chfut13",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "CHFUT14",
"source_type": "NUMERIC(15,5)",
"dest_name": "chfut14",
"dest_type": "numeric(15,5)",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

62
config/modules/icstp.sql Normal file
View File

@ -0,0 +1,62 @@
SELECT
RTRIM(CHPART) AS chpart,
CHLUC AS chluc,
CHLCC AS chlcc,
CHLFC AS chlfc,
CHLDC AS chldc,
CHL1C AS chl1c,
CHL2C AS chl2c,
CHSUC AS chsuc,
CHSCC AS chscc,
CHSFC AS chsfc,
CHSDC AS chsdc,
CHS1C AS chs1c,
CHS2C AS chs2c,
CHSCR AS chscr,
CHLCR AS chlcr,
CASE WHEN CHSDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE CHSDAT END AS chsdat,
CHSTCS AS chstcs,
CHACCS AS chaccs,
CHAVCS AS chavcs,
CHSDR AS chsdr,
CHS1R AS chs1r,
CHS2R AS chs2r,
CHLDR AS chldr,
CHL1R AS chl1r,
CHL2R AS chl2r,
CHSQTY AS chsqty,
CHAQTY AS chaqty,
RTRIM(CHTYPE) AS chtype,
RTRIM(CHCURR) AS chcurr,
CHSDWC AS chsdwc,
CHACWC AS chacwc,
RTRIM(CHPLNT) AS chplnt,
CHAVUC AS chavuc,
CHAVXC AS chavxc,
CHAVDC AS chavdc,
CHAV1C AS chav1c,
CHAV2C AS chav2c,
CHAVFC AS chavfc,
RTRIM(CHFUT1) AS chfut1,
RTRIM(CHFUT2) AS chfut2,
RTRIM(CHFUT3) AS chfut3,
CHFUT4 AS chfut4,
CHFUT5 AS chfut5,
RTRIM(CHFLG1) AS chflg1,
RTRIM(CHFLG2) AS chflg2,
RTRIM(CHFLG3) AS chflg3,
RTRIM(CHFLG4) AS chflg4,
RTRIM(CHFLG5) AS chflg5,
RTRIM(CHFLG6) AS chflg6,
RTRIM(CHFLG7) AS chflg7,
RTRIM(CHCRCD) AS chcrcd,
RTRIM(CHFUT6) AS chfut6,
RTRIM(CHFUT7) AS chfut7,
RTRIM(CHFUT8) AS chfut8,
RTRIM(CHFUT9) AS chfut9,
RTRIM(CHFUT10) AS chfut10,
RTRIM(CHFUT11) AS chfut11,
CHFUT12 AS chfut12,
CHFUT13 AS chfut13,
CHFUT14 AS chfut14
FROM LGDAT.ICSTP

393
config/modules/icstr.json Normal file
View File

@ -0,0 +1,393 @@
{
"name": "icstr",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.icstr",
"staging_table": "pipekit_staging.icstr",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Inventory Cost Master-Transferred Parts6.1",
"columns": [
{
"source_name": "Y0PART",
"source_type": "CHAR(20)",
"dest_name": "y0part",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "Y0PLNT",
"source_type": "CHAR(3)",
"dest_name": "y0plnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "Y0STCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0stcs",
"dest_type": "numeric(13,5)",
"description": "Standard Cost"
},
{
"source_name": "Y0ACCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0accs",
"dest_type": "numeric(13,5)",
"description": "Last Actual Cost"
},
{
"source_name": "Y0AVCS",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0avcs",
"dest_type": "numeric(13,5)",
"description": "Average Cost"
},
{
"source_name": "Y0SUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0suc",
"dest_type": "numeric(13,5)",
"description": "Standard Unit Cost"
},
{
"source_name": "Y0SSHR",
"source_type": "DECIMAL(9,5)",
"dest_name": "y0sshr",
"dest_type": "numeric(9,5)",
"description": "Standard S & H Rate"
},
{
"source_name": "Y0SSHC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0sshc",
"dest_type": "numeric(13,5)",
"description": "Standard S & H Cost"
},
{
"source_name": "Y0SOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0soc",
"dest_type": "numeric(13,5)",
"description": "Standard Currency Cost"
},
{
"source_name": "Y0SDAT",
"source_type": "DATE",
"dest_name": "y0sdat",
"dest_type": "date",
"description": "Standard Date"
},
{
"source_name": "Y0SQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "y0sqty",
"dest_type": "numeric(8,0)",
"description": "Standard Quantity"
},
{
"source_name": "Y0LUC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0luc",
"dest_type": "numeric(13,5)",
"description": "Last Unit Cost"
},
{
"source_name": "Y0LSHC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0lshc",
"dest_type": "numeric(13,5)",
"description": "Last S & H Cost"
},
{
"source_name": "Y0LOC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0loc",
"dest_type": "numeric(13,5)",
"description": "Last Currency Cost"
},
{
"source_name": "Y0AQTY",
"source_type": "NUMERIC(8,0)",
"dest_name": "y0aqty",
"dest_type": "numeric(8,0)",
"description": "Actual Quantity"
},
{
"source_name": "Y0TYPE",
"source_type": "CHAR(1)",
"dest_name": "y0type",
"dest_type": "text",
"description": "Part Type T"
},
{
"source_name": "Y0SMAT",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0smat",
"dest_type": "numeric(13,5)",
"description": "Standard Material Cost"
},
{
"source_name": "Y0SLAB",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0slab",
"dest_type": "numeric(13,5)",
"description": "Standard Labour Cost"
},
{
"source_name": "Y0SVBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0svbr",
"dest_type": "numeric(13,5)",
"description": "Standard Variable Burden Cost"
},
{
"source_name": "Y0SFBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0sfbr",
"dest_type": "numeric(13,5)",
"description": "Standard Fixed Burden Cost"
},
{
"source_name": "Y0SOTC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0sotc",
"dest_type": "numeric(13,5)",
"description": "Standard Other Cost"
},
{
"source_name": "Y0LMAT",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0lmat",
"dest_type": "numeric(13,5)",
"description": "Last Actual Material Cost"
},
{
"source_name": "Y0LLAB",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0llab",
"dest_type": "numeric(13,5)",
"description": "Last Actual Labour Cost"
},
{
"source_name": "Y0LVBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0lvbr",
"dest_type": "numeric(13,5)",
"description": "Last Actual Variable Burden Cost"
},
{
"source_name": "Y0LFBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0lfbr",
"dest_type": "numeric(13,5)",
"description": "Last Actual Fixed Burden Cost"
},
{
"source_name": "Y0LOTC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0lotc",
"dest_type": "numeric(13,5)",
"description": "Last Actual Other Cost"
},
{
"source_name": "Y0AMAT",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0amat",
"dest_type": "numeric(13,5)",
"description": "Average Material Cost"
},
{
"source_name": "Y0ALAB",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0alab",
"dest_type": "numeric(13,5)",
"description": "Average Labour Cost"
},
{
"source_name": "Y0AVBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0avbr",
"dest_type": "numeric(13,5)",
"description": "Average Variable Burden Cost"
},
{
"source_name": "Y0AFBR",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0afbr",
"dest_type": "numeric(13,5)",
"description": "Average Fixed Burden Cost"
},
{
"source_name": "Y0AOTC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0aotc",
"dest_type": "numeric(13,5)",
"description": "Average Other Cost"
},
{
"source_name": "Y0AUNC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0aunc",
"dest_type": "numeric(13,5)",
"description": "Average Unit Cost"
},
{
"source_name": "Y0ASHC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0ashc",
"dest_type": "numeric(13,5)",
"description": "Average S & H Cost"
},
{
"source_name": "Y0ACRC",
"source_type": "NUMERIC(13,5)",
"dest_name": "y0acrc",
"dest_type": "numeric(13,5)",
"description": "Average Currency Cost"
},
{
"source_name": "Y0FUT1",
"source_type": "CHAR(3)",
"dest_name": "y0fut1",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "Y0FUT2",
"source_type": "CHAR(10)",
"dest_name": "y0fut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT3",
"source_type": "CHAR(20)",
"dest_name": "y0fut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT4",
"source_type": "NUMERIC(11,6)",
"dest_name": "y0fut4",
"dest_type": "numeric(11,6)",
"description": "Standard Currency Rate"
},
{
"source_name": "Y0FUT5",
"source_type": "NUMERIC(11,6)",
"dest_name": "y0fut5",
"dest_type": "numeric(11,6)",
"description": "Last Currency Rate"
},
{
"source_name": "Y0FLG1",
"source_type": "CHAR(1)",
"dest_name": "y0flg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FLG2",
"source_type": "CHAR(1)",
"dest_name": "y0flg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FLG3",
"source_type": "CHAR(1)",
"dest_name": "y0flg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0CRCD",
"source_type": "CHAR(3)",
"dest_name": "y0crcd",
"dest_type": "text",
"description": "Currency Code"
},
{
"source_name": "Y0STCR",
"source_type": "NUMERIC(11,6)",
"dest_name": "y0stcr",
"dest_type": "numeric(11,6)",
"description": "Standard Currency Rate"
},
{
"source_name": "Y0LSCR",
"source_type": "NUMERIC(11,6)",
"dest_name": "y0lscr",
"dest_type": "numeric(11,6)",
"description": "Last Currency Rate"
},
{
"source_name": "Y0FUT6",
"source_type": "CHAR(10)",
"dest_name": "y0fut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT7",
"source_type": "CHAR(10)",
"dest_name": "y0fut7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT8",
"source_type": "CHAR(20)",
"dest_name": "y0fut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT9",
"source_type": "CHAR(20)",
"dest_name": "y0fut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT10",
"source_type": "CHAR(30)",
"dest_name": "y0fut10",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT11",
"source_type": "CHAR(30)",
"dest_name": "y0fut11",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "Y0FUT12",
"source_type": "NUMERIC(15,5)",
"dest_name": "y0fut12",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "Y0FUT13",
"source_type": "NUMERIC(15,5)",
"dest_name": "y0fut13",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "Y0FUT14",
"source_type": "NUMERIC(15,5)",
"dest_name": "y0fut14",
"dest_type": "numeric(15,5)",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

56
config/modules/icstr.sql Normal file
View File

@ -0,0 +1,56 @@
SELECT
RTRIM(Y0PART) AS y0part,
RTRIM(Y0PLNT) AS y0plnt,
Y0STCS AS y0stcs,
Y0ACCS AS y0accs,
Y0AVCS AS y0avcs,
Y0SUC AS y0suc,
Y0SSHR AS y0sshr,
Y0SSHC AS y0sshc,
Y0SOC AS y0soc,
CASE WHEN Y0SDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE Y0SDAT END AS y0sdat,
Y0SQTY AS y0sqty,
Y0LUC AS y0luc,
Y0LSHC AS y0lshc,
Y0LOC AS y0loc,
Y0AQTY AS y0aqty,
RTRIM(Y0TYPE) AS y0type,
Y0SMAT AS y0smat,
Y0SLAB AS y0slab,
Y0SVBR AS y0svbr,
Y0SFBR AS y0sfbr,
Y0SOTC AS y0sotc,
Y0LMAT AS y0lmat,
Y0LLAB AS y0llab,
Y0LVBR AS y0lvbr,
Y0LFBR AS y0lfbr,
Y0LOTC AS y0lotc,
Y0AMAT AS y0amat,
Y0ALAB AS y0alab,
Y0AVBR AS y0avbr,
Y0AFBR AS y0afbr,
Y0AOTC AS y0aotc,
Y0AUNC AS y0aunc,
Y0ASHC AS y0ashc,
Y0ACRC AS y0acrc,
RTRIM(Y0FUT1) AS y0fut1,
RTRIM(Y0FUT2) AS y0fut2,
RTRIM(Y0FUT3) AS y0fut3,
Y0FUT4 AS y0fut4,
Y0FUT5 AS y0fut5,
RTRIM(Y0FLG1) AS y0flg1,
RTRIM(Y0FLG2) AS y0flg2,
RTRIM(Y0FLG3) AS y0flg3,
RTRIM(Y0CRCD) AS y0crcd,
Y0STCR AS y0stcr,
Y0LSCR AS y0lscr,
RTRIM(Y0FUT6) AS y0fut6,
RTRIM(Y0FUT7) AS y0fut7,
RTRIM(Y0FUT8) AS y0fut8,
RTRIM(Y0FUT9) AS y0fut9,
RTRIM(Y0FUT10) AS y0fut10,
RTRIM(Y0FUT11) AS y0fut11,
Y0FUT12 AS y0fut12,
Y0FUT13 AS y0fut13,
Y0FUT14 AS y0fut14
FROM LGDAT.ICSTR

386
config/modules/icstt.json Normal file
View File

@ -0,0 +1,386 @@
{
"name": "icstt",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.icstt",
"staging_table": "pipekit_staging.icstt",
"merge_strategy": "incremental",
"merge_key": "jhdate",
"enabled": 1,
"dest_description": "Inventory Cost Transaction Log 6.0",
"columns": [
{
"source_name": "JHPART",
"source_type": "CHAR(20)",
"dest_name": "jhpart",
"dest_type": "text",
"description": "Part Number"
},
{
"source_name": "JHDATE",
"source_type": "DATE",
"dest_name": "jhdate",
"dest_type": "date",
"description": "Transaction Date"
},
{
"source_name": "JHTIME",
"source_type": "TIME",
"dest_name": "jhtime",
"dest_type": "time without time zone",
"description": "Transaction Time"
},
{
"source_name": "JHJOB#",
"source_type": "CHAR(10)",
"dest_name": "jhjob#",
"dest_type": "text",
"description": "Job Number"
},
{
"source_name": "JHPONR",
"source_type": "DECIMAL(9,0)",
"dest_name": "jhponr",
"dest_type": "numeric",
"description": "Purchase Order Number"
},
{
"source_name": "JHPITM",
"source_type": "DECIMAL(3,0)",
"dest_name": "jhpitm",
"dest_type": "numeric",
"description": "Purchase Order Item"
},
{
"source_name": "JHUSER",
"source_type": "CHAR(10)",
"dest_name": "jhuser",
"dest_type": "text",
"description": "User ID"
},
{
"source_name": "JHPROG",
"source_type": "CHAR(10)",
"dest_name": "jhprog",
"dest_type": "text",
"description": "Program Number"
},
{
"source_name": "JHCQTY",
"source_type": "DECIMAL(15,5)",
"dest_name": "jhcqty",
"dest_type": "numeric",
"description": "Quantity in Units of Issue"
},
{
"source_name": "JHCTYP",
"source_type": "CHAR(1)",
"dest_name": "jhctyp",
"dest_type": "text",
"description": "Standard or Actual Cost (A/S)"
},
{
"source_name": "JHMATO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhmato",
"dest_type": "numeric",
"description": "Material Unit Cost (old)"
},
{
"source_name": "JHLABO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhlabo",
"dest_type": "numeric",
"description": "Labour Unit Cost (old)"
},
{
"source_name": "JHBURO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhburo",
"dest_type": "numeric",
"description": "Burden Unit Cost (old)"
},
{
"source_name": "JHOTHO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhotho",
"dest_type": "numeric",
"description": "Other Unit Cost (old)"
},
{
"source_name": "JHTOTO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhtoto",
"dest_type": "numeric",
"description": "Total Unit Cost (old)"
},
{
"source_name": "JHMATN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhmatn",
"dest_type": "numeric",
"description": "Material Unit Cost (new)"
},
{
"source_name": "JHLABN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhlabn",
"dest_type": "numeric",
"description": "Labour Unit Cost (new)"
},
{
"source_name": "JHBURN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhburn",
"dest_type": "numeric",
"description": "Burden Unit Cost (new)"
},
{
"source_name": "JHOTHN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhothn",
"dest_type": "numeric",
"description": "Other Unit Cost (new)"
},
{
"source_name": "JHTOTN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhtotn",
"dest_type": "numeric",
"description": "Total Unit Cost (new)"
},
{
"source_name": "JHBRFO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhbrfo",
"dest_type": "numeric",
"description": "Burden Unit Cost (Old Fixed)"
},
{
"source_name": "JHBRVO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhbrvo",
"dest_type": "numeric",
"description": "Burden Unit Cost (Old Var)"
},
{
"source_name": "JHBRFN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhbrfn",
"dest_type": "numeric",
"description": "Burden Unit Cost (New Fixed)"
},
{
"source_name": "JHBRVN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhbrvn",
"dest_type": "numeric",
"description": "Burden Unit Cost (New Variable)"
},
{
"source_name": "JHSHCO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhshco",
"dest_type": "numeric",
"description": "S & H Cost (old)"
},
{
"source_name": "JHCRCO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhcrco",
"dest_type": "numeric",
"description": "Currency Cost (old)"
},
{
"source_name": "JHSHCN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhshcn",
"dest_type": "numeric",
"description": "S & H Cost (new)"
},
{
"source_name": "JHCRCN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhcrcn",
"dest_type": "numeric",
"description": "Currency Cost (new)"
},
{
"source_name": "JHPLNT",
"source_type": "CHAR(3)",
"dest_name": "jhplnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "JHABSO",
"source_type": "CHAR(1)",
"dest_name": "jhabso",
"dest_type": "text",
"description": "Absorbed or NonAbsorbed Cost (1/2)"
},
{
"source_name": "JHBOML",
"source_type": "CHAR(1)",
"dest_name": "jhboml",
"dest_type": "text",
"description": "BOM Levels Recalculated (1=Yes,2=No)"
},
{
"source_name": "JHLLPT",
"source_type": "CHAR(1)",
"dest_name": "jhllpt",
"dest_type": "text",
"description": "Lower Level Parts Recalculated (1=Yes,2=No)"
},
{
"source_name": "JHCONQ",
"source_type": "NUMERIC(15,5)",
"dest_name": "jhconq",
"dest_type": "numeric",
"description": "Issued quantity Against this receipt"
},
{
"source_name": "JHCSTS",
"source_type": "CHAR(1)",
"dest_name": "jhcsts",
"dest_type": "text",
"description": "Quantity issued record status"
},
{
"source_name": "JHAVDN",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhavdn",
"dest_type": "numeric",
"description": "Duty cost New"
},
{
"source_name": "JHAVDO",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhavdo",
"dest_type": "numeric",
"description": "Duty cost Old"
},
{
"source_name": "JHAV1N",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhav1n",
"dest_type": "numeric",
"description": "Multiplier-1 Cost New"
},
{
"source_name": "JHAV1O",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhav1o",
"dest_type": "numeric",
"description": "Multiplier-1 Cost Old"
},
{
"source_name": "JHAV2N",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhav2n",
"dest_type": "numeric",
"description": "Multiplier-2 Cost New"
},
{
"source_name": "JHAV2O",
"source_type": "NUMERIC(13,5)",
"dest_name": "jhav2o",
"dest_type": "numeric",
"description": "Multiplier-2 Cost Old"
},
{
"source_name": "JHFUT1",
"source_type": "CHAR(3)",
"dest_name": "jhfut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JHFUT2",
"source_type": "CHAR(10)",
"dest_name": "jhfut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JHFUT3",
"source_type": "CHAR(20)",
"dest_name": "jhfut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JHFUT4",
"source_type": "NUMERIC(15,5)",
"dest_name": "jhfut4",
"dest_type": "numeric",
"description": "Future Use"
},
{
"source_name": "JHFUT5",
"source_type": "NUMERIC(15,5)",
"dest_name": "jhfut5",
"dest_type": "numeric",
"description": "Future Use"
},
{
"source_name": "JHFLG1",
"source_type": "CHAR(1)",
"dest_name": "jhflg1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JHFLG2",
"source_type": "CHAR(1)",
"dest_name": "jhflg2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JHFLG3",
"source_type": "CHAR(1)",
"dest_name": "jhflg3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JHRCID",
"source_type": "CHAR(12)",
"dest_name": "jhrcid",
"dest_type": "text",
"description": "Record ID"
},
{
"source_name": "JHCRCD",
"source_type": "CHAR(3)",
"dest_name": "jhcrcd",
"dest_type": "text",
"description": "Last Actual Currency"
},
{
"source_name": "JHOHQT",
"source_type": "NUMERIC(15,5)",
"dest_name": "jhohqt",
"dest_type": "numeric",
"description": "Current On-Hand Qty"
},
{
"source_name": "JHOQTA",
"source_type": "NUMERIC(15,5)",
"dest_name": "jhoqta",
"dest_type": "numeric",
"description": "Cost On-Hand Qty"
}
],
"watermarks": [
{
"name": "icstt_wm",
"connection": "usmidsap02",
"resolver_sql": "SELECT COALESCE(MAX(jhdate), DATE '2000-01-01') - 7 FROM cms.icstt WHERE jhdate <= current_date",
"default_value": null
}
],
"hooks": []
}

55
config/modules/icstt.sql Normal file
View File

@ -0,0 +1,55 @@
SELECT
RTRIM(JHPART) AS jhpart,
CASE WHEN JHDATE IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE JHDATE END AS jhdate,
JHTIME AS jhtime,
RTRIM("JHJOB#") AS "jhjob#",
JHPONR AS jhponr,
JHPITM AS jhpitm,
RTRIM(JHUSER) AS jhuser,
RTRIM(JHPROG) AS jhprog,
JHCQTY AS jhcqty,
RTRIM(JHCTYP) AS jhctyp,
JHMATO AS jhmato,
JHLABO AS jhlabo,
JHBURO AS jhburo,
JHOTHO AS jhotho,
JHTOTO AS jhtoto,
JHMATN AS jhmatn,
JHLABN AS jhlabn,
JHBURN AS jhburn,
JHOTHN AS jhothn,
JHTOTN AS jhtotn,
JHBRFO AS jhbrfo,
JHBRVO AS jhbrvo,
JHBRFN AS jhbrfn,
JHBRVN AS jhbrvn,
JHSHCO AS jhshco,
JHCRCO AS jhcrco,
JHSHCN AS jhshcn,
JHCRCN AS jhcrcn,
RTRIM(JHPLNT) AS jhplnt,
RTRIM(JHABSO) AS jhabso,
RTRIM(JHBOML) AS jhboml,
RTRIM(JHLLPT) AS jhllpt,
JHCONQ AS jhconq,
RTRIM(JHCSTS) AS jhcsts,
JHAVDN AS jhavdn,
JHAVDO AS jhavdo,
JHAV1N AS jhav1n,
JHAV1O AS jhav1o,
JHAV2N AS jhav2n,
JHAV2O AS jhav2o,
RTRIM(JHFUT1) AS jhfut1,
RTRIM(JHFUT2) AS jhfut2,
RTRIM(JHFUT3) AS jhfut3,
JHFUT4 AS jhfut4,
JHFUT5 AS jhfut5,
RTRIM(JHFLG1) AS jhflg1,
RTRIM(JHFLG2) AS jhflg2,
RTRIM(JHFLG3) AS jhflg3,
RTRIM(JHRCID) AS jhrcid,
RTRIM(JHCRCD) AS jhcrcd,
JHOHQT AS jhohqt,
JHOQTA AS jhoqta
FROM LGDAT.ICSTT
WHERE JHDATE >= '{icstt_wm}'

183
config/modules/iprca.json Normal file
View File

@ -0,0 +1,183 @@
{
"name": "iprca",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.iprca",
"staging_table": "pipekit_staging.iprca",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Pricing - Price List Code Description 6.1",
"columns": [
{
"source_name": "JAPLCD",
"source_type": "CHAR(5)",
"dest_name": "japlcd",
"dest_type": "text",
"description": "Price List"
},
{
"source_name": "JAPLDS",
"source_type": "CHAR(30)",
"dest_name": "japlds",
"dest_type": "text",
"description": "Price List Description"
},
{
"source_name": "JAPLD1",
"source_type": "CHAR(30)",
"dest_name": "japld1",
"dest_type": "text",
"description": "Price List Description"
},
{
"source_name": "JAPLD2",
"source_type": "CHAR(30)",
"dest_name": "japld2",
"dest_type": "text",
"description": "Price List Description"
},
{
"source_name": "JABQTP",
"source_type": "CHAR(1)",
"dest_name": "jabqtp",
"dest_type": "text",
"description": "Best Quantity Pricing"
},
{
"source_name": "JABQGN",
"source_type": "CHAR(1)",
"dest_name": "jabqgn",
"dest_type": "text",
"description": "Allow Global Re-Price"
},
{
"source_name": "JABQUN",
"source_type": "NUMERIC(10,0)",
"dest_name": "jabqun",
"dest_type": "numeric(10,0)",
"description": "Last Global Re-Price Run Date"
},
{
"source_name": "JAPLNT",
"source_type": "CHAR(3)",
"dest_name": "japlnt",
"dest_type": "text",
"description": "Plant Code"
},
{
"source_name": "JABQUT",
"source_type": "NUMERIC(6,0)",
"dest_name": "jabqut",
"dest_type": "numeric(6,0)",
"description": "Last Global Re-Price Run Time"
},
{
"source_name": "JALQUN",
"source_type": "NUMERIC(10,0)",
"dest_name": "jalqun",
"dest_type": "numeric(10,0)",
"description": "Last Global Re-Run Run Date"
},
{
"source_name": "JALQUT",
"source_type": "NUMERIC(6,0)",
"dest_name": "jalqut",
"dest_type": "numeric(6,0)",
"description": "Last Global Re-Run Run Time"
},
{
"source_name": "JAADISC",
"source_type": "CHAR(1)",
"dest_name": "jaadisc",
"dest_type": "text",
"description": "Apply Disc/Charge to Standard Sales Order"
},
{
"source_name": "JAHREAS",
"source_type": "CHAR(2)",
"dest_name": "jahreas",
"dest_type": "text",
"description": "Hold Reason"
},
{
"source_name": "JAFUT1",
"source_type": "CHAR(1)",
"dest_name": "jafut1",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT2",
"source_type": "CHAR(1)",
"dest_name": "jafut2",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT3",
"source_type": "CHAR(1)",
"dest_name": "jafut3",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT4",
"source_type": "CHAR(1)",
"dest_name": "jafut4",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT5",
"source_type": "CHAR(1)",
"dest_name": "jafut5",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT6",
"source_type": "CHAR(10)",
"dest_name": "jafut6",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT7",
"source_type": "CHAR(10)",
"dest_name": "jafut7",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT8",
"source_type": "CHAR(20)",
"dest_name": "jafut8",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT9",
"source_type": "CHAR(20)",
"dest_name": "jafut9",
"dest_type": "text",
"description": "Future Use"
},
{
"source_name": "JAFUT10",
"source_type": "NUMERIC(15,5)",
"dest_name": "jafut10",
"dest_type": "numeric(15,5)",
"description": "Future Use"
},
{
"source_name": "JAFUT11",
"source_type": "NUMERIC(15,5)",
"dest_name": "jafut11",
"dest_type": "numeric(15,5)",
"description": "Future Use"
}
],
"watermarks": [],
"hooks": []
}

26
config/modules/iprca.sql Normal file
View File

@ -0,0 +1,26 @@
SELECT
RTRIM(JAPLCD) AS japlcd,
RTRIM(JAPLDS) AS japlds,
RTRIM(JAPLD1) AS japld1,
RTRIM(JAPLD2) AS japld2,
RTRIM(JABQTP) AS jabqtp,
RTRIM(JABQGN) AS jabqgn,
JABQUN AS jabqun,
RTRIM(JAPLNT) AS japlnt,
JABQUT AS jabqut,
JALQUN AS jalqun,
JALQUT AS jalqut,
RTRIM(JAADISC) AS jaadisc,
RTRIM(JAHREAS) AS jahreas,
RTRIM(JAFUT1) AS jafut1,
RTRIM(JAFUT2) AS jafut2,
RTRIM(JAFUT3) AS jafut3,
RTRIM(JAFUT4) AS jafut4,
RTRIM(JAFUT5) AS jafut5,
RTRIM(JAFUT6) AS jafut6,
RTRIM(JAFUT7) AS jafut7,
RTRIM(JAFUT8) AS jafut8,
RTRIM(JAFUT9) AS jafut9,
JAFUT10 AS jafut10,
JAFUT11 AS jafut11
FROM LGDAT.IPRCA

351
config/modules/iprcb.json Normal file
View File

@ -0,0 +1,351 @@
{
"name": "iprcb",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.iprcb",
"staging_table": "pipekit_staging.iprcb",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "Pricing - PriceLlist Assignment",
"columns": [
{
"source_name": "JBTYPE",
"source_type": "CHAR(1)",
"dest_name": "jbtype",
"dest_type": "text",
"description": "Assignment Type"
},
{
"source_name": "JBCODE",
"source_type": "CHAR(8)",
"dest_name": "jbcode",
"dest_type": "text",
"description": "Customer /Class"
},
{
"source_name": "JBPLCD",
"source_type": "CHAR(5)",
"dest_name": "jbplcd",
"dest_type": "text",
"description": "Price List"
},
{
"source_name": "JBFDAT",
"source_type": "DATE",
"dest_name": "jbfdat",
"dest_type": "date",
"description": "Valid from"
},
{
"source_name": "JBTDAT",
"source_type": "DATE",
"dest_name": "jbtdat",
"dest_type": "date",
"description": "Valid to"
},
{
"source_name": "JBDISC",
"source_type": "CHAR(3)",
"dest_name": "jbdisc",
"dest_type": "text",
"description": "Discount Code"
},
{
"source_name": "JBDIST",
"source_type": "CHAR(1)",
"dest_name": "jbdist",
"dest_type": "text",
"description": "Discount Type"
},
{
"source_name": "JBUSEG",
"source_type": "CHAR(1)",
"dest_name": "jbuseg",
"dest_type": "text",
"description": "Assignment Usage"
},
{
"source_name": "JBFLG1",
"source_type": "CHAR(1)",
"dest_name": "jbflg1",
"dest_type": "text",
"description": "Future Flag 1"
},
{
"source_name": "JBFLG2",
"source_type": "CHAR(1)",
"dest_name": "jbflg2",
"dest_type": "text",
"description": "Future Flag 2"
},
{
"source_name": "JBFLG3",
"source_type": "CHAR(1)",
"dest_name": "jbflg3",
"dest_type": "text",
"description": "Future Flag 3"
},
{
"source_name": "JBFLG4",
"source_type": "CHAR(1)",
"dest_name": "jbflg4",
"dest_type": "text",
"description": "Future Flag 4"
},
{
"source_name": "JBFLG5",
"source_type": "CHAR(1)",
"dest_name": "jbflg5",
"dest_type": "text",
"description": "Future Flag 5"
},
{
"source_name": "JBFUT1",
"source_type": "CHAR(3)",
"dest_name": "jbfut1",
"dest_type": "text",
"description": "Future Use 1"
},
{
"source_name": "JBFUT2",
"source_type": "CHAR(3)",
"dest_name": "jbfut2",
"dest_type": "text",
"description": "Future Use 2"
},
{
"source_name": "JBFUT3",
"source_type": "CHAR(3)",
"dest_name": "jbfut3",
"dest_type": "text",
"description": "Future Use 3"
},
{
"source_name": "JBFUT4",
"source_type": "CHAR(3)",
"dest_name": "jbfut4",
"dest_type": "text",
"description": "Future Use 4"
},
{
"source_name": "JBFUT5",
"source_type": "CHAR(3)",
"dest_name": "jbfut5",
"dest_type": "text",
"description": "Future Use 5"
},
{
"source_name": "JBFUT6",
"source_type": "CHAR(5)",
"dest_name": "jbfut6",
"dest_type": "text",
"description": "Future Use 6"
},
{
"source_name": "JBFUT7",
"source_type": "CHAR(5)",
"dest_name": "jbfut7",
"dest_type": "text",
"description": "Future Use 7"
},
{
"source_name": "JBFUT8",
"source_type": "CHAR(5)",
"dest_name": "jbfut8",
"dest_type": "text",
"description": "Future Use 8"
},
{
"source_name": "JBFUT9",
"source_type": "CHAR(5)",
"dest_name": "jbfut9",
"dest_type": "text",
"description": "Future Use 9"
},
{
"source_name": "JBFUT10",
"source_type": "CHAR(5)",
"dest_name": "jbfut10",
"dest_type": "text",
"description": "Future Use 10"
},
{
"source_name": "JBFUT11",
"source_type": "CHAR(10)",
"dest_name": "jbfut11",
"dest_type": "text",
"description": "Last Update Date"
},
{
"source_name": "JBFUT12",
"source_type": "CHAR(10)",
"dest_name": "jbfut12",
"dest_type": "text",
"description": "Update By User ID"
},
{
"source_name": "JBFUT13",
"source_type": "CHAR(10)",
"dest_name": "jbfut13",
"dest_type": "text",
"description": "Future Use 13"
},
{
"source_name": "JBFUT14",
"source_type": "CHAR(10)",
"dest_name": "jbfut14",
"dest_type": "text",
"description": "Future Use 14"
},
{
"source_name": "JBFUT15",
"source_type": "CHAR(10)",
"dest_name": "jbfut15",
"dest_type": "text",
"description": "Future Use 15"
},
{
"source_name": "JBFUT16",
"source_type": "CHAR(20)",
"dest_name": "jbfut16",
"dest_type": "text",
"description": "Future Use 16"
},
{
"source_name": "JBFUT17",
"source_type": "CHAR(20)",
"dest_name": "jbfut17",
"dest_type": "text",
"description": "Future Use 17"
},
{
"source_name": "JBFUT18",
"source_type": "CHAR(20)",
"dest_name": "jbfut18",
"dest_type": "text",
"description": "Future Use 18"
},
{
"source_name": "JBFUT19",
"source_type": "CHAR(20)",
"dest_name": "jbfut19",
"dest_type": "text",
"description": "Future Use 19"
},
{
"source_name": "JBFUT20",
"source_type": "CHAR(20)",
"dest_name": "jbfut20",
"dest_type": "text",
"description": "Future Use 20"
},
{
"source_name": "JBFUT21",
"source_type": "CHAR(30)",
"dest_name": "jbfut21",
"dest_type": "text",
"description": "Future Use 21"
},
{
"source_name": "JBFUT22",
"source_type": "CHAR(30)",
"dest_name": "jbfut22",
"dest_type": "text",
"description": "Future Use 22"
},
{
"source_name": "JBFUT23",
"source_type": "CHAR(30)",
"dest_name": "jbfut23",
"dest_type": "text",
"description": "Future Use 23"
},
{
"source_name": "JBFUT24",
"source_type": "CHAR(30)",
"dest_name": "jbfut24",
"dest_type": "text",
"description": "Future Use 24"
},
{
"source_name": "JBFUT25",
"source_type": "CHAR(30)",
"dest_name": "jbfut25",
"dest_type": "text",
"description": "Future Use 25"
},
{
"source_name": "JBFUT26",
"source_type": "NUMERIC(10,0)",
"dest_name": "jbfut26",
"dest_type": "numeric(10,0)",
"description": "Future Use 26"
},
{
"source_name": "JBFUT27",
"source_type": "NUMERIC(10,0)",
"dest_name": "jbfut27",
"dest_type": "numeric(10,0)",
"description": "Future Use 27"
},
{
"source_name": "JBFUT28",
"source_type": "NUMERIC(10,0)",
"dest_name": "jbfut28",
"dest_type": "numeric(10,0)",
"description": "Future Use 28"
},
{
"source_name": "JBFUT29",
"source_type": "NUMERIC(10,0)",
"dest_name": "jbfut29",
"dest_type": "numeric(10,0)",
"description": "Future Use 29"
},
{
"source_name": "JBFUT30",
"source_type": "NUMERIC(10,0)",
"dest_name": "jbfut30",
"dest_type": "numeric(10,0)",
"description": "Future Use 30"
},
{
"source_name": "JBFUT31",
"source_type": "NUMERIC(15,5)",
"dest_name": "jbfut31",
"dest_type": "numeric(15,5)",
"description": "Future Use 31"
},
{
"source_name": "JBFUT32",
"source_type": "NUMERIC(15,5)",
"dest_name": "jbfut32",
"dest_type": "numeric(15,5)",
"description": "Future Use 32"
},
{
"source_name": "JBFUT33",
"source_type": "NUMERIC(15,5)",
"dest_name": "jbfut33",
"dest_type": "numeric(15,5)",
"description": "Future Use 33"
},
{
"source_name": "JBFUT34",
"source_type": "NUMERIC(15,5)",
"dest_name": "jbfut34",
"dest_type": "numeric(15,5)",
"description": "Future Use 34"
},
{
"source_name": "JBFUT35",
"source_type": "NUMERIC(15,5)",
"dest_name": "jbfut35",
"dest_type": "numeric(15,5)",
"description": "Future Use 35"
}
],
"watermarks": [],
"hooks": []
}

50
config/modules/iprcb.sql Normal file
View File

@ -0,0 +1,50 @@
SELECT
RTRIM(JBTYPE) AS jbtype,
RTRIM(JBCODE) AS jbcode,
RTRIM(JBPLCD) AS jbplcd,
CASE WHEN JBFDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE JBFDAT END AS jbfdat,
CASE WHEN JBTDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE JBTDAT END AS jbtdat,
RTRIM(JBDISC) AS jbdisc,
RTRIM(JBDIST) AS jbdist,
RTRIM(JBUSEG) AS jbuseg,
RTRIM(JBFLG1) AS jbflg1,
RTRIM(JBFLG2) AS jbflg2,
RTRIM(JBFLG3) AS jbflg3,
RTRIM(JBFLG4) AS jbflg4,
RTRIM(JBFLG5) AS jbflg5,
RTRIM(JBFUT1) AS jbfut1,
RTRIM(JBFUT2) AS jbfut2,
RTRIM(JBFUT3) AS jbfut3,
RTRIM(JBFUT4) AS jbfut4,
RTRIM(JBFUT5) AS jbfut5,
RTRIM(JBFUT6) AS jbfut6,
RTRIM(JBFUT7) AS jbfut7,
RTRIM(JBFUT8) AS jbfut8,
RTRIM(JBFUT9) AS jbfut9,
RTRIM(JBFUT10) AS jbfut10,
RTRIM(JBFUT11) AS jbfut11,
RTRIM(JBFUT12) AS jbfut12,
RTRIM(JBFUT13) AS jbfut13,
RTRIM(JBFUT14) AS jbfut14,
RTRIM(JBFUT15) AS jbfut15,
RTRIM(JBFUT16) AS jbfut16,
RTRIM(JBFUT17) AS jbfut17,
RTRIM(JBFUT18) AS jbfut18,
RTRIM(JBFUT19) AS jbfut19,
RTRIM(JBFUT20) AS jbfut20,
RTRIM(JBFUT21) AS jbfut21,
RTRIM(JBFUT22) AS jbfut22,
RTRIM(JBFUT23) AS jbfut23,
RTRIM(JBFUT24) AS jbfut24,
RTRIM(JBFUT25) AS jbfut25,
JBFUT26 AS jbfut26,
JBFUT27 AS jbfut27,
JBFUT28 AS jbfut28,
JBFUT29 AS jbfut29,
JBFUT30 AS jbfut30,
JBFUT31 AS jbfut31,
JBFUT32 AS jbfut32,
JBFUT33 AS jbfut33,
JBFUT34 AS jbfut34,
JBFUT35 AS jbfut35
FROM LGDAT.IPRCB

View File

@ -0,0 +1,64 @@
{
"name": "iprcbhc",
"source_connection": "S78030956",
"dest_connection": "usmidsap02",
"dest_table": "cms.iprcbhc",
"staging_table": "pipekit_staging.iprcbhc",
"merge_strategy": "full",
"merge_key": null,
"enabled": 1,
"dest_description": "HC Modified Price List Assignment",
"columns": [
{
"source_name": "JBPLVL",
"source_type": "CHAR(10)",
"dest_name": "jbplvl",
"dest_type": "text",
"description": "Price Level"
},
{
"source_name": "JBPLCD",
"source_type": "CHAR(5)",
"dest_name": "jbplcd",
"dest_type": "text",
"description": "Price List"
},
{
"source_name": "JBFDAT",
"source_type": "DATE",
"dest_name": "jbfdat",
"dest_type": "date",
"description": "Valid from"
},
{
"source_name": "JBTDAT",
"source_type": "DATE",
"dest_name": "jbtdat",
"dest_type": "date",
"description": "Valid to"
},
{
"source_name": "JBDISC",
"source_type": "DECIMAL(6,5)",
"dest_name": "jbdisc",
"dest_type": "numeric(6,5)",
"description": "Discount %"
},
{
"source_name": "JBMDAT",
"source_type": "DATE",
"dest_name": "jbmdat",
"dest_type": "date",
"description": "Last Maintained"
},
{
"source_name": "JBMUSR",
"source_type": "CHAR(10)",
"dest_name": "jbmusr",
"dest_type": "text",
"description": "Last Maintained By"
}
],
"watermarks": [],
"hooks": []
}

View File

@ -0,0 +1,9 @@
SELECT
RTRIM(JBPLVL) AS jbplvl,
RTRIM(JBPLCD) AS jbplcd,
CASE WHEN JBFDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE JBFDAT END AS jbfdat,
CASE WHEN JBTDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE JBTDAT END AS jbtdat,
JBDISC AS jbdisc,
CASE WHEN JBMDAT IN (DATE('0001-01-01'), DATE('9999-12-31')) THEN NULL ELSE JBMDAT END AS jbmdat,
RTRIM(JBMUSR) AS jbmusr
FROM "CMS.CUSLG".IPRCBHC

Some files were not shown because too many files have changed in this diff Show More