Commit Graph

386 Commits

Author SHA1 Message Date
Paul Trowbridge
ae77d01d51 add sql generation function to main setup 2018-05-24 13:26:41 -04:00
Paul Trowbridge
46a1c94643 Merge branch 'dev_setup' of https://github.com/fleetside72/tps_etl into dev_setup 2018-05-24 13:22:50 -04:00
Paul Trowbridge
516653afa8 convert to functino from do block 2018-05-24 13:22:46 -04:00
Paul Trowbridge
cd311ee1ce add function to setup, drop dev set, add test script 2018-05-24 01:10:08 -04:00
Paul Trowbridge
a4f630ca54 add history column and create srce_set function 2018-05-24 00:49:10 -04:00
Paul Trowbridge
80406a2dc6 extrapolate a view from schema 2018-05-23 17:18:17 -04:00
Paul Trowbridge
eb8da0f6c5 get rid of validation steps not required 2018-05-23 00:32:15 -04:00
Paul Trowbridge
b6c1126ecb setup new files 2018-05-23 00:31:45 -04:00
Paul Trowbridge
18a7bacb73 build out sql to deploy dev schemas 2018-05-22 17:38:35 -04:00
Paul Trowbridge
c886f910b1 include file to setup dev envrionment 2018-05-22 14:30:08 -04:00
Paul Trowbridge
1342ab44c9 include notion of multiple interpretations of the data 2018-05-21 17:24:50 -04:00
Paul Trowbridge
6f7f1ddeb3 additional test and update readme with decisions 2018-05-21 17:00:19 -04:00
Paul Trowbridge
e354d6c2b8 add notes about schema and table extraction 2018-05-21 00:02:33 -04:00
Paul Trowbridge
3c4d9772bb update for current ubm2 document 2018-05-21 00:02:08 -04:00
Paul Trowbridge
8728809ddc add fiels to feel out using path to extract 2018-05-21 00:01:57 -04:00
Paul Trowbridge
809df3ef52 add notes on definition schema 2018-05-20 15:53:04 -04:00
Paul Trowbridge
d3114d5759 add throughts on new source definition 2018-05-20 02:51:25 -04:00
Paul Trowbridge
ba6a06e30a add notes 2018-05-19 16:52:59 -04:00
Paul Trowbridge
2f2aa0926b Merge branch 'j_constr' into key_log 2018-03-13 00:46:12 -04:00
Paul Trowbridge
bb8b9f5181 add unmapped recs to schema 2018-03-13 00:38:00 -04:00
Paul Trowbridge
7a516d7a24 Merge branch 'j_constr' into key_log 2018-03-13 00:28:04 -04:00
Paul Trowbridge
ac2024de8c include original recs with unique maps 2018-03-10 14:04:51 -05:00
Paul Trowbridge
484a41a9b3 fix example mapping to exclude filters 2018-03-10 14:03:52 -05:00
Paul Trowbridge
8e4ba4ef28 Merge branch 'master' into key_log 2018-03-10 02:30:41 -05:00
Paul Trowbridge
9403e55c73 Merge branch 'master' into j_constr 2018-03-10 02:27:28 -05:00
Paul Trowbridge
3e970c65e2 2 lines 2018-03-10 02:27:19 -05:00
Paul Trowbridge
3acfc908b7 resolve merge from master 2018-03-10 02:25:13 -05:00
Paul Trowbridge
e00e682f02 get rid of wmpd 2018-03-10 02:20:55 -05:00
Paul Trowbridge
c4dcb6edc8 resolve merge 2018-03-10 02:16:17 -05:00
Paul Trowbridge
b190a39a8d resolver merge conflict 2018-03-10 02:14:33 -05:00
Paul Trowbridge
b65174a24f Merge branch 'master' into j_constr 2018-03-10 02:09:04 -05:00
Paul Trowbridge
3ea353a588 get rid of dcard2 2018-03-10 02:02:38 -05:00
Paul Trowbridge
15349d2b1a push constraint to seperate column 2018-03-10 01:58:43 -05:00
Paul Trowbridge
5dd2091752 remove create table 2018-03-10 01:47:26 -05:00
Paul Trowbridge
15e5001a89 add in the rest of the body 2018-03-10 01:41:39 -05:00
Paul Trowbridge
a1123efa40 add dev file for source import to dynamically run sql 2018-03-10 01:12:18 -05:00
fleetside72
f07f47ca32
Update readme.md 2018-03-09 11:34:30 -05:00
Paul Trowbridge
b6f14286d1 git rid of WMPD map 2018-03-08 01:54:16 -05:00
Paul Trowbridge
2555e14b74 contrain element defined, need to determine where to put it on insert 2018-03-08 01:50:57 -05:00
Paul Trowbridge
38ac338637 only first element of text array was being used for the json key 2018-03-08 01:42:26 -05:00
Paul Trowbridge
cce644740d update srce_set to take a singluar json as argument 2018-03-07 00:44:19 -05:00
Paul Trowbridge
2242e80e3a Merge branch 'master' of https://github.com/fleetside72/tps_etl 2018-03-06 17:48:55 -05:00
Paul Trowbridge
0992b00e92 rename and change to json, remove sql 2018-03-06 17:48:28 -05:00
Paul Trowbridge
0fbde23da5 Merge branch 'master' into key_log 2018-03-06 00:38:06 -05:00
fleetside72
c00a2ed994
Merge pull request #14 from fleetside72/update_docs
Update docs
2018-03-06 00:36:50 -05:00
Paul Trowbridge
fb1d1218b3 Merge branch 'update_docs' into key_log 2018-03-06 00:34:55 -05:00
Paul Trowbridge
0badc9f403 add interaction details 2018-03-06 00:28:37 -05:00
Paul Trowbridge
ff18ce5bd3 simplify readme 2018-03-05 23:34:53 -05:00
fleetside72
204afa8643
Merge pull request #13 from fleetside72/import_error
update import function to trap all error at the end
2018-03-05 22:41:54 -05:00
Paul Trowbridge
ea217e9c14 update import function to trap all error at the end 2018-03-05 22:12:31 -05:00