Commit Graph

40 Commits

Author SHA1 Message Date
Paul Trowbridge
271a55d6e3 include flag to rebuild; may not want to if due to layout change 2018-06-12 22:21:16 -04:00
Paul Trowbridge
13929a6e32 rewrite mapping script for new level in json def and two-part join to test if regex def has changed 2018-06-08 17:42:48 -04:00
Paul Trowbridge
5027c792ae try modifying the mult map set function 2018-06-08 00:48:07 -04:00
Paul Trowbridge
e122c4987b try modifying the mult map set function 2018-06-08 00:47:48 -04:00
Paul Trowbridge
f9aa2a31a6 add single def set 2018-06-04 00:54:23 -04:00
Paul Trowbridge
0e028af435 when setting the map regex, retain the whole json being supplied 2018-06-01 13:37:14 -04:00
Paul Trowbridge
da9e9b08f1 sort collateral on id that needs to be in view, alter view creation to include ids 2018-05-31 10:24:15 -04:00
Paul Trowbridge
dd718a35d6 do test regex but retain all underlying orig recs 2018-05-31 02:55:32 -04:00
Paul Trowbridge
d4a697f652 rename 2018-05-31 02:52:32 -04:00
Paul Trowbridge
9897cf1bee add basic regex test 2018-05-31 02:52:08 -04:00
4f96d433e7 exit if inbound is not different, and rebuild constrint key on tps.trans rows if the constraint defintion has changed 2018-05-31 01:42:28 -04:00
Paul Trowbridge
7b543dce39 rebuild hunt so that path is in curlies 2018-05-30 23:58:35 -04:00
Paul Trowbridge
a5baf90bd6 accomodate multiple map defintions at once in an array 2018-05-30 09:48:19 -04:00
Paul Trowbridge
ffb55cafa9 definition is stored in regex object 2018-05-30 08:57:10 -04:00
Paul Trowbridge
afb9981af0 move test scripts to associated source folder 2018-05-25 15:59:15 -04:00
Paul Trowbridge
5df092b7ad merge maps into new_table then join back to trans 2018-05-25 15:04:57 -04:00
Paul Trowbridge
1ff496e072 if no map, set allj to rec. allj still an issue tho 2018-05-25 14:22:23 -04:00
Paul Trowbridge
0196ba4c53 drop old files and start working on json storage scripts 2018-05-25 13:44:37 -04:00
Paul Trowbridge
8641b286e6 add logid to trans as well as foreign key 2018-05-25 12:52:16 -04:00
Paul Trowbridge
c6554831a1 make view creationg script use allj 2018-05-25 10:25:09 -04:00
Paul Trowbridge
39820d6051 test and modify building of view to be based on allj 2018-05-25 10:23:43 -04:00
Paul Trowbridge
cdba942e9e develop map values set 2018-05-25 10:09:12 -04:00
Paul Trowbridge
64d3a1f310 add source set test 2018-05-25 10:08:20 -04:00
Paul Trowbridge
850b2b9049 add map values set 2018-05-25 09:54:00 -04:00
Paul Trowbridge
7739aeb554 comment out raise notice 2018-05-25 09:12:53 -04:00
Paul Trowbridge
44db887b6a too much to list 2018-05-25 02:25:36 -04:00
Paul Trowbridge
92d56aaba2 start work on mapping values 2018-05-24 17:35:50 -04:00
Paul Trowbridge
02555012f5 cast items in and specify insert columns, create test script 2018-05-24 17:11:26 -04:00
Paul Trowbridge
f23da6f5ec accomodate history defintion of parse map 2018-05-24 17:03:55 -04:00
Paul Trowbridge
ad2a7ed68d convert map definintion set to take only a json 2018-05-24 17:01:03 -04:00
Paul Trowbridge
6de5ece3d0 add sample map def 2018-05-24 16:56:34 -04:00
Paul Trowbridge
8ec04081b9 setup files for import 2018-05-24 16:54:00 -04:00
Paul Trowbridge
5df85836cb start work on rebuilding import 2018-05-24 16:20:19 -04:00
Paul Trowbridge
46a1c94643 Merge branch 'dev_setup' of https://github.com/fleetside72/tps_etl into dev_setup 2018-05-24 13:22:50 -04:00
Paul Trowbridge
516653afa8 convert to functino from do block 2018-05-24 13:22:46 -04:00
Paul Trowbridge
cd311ee1ce add function to setup, drop dev set, add test script 2018-05-24 01:10:08 -04:00
Paul Trowbridge
a4f630ca54 add history column and create srce_set function 2018-05-24 00:49:10 -04:00
Paul Trowbridge
80406a2dc6 extrapolate a view from schema 2018-05-23 17:18:17 -04:00
Paul Trowbridge
eb8da0f6c5 get rid of validation steps not required 2018-05-23 00:32:15 -04:00
Paul Trowbridge
b6c1126ecb setup new files 2018-05-23 00:31:45 -04:00