Commit Graph

363 Commits

Author SHA1 Message Date
Paul Trowbridge
668ca9f44a update data from dcard to reflect to 2 field unique constrain, aggregate several unique constraonts back to 1 row per id 2017-10-15 23:31:51 -04:00
Paul Trowbridge
8bbf575f93 get rid of insert 2017-10-15 13:05:20 -04:00
Paul Trowbridge
f6ab0e42f5 change COPY command to dynamic due to column list 2017-10-14 01:48:13 -04:00
Paul Trowbridge
a0b3173741 add another variable to collect column list, add a serial column to temp, copy using column list, and then build json object based on json defn 2017-10-14 01:40:26 -04:00
Paul Trowbridge
c81a7c7dc4 extract key at import 2017-10-13 17:17:56 -04:00
Paul Trowbridge
dc9e160c3e set sequence to 1 2017-10-13 12:00:34 -04:00
Paul Trowbridge
5e8768e4a6 get rid of test insert data 2017-10-13 11:57:25 -04:00
Paul Trowbridge
811fbb90f2 add rebuild script 2017-10-13 11:41:43 -04:00
Paul Trowbridge
9040c3249e Merge branch 'wk' of https://github.com/fleetside72/tps_etl into wk 2017-10-13 09:19:20 -04:00
Paul Trowbridge
b3c0b3355c add credit cards 2017-10-13 09:18:48 -04:00
Paul Trowbridge
e58823ecb7 Merge branch 'pt' 2017-10-13 03:25:16 -04:00
Paul Trowbridge
94d9a501de add batch file to re-create database 2017-10-13 03:23:41 -04:00
Paul Trowbridge
cc567e86b9 merge wk 2017-10-13 03:06:51 -04:00
Paul Trowbridge
a41ea3cfa8 Merge branch 'pt' 2017-10-13 02:59:45 -04:00
Paul Trowbridge
e560e49686 get rid of commented out sample json 2017-10-13 02:55:28 -04:00
Paul Trowbridge
78ebfd5e8f change out to sql extension 2017-10-13 02:53:21 -04:00
Paul Trowbridge
76094b5fad change extension to sql 2017-10-13 02:52:58 -04:00
Paul Trowbridge
c7a92a27c8 push changes to pt branch of pg db 2017-10-13 02:50:29 -04:00
Paul Trowbridge
28451f749c change extension to sql 2017-10-13 02:46:28 -04:00
Paul Trowbridge
378300550f change packup params 2017-10-13 02:40:41 -04:00
Paul Trowbridge
1a5aa39651 get rid of commented json sample, swap for pt branch files 2017-10-13 02:40:23 -04:00
Paul Trowbridge
acc0ce0613 change schema extension 2017-10-13 02:28:11 -04:00
Paul Trowbridge
bcd628f93d get rid of deletes, add trans table 2017-10-13 02:27:10 -04:00
Paul Trowbridge
0a5f40ca1f get rid of deletes, add trans table 2017-10-11 13:50:13 -04:00
Paul Trowbridge
f5cc765ab5 remove clean option and change extension to sql 2017-10-11 13:48:21 -04:00
Paul Trowbridge
6e6f03eaad change dump folder 2017-10-11 13:46:38 -04:00
Paul Trowbridge
4cafbff49a filter for single source and add insert to trans 2017-10-11 13:44:56 -04:00
Paul Trowbridge
efd61f205a add COPY component 2017-10-11 11:59:52 -04:00
Paul Trowbridge
2986bb85c2 change ubm_schema from .backup to .sql 2017-10-11 11:59:06 -04:00
Paul Trowbridge
2afc229c6b backup files 2017-10-11 00:46:15 -04:00
Paul Trowbridge
ad5a178873 formatting 2017-10-11 00:29:38 -04:00
Paul Trowbridge
68d00a88d1 add backup batch file 2017-10-11 00:29:25 -04:00
Paul Trowbridge
39d734bb41 unwrap the newly created json arrangement and dynamically create a temp table 2017-10-11 00:17:21 -04:00
Paul Trowbridge
750d91b8e9 add discover transactions 2017-10-07 15:45:48 -04:00
Paul Trowbridge
8c0c37314e updates to receipts 2017-10-05 23:20:29 -04:00
Paul Trowbridge
ac07f561b0 build macro for creating record 2017-10-03 01:47:30 -04:00
Paul Trowbridge
02ad9b5179 Merge branch 'pt' 2017-10-02 21:41:19 -04:00
Paul Trowbridge
850a9c7dc3 add receipts 2017-10-02 21:40:49 -04:00
Paul Trowbridge
5a26e4d4e7 Merge branch 'pt' 2017-09-30 10:34:09 -04:00
Paul Trowbridge
babd9891a5 some type ofleftover change 2017-09-30 10:33:53 -04:00
Paul Trowbridge
000d79876a enter receipts 2017-09-30 10:31:53 -04:00
Paul Trowbridge
82c0286a4e Merge branch 'pt' 2017-09-27 23:04:16 -04:00
Paul Trowbridge
82f7bd88c7 add receipt 2017-09-27 22:46:05 -04:00
Paul Trowbridge
a2841728e1 add 2 receipts 2017-09-25 14:33:01 -04:00
Paul Trowbridge
c556065b89 Merge branch 'pt' into wk 2017-09-25 14:20:32 -04:00
Paul Trowbridge
3462964ea1 Merge branch 'master' of https://github.com/fleetside72/tps_etl 2017-09-20 00:13:12 -04:00
Paul Trowbridge
c4bb5acd16 expirement with different formats and add a receipt 2017-09-20 00:12:37 -04:00
Paul Trowbridge
4688b79a52 Merge branch 'pt' into wk 2017-09-19 11:32:38 -04:00
Paul Trowbridge
08c95d1595 add files clean up 2017-09-19 10:37:53 -04:00
Paul Trowbridge
76dca0d688 explore options on format 2017-09-19 07:17:38 -04:00