pt/tps
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Commit Graph

  • caf3ffe3b4 build template for applying gl on the server side per item with offset Paul Trowbridge 2017-11-01 01:12:33 -0400
  • 0b4a638430 thought on evt.log Paul Trowbridge 2017-10-30 17:38:50 -0400
  • 242ebb8029 add a conversion to pay_month Paul Trowbridge 2017-10-30 14:43:04 -0400
  • e9b185fc05 seperate out maps for ach credits vs debits Paul Trowbridge 2017-10-30 10:37:03 -0400
  • 9a8144a2e2 Merge branch 'pt' of https://github.com/fleetside72/tps_etl into pt Paul Trowbridge 2017-10-29 13:22:36 -0400
  • f056c9a3f9 update spreadsheets Paul Trowbridge 2017-10-29 13:22:25 -0400
  • 0ee5e0ce5f add thoughts on log gl modules, a module equates to a json schema pt motog5 2017-10-28 02:44:55 -0400
  • afa16ce925 add items to log and create summary pivot Paul Trowbridge 2017-10-28 02:35:24 -0400
  • 2d6212e3cd add index to srce and couple import jobs Paul Trowbridge 2017-10-27 16:26:00 -0400
  • 273b7c9673 limit mapper to allj records are null Paul Trowbridge 2017-10-27 15:50:42 -0400
  • fac52588ae update map to exclude 6 digits at end of company name Paul Trowbridge 2017-10-27 14:18:57 -0400
  • f88584f835 convert map flag to be at the regex item level Paul Trowbridge 2017-10-27 13:51:08 -0400
  • 417bdca27d move all current map_rm into update scripts for editing Paul Trowbridge 2017-10-27 13:23:08 -0400
  • b94948b1b9 add new mappings and clean up old ones Paul Trowbridge 2017-10-27 13:12:45 -0400
  • 2829887a57 get rid of bad maps Paul Trowbridge 2017-10-27 13:08:03 -0400
  • 30da16dd0a add map definition query Paul Trowbridge 2017-10-27 13:07:52 -0400
  • 4a62ca84b1 implement sequence of target, and insure that the link to the map does not return duplicates Paul Trowbridge 2017-10-27 13:06:44 -0400
  • 69d5698ff7 add transactions Paul Trowbridge 2017-10-27 01:45:38 -0400
  • 9293fbfd1f add transactions Paul Trowbridge 2017-10-27 01:44:55 -0400
  • e0c5cf47a5 build interpretation of evt.log for running totals Paul Trowbridge 2017-10-27 01:44:41 -0400
  • a5b48325a2 add jounral entries Paul Trowbridge 2017-10-27 01:04:04 -0400
  • 7ad5b8dd6f add column to event_log. demonstact GL extraction and load initial row Paul Trowbridge 2017-10-26 23:38:36 -0400
  • 2838ff4cc5 update maps Paul Trowbridge 2017-10-26 22:51:46 -0400
  • a3b2928619 Merge branch 'pt' Paul Trowbridge 2017-10-26 20:01:45 -0400
  • 6a97c5ca69 update schema Paul Trowbridge 2017-10-26 20:01:26 -0400
  • 3486281c7c revert back to pt branch rows of data Paul Trowbridge 2017-10-26 19:03:48 -0400
  • 11aa70684d merge wk Paul Trowbridge 2017-10-26 18:46:42 -0400
  • 6b08ea8fb8 add new maps, need to convert OBI & RFB maps to a single target Paul Trowbridge 2017-10-26 17:36:03 -0400
  • 3924776161 update readme Paul Trowbridge 2017-10-26 17:34:45 -0400
  • 9623853387 add map to parse all ACH transactions Paul Trowbridge 2017-10-26 17:34:37 -0400
  • 7eba5981ef trim retained values Paul Trowbridge 2017-10-26 17:34:21 -0400
  • 6a90cc4b32 add maps Paul Trowbridge 2017-10-26 14:31:37 -0400
  • 2448ccf641 add new map, add column for all json, and apply index Paul Trowbridge 2017-10-26 13:39:50 -0400
  • bf8e901ffd add intermediate selects, add coalesce to target aggregation since some items are SQL null, then apply a strip_nulls, but exclude from subsequent step. add update line at end Paul Trowbridge 2017-10-26 13:32:14 -0400
  • fb93f73b6c create another mapping approach to better handle option g on regexp_ functions. Paul Trowbridge 2017-10-26 12:15:58 -0400
  • 21c3f74de0 couple changes Paul Trowbridge 2017-10-26 00:26:20 -0400
  • 6b8d14ddb7 add running discover card balance Paul Trowbridge 2017-10-26 00:16:46 -0400
  • 1af3f05a1e overhaul of do_map, add seperate column for parse versus mapped, accomodate rexexp_replace Paul Trowbridge 2017-10-25 16:28:42 -0400
  • a01c5c1a04 add mapping template Paul Trowbridge 2017-10-25 15:21:13 -0400
  • 4a85732890 edit function to recognize slice of array, ad bank schema to hold types there, add function to json regex definition to accomodate differntiating extracts from replaces Paul Trowbridge 2017-10-25 12:07:04 -0400
  • 8929b4eea9 try using correlated subquery for unique list of keys, is pretty slow Paul Trowbridge 2017-10-25 12:05:28 -0400
  • ba4a404980 added partion by major item, and then sort on import id Paul Trowbridge 2017-10-25 10:45:24 -0400
  • 44373bc616 copy source template from pt branch Paul Trowbridge 2017-10-25 10:44:57 -0400
  • 65ee6d703b modify to print log info Paul Trowbridge 2017-10-25 10:44:32 -0400
  • 6056491ace merge srce changes from pt branch Paul Trowbridge 2017-10-25 09:07:51 -0400
  • a630f46833 add sqitch Paul Trowbridge 2017-10-25 01:35:21 -0400
  • 8c9cc81be4 add source, some trans, and trans_log records Paul Trowbridge 2017-10-25 01:07:07 -0400
  • bd39c3fd12 add source template Paul Trowbridge 2017-10-25 01:05:45 -0400
  • bfe602762a rename fle to srce_unq Paul Trowbridge 2017-10-25 00:57:41 -0400
  • ed1a903718 finish out logging the inserts and getting them into the main do block Paul Trowbridge 2017-10-25 00:47:26 -0400
  • e2d42467af catch up with wk branch Paul Trowbridge 2017-10-25 00:42:22 -0400
  • 937cf38af1 updates in progress Paul Trowbridge 2017-10-24 17:37:20 -0400
  • 57fa123adf add transaction log Paul Trowbridge 2017-10-23 10:13:32 -0400
  • 51fbec1244 push inserts into do block so they can consume local variables, need to setup log inserts Paul Trowbridge 2017-10-23 10:12:37 -0400
  • b3775210b5 merge pt branch updates Paul Trowbridge 2017-10-20 10:09:55 -0400
  • c7f88271c5 add map_rv and apply some mapping to trans Paul Trowbridge 2017-10-20 01:16:53 -0400
  • 1aa4cb938f build out map_rv Paul Trowbridge 2017-10-20 01:05:15 -0400
  • 7abb8ce65d only assign a map if an item actually joins to map_rv Paul Trowbridge 2017-10-20 01:04:56 -0400
  • ea0084ed75 update maps for first 20, get rid of pretty and tag on summary of mappings Paul Trowbridge 2017-10-19 23:57:03 -0400
  • 085f794693 merge with wk Paul Trowbridge 2017-10-19 22:22:11 -0400
  • 41cf7af55b merge wk for srce Paul Trowbridge 2017-10-19 22:13:28 -0400
  • ccd685ca22 implement retain flag to drop keys used only for linking to the appropriate map value, but not acutally included in the map Paul Trowbridge 2017-10-19 18:02:52 -0400
  • 9001c44b46 regex mapping script Paul Trowbridge 2017-10-19 17:39:52 -0400
  • 75d511f6a4 regex modification template Paul Trowbridge 2017-10-19 17:39:29 -0400
  • 2979fd3437 add jsonb object aggregate functions, change regex to jsonb, remove seq from primary key of map_rm, add foreign key to map_rv pointing map_rm Paul Trowbridge 2017-10-19 17:38:58 -0400
  • 351b83a206 alter regex defs to have a retention flag indicating if the return value shoudl be mapped or thrown away Paul Trowbridge 2017-10-19 17:37:46 -0400
  • 5369a39f34 add mapping tables & data Paul Trowbridge 2017-10-19 14:13:57 -0400
  • f203c7010a add calc columns to collateral Paul Trowbridge 2017-10-19 13:10:36 -0400
  • e68b3e0349 revise import to work with a set of unique keys in determining which rows to insert. prior used many of the same key, creating large duplication on join to tps Paul Trowbridge 2017-10-19 13:10:25 -0400
  • 2a2652e397 qualify the order by id Paul Trowbridge 2017-10-19 11:31:54 -0400
  • f0838b28c0 retain the id number in the json rec, and order by id asc before inserting to trans. if mult records per key, this helps sort Paul Trowbridge 2017-10-19 11:22:03 -0400
  • 2190f55acb add running collateral & loan balances Paul Trowbridge 2017-10-19 11:20:52 -0400
  • 774540a83e remove assn & coll Paul Trowbridge 2017-10-19 10:30:40 -0400
  • e03a5cdbac backup Paul Trowbridge 2017-10-19 10:29:33 -0400
  • e0f8bad70a add ADPRP Paul Trowbridge 2017-10-19 09:53:52 -0400
  • 1ae5298557 add index on tps.rec Paul Trowbridge 2017-10-19 09:25:42 -0400
  • dcf2fcbb6c update srce definitions Paul Trowbridge 2017-10-19 09:25:31 -0400
  • bc3cecec09 add order by clause Paul Trowbridge 2017-10-19 09:25:07 -0400
  • 995eb181c1 dont export tps.trans table Paul Trowbridge 2017-10-19 09:24:55 -0400
  • e0163382f9 added sources Paul Trowbridge 2017-10-19 08:49:33 -0400
  • c5a9dfe0db add order by clause on transactions range, add hungtington transactions, add data type to match sources Paul Trowbridge 2017-10-19 00:42:30 -0400
  • 5fabbd7fb3 add odbc query Paul Trowbridge 2017-10-19 00:41:24 -0400
  • dabd38b98b add huntington transactions Paul Trowbridge 2017-10-19 00:13:28 -0400
  • 419017f98c switch to PNCC Paul Trowbridge 2017-10-18 14:11:57 -0400
  • 748d6ddb3c merge summary of records not inserted from pt branch Paul Trowbridge 2017-10-18 14:10:07 -0400
  • a18774473b move exception union into CTE and summarize at end for records not inserted Paul Trowbridge 2017-10-18 02:07:33 -0400
  • 4f958485d5 merge pt Paul Trowbridge 2017-10-18 01:57:24 -0400
  • 9dbe11619f Merge branch 'pt' Paul Trowbridge 2017-10-18 01:51:10 -0400
  • 144fd62bd8 fix conflicts Paul Trowbridge 2017-10-18 01:49:09 -0400
  • 160002404c fix conflicts Paul Trowbridge 2017-10-18 01:48:22 -0400
  • c582d5f176 merge from c9 Paul Trowbridge 2017-10-18 01:45:44 -0400
  • e219827d93 more discover transactions Paul Trowbridge 2017-10-18 01:41:19 -0400
  • 4766f157fc get rid of id key in json, remove constraint Paul Trowbridge 2017-10-18 01:40:09 -0400
  • fe761c6975 include pt branch srce.pgsql changes & transaction range query Paul Trowbridge 2017-10-18 01:06:00 -0400
  • 7a83d1836e Merge branch 'pt' Paul Trowbridge 2017-10-18 01:03:27 -0400
  • 3afe033fa7 add transaction query and new data Paul Trowbridge 2017-10-18 01:01:54 -0400
  • 63a3bd3b97 snap to pt branch on srce.pgsql Paul Trowbridge 2017-10-18 01:00:10 -0400
  • a970e87b95 add discover transactions Paul Trowbridge 2017-10-18 00:57:40 -0400
  • 006a1b0103 and query to show range of key values in transation table Paul Trowbridge 2017-10-18 00:55:15 -0400
  • c123cbfa84 add insert as part of with a return rows not inserted, probably needs modified to show the keys not inserted and sorted Paul Trowbridge 2017-10-18 00:55:00 -0400