2018-06-25 00:37:05 -04:00
|
|
|
|
2018-06-28 00:16:32 -04:00
|
|
|
## general workflow overview
|
2018-06-25 18:14:49 -04:00
|
|
|
* initial setup
|
|
|
|
|
1. create a source
|
|
|
|
|
2. run import
|
|
|
|
|
3. setup regex
|
|
|
|
|
4. map all regex
|
|
|
|
|
* on-going usage
|
|
|
|
|
1. run import
|
|
|
|
|
2. address any new unmapped items
|
|
|
|
|
|
|
|
|
|
## source maintenance
|
2018-06-25 00:37:05 -04:00
|
|
|
|
|
|
|
|
```
|
2018-06-25 21:53:03 -04:00
|
|
|
+-------------------------------------------------------------------------------------------------+
|
|
|
|
|
| +-------------+ |
|
|
|
|
|
| |MAKE NEW | |
|
|
|
|
|
| +-------------+ |
|
|
|
|
|
| |
|
|
|
|
|
| existing sources source name |
|
|
|
|
|
| +--------------+ +---------------+ |
|
|
|
|
|
| |dcard | |dcard | |
|
|
|
|
|
| |hunt | +---------------+ |
|
|
|
|
|
| |pncc | data source |
|
|
|
|
|
| |paycom | +---------------+ |
|
|
|
|
|
| |adp | |client file | enum based on api functions |
|
|
|
|
|
| | | +---------------+ |
|
|
|
|
|
| | | loading function |
|
|
|
|
|
| | | +---------------+ |
|
|
|
|
|
| | | |cs^ parser | enum based on api functions |
|
|
|
|
|
| | | +---------------+ |
|
|
|
|
|
| | | schema |
|
|
|
|
|
| | | +----------------+ +------------+ |
|
|
|
|
|
| | | |default | |b: add new | |
|
|
|
|
|
| | | +----------------+ +------------+ |
|
|
|
|
|
| | | +------------------------------------------------------------+ |
|
|
|
|
|
| | | |path |data type |column name |constrai| |
|
|
|
|
|
| | | +------------------------------------------------------------+ |
|
|
|
|
|
| | | |{Post. Date} |date |post_date |X |delete |
|
|
|
|
|
| | | |{Amount} |numeric |amount |X |delete |
|
|
|
|
|
| | | |{Trans. Date} |date |trans_date |X |delete |
|
|
|
|
|
| | | |{Category} |text |category | |delete |
|
|
|
|
|
| | | |{Description} |text |descr | |delete |
|
|
|
|
|
| | | | | | | |add |
|
|
|
|
|
| +--------------+ +------------------------------------------------------------+ |
|
|
|
|
|
| |
|
|
|
|
|
| |
|
|
|
|
|
| |
|
|
|
|
|
| |
|
|
|
|
|
+-------------------------------------------------------------------------------------------------+
|
|
|
|
|
||Trans. Date|Post Date|Description |Amount|Category | |
|
|
|
|
|
|---------------------------------------------------------------------------------------------+ |
|
|
|
|
|
||1/2/2018 |1/2/2018 |GOOGLE *YOUTUBE VIDEOS G.CO/HELPPAY#CAP0H07TXV|4.26 |Services | |
|
|
|
|
|
||1/2/2018 |1/2/2018 |MICROSOFT *ONEDRIVE 800-642-7676 WA |4.26 |Services | |
|
|
|
|
|
||1/3/2018 |1/3/2018 |CLE CLINIC PT PMTS 216-445-6249 OHAK2C57F2F0B3|200 |Medical Services| |
|
|
|
|
|
+|1/4/2018 +1/4/2018 +AT&T *PAYMENT 800-288-2020 TX +57.14 +Services | |
|
|
|
|
|
| |
|
|
|
|
|
+-------------------------------------------------------------------------------------------------+
|
|
|
|
|
```
|
|
|
|
|
## regex maintenance
|
|
|
|
|
|
2018-06-25 22:43:24 -04:00
|
|
|
```
|
|
|
|
|
+-------------------------------------------------------------------------------------------------------------------------------------+
|
|
|
|
|
| |
|
|
|
|
|
| |
|
|
|
|
|
| filter - only apply to where these top level keys exist |
|
|
|
|
|
| sources name |
|
|
|
|
|
| +---------------+ +--------------+ +----------------------+----------------------+ |
|
|
|
|
|
| |dcard | |First 20 | |top level key | value | |
|
|
|
|
|
| |hunt | +--------------+ +---------------------------------------------+ |
|
|
|
|
|
| |pncc | source |key-name |certain value | |
|
|
|
|
|
| |pnco | +--------------+ | | | |
|
|
|
|
|
| |pncl | |dcard | | | | |
|
|
|
|
|
| |paycom | +--------------+ | | | |
|
|
|
|
|
| |adp | sequence | | | |
|
|
|
|
|
| | | +--------------+ +----------------------+----------------------+ |
|
|
|
|
|
| +---------------+ |1 | |
|
|
|
|
|
| targets +--------------+ |
|
|
|
|
|
| +---------------+ function |
|
|
|
|
|
| |check number|1 | +--------------+ |
|
|
|
|
|
| |strip commas|2 | |extract | enum extract, replace |
|
|
|
|
|
| |trans type |3 | +--------------+ |
|
|
|
|
|
| |currency |4 | |
|
|
|
|
|
| |parse ach |5 | +-----------------------------------+---------+-----------------------------------------------+ |
|
|
|
|
|
| | | | |key |map |fl|re|replace | newkey | | |
|
|
|
|
|
| | | | +---------------------------------------------------------------------------------------------+ |
|
|
|
|
|
| | | | |{Description} |y | |y | | f20 |.{1,20} |delete |
|
|
|
|
|
| | | | | | | | | | | |add |
|
|
|
|
|
| | | | | | | | | | | | |
|
|
|
|
|
| | | | | | | | | | | | |
|
|
|
|
|
| | | | +--------------+----+--+--+---------+---------+-----------------------------------------------+ |
|
|
|
|
|
| +------------+--+ |
|
|
|
|
|
| +-------------------------------------------------------------------------------------+ |
|
|
|
|
|
| |map |return value |party |reason |add column | |
|
|
|
|
|
| +-------------------------------------------------------------------------------------+ |
|
|
|
|
|
| |First 20|{"f20": "DISCOUNT DRUG MART 3"}|Discount Drug Mart|groceries | | |
|
|
|
|
|
| |First 20|{"f20": "TARGET STOW OH"} |Target |groceries | | |
|
|
|
|
|
| |First 20|{"f20": "WALMART GROCERY 800-"}|Walmart |groceries | | |
|
|
|
|
|
| |First 20|{"f20": "CIRCLE K 05416 STOW "}|Circle K |gasoline | | |
|
|
|
|
|
| |First 20|{"f20": "TARGET.COM * 800-591"}|Target |home supplies| | |
|
|
|
|
|
| |First 20|{"f20": "ACME NO. 17 STOW OH"} |Acme |groceries | | |
|
|
|
|
|
| |First 20|{"f20": "AT&T *PAYMENT 800-28"}|AT&T |internet | | |
|
|
|
|
|
| |First 20|{"f20": "AUTOZONE #0722 STOW "}|Autozone |auto maint | | |
|
|
|
|
|
| |First 20|{"f20": "BESTBUYCOM8055267948"}|BestBuy |home supplies| | |
|
|
|
|
|
| |First 20|{"f20": "BUFFALO WILD WINGS K"}|Buffalo Wild Wings|restaurante | | |
|
|
|
|
|
| |First 20|{"f20": "CASHBACK BONUS REDEM"}|Discover Card |financing | | |
|
|
|
|
|
| |First 20|{"f20": "CLE CLINIC PT PMTS 2"}|Cleveland Clinic |medical | | |
|
|
|
|
|
| | | | |
|
|
|
|
|
| +-------------------------------------------------------------------------------------+ |
|
|
|
|
|
+-------------------------------------------------------------------------------------------------------------------------------------+
|
|
|
|
|
|
|
|
|
|
```
|
