11 KiB
11 KiB
general workflow overview
- initial setup
- create a source
- run import
- setup regex
- map all regex
- on-going usage
- run import
- address any new unmapped items
source maintenance
+-------------------------------------------------------------------------------------------------+
| +-------------+ |
| |MAKE NEW | |
| +-------------+ |
| |
| existing sources source name |
| +--------------+ +---------------+ |
| |dcard | |dcard | |
| |hunt | +---------------+ |
| |pncc | data source |
| |paycom | +---------------+ |
| |adp | |client file | enum based on api functions |
| | | +---------------+ |
| | | loading function |
| | | +---------------+ |
| | | |cs^ parser | enum based on api functions |
| | | +---------------+ |
| | | schema |
| | | +----------------+ +------------+ |
| | | |default | |b: add new | |
| | | +----------------+ +------------+ |
| | | +------------------------------------------------------------+ |
| | | |path |data type |column name |constrai| |
| | | +------------------------------------------------------------+ |
| | | |{Post. Date} |date |post_date |X |delete |
| | | |{Amount} |numeric |amount |X |delete |
| | | |{Trans. Date} |date |trans_date |X |delete |
| | | |{Category} |text |category | |delete |
| | | |{Description} |text |descr | |delete |
| | | | | | | |add |
| +--------------+ +------------------------------------------------------------+ |
| |
| |
| |
| |
+-------------------------------------------------------------------------------------------------+
||Trans. Date|Post Date|Description |Amount|Category | |
|---------------------------------------------------------------------------------------------+ |
||1/2/2018 |1/2/2018 |GOOGLE *YOUTUBE VIDEOS G.CO/HELPPAY#CAP0H07TXV|4.26 |Services | |
||1/2/2018 |1/2/2018 |MICROSOFT *ONEDRIVE 800-642-7676 WA |4.26 |Services | |
||1/3/2018 |1/3/2018 |CLE CLINIC PT PMTS 216-445-6249 OHAK2C57F2F0B3|200 |Medical Services| |
+|1/4/2018 +1/4/2018 +AT&T *PAYMENT 800-288-2020 TX +57.14 +Services | |
| |
+-------------------------------------------------------------------------------------------------+
regex maintenance
+-------------------------------------------------------------------------------------------------------------------------------------+
| |
| |
| filter - only apply to where these top level keys exist |
| sources name |
| +---------------+ +--------------+ +----------------------+----------------------+ |
| |dcard | |First 20 | |top level key | value | |
| |hunt | +--------------+ +---------------------------------------------+ |
| |pncc | source |key-name |certain value | |
| |pnco | +--------------+ | | | |
| |pncl | |dcard | | | | |
| |paycom | +--------------+ | | | |
| |adp | sequence | | | |
| | | +--------------+ +----------------------+----------------------+ |
| +---------------+ |1 | |
| targets +--------------+ |
| +---------------+ function |
| |check number|1 | +--------------+ |
| |strip commas|2 | |extract | enum extract, replace |
| |trans type |3 | +--------------+ |
| |currency |4 | |
| |parse ach |5 | +-----------------------------------+---------+-----------------------------------------------+ |
| | | | |key |map |fl|re|replace | newkey | | |
| | | | +---------------------------------------------------------------------------------------------+ |
| | | | |{Description} |y | |y | | f20 |.{1,20} |delete |
| | | | | | | | | | | |add |
| | | | | | | | | | | | |
| | | | | | | | | | | | |
| | | | +--------------+----+--+--+---------+---------+-----------------------------------------------+ |
| +------------+--+ |
| +-------------------------------------------------------------------------------------+ |
| |map |return value |party |reason |add column | |
| +-------------------------------------------------------------------------------------+ |
| |First 20|{"f20": "DISCOUNT DRUG MART 3"}|Discount Drug Mart|groceries | | |
| |First 20|{"f20": "TARGET STOW OH"} |Target |groceries | | |
| |First 20|{"f20": "WALMART GROCERY 800-"}|Walmart |groceries | | |
| |First 20|{"f20": "CIRCLE K 05416 STOW "}|Circle K |gasoline | | |
| |First 20|{"f20": "TARGET.COM * 800-591"}|Target |home supplies| | |
| |First 20|{"f20": "ACME NO. 17 STOW OH"} |Acme |groceries | | |
| |First 20|{"f20": "AT&T *PAYMENT 800-28"}|AT&T |internet | | |
| |First 20|{"f20": "AUTOZONE #0722 STOW "}|Autozone |auto maint | | |
| |First 20|{"f20": "BESTBUYCOM8055267948"}|BestBuy |home supplies| | |
| |First 20|{"f20": "BUFFALO WILD WINGS K"}|Buffalo Wild Wings|restaurante | | |
| |First 20|{"f20": "CASHBACK BONUS REDEM"}|Discover Card |financing | | |
| |First 20|{"f20": "CLE CLINIC PT PMTS 2"}|Cleveland Clinic |medical | | |
| | | | |
| +-------------------------------------------------------------------------------------+ |
+-------------------------------------------------------------------------------------------------------------------------------------+