add notes

package.json

@@ -0,0 +1,19 @@
+{
+  "name": "tps_etl",
+  "version": "1.0.0",
+  "description": "third party source data transformation",
+  "main": "index.js",
+  "scripts": {
+    "test": "uh"
+  },
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/fleetside72/tps_etl.git"
+  },
+  "author": "",
+  "license": "ISC",
+  "bugs": {
+    "url": "https://github.com/fleetside72/tps_etl/issues"
+  },
+  "homepage": "https://github.com/fleetside72/tps_etl#readme"
+}

readme.md

@@ -1,5 +1,5 @@
 Generic Data Transformation Tool
-----------------------------------------------
+=======================================================
 
 The goal is to:
 1. house external data and prevent duplication on insert
@@ -33,24 +33,49 @@ Major Interactions
 
 
 ### Interaction Details
-* Source Definitions (Maint/Inquire)
+* _Source Definitions (Maint/Inquire)_
 
     * display a list of existing sources with display detials/edit options
     * create new option
     * underlying function is `tps.srce_set(_name text, _defn jsonb)`
 
-* Regex Instructions (Maint/Inquire)
+    * the current definition of a source includes data based on bad presumptions:
+        * how to load from a csv file using `COPY`
+        * setup a Postgres type to reflect the associated columns (if applicable)
+        
+
+* _Regex Instructions (Maint/Inquire)_
 
     * display a list of existing instruction sets with display details/edit options
     * create new option
     * underlying function is `tps.srce_map_def_set(_srce text, _map text, _defn jsonb, _seq int)` which takes a source "code" and a json
 
-* Cross Reference List (Maint/Inquire)
+* _Cross Reference List (Maint/Inquire)_
 
     * first step is to populate a list of values returned from the instructions (choose all or unmapped) `tps.report_unmapped(_srce text)`
     * the list of rows facilitates additional named column(s) to be added which are used to assign values anytime the result occurs
     * function to set the values of the cross reference `tps.srce_map_val_set_multi(_maps jsonb)`
 
-* Run Import
+* _Run Import_
 
     * underlying function is `tps.srce_import(_path text, _srce text)`
+
+
+
+source definition
+----------------------------------------------------------------------
+
+* **load data**
+    * parsing function reference
+        * csv_from_client --> load file dialog, send content as post body to backend, backend sends array of json as argument to database?
+        * custom_pnc_parse --> load file dialog, send content as post body to backend, parse out data to array of json and send to db as large json object?
+        * _note_ : the database will have to store in the json a reference to these functions which the browser will need to read in order to act on an import request
+
+        * the brwosers role is to extract the contents of a file and send them as a post body to the backend for processing under target function (/parse_csv&q=source)
+
+    * constraints
+* **read data**
+    * top level key to table as type?
+    * function that returns a string that is a list of columns?
+    * custom function to read and return the table?
+