formatting

This commit is contained in:
Paul Trowbridge 2017-07-07 14:12:05 -04:00
parent 01f87ce7a6
commit 6a869d6483

View File

@ -4,21 +4,20 @@ Concepts
pull various static files into postgres and do basic transformation without losing the original document
or getting into custom code for each scenario
##Storage
## Storage
all records are jsonb
applied mappings are in associated jsonb documents
##Import
## Import
`COPY` function utilized
##Mappings
## Mappings
1. regular expressions are used to extract pieces of the json objects
2. the results of the regular expressions are bumped up against a list of basic mappings and written to an associated jsonb document
##Transformation tools
## Transformation tools
* `COPY`
* `regexp_matches()`
##Difficulties
## Difficulties
Non standard file formats will require additional logic
This