initialize readme
This commit is contained in:
parent
09afa88ee1
commit
01f87ce7a6
23
readme.md
23
readme.md
@ -1 +1,24 @@
|
|||||||
|
Concepts
|
||||||
|
======================================
|
||||||
|
|
||||||
|
pull various static files into postgres and do basic transformation without losing the original document
|
||||||
|
or getting into custom code for each scenario
|
||||||
|
|
||||||
|
##Storage
|
||||||
|
all records are jsonb
|
||||||
|
applied mappings are in associated jsonb documents
|
||||||
|
|
||||||
|
##Import
|
||||||
|
`COPY` function utilized
|
||||||
|
|
||||||
|
##Mappings
|
||||||
|
1. regular expressions are used to extract pieces of the json objects
|
||||||
|
2. the results of the regular expressions are bumped up against a list of basic mappings and written to an associated jsonb document
|
||||||
|
|
||||||
|
##Transformation tools
|
||||||
|
* `COPY`
|
||||||
|
* `regexp_matches()`
|
||||||
|
|
||||||
|
##Difficulties
|
||||||
|
Non standard file formats will require additional logic
|
||||||
|
This
|
||||||
|
Loading…
Reference in New Issue
Block a user