formatting
This commit is contained in:
parent
01f87ce7a6
commit
6a869d6483
11
readme.md
11
readme.md
@ -4,21 +4,20 @@ Concepts
|
|||||||
pull various static files into postgres and do basic transformation without losing the original document
|
pull various static files into postgres and do basic transformation without losing the original document
|
||||||
or getting into custom code for each scenario
|
or getting into custom code for each scenario
|
||||||
|
|
||||||
##Storage
|
## Storage
|
||||||
all records are jsonb
|
all records are jsonb
|
||||||
applied mappings are in associated jsonb documents
|
applied mappings are in associated jsonb documents
|
||||||
|
|
||||||
##Import
|
## Import
|
||||||
`COPY` function utilized
|
`COPY` function utilized
|
||||||
|
|
||||||
##Mappings
|
## Mappings
|
||||||
1. regular expressions are used to extract pieces of the json objects
|
1. regular expressions are used to extract pieces of the json objects
|
||||||
2. the results of the regular expressions are bumped up against a list of basic mappings and written to an associated jsonb document
|
2. the results of the regular expressions are bumped up against a list of basic mappings and written to an associated jsonb document
|
||||||
|
|
||||||
##Transformation tools
|
## Transformation tools
|
||||||
* `COPY`
|
* `COPY`
|
||||||
* `regexp_matches()`
|
* `regexp_matches()`
|
||||||
|
|
||||||
##Difficulties
|
## Difficulties
|
||||||
Non standard file formats will require additional logic
|
Non standard file formats will require additional logic
|
||||||
This
|
|
||||||
|
Loading…
Reference in New Issue
Block a user