tps/readme.md
2017-07-07 14:11:25 -04:00

666 B

Concepts

pull various static files into postgres and do basic transformation without losing the original document or getting into custom code for each scenario

##Storage all records are jsonb applied mappings are in associated jsonb documents

##Import COPY function utilized

##Mappings

  1. regular expressions are used to extract pieces of the json objects
  2. the results of the regular expressions are bumped up against a list of basic mappings and written to an associated jsonb document

##Transformation tools

  • COPY
  • regexp_matches()

##Difficulties Non standard file formats will require additional logic This