Commit Graph

109 Commits

Author SHA1 Message Date
Rob DiCiuccio
806fb73d25
feat(SIP-39): Websocket sidecar app (#11498)
* WIP node.js websocket app

* Load testing

* Multi-stream publish with blocking reads

* Use JWT for auth and channel ID

* Update ws jwt cookie name

* Typescript

* Frontend WebSocket transport support

* ws server ping/pong and GC logic

* ws server unit tests

* GC interval config, debug logging

* Cleanup JWT cookie logic

* Refactor asyncEvents.ts to support non-Redux use cases

* Update tests for refactored asyncEvents

* Add eslint, write READMEs, reorg files

* CI workflow

* Moar Apache license headers

* pylint found something

* adjust GH actions workflow

* Improve documentation & comments

* Prettier

* Add configurable logging via Winston

* Add SSL support for Redis connections

* Fix incompatible logger statements

* Apply suggestions from code review

Co-authored-by: David Aaron Suddjian <1858430+suddjian@users.noreply.github.com>

* rename streamPrefix config

Co-authored-by: David Aaron Suddjian <1858430+suddjian@users.noreply.github.com>
2021-04-08 11:12:03 -07:00
Rob DiCiuccio
6a81a7961c
feat: Support feature flag overrides in ephemeral test envs (#14008)
* Add support for feature flag overrides in ephemeral env cmd

* update docs to reference correct config

* Update ephemeral env docs
2021-04-08 11:05:59 -07:00
Rob DiCiuccio
f81b746556
chore: Update PR template for SIP-59 DB migrations process (#13855) 2021-03-30 08:54:26 -07:00
Rob DiCiuccio
2a4e4b320c
Add CODEOWNERS (#13759) 2021-03-30 08:54:08 -07:00
Jesse Yang
e61f5a924b
chore(CI): dont run Hive tests on Py 3.7 (#13757) 2021-03-25 23:03:58 -07:00
Jesse Yang
9773aba522
fix(CI): use presto docker image from starburst (#13756) 2021-03-23 20:11:58 -07:00
Jesse Yang
5fca19da56
build: check potential db migration conflict for open PRs (#13498) 2021-03-10 16:02:52 -08:00
Rob DiCiuccio
b21d2cfcac
build(test env): Shutdown test environments on PR close (#13452)
* Ephemeral env PR close cleanup action

* Add documentation for test envs
2021-03-09 10:19:43 -08:00
Jesse Yang
d39bc14a0b
test: optimize codecov config (#13329)
* test: optimize codecov config to let GitHub checks always pass

* Run tests on workflow changes, too
2021-02-25 05:22:34 -08:00
Rob DiCiuccio
27f7d1157f
build: Ephemeral environments for PRs via slash command (#13189)
* First pass at ephemeral env, new Docker ci target

* Add service checks, get public IP

* Separate issue_comment and workflow_run jobs

* Refactor workflows

* Adjust comment author association

* Checkout code

* Fix image name, manage service desired task count

* Use merge commit sha

* Fix IP output, add failure comment

* Refactor comment parsing & env spinup

* Check container image publish status

* Parse AWS account ID from registry URL

* Use PR number rather than variable merge commit SHA for image tag

* Fix docker push conditional

* Push multiple tags to ECR

* Fix comment author check

* Refactor comment body check

* Provision service with active task to get correct IP

* /testenv up

* Add @mentions to PR comments, env var cleanup
2021-02-24 10:50:52 -08:00
Erik Ritter
beee11de0f
fix: misspelling Erik Ritter (#13120)
* fix: misspelling Erik Ritter

* Add --all-tags to docker push to account for new default behavior

Co-authored-by: Rob DiCiuccio <rob.diciuccio@gmail.com>
2021-02-16 11:20:23 -08:00
Daniel Vaz Gaspar
fa4c118e2d
fix: API tests, make them possible to run independently again (#13076)
* fix: API tests, possible to run independently

* fix workflow name
2021-02-11 18:19:41 +00:00
Daniel Vaz Gaspar
0cf57756f0
fix: add config to disable dataset ownership on the old api (#13051)
* fix: add config to disable dataset ownership on the old api

* fix CI docker build

* fix logic

* add deprecation comment on the config
2021-02-11 18:18:27 +00:00
Ville Brofeldt
b12e8024b3
ci: skip cypress if no code changes (#12982) 2021-02-09 13:58:50 +02:00
Elizabeth Thompson
1bb305323e
chore: rename action to docker-build (#12980) 2021-02-06 14:25:46 -10:00
Jesse Yang
2799894221
chore: cleanup no-op Cypress (chrome) job (#12972) 2021-02-05 13:05:48 -08:00
Elizabeth Thompson
0d1b59eb86
chore: change name of python lint action (#12968) 2021-02-05 12:54:37 -08:00
Ville Brofeldt
5d55c4367c
ci: conditionally skip python and frontend tests (#12583)
* ci: conditionally skip python tests

* parametrize check script and implement for frontend

* add missing script

* fix incorrect check

* move CHECKS to ARGS and fix typo

* fix SC2086 nit
2021-02-05 17:40:08 +02:00
adam-stasiak-polidea
3235d918aa
test: Added some Cypress tests for Native Filters (#12180) 2021-02-04 22:54:00 -08:00
Elizabeth Thompson
94b6b29362
chore: rename duplicate build jobs (#12921) 2021-02-03 16:40:38 -08:00
Jesse Yang
9c5ec3d72a
fix(CI): properly configure cancel duplicates (#12625)
Updating the "Cancel Duplicates" job to use our own Python script, which will try to cancel all duplicate jobs of all workflows:

For each workflow, we keep only the latest run for a given branch + event type (pull_request or push).
Older runs will be cancelled even if they are already running.
2021-01-29 12:29:46 -08:00
Elizabeth Thompson
41b990f72d
chore: add breaking change to title regex (#12754) 2021-01-27 18:48:11 -08:00
Elizabeth Thompson
80deb4ed7c
fix: update latest tag action to use set-output (#12706) 2021-01-24 16:40:52 -08:00
Tobiasz Kędzierski
1f27b62d51
ci: use git submodules for (securely) using third party Github Actions (#12709)
* Use git submodules for (securely) using third party Github Actions

List of repositories added as submodules:

EndBug/latest-tag@latest
morrisoncole/pr-lint-action@v1.4.1
trilom/file-changes-action@v1.2.4
styfle/cancel-workflow-action@0.6.0
apache-superset/cached-dependencies@b90713b
unsplash/comment-on-pr@v1.2.0
2021-01-23 23:10:16 -08:00
Amit Miran
d80c2ed72a
chore: skip CI on draft PR (#12666) 2021-01-21 16:10:17 -08:00
Jesse Yang
c68cec77a5
fix(CI): remove duplicate hive and presto tests (#12638) 2021-01-20 18:50:08 -08:00
Jesse Yang
438be9a75e
chore: upgrade CI runner to Ubuntu 20.04 (#12563)
This should fix a broken CI error where apt fails to update:

  E: The repository 'https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_18.04  Release' no longer has a Release file.
2021-01-15 16:14:33 -08:00
Rob DiCiuccio
b1fcd61b73
build: add Cypress parallelization with obfuscated record key (#12534) 2021-01-15 12:18:18 -08:00
Daniel Vaz Gaspar
2d10a2c089
ci: remove refs/tags from docker tags on a release (#12518)
* ci: remove refs/tags from docker tags on a release

* wider head
2021-01-15 09:23:59 +02:00
Jesse Yang
5fe4173a5d
build: add cancel-workflow-runs action locally (#12394) 2021-01-12 22:11:51 -08:00
Amit Miran
37f648c41b
chore: rename docker image in build_docker_image.sh, docker-compose.yml and helm values.yaml (#12337) 2021-01-10 09:29:17 -08:00
Daniel Vaz Gaspar
f642aea683
ci(docker): fix release published event checkout tag-sha (#12096)
* release: push 0.38.0 image and fix

* fix

* remove manual action
2021-01-08 14:59:59 -08:00
Jesse Yang
f48284909d
build: try to speed up Github workflows (#12090) 2021-01-07 00:47:00 -08:00
Amit Miran
b221417e19
chore: remove harmless incubator refs (#12289)
* chore: migrate all harmless incubator refs like comments and documentation files

* chore: migrate all superset.incubator.apache.org to superset.apache.org to

* chore: migrate dist.apache.org refs

* chore: removing incubating and Disclaimer

* fix: linting issues
2021-01-06 13:45:19 +02:00
Jesse Yang
cf1c57a6d4
build: ignore github actions from dependabot (#12291) 2021-01-05 22:45:44 -08:00
Jesse Yang
4149ab4e5e
build: remove parallelization for E2E tests (#12290) 2021-01-05 15:46:52 -08:00
dependabot[bot]
95296df507
build(deps): bump node-fetch in /.github/actions/file-changes-action (#12248)
Bumps [node-fetch](https://github.com/bitinn/node-fetch) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases)
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md)
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-01-04 14:40:01 -08:00
dependabot[bot]
e853c16a3d
build(deps): bump @actions/core in /.github/actions/file-changes-action (#12246)
Bumps [@actions/core](https://github.com/actions/toolkit/tree/HEAD/packages/core) from 1.2.4 to 1.2.6.
- [Release notes](https://github.com/actions/toolkit/releases)
- [Changelog](https://github.com/actions/toolkit/blob/main/packages/core/RELEASES.md)
- [Commits](https://github.com/actions/toolkit/commits/HEAD/packages/core)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-01-04 14:08:53 -08:00
Jesse Yang
a3bbbf8ea3
build: inline external Github Actions to unblock CI (#12241)
* build: inline cached-dependencies to unblock CI

* Run E2E on pull_request on;y

* Inline all external actions

* Checkout needed for internal actions

Also fixes pre-commit

* Add missing files
2021-01-04 14:16:07 +02:00
Elizabeth Thompson
895fa19d8d
chore: add latest tag action (#11148)
* add latest tag action

* update documentation with latest tag info

* Python in docs doesn't need v3 reference

* add check that latest tag is truly a later version

* remove rc from acceptable tags

* move tag script to seperate file

* add a check that the tag exists
2020-12-17 20:50:44 +02:00
Rob DiCiuccio
148a0017b7
Remove e2e pull_request event trigger (#12076) 2020-12-16 11:38:55 -08:00
Rob DiCiuccio
8fe9ee04c8
build(cypress): Use pull_request_target event to run cypress (#11750)
* Use pull_request_target event to run cypress in order to access repo secrets

* Summary job for branch protection requirements

* Restore pull_request trigger

* Use merge base for e2e tests

* Restore push trigger for all branches
2020-12-16 10:45:21 -08:00
Jesse Yang
8164aeafb1
build: cancel previous github action runs (#11940) 2020-12-08 15:27:08 -08:00
Beto Dealmeida
66cd565bff
feat: add Postgres SQL validator (#11538)
* Add Postgres SQL validator

* Strip line number from message

* Add unit tests

* Run tests only with postgres backend

* Add dep

* Add dep to bashlib
2020-12-04 19:17:23 -08:00
Craig Rueda
8adc8b8866
Quick fix for branch names in tags (#11930) 2020-12-04 14:27:25 -08:00
Daniel Vaz Gaspar
f121107bbe
ci(docker): build image on release (#11828)
* feat(docker): build image on release

* separate trigger separate handling

* fix triggers

* less states for docker build on PR's
2020-11-27 09:38:38 +00:00
Erik Ritter
67c44479b5
build: split python CI jobs (#11794)
* build: split python CI jobs

* Rename superset-python.yml to superset-python-misc.yml
2020-11-24 11:40:16 -08:00
Craig Rueda
68693c7c0a
feat: Helm improvements (#11700)
* Adding docker build/push

* Adding build script

* Trying username

* Updating build script

* Fixing script path?

* Lising envvars

* Pulling HEAD

* Actually pushing

* Fixing build / SHA

* Logout before login

* updating docker login

* Fixing docker login

* Trying stdin pwd

* Adding check for forks

* Fixing tagging

* Fixing refspec

* Updating Dockerfile-dev

* Adding license to script

* Fixing Cypress tests

* Adding Helm hooks and force reload option

* Adding worker pod

* Removing head SHA checkout in docker.yml
2020-11-13 15:17:52 -08:00
Craig Rueda
95246e8812
feat: Adding docker build/push (#11616)
* Adding docker build/push

* Adding build script

* Trying username

* Updating build script

* Fixing script path?

* Lising envvars

* Pulling HEAD

* Actually pushing

* Fixing build / SHA

* Logout before login

* updating docker login

* Fixing docker login

* Trying stdin pwd

* Adding check for forks

* Fixing tagging

* Fixing refspec

* Updating Dockerfile-dev

* Adding license to script

* Fixing Cypress tests
2020-11-13 11:32:18 -08:00
Jesse Yang
7cbf21c39f
build: set actions/setup-python to v2 (#11644)
This upgrades the `setup-python` action and pins it to the latest v2,
which suppresses the warnings about set-env and add-path:

    Error: The `set-env` command is deprecated and will be disabled on November 16th. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2020-10-01-github-actions-deprecating-set-env-and-add-path-commands/
2020-11-11 13:15:05 -08:00