Commit Graph

121 Commits

Author SHA1 Message Date
Amit Miran 62a8f2e193
chore(python-testing): move memoized tests to unit tests (#15507)
* chore: move memoized test into a separated file

create integration test workflow

* chore: create unit test workflow to run purely pytest

* fix: bad reference

* fix: remove pip requirements bc there aren't any yet

* temp: install unit dependencies directly

* fix: --rootdir=

* fix: try to run only unit test

* chore: decouple memoized as separated module

* fix: bring back dependencies bc superset top-level module is coupled to flask and others so no reason no to do it

* fix: reference

* fix: pre-commit

* fix: pylint
2021-07-12 10:00:18 +03:00
ofekisr b5119b8dff
refactor(tests): decouple unittests from integration tests (#15473)
* refactor move all tests to be under integration_tests package

* refactor decouple unittests from integration tests - commands

* add unit_tests package

* fix celery_tests.py

* fix wrong FIXTURES_DIR value
2021-07-01 18:03:07 +03:00
John Bodley f53b2c6587
docs: Update SIP template (#14278)
* [SIP] Update SIP template

* Update sip.md

* Update .github/ISSUE_TEMPLATE/sip.md

Co-authored-by: Erik Ritter <erik.ritter@airbnb.com>

Co-authored-by: Amit Miran <47772523+amitmiran137@users.noreply.github.com>
Co-authored-by: Erik Ritter <erik.ritter@airbnb.com>
2021-06-28 07:28:16 +03:00
Rob DiCiuccio 7a21f9afa7
chore: Disable comment logging for ephemeral envs (#15156)
* Disable comment logging

* Update CODEOWNERS
2021-06-14 14:31:36 -07:00
Ke Zhu 9967a5f640
refactor: adopt --app as celery global option (#15053) 2021-06-08 20:18:55 -07:00
David Aaron Suddjian 32622c5081
chore: Update pull request template (#14723)
* Update PULL_REQUEST_TEMPLATE.md

* Update PULL_REQUEST_TEMPLATE.md
2021-05-20 14:35:33 -07:00
Daniel Vaz Gaspar 437be4b689
ci: set remote URL to https and bump sha (#14350)
* ci: set remote URL to https and bump sha

* update gitmodules
2021-04-26 17:43:32 +01:00
ʈᵃᵢ e913ef3261
docs: add publish step (#14304) 2021-04-23 10:43:58 -06:00
Rob DiCiuccio 25922e341f
Add Preset code owners for ephemeral test env workflows (#14238) 2021-04-19 22:19:18 -07:00
jawabuu 61325635da
ci: use git submodules for Chart Actions (#14211)
* Add chart-action submodules

* use local github actions for chart actions

* Run actions checkout for local checkout

* Run lint when PR is edited

* Remove path filter and dummy value

* Fix fetch-depth

* Test chart version bump

* Update maintainer to pass validation

* Update maintainer to pass validation
2021-04-17 19:13:36 +03:00
Craig Rueda 8db7be16da
fix: Switching to local codecov script (#14170)
* Switching to local codecov script

* Adding license / update instructions

* Fixing FE build

* Fixing FE codecov test
2021-04-16 09:26:50 -07:00
jawabuu c3e89d53c2
feat: publish superset helm chart (#14163)
* Create initial helm-release action for superset

* Add lintconf to ensure chart passes validation

* Add lint-test job

* Add apache licence headers

* Run job for master only

* Move helm-lint to separate workflow

* Helm release for master & helm dir changes only

* Dummy change to test linter
2021-04-16 09:13:43 -07:00
Rob DiCiuccio 806fb73d25
feat(SIP-39): Websocket sidecar app (#11498)
* WIP node.js websocket app

* Load testing

* Multi-stream publish with blocking reads

* Use JWT for auth and channel ID

* Update ws jwt cookie name

* Typescript

* Frontend WebSocket transport support

* ws server ping/pong and GC logic

* ws server unit tests

* GC interval config, debug logging

* Cleanup JWT cookie logic

* Refactor asyncEvents.ts to support non-Redux use cases

* Update tests for refactored asyncEvents

* Add eslint, write READMEs, reorg files

* CI workflow

* Moar Apache license headers

* pylint found something

* adjust GH actions workflow

* Improve documentation & comments

* Prettier

* Add configurable logging via Winston

* Add SSL support for Redis connections

* Fix incompatible logger statements

* Apply suggestions from code review

Co-authored-by: David Aaron Suddjian <1858430+suddjian@users.noreply.github.com>

* rename streamPrefix config

Co-authored-by: David Aaron Suddjian <1858430+suddjian@users.noreply.github.com>
2021-04-08 11:12:03 -07:00
Rob DiCiuccio 6a81a7961c
feat: Support feature flag overrides in ephemeral test envs (#14008)
* Add support for feature flag overrides in ephemeral env cmd

* update docs to reference correct config

* Update ephemeral env docs
2021-04-08 11:05:59 -07:00
Rob DiCiuccio f81b746556
chore: Update PR template for SIP-59 DB migrations process (#13855) 2021-03-30 08:54:26 -07:00
Rob DiCiuccio 2a4e4b320c
Add CODEOWNERS (#13759) 2021-03-30 08:54:08 -07:00
Jesse Yang e61f5a924b
chore(CI): dont run Hive tests on Py 3.7 (#13757) 2021-03-25 23:03:58 -07:00
Jesse Yang 9773aba522
fix(CI): use presto docker image from starburst (#13756) 2021-03-23 20:11:58 -07:00
Jesse Yang 5fca19da56
build: check potential db migration conflict for open PRs (#13498) 2021-03-10 16:02:52 -08:00
Rob DiCiuccio b21d2cfcac
build(test env): Shutdown test environments on PR close (#13452)
* Ephemeral env PR close cleanup action

* Add documentation for test envs
2021-03-09 10:19:43 -08:00
Jesse Yang d39bc14a0b
test: optimize codecov config (#13329)
* test: optimize codecov config to let GitHub checks always pass

* Run tests on workflow changes, too
2021-02-25 05:22:34 -08:00
Rob DiCiuccio 27f7d1157f
build: Ephemeral environments for PRs via slash command (#13189)
* First pass at ephemeral env, new Docker ci target

* Add service checks, get public IP

* Separate issue_comment and workflow_run jobs

* Refactor workflows

* Adjust comment author association

* Checkout code

* Fix image name, manage service desired task count

* Use merge commit sha

* Fix IP output, add failure comment

* Refactor comment parsing & env spinup

* Check container image publish status

* Parse AWS account ID from registry URL

* Use PR number rather than variable merge commit SHA for image tag

* Fix docker push conditional

* Push multiple tags to ECR

* Fix comment author check

* Refactor comment body check

* Provision service with active task to get correct IP

* /testenv up

* Add @mentions to PR comments, env var cleanup
2021-02-24 10:50:52 -08:00
Erik Ritter beee11de0f
fix: misspelling Erik Ritter (#13120)
* fix: misspelling Erik Ritter

* Add --all-tags to docker push to account for new default behavior

Co-authored-by: Rob DiCiuccio <rob.diciuccio@gmail.com>
2021-02-16 11:20:23 -08:00
Daniel Vaz Gaspar fa4c118e2d
fix: API tests, make them possible to run independently again (#13076)
* fix: API tests, possible to run independently

* fix workflow name
2021-02-11 18:19:41 +00:00
Daniel Vaz Gaspar 0cf57756f0
fix: add config to disable dataset ownership on the old api (#13051)
* fix: add config to disable dataset ownership on the old api

* fix CI docker build

* fix logic

* add deprecation comment on the config
2021-02-11 18:18:27 +00:00
Ville Brofeldt b12e8024b3
ci: skip cypress if no code changes (#12982) 2021-02-09 13:58:50 +02:00
Elizabeth Thompson 1bb305323e
chore: rename action to docker-build (#12980) 2021-02-06 14:25:46 -10:00
Jesse Yang 2799894221
chore: cleanup no-op Cypress (chrome) job (#12972) 2021-02-05 13:05:48 -08:00
Elizabeth Thompson 0d1b59eb86
chore: change name of python lint action (#12968) 2021-02-05 12:54:37 -08:00
Ville Brofeldt 5d55c4367c
ci: conditionally skip python and frontend tests (#12583)
* ci: conditionally skip python tests

* parametrize check script and implement for frontend

* add missing script

* fix incorrect check

* move CHECKS to ARGS and fix typo

* fix SC2086 nit
2021-02-05 17:40:08 +02:00
adam-stasiak-polidea 3235d918aa
test: Added some Cypress tests for Native Filters (#12180) 2021-02-04 22:54:00 -08:00
Elizabeth Thompson 94b6b29362
chore: rename duplicate build jobs (#12921) 2021-02-03 16:40:38 -08:00
Jesse Yang 9c5ec3d72a
fix(CI): properly configure cancel duplicates (#12625)
Updating the "Cancel Duplicates" job to use our own Python script, which will try to cancel all duplicate jobs of all workflows:

For each workflow, we keep only the latest run for a given branch + event type (pull_request or push).
Older runs will be cancelled even if they are already running.
2021-01-29 12:29:46 -08:00
Elizabeth Thompson 41b990f72d
chore: add breaking change to title regex (#12754) 2021-01-27 18:48:11 -08:00
Elizabeth Thompson 80deb4ed7c
fix: update latest tag action to use set-output (#12706) 2021-01-24 16:40:52 -08:00
Tobiasz Kędzierski 1f27b62d51
ci: use git submodules for (securely) using third party Github Actions (#12709)
* Use git submodules for (securely) using third party Github Actions

List of repositories added as submodules:

EndBug/latest-tag@latest
morrisoncole/pr-lint-action@v1.4.1
trilom/file-changes-action@v1.2.4
styfle/cancel-workflow-action@0.6.0
apache-superset/cached-dependencies@b90713b
unsplash/comment-on-pr@v1.2.0
2021-01-23 23:10:16 -08:00
Amit Miran d80c2ed72a
chore: skip CI on draft PR (#12666) 2021-01-21 16:10:17 -08:00
Jesse Yang c68cec77a5
fix(CI): remove duplicate hive and presto tests (#12638) 2021-01-20 18:50:08 -08:00
Jesse Yang 438be9a75e
chore: upgrade CI runner to Ubuntu 20.04 (#12563)
This should fix a broken CI error where apt fails to update:

  E: The repository 'https://download.opensuse.org/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_18.04  Release' no longer has a Release file.
2021-01-15 16:14:33 -08:00
Rob DiCiuccio b1fcd61b73
build: add Cypress parallelization with obfuscated record key (#12534) 2021-01-15 12:18:18 -08:00
Daniel Vaz Gaspar 2d10a2c089
ci: remove refs/tags from docker tags on a release (#12518)
* ci: remove refs/tags from docker tags on a release

* wider head
2021-01-15 09:23:59 +02:00
Jesse Yang 5fe4173a5d
build: add cancel-workflow-runs action locally (#12394) 2021-01-12 22:11:51 -08:00
Amit Miran 37f648c41b
chore: rename docker image in build_docker_image.sh, docker-compose.yml and helm values.yaml (#12337) 2021-01-10 09:29:17 -08:00
Daniel Vaz Gaspar f642aea683
ci(docker): fix release published event checkout tag-sha (#12096)
* release: push 0.38.0 image and fix

* fix

* remove manual action
2021-01-08 14:59:59 -08:00
Jesse Yang f48284909d
build: try to speed up Github workflows (#12090) 2021-01-07 00:47:00 -08:00
Amit Miran b221417e19
chore: remove harmless incubator refs (#12289)
* chore: migrate all harmless incubator refs like comments and documentation files

* chore: migrate all superset.incubator.apache.org to superset.apache.org to

* chore: migrate dist.apache.org refs

* chore: removing incubating and Disclaimer

* fix: linting issues
2021-01-06 13:45:19 +02:00
Jesse Yang cf1c57a6d4
build: ignore github actions from dependabot (#12291) 2021-01-05 22:45:44 -08:00
Jesse Yang 4149ab4e5e
build: remove parallelization for E2E tests (#12290) 2021-01-05 15:46:52 -08:00
dependabot[bot] 95296df507
build(deps): bump node-fetch in /.github/actions/file-changes-action (#12248)
Bumps [node-fetch](https://github.com/bitinn/node-fetch) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases)
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md)
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-01-04 14:40:01 -08:00
dependabot[bot] e853c16a3d
build(deps): bump @actions/core in /.github/actions/file-changes-action (#12246)
Bumps [@actions/core](https://github.com/actions/toolkit/tree/HEAD/packages/core) from 1.2.4 to 1.2.6.
- [Release notes](https://github.com/actions/toolkit/releases)
- [Changelog](https://github.com/actions/toolkit/blob/main/packages/core/RELEASES.md)
- [Commits](https://github.com/actions/toolkit/commits/HEAD/packages/core)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-01-04 14:08:53 -08:00