Commit Graph

477 Commits

Author SHA1 Message Date
kamalkeshavani-aiinside 02a9b84b14
chore: Bump FAB to 3.4.0 (#17420)
Bumping FAB to latest 3.4.0
2021-11-19 14:59:03 +00:00
PApostol a898883f38
Remove redundant parentheses from setup.py (#17284) 2021-11-01 09:04:25 -07:00
Craig Rueda 6a63a21e06
chore: Bumping pyarrow / pandas (#17290)
* Bumping pyarrow / pandas

* Appeasing the pylint gods

* Adjusting UPDATING.md

* Buping testing requirements
2021-10-31 10:47:02 -07:00
Hugh A. Miles II 792efefcb4
Update setup.py (#17220) 2021-10-26 15:00:42 -04:00
Daniel Vaz Gaspar d944503873
fix: Bump FAB to 3.3.4 (#17113) 2021-10-14 12:08:48 +01:00
Ville Brofeldt 82601abe17
feat: upgrade docker image to py38 and add support for py39 (#16889)
* feat: upgrade docker image to py38 and add support for py39

* update required tests
2021-10-05 11:35:14 +03:00
apurva-sigmoid 420eff42b8
feat: add Firebolt DB engine spec (#16903)
* New branch from superset for integration with firebolt sqlalchemy adapter

* Added db_engine_spec file for Firebolt

* Removed firebolt code from superset repo

* Deleted virtual env commit

* Adding time grain changes to firebolt.py

* Updated README.md

Added steps to install and run Superset with Firebolt SQLAlchemy Adapter

* Update README.md

Reduced installation steps. Using PyPi installation for adapter now

* Revert "Update README.md"

This reverts commit 5ed17c7a45.

* Revert "Updated README.md"

This reverts commit 45c5072649.

* added epoch methods, added test cases for firebolt db engine spec and edited setup.py

* Added license to files

* Added documentation for Firebolt-SQLAlchemy

* Removed trailing whitespace

Co-authored-by: raghavsharma <raghavs@sigmoidanalytics.com>
Co-authored-by: raghavSharmaSigmoid <88667094+raghavSharmaSigmoid@users.noreply.github.com>
2021-10-01 19:43:15 +03:00
Beto Dealmeida 4af5ae08f9
fix: encode rison characters when searching (#16768) 2021-09-22 10:06:24 -07:00
Daniel Vaz Gaspar 7e09b7241e
chore: Bump FAB to 3.3.2 (#16615) 2021-09-08 12:15:04 +01:00
Beto Dealmeida 359383b578
feat: Add Aurora Data API engine spec (#16535)
* feat: Add Aurora Data API engine spec

* Fix lint
2021-09-04 08:40:14 -07:00
Daniel Wood e024f8c7d6
fix: Set correct comparison operator for snowflake-sqlalchemy pinning (#16526) 2021-08-31 16:18:55 -06:00
Daniel Wood ad8336a5b4
fix: Pin snowflake-sqlalchemy to 1.2.4 (#16515)
* Pin snowflake-sqlalchemy to 1.2.4

* lint files
2021-08-31 07:48:51 +03:00
Beto Dealmeida 5e472980a6
feat: add Shillelagh DB engine spec (#16416) 2021-08-24 17:07:29 -07:00
Srini Kadamati 5f060a2227
feat: Adding Rockset db engine spec (#16167)
* rockset prototype

* rockset

* t

* removed print / logging

* set a more specific version range for Rockset library
2021-08-18 13:04:59 +03:00
Ville Brofeldt d46dc9aa45
chore: upgrade mypy and add type guards (#16227) 2021-08-14 06:31:45 +03:00
Rob DiCiuccio 04622529df
Revert a7f247b472 (#16039) 2021-08-03 09:27:45 -07:00
John Bodley a7f247b472
chore: Bump Celery (#15927)
Co-authored-by: John Bodley <john.bodley@airbnb.com>
2021-08-03 05:28:20 +12:00
Beto Dealmeida 6afa840659
feat: send report data to Slack (#15806)
* feat: send data embedded in report email

* Change post-processing to use new endpoint

* Show TEXT option only to text-based vizs

* Fix test

* feat: send data embedded in report email

* feat: send report data to Slack

* Add unit test

* trigger tests
2021-07-29 10:13:28 -07:00
Beto Dealmeida 3441182630
chore: remove unnecessary deps (#15787)
* chore: remove unneeded deps

* fix lint

* Run compile
2021-07-21 16:53:45 -07:00
John Bodley ab4e3b9bf9
chore: Enforce Mypy for non-tests (#15757)
Co-authored-by: John Bodley <john.bodley@airbnb.com>
2021-07-22 06:46:43 +12:00
Beto Dealmeida c9dad05f2b
chore: remove `retry` dependency in favor of `backoff` (#15788)
* chore: remove retry dep in favor of backoff

* Fix lint
2021-07-20 10:33:37 -07:00
Beto Dealmeida 83be06d2cc
Revert #15405 #15435 #15444 (#15558) 2021-07-06 14:56:08 -07:00
Daniel Vaz Gaspar dd16468d44
fix: base requirements missing deprecation pkg (#15527) 2021-07-04 10:27:02 +03:00
Beto Dealmeida cbc4aa8dc1
feat: extra table metadata for Google Sheets (#14775)
* feat: GSheets extra table metadata

* Bump version
2021-07-01 19:27:26 -07:00
Abhishek Jog 7ad8fd5c98
feat(add Netezza database): Add IBM Netezza support (#15450)
* Add netezza to superset

* update netezza logo

* change in logo filename

* fixing linter error

* removing stray code
2021-06-30 08:27:54 -04:00
Beto Dealmeida ed6d10e283
Remove pydash merge (#15435) 2021-06-28 15:40:44 -07:00
ofekisr d8a1acffde
chore(refactor): load configuration and merge recursively (#15405)
* refactor load configuration

* refactor init configuration to enable recursive merge

* Update config.py

* Update app.py

* fix lint and black issue
2021-06-28 13:53:26 +03:00
Ke Zhu 2ebc0a078a
chore: upgrade Flask-Caching>=1.10.0 2021-06-28 08:58:56 +08:00
ofekisr 73e2c09af0
fix(regression): removed flask_app property can break derived class (#15407)
* fix removed flask_app property can break derived class

* Update __init__.py
2021-06-27 17:52:13 +03:00
Daniel Wood 5e543e3b9e
fix(aarch64): Bump pyarrow version to 4.0.1 (#14891)
* Bump pyarrow to v4 for aarch64 compatibility.

* Update base.txt

* Bump to 4.0.1
2021-06-16 14:19:32 -07:00
Will Barrett 1d78c43e27
Upgrade cryptography package (#14906) 2021-05-28 14:59:15 -07:00
Beto Dealmeida 9e13476714
feat: enable user impersonation in GSheets (#14767) 2021-05-22 13:46:36 -07:00
John Bodley 2bd0b62902
fix: Use simplejson for Flask JSON encoding (#14627)
Co-authored-by: John Bodley <john.bodley@airbnb.com>
2021-05-14 15:13:29 +12:00
Ben Reinhart 0fe2bf1150
chore: Update FAB to 3.3.0 (#14556) 2021-05-11 10:00:07 +01:00
Daniel Vaz Gaspar b4e527a8c4
fix: bootstrap data permissions (#14348) 2021-04-30 12:02:01 -06:00
Ville Brofeldt 55bf72aead
chore(prophet): bump prophet to 1.0.1 (#14228) 2021-04-20 15:55:55 +03:00
Erik Ritter a3e302374b
fix: Add extra requires for shillelagh (#14180)
* fix: Add extra requires for shillelagh

* Update google-sheets.mdx

* Update index.mdx
2021-04-16 09:16:35 -07:00
Beto Dealmeida c1cb3619ab
feat: script to benchmark DB migrations (#13561) 2021-04-15 10:55:35 -07:00
Étienne Boisseau-Sierra 73a2cc322a
fix: Pin Prophet dependency after breaking changes (#13852)
Prophet is heavily dependent on Pystan:
https://facebook.github.io/prophet/docs/installation.html

Pystan has recently (2021-03-25) release its v3.0.0.

This release is not backward compatible and breaks fbprophet:
https://github.com/facebook/prophet/issues/1856

(Indeed, fbprophet 0.6 specifies `pystan>=2.14` — but doesn't restrict
upgrading to next major release:
https://github.com/facebook/prophet/blob/0.6/python/requirements.txt#L3)

So we need to pin pystan to the lastest non 3.x release, while fbprophet
fixes the dependency on their side.

We have taken this opportunity to bump fbprophet too to its next minor
version.

Signed-off-by: Étienne Boisseau-Sierra <etienne.boisseau-sierra@unipart.io>
2021-04-02 00:42:29 +08:00
Beto Dealmeida adc247b7e4
feat: add Databricks DB engine spec (#13682) 2021-03-18 09:19:15 +00:00
Rob DiCiuccio 697cdf26b3
Bump pyyaml to latest (#13658) 2021-03-17 14:41:02 -07:00
Daniel Vaz Gaspar 0819beaedc
fix: bump FAB to 3.2.1, SQLAlchemy fix (#13642) 2021-03-16 23:10:34 +00:00
Srini Kadamati bebac5921b
feat: add connector for CrateDB (#13152)
* feat: add connector for CrateDB

* added crate

* fix PyPI reference

* add tests

* added more clarity on installing crate

* fix test

Co-authored-by: Ville Brofeldt <ville.v.brofeldt@gmail.com>
2021-03-11 23:03:22 +02:00
Ville Brofeldt 70e12ed27d
chore: bump pyarrow and pandas (#12882)
* bump pyarrow and pandas

* remove df copy
2021-03-02 19:44:53 +02:00
Beto Dealmeida 892eef1af6
feat: add Firebird DB engine spec (#13353)
* feat: add Firebird DB engine spec

* Add dep to setup.py

* Fix lint

* Add tests

* Remove uneeded code

* Fix old bug
2021-02-26 12:07:27 -08:00
Beto Dealmeida 3d23adec5e
chore: use shillelagh instead of gsheetsdb (#13185)
* chore: use shillelagh instead of gsheetsdb

* Fix tests

* Clean up code and remove duplication

* Fix test

* Tighten dep
2021-02-18 09:48:18 -08:00
Đặng Minh Dũng 2dbe92ba2f
feat: first step native support Trino (#13105)
* feat: add TrinoEngineSpec

Signed-off-by: Đặng Minh Dũng <dungdm93@live.com>

* feat: add trino into extras_require

Signed-off-by: Đặng Minh Dũng <dungdm93@live.com>

* test: add trino_tests.py

Signed-off-by: Đặng Minh Dũng <dungdm93@live.com>
2021-02-15 14:30:13 +02:00
Daniel Vaz Gaspar b3a814fa27
feat(db engines): add support for Opendistro Elasticsearch (AWS ES) (#12602)
* feat(db engines): add support for Opendistro Elasticsearch (AWS ES)

* add time grains

* lint

* bump elasticsearch-dbapi version

* add tests

* fix test
2021-02-10 08:17:27 +00:00
Ville Brofeldt bab86abd92
fix(release): pin pyjwt to version <2 (#12804) 2021-01-29 12:01:58 +02:00
Ville Brofeldt b8a93fdaf2
fix(release): add typing-extensions as dependency (#12648) 2021-01-22 15:13:44 -08:00
Ahmed Adel e6a76a58d3
feat(db-engine): Add support for Apache Solr (#12403)
* [db engine] Add support for Apache Solr

* Fixing typo
2021-01-15 15:11:56 +02:00
Amit Miran b221417e19
chore: remove harmless incubator refs (#12289)
* chore: migrate all harmless incubator refs like comments and documentation files

* chore: migrate all superset.incubator.apache.org to superset.apache.org to

* chore: migrate dist.apache.org refs

* chore: removing incubating and Disclaimer

* fix: linting issues
2021-01-06 13:45:19 +02:00
Jagadish 732d1ed40b
updated SQLAlchemy=1.3.21 is incompatible in setup.py file. (#12191) 2020-12-23 13:23:29 +02:00
Yongjie Zhao b592cc7e73
feat(explore): time picker enhancement (#11418) 2020-12-17 18:27:21 -08:00
John Bodley c306368f3c
fix: Python dependencies in #11499 (#12079)
Co-authored-by: John Bodley <john.bodley@airbnb.com>
2020-12-17 11:52:21 +13:00
ʈᵃᵢ 6fcda5dac1
feat: add cron picker to AlertReportModal (#12032)
* humanize cron display in list view
2020-12-14 22:29:31 -08:00
Beto Dealmeida 66cd565bff
feat: add Postgres SQL validator (#11538)
* Add Postgres SQL validator

* Strip line number from message

* Add unit tests

* Run tests only with postgres backend

* Add dep

* Add dep to bashlib
2020-12-04 19:17:23 -08:00
Beto Dealmeida 54bf70733f
feat: run BQ queries as single statement (#11904)
* feat: run BQ queries as single statement

* Update deps

* Fix lint

* Update superset/sql_lab.py

Co-authored-by: Ville Brofeldt <33317356+villebro@users.noreply.github.com>

Co-authored-by: Ville Brofeldt <33317356+villebro@users.noreply.github.com>
2020-12-03 13:20:23 -08:00
Daniel Vaz Gaspar 1591d75d2f
fix(setup): disallow python 3.6 for pip install (#11825)
* fix(setup): disallow python 3.6 for pip install

* remove old py constraint
2020-11-26 11:49:12 +00:00
Maxime Beauchemin 9a1fcc70bc
chore: bump pypi cryptography from 2.4.2 to 3.2.1 (#11511) 2020-10-31 13:28:19 -07:00
Daniel Vaz Gaspar 427058b4dc
fix: bump FAB to 3.1.1 (#11444) 2020-10-27 14:54:29 +00:00
Ville Brofeldt 6181994084
chore: bump pandas to latest stable version (#11018)
* chore: bump pandas to latest stable version

* fix nest_values
2020-09-24 13:11:10 +03:00
Ville Brofeldt 9a6697141d
chore: deprecate python 3.6 support (#10803) 2020-09-09 08:51:55 +03:00
Ville Brofeldt 4392c4608f
chore: bump pyarrow (#10733)
* chore: bump pandas an pyarrow

* remove unsupported kwargs

* fix types

* move pandas back to 1.0 branch due to possible MultiIndex regression
2020-08-31 19:55:53 +03:00
Hossein Torabi 8190dcb61f
fix drill installation (#10558) 2020-08-10 11:39:46 -07:00
Ville Brofeldt 3983fff084
ci: bump tests to 3.7 and add support for 3.8 (#10110) 2020-08-05 13:29:07 +03:00
Hossein Torabi 514b29f6df
fix db installaion (#10425) 2020-08-04 21:51:32 -07:00
John Bodley cda764fd4b
chore: Adding pip-compile-multi et al. (#10499)
* chore: Adding pip-compile-multi et al

* Specify requirements.txt path for fossa

* [ci] Fixing CI

Co-authored-by: John Bodley <john.bodley@airbnb.com>
Co-authored-by: Jesse Yang <jesse.yang@airbnb.com>
2020-08-04 19:31:52 -07:00
Bogdan 7075c2ff69
Pin slack client, breaking change (#10345)
Co-authored-by: bogdan kyryliuk <bogdankyryliuk@dropbox.com>
2020-07-20 09:20:05 -07:00
Ville Brofeldt 7af8b2b3f8
feat: add optional prophet forecasting functionality to chart data api (#10324)
* feat: add prophet post processing operation

* add tests

* lint

* whitespace

* remove whitespace

* address comments

* add note to UPDATING.md
2020-07-20 18:46:51 +03:00
Daniel Vaz Gaspar 266238caab
fix: Bump FAB to 3.0.1 fix superset init (#10310) 2020-07-14 15:16:45 +01:00
Daniel Vaz Gaspar 878dbcda3f
feat(api): bump marshmallow and FAB to version 3 (#9964)
* feat(api): bump marshmallow and FAB to version 3

* revert query context tests changes

* obey mypy

* fix tests

* ignore types that collide with marshmallow

* preparing for RC2

* fix tests for marshmallow 3

* typing fixes for marshmallow

* fix tests and black

* fix tests

* bump to RC3 and lint

* Test RC4

* Final 3.0.0

* Address comments, fix tests, better naming, docs

* fix test

* couple of fixes, addressing comments

* bumping marshmallow
2020-07-07 13:26:54 +01:00
Bogdan b7c45fed80
fix: downgrade sqlparse and add unit test (#10165)
* Downgrade sqlparse and add unit test

* Explain why sqlparse is pinned

Co-authored-by: bogdan kyryliuk <bogdankyryliuk@dropbox.com>
2020-07-06 11:10:46 -07:00
Hossein Torabi fdd28c1a5e
Upload excel (#9825) 2020-07-03 08:28:30 +03:00
thibault ketterer 539e11b67e
update to last pyathena >= 1.10.8, to fix athena CSV upload (#10188) 2020-06-29 17:38:58 +03:00
Ville Brofeldt d615949820
chore: Bump sqlalchemy-utils and cachelib and refresh requirements.txt (#10117)
* chore: Bump sqlalchemy-utils and cachelib and refresh requirements.txt

* undeprecate EncryptedType

* black

* reference correct class

Co-authored-by: Maxime Beauchemin <maximebeauchemin@gmail.com>
2020-06-22 16:01:46 +03:00
Bogdan 29e9f2c70b
feat: superset report slack integration (#9810)
* First draft for the slack integration

Fix slack

another typo

another typo

Fix slack

Add channels to the form

another typo

Another set of changes

Make code more transparent

Fix tests

Add logging

logging

use logger

import logging

import logging

import logging

add assert

more logging

Fix channels

Fix channels

* Address comments

* Move slack into a separate module

Co-authored-by: bogdan kyryliuk <bogdankyryliuk@dropbox.com>
2020-06-17 11:01:25 -07:00
Ville Brofeldt 373651efa4
fix: bump pydruid version (#10046) 2020-06-12 18:41:36 +03:00
Karen Palacio 1a6b9d7456
fix: bump pydruid to 0.6.0 (#10014)
* bump pydruid to 0.5.11

* bump pydruid to 0.6.0
2020-06-10 12:40:51 -07:00
Erik Ritter c7c76c6a99
build: Add python 3.8 to the build matrix (#9827) 2020-05-17 14:49:51 -07:00
Ville Brofeldt b532c4609f
chore: bump python dependencies (#9786)
* chore: bump pyhton dependencies

* bump flask-testing

* Add note to UPDATING and bump flask-testing in requirements-dev.txt

* fix old sqlparse test case that is fixed with sqlparse==0.3.1

* Fix migration and sqlparse set test

* downgrade alembic

* Downgrade sqlalchemy-utils

* pin sqlalchemy-utils due to regression in 0.36.5

* Refine comment in setup.py

* make cachelib an explicit requirement
2020-05-13 18:49:34 +03:00
Daniel Vaz Gaspar d373cc8074
perf(dashboards): improve API performance for dashboards (#9704) 2020-05-05 14:30:24 +01:00
Ville Brofeldt aad8209922
chore: Bump PyArrow to latest stable version (#9696) 2020-04-30 22:34:27 +03:00
John Bodley 3b0f8e9c8a
[sql] Adding lighweight Table class (#9649)
Co-authored-by: John Bodley <john.bodley@airbnb.com>
2020-04-30 08:38:02 -07:00
Daniel Vaz Gaspar d81f720502
[thumbnails] API and celery task for dashboards and charts (#8947) 2020-04-15 09:40:14 +01:00
Ville Brofeldt 11ac8c7392
Bump sqlalchemy and dremio deps (#9503) 2020-04-11 08:19:25 +03:00
Ville Brofeldt a8ce3bccdf
feat: Add post processing to QueryObject (#9427)
* Add post processing to QueryObject

* Simplify sort signature and require explicit sort order

* Add new operations and unit tests

* linting

* Address comments

* Simplify test method names

* Address comments

* Linting

* remove unnecessary logic

* Apply strict whitelisting to all getattr calls

* Add checking of rolling_type_options and add/improve docs
2020-04-10 20:50:11 +03:00
Daniel Vaz Gaspar ecfc1f147d
Bump FAB to 2.3.2 (#9491) 2020-04-09 09:07:19 +01:00
Daniel Vaz Gaspar 2e81e27272
[dependency] Fix, Bump FAB to 2.3.1 (#9413) 2020-03-29 16:26:52 +01:00
John Bodley 232925b7bf
[requirements] Telling Celery 4.4.1 it is not welcome here (#9331)
Co-authored-by: John Bodley <john.bodley@airbnb.com>
2020-03-20 10:45:26 -07:00
ʈᵃᵢ 8f7ce168a0
bump FAB to 2.3.0 (#9318) 2020-03-17 22:17:02 +00:00
Ville Brofeldt 91f3cb9878
fix: bump click in setup.py and requirements.txt (#9299)
* bump click

* add token_normalize_func to click cli decorator
2020-03-13 21:36:16 +02:00
Rob DiCiuccio 8cabea5cb8
Update PyArrow to 0.16.0 (#9119) 2020-03-08 23:07:15 +02:00
Daniel Vaz Gaspar 8c095a6e39
Bump FAB to 2.2.4 (#9165) 2020-02-24 18:57:58 +00:00
David Aaron Suddjian 966d321703
[docker] fix, Dockerfile for frontend builds (#9114)
* fix dockerfile for frontend builds

* fix paths

* empty commit for CI

* adjust version_info.json

* making version_info work

* rat

* fixing docker-compose node service

* address feedback
2020-02-12 15:48:24 +00:00
Daniel Vaz Gaspar 30b7064e30
Bump FAB to 2.2.3 (#9117) 2020-02-12 08:59:11 +00:00
David Aaron Suddjian 2913063924 SIP-32: Moving frontend code to the base of the repo (#9098)
* move assets out, get webpack dev working

* update docs to reference superset-frontend

* draw the rest of the owl

* fix docs

* fix webpack script

* rats

* correct docs

* fix tox dox
2020-02-09 17:53:56 -08:00
Arian Treffer 0cf354cc88
Add support for Cockroach DB (#9043)
* Add support for Cockroach DB

* Add documentation, fix installation and style for CockroachDB

* Fix formatting for black
2020-02-08 12:07:02 +02:00
Daniel Vaz Gaspar 6f1c931ff0
Bump FAB to 2.2.2 (#9004) 2020-01-23 16:51:01 +00:00
Ville Brofeldt e46ff239af
Bump pandas to 0.25.3 (#8985)
* Bump pandas to 0.25.3 as per recommendation to get ready for 1.0

* Localize timezone aware Pandas series prior to Arrow conversion
2020-01-22 09:03:19 +02:00
Naren 3bedee75d3 Add support for Dremio as a new source (#8939)
* Added spec for Dremio

* Installation instructions for Dremio

* added dependency for dremio

* Update dremio.py

* ASF header, dttm, set min version in setup.py

* Update installation.rst

* Update installation.rst

* fix tox 'Title underline too short.'

* change URI example

Co-authored-by: Naren <41924335+naren-dremio@users.noreply.github.com>
2020-01-10 17:37:40 +02:00
Daniel Vaz Gaspar 8a00168b63 Bump FAB to 2.2.1 (#8793) 2019-12-09 08:11:21 -08:00
Daniel Vaz Gaspar 3690fb4979
[setup] Fix, sqlalchemy and sqlparse version interval (#8689) 2019-11-28 18:47:19 +00:00
Ville Brofeldt 4a34c553c7
Bump to gunicorn 20 (#8643) 2019-11-24 10:18:22 +02:00
Craig Rueda e490414484 Flask App factory PR #1 (#8418)
* First cut at app factory

* Setting things back to master

* Working with new FLASK_APP

* Still need to refactor Celery

* CLI mostly working

* Working on unit tests

* Moving cli stuff around a bit

* Removing get in config

* Defaulting test config

* Adding flask-testing

* flask-testing casing

* resultsbackend property bug

* Fixing up cli

* Quick fix for KV api

* Working on save slice

* Fixed core_tests

* Fixed utils_tests

* Most tests working - still need to dig into remaining app_context issue in tests

* All tests passing locally - need to update code comments

* Fixing dashboard tests again

* Blacking

* Sorting imports

* linting

* removing envvar mangling

* blacking

* Fixing unit tests

* isorting

* licensing

* fixing mysql tests

* fixing cypress?

* fixing .flaskenv

* fixing test app_ctx

* fixing cypress

* moving manifest processor around

* moving results backend manager around

* Cleaning up __init__ a bit more

* Addressing PR comments

* Addressing PR comments

* Blacking

* Fixes for running celery worker

* Tuning isort

* Blacking
2019-11-20 15:47:06 +00:00
Rob DiCiuccio fc12e53ff5 Bump pyarrow to 0.15.1 due to CVE (#8583) 2019-11-15 09:08:23 -08:00
axuew 763f59fc58 Add support for database engine SAP Hana (#8411)
* Add support for database engine SAP Hana

* Support hana services

Increase time, minute, and second

* Fix hana return string

* Fix formatting errors
2019-11-12 08:42:44 +02:00
ʈᵃᵢ 6bce4f9877 fab 2.2.0 (#8517) 2019-11-11 17:34:08 -08:00
Daniel Vaz Gaspar a757b43164
[db engine] Add support for Elasticsearch (#8441)
* [db engine] Add support for Elasticsearch
2019-10-28 16:04:14 +00:00
Daniel Vaz Gaspar 59889a4436
[setup] Fix, download_url (#8439)
* [setup] Fix, download_url
2019-10-25 08:59:06 +01:00
John Bodley b91205d991
[pydruid] Bumping the pydruid version (#8430) 2019-10-22 15:19:37 -07:00
Ville Brofeldt 52a84d2581
Add explicit support for python 3.7 (#8309) 2019-09-27 17:54:45 +03:00
Maxime Beauchemin 30483cee31
chore: fix version info (#8196)
* Fix version info

Ran into Cypress issues while getting too ambitious in #8157
this is a simplified more targeted version of it

* include package.json (but not under static/)
* use package.json as single source of truth for version info

* typo
2019-09-10 22:25:58 -07:00
Daniel Vaz Gaspar 055d2ef252 Bump FAB to 2.1.13 (#8176)
* Bump FAB to 2.1.13

* [SQLLab] dummy commit

* [SQLLab] remove dummy commit

* [SQLLab] test

* [SQLLab] bump back to 13
2019-09-08 22:06:24 -07:00
ericandrewmeadows ae0dc30c0a Fix to Werkzeug ProxyFix; expose ProxyFix configuration items (#8117)
* Fix to werkzeug proxy; expose additional configuration items

* Forced to all x-forwarded configurations ON; black done

* added comments related to x_port after testing

* Updated UPDATING.md

* Removed accidental notebook; added *.ipynb to gitignore

* Delete Untitled-checkpoint.ipynb
2019-09-04 10:21:13 -07:00
serenajiang 00257b9433 [sqllab] add retries for stop_query (#8139)
* [sqllab] add retries for stop_query

* use backoff for retries

* address PR comments

* import statement order
2019-09-03 16:37:42 -07:00
Daniel Vaz Gaspar 6aa10dc016 [setup] use new python requires metadata key (#8135) 2019-08-28 10:12:46 -07:00
Rob DiCiuccio 7595d9e5fd [SQL Lab] Async query results serialization with MessagePack and PyArrow (#8069)
* Add support for msgpack results_backend serialization

* Serialize DataFrame with PyArrow rather than JSON

* Adjust dependencies, de-lint

* Add tests for (de)serialization methods

* Add MessagePack config info to Installation docs

* Enable msgpack/arrow serialization by default

* [Fix] Prevent msgpack serialization on synchronous queries

* Add type annotations
2019-08-27 14:23:40 -07:00
Dave Smith 995b96fc52 remove idna req from setup.py (#8067) 2019-08-20 18:04:59 -07:00
Daniel Vaz Gaspar 73cdad2375 [SQLLab] Fix, database api unlimited page size v2 (#8002)
* [database] Fix, Removes the limit for the page size, Bump FAB to 2.1.8

Old FAB API had no limits by default, this will keep this behaviour
but only for this endpoint

* [sqllab] Add test for database API

* [sqllab] Add test for database API

* [sqllab] Include page zero on request

* [sqllab] Fix, Black and requirements

* [sqllab] Make database API return unlimited results

* [sqllab] just a test

* [sqllab] Bump FAB to 2.1.9

* [sqllab] Remove unused import
2019-08-08 11:37:00 -07:00
Erik Ritter e830474e5b Revert "Bump FAB to 2.1.8 (#7986)" (#7996)
This reverts commit 0c817e5fa9.
2019-08-06 16:56:02 -07:00
Daniel Vaz Gaspar 0c817e5fa9 Bump FAB to 2.1.8 (#7986) 2019-08-05 22:52:17 -07:00
Ville Brofeldt a1261d7f9a
Bump sqlparse to 0.3.0 (#7973)
* Black

* Bump sqlparse to 0.3.0

* Convert str.format() to f-string
2019-08-05 17:08:05 +03:00
Gianluca Ciccarelli e23920b8ba 7620: Start removing dependencies on requests (#7643)
* 7620: Start removing dependencies on requests

* Patch urllib.request.urlopen instead of requests.get

* Try to fix flake8

* More work on flake8 import errors

* First attempt at using urllib with cookies

* Fix pylint/flake8

* Fix test_deliver_slice_csv_attachment

* Fix test_deliver_slice_csv_inline

* Import requests and pydruid conditionally, remove dependency on prison

* Fix flake errors

* Fix load_examples

* Please flake

* Skip tests depending on optional deps

* Try to please flake

* Address review comments

* Remove Druid-related UI

* Revert "Remove Druid-related UI"

This reverts commit d7e0f166cc3f3dd2496b4a666e177f0c191aeb0f.

* Skip a few tests more

* Put imports in right order

* Apply black patch

* Please flake

* Please black, silence flake

* Use flake8 silencing the right way

* Add deps for CI
2019-08-02 10:01:28 -07:00
Ville Brofeldt cbac428b28 Bump python requirements file (#7965)
* Bump requirements.txt

* Cap gunicorn to <19.9.0 due to X-Forwarded-Proto regression

* Remove python-dotenv from requirements-dev.txt

* Cap sqlparse due to regression in 0.3.0
2019-08-01 13:41:07 -07:00
Ville Brofeldt f53acd84a7 Bump pandas to 0.24 (#7852) 2019-07-14 08:38:11 -07:00
Daniel Vaz Gaspar 5ebc5a69d9 [celery] Bump celery to 4.3.0 (#7848)
* [celery] Bump celery to 4.3.0

* re-triggering CI

* re-trigger CI

* Bump redis to 3.2.1
2019-07-12 08:41:58 -07:00
Daniel Vaz Gaspar f5839c413e Bump FAB to 2.1.6 (#7832) 2019-07-08 09:33:40 -07:00
John Bodley 5c58fd1802
[format] Using Black (#7769) 2019-06-25 13:34:48 -07:00
Maxime Beauchemin 859d6e7c6a
chore: taking db dependencies out of requirements-dev.txt (#7605)
* chore: taking db dependencies out of requirements-dev.txt

The deps on mysqlclient and psycopg2

* Fix unit tests

* fix tox.ini

* fix tests
2019-06-23 22:37:41 -07:00
Ville Brofeldt 1c4092c61c Add csv upload support for BigQuery (#7756)
* Add extra_require for bigquery to setup.py

* Refactor df_to_db and add df upload capability for BigQuery

* Fix unit tests and clarify kwarg logic

* Fix flake8 errors

* Add minimum versions for bigquery dependencies

* wrap to_gbq in try-catch block and raise error if pandas-gbq is missing

* Fix linting error and make error more generic
2019-06-23 14:20:09 -07:00
Daniel Vaz Gaspar f09c916879 Bump FAB to 2.1.5 (#7750) 2019-06-21 19:43:10 +03:00
Ville Brofeldt 437ca09f94 Bump sqla to 1.3.5 (#7729) 2019-06-19 09:50:10 -07:00
Daniel Vaz Gaspar 6eb60ed89d Bump FAB to 2.1.4 (#7478)
* Bump FAB to 2.1.0

* Bump FAB to 2.1.1

* Bump FAB to 2.1.2

* Test revert to 2.1.1

* again to 2.1.2

* Bump FAB to 2.1.4
2019-06-09 18:25:31 -07:00
Maxime Beauchemin fd5befee38
Bump python libs, address insecure releases (#7550)
* Bump python libs, address insecure releases

Using
https://requires.io/github/mistercrunch/superset/requirements/?branch=apache_release_improv
to identify insecure, old releases we're using and bumping.

* redis <3.0

* fix new flakes
2019-05-28 21:03:49 -07:00
Maxime Beauchemin 551fe926cf
Add dotenv to dependencies (#7330) 2019-05-21 13:21:05 -07:00
John Bodley a4392c8fcd
[security] Adding Flask-Talisman (#7443) 2019-05-13 17:08:24 -07:00
Luca Toscano 51fd43a47b druid connector: avoid using 'dimensions' for scan queries (#7377)
After the following PyDruid change (contained in version 0.5.2)
the Superset Histogram charts rendered with Druid data are
broken:

druid-io/pydruid@0a59a70

Bump the pydruid requirements accordingly in setup.py

Issue: apache#7368
2019-05-09 00:25:34 -05:00
Russell Jurney 70be44afe1 Removed --console-log and superset runserver (#7421) 2019-05-01 20:46:39 -07:00
Daniel Vaz Gaspar 06c4610e8e Bump FAB to 2.0.0 (#7323)
* Bump FAB to 2.0.0

* [tests] whitelist SecurityApi login and refresh endpoints

* [style] Fix, C812 missing trailing commas

* [security] Remove SUPERSET_UPDATE_PERMS flag

Registering sources needs to be performed after the views are
initialized on UPDATE_PERMS=False configuration

* [docs] New, FAB_UPDATE_PERMS and flask fab cli

* [docs] Fix, db upgrade needs to come first, create-admin needs a db

* [cli] New, superset init bootstraps all permissions for FAB and Superset

* [style] Fix, flakes
2019-04-30 09:01:18 -07:00
John Bodley ee36ce8b31 chore: updating extra requires (#7115) 2019-03-27 13:48:11 -07:00
Maxime Beauchemin 215ed392a1 Bump python lib croniter to an existing version (#7132)
Package maintainers should really never delete packages, but it appears
this happened with croniter and resulted in breaking our builds.

This PR bumps to a more recent existing version of the library
2019-03-26 13:27:16 -07:00
Ville Brofeldt 23e823f0c1 Bump SQLAlchemy to 1.3 (#7099)
* Bump sqla to >=1.3.1

* Refine mssql column types to only use N-prefixing when necessary

* make join explicit

* replace set with list

* Add additional test case for N-prefix

* Replace engine with dialect and fix linting error

* Remove unneeded import
2019-03-24 20:44:05 -07:00
Daniel Vaz Gaspar 10d003346f Bump FAB to 1.12.5 (#7085)
* Bump FAB to 1.12.5

* [requirements] New dependency pyJWT added on FAB 1.12.4 for OAuth redirect

* [requirements] Fix, pip-tools bump to 3.5.0 related to #714
2019-03-21 17:03:52 -07:00
Boris Hajduk 5137539a86 [fix] Use HTTPS, not HTTP wherever practical (#7040)
* Download RAT binary via HTTPS, not HTTP

* Merge branch 'patch-1' of github.com:hajdbo/incubator-superset into patch-1
2019-03-17 23:21:32 -07:00
Maxime Beauchemin d308c842f9
Bump sqlalchemy dependency (#7000)
* Bump sqlalchemy dep

* Addressing comments
2019-03-11 23:03:20 -07:00
Maxime Beauchemin de403de6fe
Bump FAB to 1.12.3 (#6854)
Related CHANGELOG:
https://github.com/dpgaspar/Flask-AppBuilder/blob/master/docs/versions.rst#improvements-and-bug-fixes-on-1123
2019-02-11 22:36:18 -08:00
John Bodley e1b907783a
[wtforms] Using wtforms-json which supports None (#5445) 2019-02-04 09:35:40 -08:00
ziheng 83ee917832 [fix] `pandas`>=0.24.0 datetimelike API changes (#6765) 2019-01-27 17:29:56 -08:00
Marcus 01689c38ea bump PyHive version for prod requirements.txt (#6751) 2019-01-24 23:11:22 -08:00
Maxime Beauchemin f742b9876b
Making thrift, pyhive and tableschema as extra_requires (#6696)
* Making thrift, pyhive and tableschema as extra_requires

Looking at the dependency tree for license related questions, I noticed
that tableschema had a huge tree, and only people running Hive really
need it. Making this as well as pyhive and thrift optional.

Also bumping some python dependencies

* Run pip-compile

* Removing refs to past.builtins (from future lib)

* Add thrift
2019-01-19 14:27:18 -08:00
bolkedebruin 3cc7cdfee0 Fix setup.py ASF issues (#6677)
* This renames the package to apache-superset instead of superset.
  This is required.
* It sets the download location to the official ASF repositories
2019-01-19 03:16:33 -08:00
Maxime Beauchemin 1dd4d7a587
Apply ASF licenses throughout the code base (#5800)
* Add license headers

* reabased

* lint

* Removing licenses from vendors folder
2019-01-15 15:53:27 -08:00
Maxime Beauchemin ae6217ba55
Remove dep on unidecode (#6673)
Not needed anymore in py3
2019-01-13 09:22:13 -08:00
Tao Feng fafa6b4dda Minor doc fix for superset (#6662) 2019-01-11 09:50:31 -08:00
Mahendra M fbf9586adf Bump requirements (#6625)
* Bump requirements

* Fix setup.py for email reports
2019-01-09 16:00:04 -08:00
Beto Dealmeida 3c17dac35a
Upgrade gsheetsdb (#6609) 2019-01-07 22:48:33 -08:00
Patrick Tyler Haas d99b36e892 Fix: updated required cryptography version to 2.4.2 to resolve #6509 (#6516)
* Fix: updated required cryptography version to 2.4.2 to resolve #6509

* Fix: updated cryptography version to 2.4.2 to resolve #6509

* Fix: updated cryptography version to 2.4.2 to resolve #6509

* Revert "Fix: updated required cryptography version to 2.4.2 to resolve #6509"

This reverts commit b57b08c8e5.

* Fix: updated cryptography version to 2.4.2
2018-12-27 14:14:01 -08:00
Maxime Beauchemin 6e942c9fb3
Make boto3/botocore installation optional (#6540)
* Make boto3 installation optional

* pylinting
2018-12-21 12:27:57 -08:00
Beto Dealmeida 852c51219b Update requests version (#6510)
* Update requests version

* Run pip-compile --output-file requirements.txt
2018-12-11 22:01:06 -08:00
Mahendra M 808622414c [SIP-3] Scheduled email reports for Slices / Dashboards (#5294)
* [scheduled reports] Add support for scheduled reports

* Scheduled email reports for slice and dashboard visualization
  (attachment or inline)
* Scheduled email reports for slice data (CSV attachment on inline table)
* Each schedule has a list of recipients (all of them can receive a single mail,
  or separate mails)
* All outgoing mails can have a mandatory bcc - for audit purposes.
* Each dashboard/slice can have multiple schedules.

In addition, this PR also makes a few minor improvements to the celery
infrastructure.
* Create a common celery app
* Added more celery annotations for the tasks
* Introduced celery beat
* Update docs about concurrency / pools

* [scheduled reports] - Debug mode for scheduled emails

* [scheduled reports] - Ability to send test mails

* [scheduled reports] - Test email functionality - minor improvements

* [scheduled reports] - Rebase with master. Minor fixes

* [scheduled reports] - Add warning messages

* [scheduled reports] - flake8

* [scheduled reports] - fix rebase

* [scheduled reports] - fix rebase

* [scheduled reports] - fix flake8

* [scheduled reports] Rebase in prep for merge

* Fixed alembic tree after rebase
* Updated requirements to latest version of packages (and tested)
* Removed py2 stuff

* [scheduled reports] - fix flake8

* [scheduled reports] - address review comments

* [scheduled reports] - rebase with master
2018-12-10 22:29:29 -08:00
Beto Dealmeida f366bbe735
Google spreadsheets (#5915)
* Google spreadsheets

* Fetch table metadata in SQL Lab

* Show full URL for spreadsheet

* Fix version

* Remove sqllab changes
2018-12-10 13:11:54 -08:00
Maxime Beauchemin e46ab4db52
Bump Flask, bleach and sync pip-compile (#6239)
* sync pip-compile

* Support Flask >= 1.0.0

* pylint

* Trying something else to fix pylint
2018-10-31 16:58:50 -07:00
Maxime Beauchemin 0f6b39a6f7
A few setup.py improvements, removing future lib (#6219) 2018-10-29 21:22:25 -07:00
Maxime Beauchemin 7db11d95b0 [setup.py] allow for range on boto library (#6071) 2018-10-29 11:05:35 -07:00
Maxime Beauchemin 81fc3dfbee [build] fix pip install issues on OSX High Sierra (#6201)
* [build] fix pip install issues on OSX High Sierra

I think requirements.txt was out-of-sync as well.

Also had to:
export
  LDFLAGS="-L/usr/local/opt/openssl/lib"
export
  CPPFLAGS="-I/usr/local/opt/openssl/include"
export
  PKG_CONFIG_PATH="/usr/local/opt/openssl/lib/pkgconfig"

* Fix click
2018-10-29 10:33:51 -07:00
Maxime Beauchemin 9e6b171ee9 Bump FAB to 1.12.1 (#6138) 2018-10-23 15:02:29 -07:00
timifasubaa 46c86672c8 remove utf8 declaration (#6096) 2018-10-15 11:53:24 -07:00
timifasubaa dd9eeda03e
remove future (#6065) 2018-10-13 09:39:04 -07:00
timifasubaa 047c8b0943
remove six dependency (#6091) 2018-10-13 09:38:46 -07:00
Joshua Carp 9dcf8e101a Upgrade flask-appbuilder to latest. (#6030)
* Upgrade flask-appbuilder to latest.

* Skip constraint deletes if not exist.

* Document breaking change in flask-login.
2018-10-08 12:40:52 -04:00
Maxime Beauchemin 160e47720c
Deprecate support for Python < 3.6 (#5985)
* Deprecate support for Python < 3.6

This is a first step, beyond this we can:
* remove all from future imports
* remove 'six' lib as a dependency
* start using f-strings
* enjoy ourselves

* fix tox

* Rebasing

* fix
2018-10-05 13:44:45 -04:00
Mạnh Tài 458b2b5970 Explicit set markdown version to >= 3.0 (#5959)
* Explicit set markdown version to >= 3.0

* Pinning
2018-09-26 23:48:13 -07:00
Victor Noël 5811a26101 Constrain the max version of markdown (#5967)
Closes #5958
2018-09-24 11:41:16 -07:00
Maxime Beauchemin 94cb20cf96
Apply SQL_QUERY_MUTATOR to explore & dashboard (#5493)
* Apply SQL_QUERY_MUTATOR kn explore & dashboard

* Add unit test
2018-07-26 15:20:23 -07:00
timifasubaa bea0a0aa15 fix migration 3dda56f1c (#5468)
* fix migration 3dda56f1c

* add isodate to setup.py:
2018-07-23 16:27:41 -07:00
gbates101 90decbc5db Migrated to click (#5410)
* Migrate flask_script to the Flask built-in click.

Flask 0.11 is the built-in integration of the click command line interface.
Flask-Migrate support for the new Flask CLI based on Click after Release 2.0.0.

* Resolved merge conflicts.

* Fixed issue introduced from bad merge.

* Fixed flake8 errors, added build to excluded flake8 stuff.

* * Moved the FlaskGroup declaration to the driver script.
* Moved shell context definition to cli.py
* Switched shell context definition to use decorator.
* Moved create_app definition to cli.py
* Fixed InvocationError with a wrapped function

* Added extra newlines between functions

* Removed flask-script dependency.
2018-07-20 15:26:33 -07:00
Maxime Beauchemin 996304aba9
Make Pypi upload support markdown (#5352)
Moving to using Twine to upload to pypi and fixing up the markdown
support so that the page on Pypi looks like the README on Github.

This has been tested on the 0.26 branch starting 0.26.3
2018-07-16 12:27:57 -07:00
Ville Brofeldt 6fee0587ee Implement rolling api introduced in pandas 0.18 (#5328)
* Implement new rolling api introduced in pandas 0.18

* Bump pandas to 0.23.1

* Add 0.18 requirement in setup.py

* Require >=0.18.0, not just 0.18
2018-07-04 18:04:57 -04:00
Riccardo Magliocchetti 81bd5cc4c3 A couple of setup.py fixes (#5338)
* setup: fix long description read in python2

* setup: fix git_get_sha in python3

Fix #5317
2018-07-04 17:04:39 -04:00
Maxime Beauchemin 885d7791a0
[bugfix] README encoding-related UnicodeDecodeError on setup.py (#5309)
Seeing UnicodeDecodeError on our build system running py3.6, though I
couldn't reproduce on my local 3.6. This fix addresses the issue.
2018-07-01 08:57:14 -07:00
Jeffrey Wang fb988fee2e Pin boto3 to 1.4.7 (#5290) 2018-06-27 08:55:47 -07:00
timifasubaa b0eee129e9
add more precise types to hive table from csv (#5267) 2018-06-25 16:12:01 -07:00
Maxime Beauchemin 409ac6824a
[sql lab] Fix issue around VARBINARY type in Presto (#5121)
When receiving a VARBINARY field out of Presto, it shows up as type
`bytes` out of the pyhive driver. Then the pre 3.15 version of
simplejson attempts to convert it to utf8 by default and it craps out.

I bumped to simplejson>=3.25.0 and set `encoding=None` as documented
here
https://simplejson.readthedocs.io/en/latest/#basic-usage so that we can
handle bytes on our own.
2018-06-20 12:16:59 -07:00
Louis-Etienne 70679d4c93 Pin botocore version (#5184)
* Pin botocore version

* Version range for botocore
2018-06-19 08:49:51 -07:00
Riccardo Magliocchetti c670621012 setup: improve description (#5226)
* setup: improve description

* setup: use README.md as long_description

As pypy.io now should render markdown.
2018-06-18 08:42:48 -07:00
Ville Brofeldt ccf211036d Bump Celery to 4.2.0 (#5222)
* Downgrade celery and kombu

* Remove kombu from requirements.txt

* Pin kombu at 4.1.0

* Bump celery to 4.2.0
2018-06-18 08:19:07 -07:00
Maxime Beauchemin d2bc4ece3e
Bump celery to 4.1.1 (#5134)
* Bump celery to 4.1.1

Docs reference `celery worker --app=superset.sql_lab:celery_app
--pool=gevent -Ofair` command which seems only to work with Celery 4.1.1

* Add UPDATING.md message
2018-06-04 14:54:36 -07:00
Maxime Beauchemin ffd65ce623
Pin FAB to 1.10.0 (#5133)
Related to
https://github.com/apache/incubator-superset/issues/5088#issuecomment-394064133
2018-06-04 09:03:30 -07:00
Maxime Beauchemin f6117973e9
Bump dep on pydruid to 0.4.3 (#5098) 2018-05-30 09:15:10 -07:00
Maxime Beauchemin ce0011e5fc
Add missing dep on contextlib2 (#5027) 2018-05-21 13:19:07 -07:00
Maxime Beauchemin 2ba929ac9e Fix flask<1.0.0
Made a mistake originally, meant to flask<1.0.0
2018-05-16 18:37:14 -05:00
Maxime Beauchemin 2c5200affd
[deps] force flask<=1.0.0 (#4959)
flask 1.0 came out and has backwards incompatible changes. People
are reporting that fresh install doesn't work anymore.

fixes https://github.com/apache/incubator-superset/issues/4953

We should ship a 0.25.1 with this in
2018-05-13 11:16:09 -07:00
Maxime Beauchemin 45ffed9976
Move from deprecated flask-cache to flask-caching (#4944)
It appears the officially maintained fork of flask-cache is
flask-caching https://github.com/sh4nks/flask-caching . It is fully
compatible with flask-cache.
2018-05-07 23:18:46 -07:00
Maxime Beauchemin 590e3462d6
Fix 'pip install .' (#4856)
* Fix 'pip install .'

Fix error :
> flask-appbuilder 1.10.0 has requirement Flask-SQLAlchemy==2.1,
> but you'll have flask-sqlalchemy 2.3.2 which is incompatible.
> botocore 1.10.5 has requirement python-dateutil<2.7.0,>=2.1, but you'll
> have python-dateutil 2.7.2 which is incompatible.

* remove flask-sqlalchemy==2.1 from reqs.txt
2018-04-23 08:16:22 -07:00
John Bodley 44c2d5bdab
[setup] Dropping 3.4 and adding 3.6 (#4835)
* [setup] Dropping 3.4 and 3.6

* Update tox.ini

* Update .travis.yml
2018-04-17 21:30:12 -07:00
Beto Dealmeida fd84fd89ce RFC: add logger that logs into browser console (#4702)
* Option for logging into browser console

* Move import

* Add lint req

* Add docs, use Flask logger
2018-04-12 21:48:17 -07:00
John Bodley 1627fd096b
[travis/tox] Restructuring configuration (#4552) 2018-04-10 15:59:44 -07:00
John Bodley 68bfcefb27 [flask-appbuilder] Bumping version to 1.10.0 (#4603) 2018-04-02 21:35:10 -07:00
John Bodley b3442a7b53
[cli] Deprecating gunicorn/flower dependencies (#4451) 2018-03-30 09:28:16 -07:00