2019-01-22 11:21:13 -05:00
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->
2018-03-27 19:46:02 -04:00
# Updating Superset
This file documents any backwards-incompatible changes in Superset and
assists people when migrating to a new version.
2019-12-03 13:51:06 -05:00
## Next
2020-02-24 19:49:56 -05:00
2020-03-05 14:15:47 -05:00
* [8867 ](https://github.com/apache/incubator-superset/pull/8867 ): a change which adds the `tmp_schema_name` column to the `query` table which requires locking the table. Given the `query` table is heavily used performance may be degraded during the migration. Scheduled downtime may be advised.
2020-03-05 00:25:50 -05:00
* [9238 ](https://github.com/apache/incubator-superset/pull/9238 ): the config option `TIME_GRAIN_FUNCTIONS` has been renamed to `TIME_GRAIN_EXPRESSIONS` to better reflect the content of the dictionary.
2020-03-02 16:13:11 -05:00
* [9218 ](https://github.com/apache/incubator-superset/pull/9218 ): SQLite connections have been disabled by default
for analytics databases. You can optionally enable SQLite by setting `PREVENT_UNSAFE_DB_CONNECTIONS` to `False` .
It is not recommended to change this setting, as arbitrary SQLite connections can lead to security vulnerabilities.
2020-02-24 19:49:56 -05:00
* [9133 ](https://github.com/apache/incubator-superset/pull/9133 ): Security list of permissions and list views has been
2020-03-02 16:13:11 -05:00
disable by default. You can optionally enable them back again by setting the following config keys:
`FAB_ADD_SECURITY_PERMISSION_VIEW` , `FAB_ADD_SECURITY_VIEW_MENU_VIEW` , `FAB_ADD_SECURITY_PERMISSION_VIEWS_VIEW` to `True` .
2020-02-20 14:15:12 -05:00
* [9173 ](https://github.com/apache/incubator-superset/pull/9173 ): Changes the encoding of the query source from an int to an enum.
2020-02-24 19:49:56 -05:00
2020-02-19 12:51:50 -05:00
* [9120 ](https://github.com/apache/incubator-superset/pull/9120 ): Changes the default behavior of ad-hoc sharing of
queries in SQLLab to one that links to the saved query rather than one that copies the query data into the KVStore
model and links to the record there. This is a security-related change that makes SQLLab query
sharing respect the existing role-based access controls. Should you wish to retain the existing behavior, set two feature flags:
`"KV_STORE": True` will re-enable the `/kv/` and `/kv/store/` endpoints, and `"SHARE_QUERIES_VIA_KV_STORE": True`
will tell the front-end to utilize them for query sharing.
2020-02-24 19:49:56 -05:00
2020-02-20 14:15:12 -05:00
* [9109 ](https://github.com/apache/incubator-superset/pull/9109 ): Expire `filter_immune_slices` and
2020-02-14 16:26:04 -05:00
`filter_immune_filter_fields` to favor dashboard scoped filter metadata `filter_scopes` .
2020-02-05 03:58:12 -05:00
* [9046 ](https://github.com/apache/incubator-superset/pull/9046 ): Replaces `can_only_access_owned_queries` by
2020-02-20 14:15:12 -05:00
`all_query_access` favoring a white list approach. Since a new permission is introduced use `superset init`
2020-02-05 03:58:12 -05:00
to create and associate it by default to the `Admin` role. Note that, by default, all non `Admin` users will
not be able to access queries they do not own.
2020-01-16 00:51:13 -05:00
* [8901 ](https://github.com/apache/incubator-superset/pull/8901 ): The datasource's update
timestamp has been added to the query object's cache key to ensure updates to
datasources are always reflected in associated query results. As a consequence all
previously cached results will be invalidated when updating to the next version.
2019-12-03 13:51:06 -05:00
2020-03-02 16:13:11 -05:00
* [8699 ](https://github.com/apache/incubator-superset/pull/8699 ): A `row_level_security_filters`
table has been added, which is many-to-many with `tables` and `ab_roles` . The applicable filters
are added to the sqla query, and the RLS ids are added to the query cache keys. If RLS is enabled in config.py (`ENABLE_ROW_LEVEL_SECURITY = True`; by default, it is disabled), they can be
2020-02-22 04:21:31 -05:00
accessed through the `Security` menu, or when editting a table.
2020-01-16 00:51:13 -05:00
* [8732 ](https://github.com/apache/incubator-superset/pull/8732 ): Swagger user interface is now enabled by default.
2019-12-04 04:50:56 -05:00
A new permission `show on SwaggerView` is created by `superset init` and given to the `Admin` Role. To disable the UI,
set `FAB_API_SWAGGER_UI = False` on config.
2019-12-03 13:51:06 -05:00
* [8721 ](https://github.com/apache/incubator-superset/pull/8721 ): When using the cache
warmup Celery task you should now specify the `SUPERSET_WEBSERVER_PROTOCOL` variable
in your configuration (probably either "http" or "https"). This defaults to "http".
2019-11-27 14:28:23 -05:00
* [8512 ](https://github.com/apache/incubator-superset/pull/8512 ): `DRUID_IS_ACTIVE` now
defaults to False. To enable Druid-API-based functionality, override the
`DRUID_IS_ACTIVE` configuration variable by setting it to `True` for your deployment.
2019-12-03 13:51:06 -05:00
* [8450 ](https://github.com/apache/incubator-superset/pull/8450 ): The time range picker
2019-10-28 16:05:01 -04:00
now uses UTC for the tooltips and default placeholder timestamps (sans timezone).
2019-12-06 16:15:12 -05:00
* [8418 ](https://github.com/apache/incubator-superset/pull/8418 ): FLASK_APP / Worker App
have changed. FLASK_APP should be updated to `superset.app:create_app()` and Celery Workers
should be started with `--app=superset.tasks.celery_app:app`
2020-02-03 13:37:29 -05:00
* [9017 ](https://github.com/apache/incubator-superset/pull/9017 ): `SIP_15_ENABLED` now
defaults to True which ensures that for all new SQL charts the time filter will behave
like [start, end). Existing deployments should either disable this feature to keep the
status quo or inform their users of this change prior to enabling the flag. The
`SIP_15_GRACE_PERIOD_END` option provides a mechanism for specifying how long chart
owners have to migrate their charts (the default is indefinite).
2019-12-04 12:04:21 -05:00
## 0.35.0
2019-10-17 12:09:25 -04:00
* [8370 ](https://github.com/apache/incubator-superset/pull/8370 ): Deprecates
the `HTTP_HEADERS` variable in favor of `DEFAULT_HTTP_HEADERS` and
`OVERRIDE_HTTP_HEADERS` . To retain the same behavior you should use
`OVERRIDE_HTTP_HEADERS` instead of `HTTP_HEADERS` . `HTTP_HEADERS` will still
work but may be removed in a future update.
chore: deprecate restricted metrics (#8197)
* chore: deprecate restricted metrics
An early community contribution added the concept of restricted metrics.
The idea was to allow for some metrics to be restricted, and if a metric
was tagged as such, a user would need to be given access to that metric
more explicitely, through a special perm we would maintain for that
metric.
Now since the new concept of "Adhoc Metrics", the popover that lets a
user pick a column and an aggregate function or to write their own SQL
expression inline, this restriction is completely bypassed. Adhoc
metrics was developed without the restricted metrics in mind.
Anyhow, in the near future, we'll be rethinking the ideas behind
data-access permissions, and things like column-level or row-level
security will be redesigned from scratch.
By deprecating this feature, we're removing a confusing and mostly broken
feature, and making it easy to move forward
* Use context manager to drop columns
* disable jest's maxWorkers
2019-09-09 20:20:32 -04:00
* We're deprecating the concept of "restricted metric", this feature
was not fully working anyhow.
2019-09-04 13:21:13 -04:00
* [8117 ](https://github.com/apache/incubator-superset/pull/8117 ): If you are
using `ENABLE_PROXY_FIX = True` , review the newly-introducted variable,
`PROXY_FIX_CONFIG` , which changes the proxy behavior in accordance with
[Werkzeug ](https://werkzeug.palletsprojects.com/en/0.15.x/middleware/proxy_fix/ )
2019-08-27 17:23:40 -04:00
* [8069 ](https://github.com/apache/incubator-superset/pull/8069 ): introduces
[MessagePack ](https://github.com/msgpack/msgpack-python ) and
[PyArrow ](https://arrow.apache.org/docs/python/ ) for async query results
backend serialization. To disable set `RESULTS_BACKEND_USE_MSGPACK = False`
in your configuration.
2019-10-15 19:51:04 -04:00
* [8371 ](https://github.com/apache/incubator-superset/pull/8371 ): makes
`tables.table_name` , `dbs.database_name` , `datasources.cluster_name` , and `clusters.cluster_name` non-nullable.
Depending on the integrity of the data, manual intervention may be required.
2019-09-10 13:36:07 -04:00
## 0.34.0
chore: deprecate restricted metrics (#8197)
* chore: deprecate restricted metrics
An early community contribution added the concept of restricted metrics.
The idea was to allow for some metrics to be restricted, and if a metric
was tagged as such, a user would need to be given access to that metric
more explicitely, through a special perm we would maintain for that
metric.
Now since the new concept of "Adhoc Metrics", the popover that lets a
user pick a column and an aggregate function or to write their own SQL
expression inline, this restriction is completely bypassed. Adhoc
metrics was developed without the restricted metrics in mind.
Anyhow, in the near future, we'll be rethinking the ideas behind
data-access permissions, and things like column-level or row-level
security will be redesigned from scratch.
By deprecating this feature, we're removing a confusing and mostly broken
feature, and making it easy to move forward
* Use context manager to drop columns
* disable jest's maxWorkers
2019-09-09 20:20:32 -04:00
* [7848 ](https://github.com/apache/incubator-superset/pull/7848 ): If you are
2019-07-15 13:22:20 -04:00
running redis with celery, celery bump to 4.3.0 requires redis-py upgrade to
3.2.0 or later.
2019-06-12 01:34:53 -04:00
* [7667 ](https://github.com/apache/incubator-superset/pull/7667 ): a change to
make all Unix timestamp (which by definition are in UTC) comparisons refer
to a timestamp in UTC as opposed to local time.
2019-07-03 17:05:59 -04:00
* [7653 ](https://github.com/apache/incubator-superset/pull/7653 ): a change
which deprecates the table_columns.database_expression column. Expressions
should be handled by the DB engine spec conversion, Python date format, or
custom column expression/type.
2019-07-04 01:33:14 -04:00
* The repo no longer contains translation binaries (`.mo`) files. If you
want translations in your build, you now have to run the command
`babel-compile --target superset/translations` as part of your builds
2019-04-23 16:22:29 -04:00
* [5451 ](https://github.com/apache/incubator-superset/pull/5451 ): a change
which adds missing non-nullable fields to the `datasources` table. Depending on
the integrity of the data, manual intervention may be required.
2019-04-23 21:06:21 -04:00
* [5452 ](https://github.com/apache/incubator-superset/pull/5452 ): a change
2020-01-16 00:51:13 -05:00
which adds missing non-nullable fields and uniqueness constraints (which may be
case insensitive depending on your database configuration) to the `columns` and
`table_columns` tables. Depending on the integrity of the data, manual
2019-10-29 21:01:49 -04:00
intervention may be required.
2019-04-30 12:01:18 -04:00
* `fabmanager` command line is deprecated since Flask-AppBuilder 2.0.0, use
the new `flask fab <command>` integrated with *Flask cli* .
2019-06-12 01:34:53 -04:00
* `SUPERSET_UPDATE_PERMS` environment variable was replaced by
2019-04-30 12:01:18 -04:00
`FAB_UPDATE_PERMS` config boolean key. To disable automatic
creation of permissions set `FAB_UPDATE_PERMS = False` on config.
2019-04-25 00:50:14 -04:00
* [5453 ](https://github.com/apache/incubator-superset/pull/5453 ): a change
2020-01-16 00:51:13 -05:00
which adds missing non-nullable fields and uniqueness constraints (which may be
2019-10-29 21:01:49 -04:00
case insensitive depending on your database configuration) to the metrics
2019-04-25 00:50:14 -04:00
and sql_metrics tables. Depending on the integrity of the data, manual
intervention may be required.
2019-06-19 13:10:18 -04:00
* [7616 ](https://github.com/apache/incubator-superset/pull/7616 ): this bug fix
changes time_compare deltas to correctly evaluate to the number of days prior
instead of number of days in the future. It will change the data for advanced
analytics time_compare so `1 year` from 5/1/2019 will be calculated as 365 days
instead of 366 days.
2019-04-25 00:50:14 -04:00
2019-01-19 17:27:18 -05:00
## Superset 0.32.0
2019-04-10 11:46:05 -04:00
* `npm run backend-sync` is deprecated and no longer needed, will fail if called
2019-04-23 16:22:29 -04:00
* [5445 ](https://github.com/apache/incubator-superset/pull/5445 ): a change
which prevents encoding of empty string from form data in the database.
2019-02-04 12:35:40 -05:00
This involves a non-schema changing migration which does potentially impact
a large number of records. Scheduled downtime may be advised.
2018-12-21 13:24:49 -05:00
## Superset 0.31.0
2019-03-25 18:03:08 -04:00
* If you use `Hive` or `Presto` , we've moved some dependencies that were
in the main package as optional now. To get these packages,
run `pip install superset[presto]` and/or `pip install superset[hive]` as
required.
* Similarly, if you use Celery's `flower` , `gsheetsdb` , `thrift` or
`thrift-sasl` , those dependencies have now been made optional in our
package, meaning you may have to install them in your environment post
0.31.0
2018-12-21 15:27:57 -05:00
* boto3 / botocore was removed from the dependency list. If you use s3
as a place to store your SQL Lab result set or Hive uploads, you may
have to rely on an alternate requirements.txt file to install those
dependencies.
* From 0.31.0 onwards, we recommend not using the npm package `yarn` in
2018-12-21 13:24:49 -05:00
favor of good old `npm install` . While yarn should still work just fine,
you should probably align to guarantee builds similar to the ones we
use in testing and across the community in general.
2019-01-22 17:38:01 -05:00
## Superset 0.30.0
* 0.30.0 includes a db_migration that removes allow_run_sync. This may
require downtime because during the migration if the db is migrated first,
superset will get 500 errors when the code can't find the field (until
the deploy finishes).
2018-12-09 02:52:47 -05:00
## Superset 0.29.0
* India was removed from the "Country Map" visualization as the geojson
file included in the package was very large
2020-01-29 23:22:46 -05:00
* [5933 ](https://github.com/apache/incubator-superset/pull/5933 )/[6078](https://github.com/apache/incubator-superset/pull/6078): changes which add schema and table metadata cache timeout logic at the database level. If left undefined caching of metadata is disabled.
2018-08-27 21:01:20 -04:00
## Superset 0.28.0
2018-10-05 13:44:45 -04:00
* Support for Python 2 is deprecated, we only support >=3.6 from
`0.28.0` onwards
2018-08-27 21:01:20 -04:00
* Superset 0.28 deprecates the previous dashboard layout. While 0.27
offered a migration workflow to users and allowed them to validate and
publish their migrated dashboards individually, 0.28 forces
the migration of all
dashboards through an automated db migration script. We
do recommend that you take a backup prior to this migration.
2018-09-18 15:38:17 -04:00
* Superset 0.28 deprecates the `median` cluster label aggregator for mapbox visualizations. This particular aggregation is not supported on mapbox visualizations going forward.
2018-10-08 12:40:52 -04:00
* Superset 0.28 upgrades `flask-login` to `>=0.3` , which includes a
backwards-incompatible change: `g.user.is_authenticated` ,
`g.user.is_anonymous` , and `g.user.is_active` are now properties
2018-10-11 12:14:41 -04:00
instead of methods.
2018-10-08 12:40:52 -04:00
2018-07-24 18:14:11 -04:00
## Superset 0.27.0
2018-09-18 15:38:17 -04:00
* Superset 0.27 start to use nested layout for dashboard builder, which is not
2018-07-24 18:14:11 -04:00
backward-compatible with earlier dashboard grid data. We provide migration script
2018-09-18 15:38:17 -04:00
to automatically convert dashboard grid to nested layout data. To be safe, please
take a database backup prior to this upgrade. It's the only way people could go
2018-07-24 18:14:11 -04:00
back to a previous state.
2018-06-04 17:54:36 -04:00
## Superset 0.26.0
* Superset 0.26.0 deprecates the `superset worker` CLI, which is a simple
wrapper around the `celery worker` command, forcing you into crafting
your own native `celery worker` command. Your command should look something
like `celery worker --app=superset.sql_lab:celery_app --pool=gevent -Ofair`
2018-04-30 12:47:48 -04:00
## Superset 0.25.0
2018-05-08 11:24:54 -04:00
Superset 0.25.0 contains a backwards incompatible changes.
2018-04-30 12:47:48 -04:00
If you run a production system you should schedule downtime for this
upgrade.
2018-05-08 11:24:54 -04:00
The PRs bellow have more information around the breaking changes:
* [4587 ](https://github.com/apache/incubator-superset/pull/4587 ) : a backward
incompatible database migration that requires downtime. Once the
db migration succeeds, the web server needs to be restarted with the
new version. The previous version will fail
* [4565 ](https://github.com/apache/incubator-superset/pull/4565 ) : we've
changed the security model a bit where in the past you would have to
define your authentication scheme by inheriting from Flask
2018-09-18 15:38:17 -04:00
App Builder's
2018-05-08 11:24:54 -04:00
`from flask_appbuilder.security.sqla.manager import SecurityManager` ,
you now have to derive Superset's
own derivative `superset.security.SupersetSecurityManager` . This
can provide you with more hooks to define your own logic and/or defer
permissions to another system as needed. For all implementation, you
simply have to import and derive `SupersetSecurityManager` in place
of the `SecurityManager`
2018-09-18 15:38:17 -04:00
* [4835 ](https://github.com/apache/incubator-superset/pull/4835 ) :
2018-05-08 11:24:54 -04:00
our `setup.py` now only pins versions where required, giving you
more latitude in using versions of libraries as needed. We do now
provide a `requirements.txt` with pinned versions if you want to run
the suggested versions that `Superset` builds and runs tests against.
Simply `pip install -r requirements.txt` in your build pipeline, likely
prior to `pip install superset==0.25.0`
