今天Spark社區(qū)為大家?guī)砹俗钚碌腟park 2.3.0
Spark Release 2.3.0
Apache Spark 2.3.0 is the fourth release in the 2.x line. This release adds support for Continuous Processing in Structured Streaming along with a brand new Kubernetes Scheduler backend. Other major updates include the new DataSource and Structured Streaming v2 APIs, and a number of PySpark performance enhancements. In addition, this release continues to focus on usability, stability, and polish while resolving around 1400 tickets.
To download Apache Spark 2.3.0, visit the downloads page. You can consult JIRA for the detailed changes. We have curated a list of high level changes here, grouped by major modules.
Spark Authorizer權(quán)限管理插件現(xiàn)已支持spark 2.3.0
GitHup repo: https://github.com/yaooqinn/spark-authorizer
Branch:Spark-2.3
也可基于spark依賴參數(shù)--packages直接使用
$SPARK_HOME/bin/spark-shell --packages yaooqinn:spark-authorizer:1.0.0.spark2.3
詳細(xì)文檔參見
https://yaooqinn.github.io/spark-authorizer/