NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI, #453 most downloaded on PyPI
Apache Spark Python API
Latest stable
4.3.0
Last release 23 days ago
30 Oct 2026
Release timing varies
gaps range from 3 weeks to 3 months
Rarely documented
notes for 8 of the last 60 stable releases
Nothing withdrawn
no release was ever pulled
9 years old
78 releases · first in 2017
Drag across the ruler to compare, or tap a release to open it.
Preparing Spark release v4.3.0-rc3
Preparing Spark release v4.3.0-rc3
This project publishes no release notes. Between v4.2.1 and v4.3.0 there were 250 commits, 250 of them substantive:
SPARK_USER from --proxy-userstreaming query listener and listener event in ClientStreamingQuerySuite…and 230 more.
Your coding agent can read these notes before it upgrades. Set up the MCP server →
Preparing Spark release v4.2.1-rc3
Preparing Spark release v4.2.1-rc3
This project publishes no release notes. Between v4.2.0 and v4.2.1 there were 202 commits, 202 of them substantive:
RPackageUtilsexecutorspage.jsDriverKubernetesCredentialsFeatureStepSparkKubernetesClientFactorySuite…and 182 more.
Preparing Spark release v4.2.0-rc6
Preparing Spark release v4.2.0-rc6
This project publishes no release notes. Between v4.1.3 and v4.2.0 there were 250 commits, 250 of them substantive:
…and 230 more.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Preparing Spark release v4.1.4-rc4
Preparing Spark release v4.1.4-rc4
This project publishes no release notes. Between v4.1.3 and v4.1.4 there were 142 commits, 142 of them substantive:
RPackageUtilsexecutorspage.jsDriverKubernetesCredentialsFeatureStepSparkKubernetesClientFactorySuiterunning-on-kubernetes.mdsql…and 122 more.
Preparing Spark release v4.1.3-rc1
Preparing Spark release v4.1.3-rc1
This project publishes no release notes. Between v4.1.2 and v4.1.3 there were 109 commits, 109 of them substantive:
spark.sql.redaction.string.regexspark.sql.redaction.string.regex…and 89 more.
This project publishes no release notes. Between v4.1.1 and v4.1.2 there were 109 commits, 109 of them substantive:
This project publishes no release notes. Between v4.1.1 and v4.1.2 there were 109 commits, 109 of them substantive:
NOT IN subquery returns incorrect results with a collated tableconnect/setup.py…and 89 more.
This project publishes no release notes. Between v4.1.0 and v4.1.1 there were 50 commits, 50 of them substantive:
This project publishes no release notes. Between v4.1.0 and v4.1.1 there were 50 commits, 50 of them substantive:
org.apache.spark.sql.pipelines internal package and make EstimatorUtils privatedataframe.isEmpty…and 30 more.
This project publishes no release notes. Between v4.0.4 and v4.1.0 there were 250 commits, 250 of them substantive:
This project publishes no release notes. Between v4.0.4 and v4.1.0 there were 250 commits, 250 of them substantive:
ExecutorsPodsLifecycleManager not to request to delete if deletionTimestamp existspip install commands to use proper quotation marksDRIVER_BIND_ADDRESS in case of useDriverPodIP=true…and 230 more.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Preparing Spark release v4.0.5-rc3
Preparing Spark release v4.0.5-rc3
This project publishes no release notes. Between v4.0.4 and v4.0.5 there were 118 commits, 118 of them substantive:
RPackageUtilsexecutorspage.jsDriverKubernetesCredentialsFeatureStepSparkKubernetesClientFactorySuiterunning-on-kubernetes.mdcloseQuietly(AutoCloseable) overload to SparkErrorUtils…and 98 more.
Preparing Spark release v4.0.4-rc1
Preparing Spark release v4.0.4-rc1
This project publishes no release notes. Between v4.0.3 and v4.0.4 there were 83 commits, 83 of them substantive:
spark.sql.redaction.string.regexThriftHttpServletEncoders.Strings.decodeEncoders.ByteArrays.decodeEncoders.(Int|Long)Arrays decodeescapeSql to comment in JDBC table/schema comment queries(H2|MySQL|Postgres)Dialect.indexExistsspark.authenticate.secret with Master REST serverEncoders.StringArrays.decodeEncoders.BitmapArrays.decodeFORBIDDEN instead of METHOD_NOT_ALLOWED for disallowed /workers/kill requests…and 63 more.
This project publishes no release notes. Between v4.0.2 and v4.0.3 there were 70 commits, 70 of them substantive:
This project publishes no release notes. Between v4.0.2 and v4.0.3 there were 70 commits, 70 of them substantive:
strategy.max-parrallel to 20 for all GitHub Action jobsEventLogFileWriters.closeWriter to handle checkErrorjupyterTestFramework instead of TestFrameworks.JUnitKeyGroupedPartitioningpostgres-krb-setup.sh to find config filesaircompressor to 2.0.3SupportsRuntimeFiltering and SupportsRuntimeV2Filtering documentation…and 50 more.
This project publishes no release notes. Between v4.0.1 and v4.0.2 there were 84 commits, 84 of them substantive:
This project publishes no release notes. Between v4.0.1 and v4.0.2 there were 84 commits, 84 of them substantive:
preview postfix in documentation.md when releasingSparkConnectPlanner.scala to make build successSparkConnectServiceSuiteSparkConnectServiceSuite which are caused by executorHolder undefinedExpandExec should initialize the unsafe projectionslibwebp-dev to recover spark-rm/Dockerfile building…and 64 more.
This project publishes no release notes. Between v4.0.0 and v4.0.1 there were 133 commits, 133 of them substantive:
This project publishes no release notes. Between v4.0.0 and v4.0.1 there were 133 commits, 133 of them substantive:
SparkContext not to populate o.a.s.internal.io.cloud.*-related setting if not exist…and 113 more.
Nothing published for this version
Nothing published for this version
Nothing published for this version
Preparing Spark release v3.5.9-rc1
Preparing Spark release v3.5.9-rc1
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
Nothing published for this version
One column per quarter.