Skip to content

Commit 14eb674

Browse files
tvaron3Copilot
tvaron3
and
Copilot
authored
Spark and Fabric Spark Release (#46226)
* release changes * release changes * Update sdk/cosmos/azure-cosmos-spark_3-5_2-12/CHANGELOG.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
1 parent c4bfada commit 14eb674

File tree

13 files changed

+33
-41
lines changed

13 files changed

+33
-41
lines changed

‎eng/versioning/version_client.txt‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -106,9 +106,9 @@ com.azure:azure-cosmos;4.73.1;4.74.0-beta.1
106106
com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
107107
com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
108108
com.azure:azure-cosmos-encryption;2.22.0;2.23.0-beta.1
109-
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.37.2;4.38.0-beta.1
110-
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.37.2;4.38.0-beta.1
111-
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.37.2;4.38.0-beta.1
109+
com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.37.2;4.38.0
110+
com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.37.2;4.38.0
111+
com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.37.2;4.38.0
112112
com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample;1.0.0-beta.1;1.0.0-beta.1
113113
com.azure.cosmos.spark:fabric-cosmos-spark-auth_3;1.0.0-beta.1;1.0.0-beta.1
114114
com.azure:azure-cosmos-test;1.0.0-beta.13;1.0.0-beta.14

‎sdk/cosmos/azure-cosmos-spark-account-data-resolver-sample/pom.xml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -97,7 +97,7 @@
9797
<dependency>
9898
<groupId>com.azure.cosmos.spark</groupId>
9999
<artifactId>azure-cosmos-spark_3-5_2-12</artifactId>
100-
<version>4.38.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
100+
<version>4.38.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
101101
<scope>provided</scope>
102102
</dependency>
103103
<dependency>
@@ -292,7 +292,7 @@
292292
<include>com.fasterxml.jackson.core:jackson-databind:[2.15.2]</include> <!-- {x-include-update;cosmos_com.fasterxml.jackson.core:jackson-databind;external_dependency} -->
293293
<include>com.fasterxml.jackson.module:jackson-module-scala_2.12:[2.15.2]</include> <!-- {x-include-update;cosmos_com.fasterxml.jackson.module:jackson-module-scala_2.12;external_dependency} -->
294294
<include>com.globalmentor:hadoop-bare-naked-local-fs:[0.1.0]</include> <!-- {x-include-update;cosmos_com.globalmentor:hadoop-bare-naked-local-fs;external_dependency} -->
295-
<include>com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:[4.38.0-beta.1]</include> <!-- {x-include-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
295+
<include>com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:[4.38.0]</include> <!-- {x-include-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
296296
</includes>
297297
</bannedDependencies>
298298
</rules>

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md‎

Lines changed: 2 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,9 @@
11
## Release History
22

3-
### 4.38.0-beta.1 (Unreleased)
3+
### 4.38.0 (2025-07-31)
44

55
#### Features Added
6-
7-
#### Breaking Changes
8-
9-
#### Bugs Fixed
10-
11-
#### Other Changes
6+
* Added telemetry support by adding OTEL span attribute naming schemes, introducing Azure Monitor integration, and sampled diagnostics. - See [PR 45924](https://github.com/Azure/azure-sdk-for-java/pull/45924)
127

138
### 4.37.2 (2025-05-14)
149

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-3_2-12
2929
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
31+
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
3132
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
3233
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
3334
| 4.37.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
@@ -72,6 +73,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
7273
#### azure-cosmos-spark_3-4_2-12
7374
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
7475
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
76+
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
7577
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
7678
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
7779
| 4.37.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
@@ -107,6 +109,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
107109
#### azure-cosmos-spark_3-5_2-12
108110
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
109111
|-----------|--------------------------|----------------------|----------------------------|-------------------------------|
112+
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
110113
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
111114
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
112115
| 4.37.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
@@ -128,11 +131,11 @@ to use the same version of Scala that Spark was compiled for.
128131
### Download
129132

130133
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
131-
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.37.2`
134+
`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.38.0`
132135

133136
You can also integrate against Cosmos DB Spark Connector in your SBT project:
134137
```scala
135-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.37.2"
138+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.38.0"
136139
```
137140

138141
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
14-
<version>4.38.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
14+
<version>4.38.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
1717
<name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>

‎sdk/cosmos/azure-cosmos-spark_3-4_2-12/CHANGELOG.md‎

Lines changed: 2 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,9 @@
11
## Release History
22

3-
### 4.38.0-beta.1 (Unreleased)
3+
### 4.38.0 (2025-07-31)
44

55
#### Features Added
6-
7-
#### Breaking Changes
8-
9-
#### Bugs Fixed
10-
11-
#### Other Changes
6+
* Added telemetry support by adding OTEL span attribute naming schemes, introducing Azure Monitor integration, and sampled diagnostics. - See [PR 45924](https://github.com/Azure/azure-sdk-for-java/pull/45924)
127

138
### 4.37.2 (2025-05-14)
149

‎sdk/cosmos/azure-cosmos-spark_3-4_2-12/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-4_2-12
2929
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
31+
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
3132
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
3233
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
3334
| 4.37.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
@@ -63,6 +64,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
6364
#### azure-cosmos-spark_3-3_2-12
6465
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
6566
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
67+
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
6668
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
6769
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
6870
| 4.37.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
@@ -107,6 +109,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
107109
#### azure-cosmos-spark_3-5_2-12
108110
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
109111
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
112+
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
110113
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
111114
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
112115
| 4.37.0 | 3.5.0 | [8, 11] | 2.12 | 14.*, 15.\* |
@@ -128,11 +131,11 @@ to use the same version of Scala that Spark was compiled for.
128131
### Download
129132

130133
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
131-
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.37.2`
134+
`com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12:4.38.0`
132135

133136
You can also integrate against Cosmos DB Spark Connector in your SBT project:
134137
```scala
135-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.37.2"
138+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-4_2-12" % "4.38.0"
136139
```
137140

138141
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

‎sdk/cosmos/azure-cosmos-spark_3-4_2-12/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
</parent>
1212
<groupId>com.azure.cosmos.spark</groupId>
1313
<artifactId>azure-cosmos-spark_3-4_2-12</artifactId>
14-
<version>4.38.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
14+
<version>4.38.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;current} -->
1515
<packaging>jar</packaging>
1616
<url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-4_2-12</url>
1717
<name>OLTP Spark 3.4 Connector for Azure Cosmos DB SQL API</name>

‎sdk/cosmos/azure-cosmos-spark_3-5_2-12/CHANGELOG.md‎

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,9 @@
11
## Release History
22

3-
### 4.38.0-beta.1 (Unreleased)
3+
### 4.38.0 (2025-07-31)
44

55
#### Features Added
6-
7-
#### Breaking Changes
8-
9-
#### Bugs Fixed
6+
* Added telemetry support by adding OTEL span attribute naming schemes, introducing Azure Monitor integration, and sampled diagnostics. - See [PR 45924](https://github.com/Azure/azure-sdk-for-java/pull/45924)
107

118
#### Other Changes
129
* Added compatibility with CosmosDB Fabric Native Accounts using the `FabricAccountDataResolver` for authentication. - See [PR 45890](https://github.com/Azure/azure-sdk-for-java/pull/45890)

‎sdk/cosmos/azure-cosmos-spark_3-5_2-12/README.md‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
2828
#### azure-cosmos-spark_3-5_2-12
2929
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
3030
|-----------|--------------------------|-----------------------|---------------------------|-------------------------------|
31+
| 4.38.0 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
3132
| 4.37.2 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
3233
| 4.37.1 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
3334
| 4.37.0 | 3.5.0 | [8, 11] | 2.12 | 14.\*, 15.\* |
@@ -49,6 +50,7 @@ to use the same version of Scala that Spark was compiled for.
4950
#### azure-cosmos-spark_3-4_2-12
5051
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
5152
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
53+
| 4.38.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
5254
| 4.37.2 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
5355
| 4.37.1 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
5456
| 4.37.0 | 3.4.0 - 3.4.1 | [8, 11] | 2.12 | 13.\* |
@@ -84,6 +86,7 @@ to use the same version of Scala that Spark was compiled for.
8486
#### azure-cosmos-spark_3-3_2-12
8587
| Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
8688
|-----------|--------------------------|------------------------|--------------------------|-------------------------------|
89+
| 4.38.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
8790
| 4.37.2 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
8891
| 4.37.1 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
8992
| 4.37.0 | 3.3.0 - 3.3.2 | [8, 11] | 2.12 | 11.\*, 12.\* |
@@ -128,11 +131,11 @@ to use the same version of Scala that Spark was compiled for.
128131
### Download
129132

130133
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 14 from Maven:
131-
`com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.37.2`
134+
`com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12:4.38.0`
132135

133136
You can also integrate against Cosmos DB Spark Connector in your SBT project:
134137
```scala
135-
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-5_2-12" % "4.37.2"
138+
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-5_2-12" % "4.38.0"
136139
```
137140

138141
Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

0 commit comments

Comments
 (0)