With the introduction of a new pipeline environment for stream processing the following environment has been deprecated and will be removed after 12 months: stream-6.1 for stream environment with Flink 1.19.2. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
7.0
ADDED
Added on 2026-03-25
A new pipeline environment for stream processing has been introduced: stream-7.0 for stream environment with Flink 2.2.0.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.13
ch.qos.logback
logback-core
1.2.13
com.esotericsoftware
kryo
5.6.2
com.esotericsoftware
minlog
1.3.1
com.esotericsoftware
reflectasm
1.11.9
com.google.code.findbugs
jsr305
1.3.9
com.ververica
forstjni
0.1.8
com.ververica
frocksdbjni
8.10.0-ververica-1.0
commons-cli
commons-cli
1.5.0
commons-collections
commons-collections
3.2.2
commons-io
commons-io
2.15.1
org.apache.commons
commons-compress
1.26.0
org.apache.commons
commons-lang3
3.18.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.flink
flink-annotations
2.2.0
org.apache.flink
flink-cep
2.2.0
org.apache.flink
flink-clients
2.2.0
org.apache.flink
flink-connector-base
2.2.0
org.apache.flink
flink-connector-datagen
2.2.0
org.apache.flink
flink-connector-files
2.2.0
org.apache.flink
flink-container
2.2.0
org.apache.flink
flink-core
2.2.0
org.apache.flink
flink-core-api
2.2.0
org.apache.flink
flink-csv
2.2.0
org.apache.flink
flink-datastream
2.2.0
org.apache.flink
flink-datastream-api
2.2.0
org.apache.flink
flink-dstl-dfs
2.2.0
org.apache.flink
flink-file-sink-common
2.2.0
org.apache.flink
flink-hadoop-fs
2.2.0
org.apache.flink
flink-json
2.2.0
org.apache.flink
flink-kubernetes
2.2.0
org.apache.flink
flink-metrics-core
2.2.0
org.apache.flink
flink-queryable-state-client-java
2.2.0
org.apache.flink
flink-rpc-akka-loader
2.2.0
org.apache.flink
flink-rpc-core
2.2.0
org.apache.flink
flink-runtime
2.2.0
org.apache.flink
flink-runtime-web
2.2.0
org.apache.flink
flink-shaded-asm-9
9.6-20.0
org.apache.flink
flink-shaded-force-shading
20.0
org.apache.flink
flink-shaded-guava
33.4.0-jre-20.0
org.apache.flink
flink-shaded-jackson
2.18.2-20.0
org.apache.flink
flink-shaded-netty
4.1.100.Final-20.0
org.apache.flink
flink-shaded-zookeeper-3
3.7.2-20.0
org.apache.flink
flink-sql-gateway-api
2.2.0
org.apache.flink
flink-statebackend-changelog
2.2.0
org.apache.flink
flink-statebackend-common
2.2.0
org.apache.flink
flink-statebackend-forst
2.2.0
org.apache.flink
flink-statebackend-rocksdb
2.2.0
org.apache.flink
flink-streaming-java
2.2.0
org.apache.flink
flink-table-api-bridge-base
2.2.0
org.apache.flink
flink-table-api-java
2.2.0
org.apache.flink
flink-table-api-java-bridge
2.2.0
org.apache.flink
flink-table-common
2.2.0
org.apache.flink
flink-table-planner-loader
2.2.0
org.apache.flink
flink-table-runtime
2.2.0
org.apache.flink
flink-yarn
2.2.0
org.apache.logging.log4j
log4j-1.2-api
2.24.3
org.apache.logging.log4j
log4j-api
2.24.3
org.apache.logging.log4j
log4j-core
2.24.3
org.apache.logging.log4j
log4j-layout-template-json
2.24.3
org.apache.logging.log4j
log4j-slf4j-impl
2.24.3
org.javassist
javassist
3.24.0-GA
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.4
org.slf4j
log4j-over-slf4j
1.7.36
org.slf4j
slf4j-api
1.7.36
org.snakeyaml
snakeyaml-engine
2.6
org.xerial.snappy
snappy-java
1.1.10.7
tools.profiler
async-profiler
2.9
6.0
DEPRECATED
Deprecated on 2025-07-01
With the introduction of a new pipeline environment for stream the following environment has been deprecated and will be removed after 12 months: stream-6.0 for stream environment with Flink 1.19.2. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
6.1
ADDED
Added on 2025-05-28
A new pipeline environment for stream processing has been introduced: stream-6.1 for stream environment with Flink 1.19.2.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.13
ch.qos.logback
logback-core
1.2.13
com.esotericsoftware.kryo
kryo
2.24.0
com.esotericsoftware.minlog
minlog
1.2
com.google.code.findbugs
jsr305
1.3.9
com.twitter
chill-java
0.7.6
com.ververica
frocksdbjni
6.20.3-ververica-2.0
commons-cli
commons-cli
1.5.0
commons-collections
commons-collections
3.2.2
commons-io
commons-io
2.15.1
org.apache.commons
commons-compress
1.26.0
org.apache.commons
commons-lang3
3.12.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.flink
flink-annotations
1.19.2
org.apache.flink
flink-cep
1.19.2
org.apache.flink
flink-clients
1.19.2
org.apache.flink
flink-connector-base
1.19.2
org.apache.flink
flink-connector-datagen
1.19.2
org.apache.flink
flink-connector-files
1.19.2
org.apache.flink
flink-container
1.19.2
org.apache.flink
flink-core
1.19.2
org.apache.flink
flink-csv
1.19.2
org.apache.flink
flink-dstl-dfs
1.19.2
org.apache.flink
flink-file-sink-common
1.19.2
org.apache.flink
flink-hadoop-fs
1.19.2
org.apache.flink
flink-java
1.19.2
org.apache.flink
flink-json
1.19.2
org.apache.flink
flink-kubernetes
1.19.2
org.apache.flink
flink-metrics-core
1.19.2
org.apache.flink
flink-optimizer
1.19.2
org.apache.flink
flink-queryable-state-client-java
1.19.2
org.apache.flink
flink-rpc-akka-loader
1.19.2
org.apache.flink
flink-rpc-core
1.19.2
org.apache.flink
flink-runtime
1.19.2
org.apache.flink
flink-runtime-web
1.19.2
org.apache.flink
flink-shaded-asm-9
9.5-17.0
org.apache.flink
flink-shaded-force-shading
17.0
org.apache.flink
flink-shaded-guava
31.1-jre-17.0
org.apache.flink
flink-shaded-jackson
2.14.2-17.0
org.apache.flink
flink-shaded-netty
4.1.91.Final-17.0
org.apache.flink
flink-shaded-zookeeper-3
3.7.1-17.0
org.apache.flink
flink-sql-gateway-api
1.19.2
org.apache.flink
flink-statebackend-changelog
1.19.2
org.apache.flink
flink-statebackend-common
1.19.2
org.apache.flink
flink-statebackend-rocksdb
1.19.2
org.apache.flink
flink-streaming-java
1.19.2
org.apache.flink
flink-table-api-bridge-base
1.19.2
org.apache.flink
flink-table-api-java
1.19.2
org.apache.flink
flink-table-api-java-bridge
1.19.2
org.apache.flink
flink-table-common
1.19.2
org.apache.flink
flink-table-planner-loader
1.19.2
org.apache.flink
flink-table-runtime
1.19.2
org.apache.flink
flink-yarn
1.19.2
org.apache.logging.log4j
log4j-1.2-api
2.17.1
org.apache.logging.log4j
log4j-api
2.17.1
org.apache.logging.log4j
log4j-core
2.17.1
org.apache.logging.log4j
log4j-slf4j-impl
2.17.1
org.javassist
javassist
3.24.0-GA
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
2.1
org.slf4j
log4j-over-slf4j
1.7.36
org.slf4j
slf4j-api
1.7.36
org.snakeyaml
snakeyaml-engine
2.6
org.xerial.snappy
snappy-java
1.1.10.4
tools.profiler
async-profiler
2.9
6.0
CHANGED
Updated on 2025-04-29
An existing pipeline environment for stream processing has been changed: stream-6.0 for stream environment with Flink 1.19.2.
Please visit official Apache Flink documentation page to check Flink 1.19.2 release notes.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.13
ch.qos.logback
logback-core
1.2.13
com.esotericsoftware.kryo
kryo
2.24.0
com.esotericsoftware.minlog
minlog
1.2
com.google.code.findbugs
jsr305
1.3.9
com.twitter
chill-java
0.7.6
com.ververica
frocksdbjni
6.20.3-ververica-2.0
commons-cli
commons-cli
1.5.0
commons-collections
commons-collections
3.2.2
commons-io
commons-io
2.15.1
org.apache.commons
commons-compress
1.26.0
org.apache.commons
commons-lang3
3.12.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.flink
flink-annotations
1.19.2
org.apache.flink
flink-cep
1.19.2
org.apache.flink
flink-clients
1.19.2
org.apache.flink
flink-connector-base
1.19.2
org.apache.flink
flink-connector-datagen
1.19.2
org.apache.flink
flink-connector-files
1.19.2
org.apache.flink
flink-container
1.19.2
org.apache.flink
flink-core
1.19.2
org.apache.flink
flink-csv
1.19.2
org.apache.flink
flink-dstl-dfs
1.19.2
org.apache.flink
flink-file-sink-common
1.19.2
org.apache.flink
flink-hadoop-fs
1.19.2
org.apache.flink
flink-java
1.19.2
org.apache.flink
flink-json
1.19.2
org.apache.flink
flink-kubernetes
1.19.2
org.apache.flink
flink-metrics-core
1.19.2
org.apache.flink
flink-optimizer
1.19.2
org.apache.flink
flink-queryable-state-client-java
1.19.2
org.apache.flink
flink-rpc-akka-loader
1.19.2
org.apache.flink
flink-rpc-core
1.19.2
org.apache.flink
flink-runtime
1.19.2
org.apache.flink
flink-runtime-web
1.19.2
org.apache.flink
flink-shaded-asm-9
9.5-17.0
org.apache.flink
flink-shaded-force-shading
17.0
org.apache.flink
flink-shaded-guava
31.1-jre-17.0
org.apache.flink
flink-shaded-jackson
2.14.2-17.0
org.apache.flink
flink-shaded-netty
4.1.91.Final-17.0
org.apache.flink
flink-shaded-zookeeper-3
3.7.1-17.0
org.apache.flink
flink-sql-gateway-api
1.19.2
org.apache.flink
flink-statebackend-changelog
1.19.2
org.apache.flink
flink-statebackend-common
1.19.2
org.apache.flink
flink-statebackend-rocksdb
1.19.2
org.apache.flink
flink-streaming-java
1.19.2
org.apache.flink
flink-table-api-bridge-base
1.19.2
org.apache.flink
flink-table-api-java
1.19.2
org.apache.flink
flink-table-api-java-bridge
1.19.2
org.apache.flink
flink-table-common
1.19.2
org.apache.flink
flink-table-planner-loader
1.19.2
org.apache.flink
flink-table-runtime
1.19.2
org.apache.flink
flink-yarn
1.19.2
org.apache.logging.log4j
log4j-1.2-api
2.17.1
org.apache.logging.log4j
log4j-api
2.17.1
org.apache.logging.log4j
log4j-core
2.17.1
org.apache.logging.log4j
log4j-slf4j-impl
2.17.1
org.javassist
javassist
3.24.0-GA
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
2.1
org.slf4j
log4j-over-slf4j
1.7.36
org.slf4j
slf4j-api
1.7.36
org.snakeyaml
snakeyaml-engine
2.6
org.xerial.snappy
snappy-java
1.1.10.4
tools.profiler
async-profiler
2.9
5.0
DEPRECATED
Deprecated on 2025-02-26
With the introduction of a new pipeline environment for stream the following environment has been deprecated and will be removed after 12 months: stream-5.0 for stream environment with Flink 1.13.5. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
6.0
ADDED
Added on 2025-02-26
A new pipeline environment for stream processing has been introduced: stream-6.0 for stream environment with Flink 1.19.1.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.13
ch.qos.logback
logback-core
1.2.13
com.esotericsoftware.kryo
kryo
2.24.0
com.esotericsoftware.minlog
minlog
1.2
com.google.code.findbugs
jsr305
1.3.9
com.ibm.icu
icu4j
67.1
com.twitter
chill-java
0.7.6
com.ververica
frocksdbjni
6.20.3-ververica-2.0
commons-cli
commons-cli
1.5.0
commons-collections
commons-collections
3.2.2
commons-io
commons-io
2.15.1
org.apache.commons
commons-compress
1.26.0
org.apache.commons
commons-lang3
3.12.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.flink
flink-annotations
1.19.1
org.apache.flink
flink-cep
1.19.1
org.apache.flink
flink-clients
1.19.1
org.apache.flink
flink-connector-base
1.19.1
org.apache.flink
flink-connector-datagen
1.19.1
org.apache.flink
flink-connector-files
1.19.1
org.apache.flink
flink-container
1.19.1
org.apache.flink
flink-core
1.19.1
org.apache.flink
flink-csv
1.19.1
org.apache.flink
flink-dstl-dfs
1.19.1
org.apache.flink
flink-file-sink-common
1.19.1
org.apache.flink
flink-hadoop-fs
1.19.1
org.apache.flink
flink-java
1.19.1
org.apache.flink
flink-json
1.19.1
org.apache.flink
flink-kubernetes
1.19.1
org.apache.flink
flink-metrics-core
1.19.1
org.apache.flink
flink-optimizer
1.19.1
org.apache.flink
flink-queryable-state-client-java
1.19.1
org.apache.flink
flink-rpc-akka-loader
1.19.1
org.apache.flink
flink-rpc-core
1.19.1
org.apache.flink
flink-runtime
1.19.1
org.apache.flink
flink-runtime-web
1.19.1
org.apache.flink
flink-shaded-asm-9
9.5-17.0
org.apache.flink
flink-shaded-force-shading
17.0
org.apache.flink
flink-shaded-guava
31.1-jre-17.0
org.apache.flink
flink-shaded-jackson
2.14.2-17.0
org.apache.flink
flink-shaded-netty
4.1.91.Final-17.0
org.apache.flink
flink-shaded-zookeeper-3
3.7.1-17.0
org.apache.flink
flink-sql-gateway-api
1.19.1
org.apache.flink
flink-statebackend-changelog
1.19.1
org.apache.flink
flink-statebackend-common
1.19.1
org.apache.flink
flink-statebackend-rocksdb
1.19.1
org.apache.flink
flink-streaming-java
1.19.1
org.apache.flink
flink-table-api-bridge-base
1.19.1
org.apache.flink
flink-table-api-java
1.19.1
org.apache.flink
flink-table-api-java-bridge
1.19.1
org.apache.flink
flink-table-common
1.19.1
org.apache.flink
flink-table-planner-loader
1.19.1
org.apache.flink
flink-table-runtime
1.19.1
org.apache.flink
flink-yarn
1.19.1
org.apache.logging.log4j
log4j-1.2-api
2.17.1
org.apache.logging.log4j
log4j-api
2.17.1
org.apache.logging.log4j
log4j-core
2.17.1
org.apache.logging.log4j
log4j-slf4j-impl
2.17.1
org.javassist
javassist
3.24.0-GA
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
2.1
org.slf4j
log4j-over-slf4j
1.7.36
org.slf4j
slf4j-api
1.7.36
org.snakeyaml
snakeyaml-engine
2.6
org.xerial.snappy
snappy-java
1.1.10.4
tools.profiler
async-profiler
2.9
4.0
REMOVED
Removed on 2025-02-25
The deprecated pipeline environment stream-4.0 for stream processing with Flink 1.10.3 has been removed. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
3.0.0
REMOVED
Removed on 2025-02-25
The deprecated pipeline environment stream-3.0.0 for stream processing with Flink 1.10.1 has been removed. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
2.0.0
REMOVED
Removed on 2025-02-25
The deprecated pipeline environment stream-2.0.0 for stream processing with Flink 1.7.1 has been removed. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
5.0
CHANGED
Updated on 2025-02-25
An existing pipeline environment for stream processing has been changed: stream-5.0 for stream environment with Flink 1.13.5.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.13
ch.qos.logback
logback-core
1.2.13
com.esotericsoftware.kryo
kryo
2.24.0
com.esotericsoftware.minlog
minlog
1.2
com.esotericsoftware.reflectasm
reflectasm
1.09
org.apache.calcite
calcite-core
1.26.0
org.apache.calcite
calcite-linq4j
1.26.0
org.apache.calcite.avatica
avatica-core
1.17.0
org.apache.commons
commons-compress
1.21
org.apache.commons
commons-lang3
3.3.2
org.apache.commons
commons-math3
3.5
org.apache.flink
flink-annotations
1.13.5
org.apache.flink
flink-cep_2.12
1.13.5
org.apache.flink
flink-clients_2.12
1.13.5
org.apache.flink
flink-connector-base
1.13.5
org.apache.flink
flink-connector-files
1.13.5
org.apache.flink
flink-container_2.12
1.13.5
org.apache.flink
flink-core
1.13.5
org.apache.flink
flink-csv
1.13.5
org.apache.flink
flink-file-sink-common
1.13.5
org.apache.flink
flink-hadoop-fs
1.13.5
org.apache.flink
flink-java
1.13.5
org.apache.flink
flink-json
1.13.5
org.apache.flink
flink-kubernetes_2.12
1.13.5
org.apache.flink
flink-mapr-fs
1.13.5
org.apache.flink
flink-mesos_2.12
1.13.5
org.apache.flink
flink-metrics-core
1.13.5
org.apache.flink
flink-optimizer_2.12
1.13.5
org.apache.flink
flink-queryable-state-client-java
1.13.5
org.apache.flink
flink-runtime-web_2.12
1.13.5
org.apache.flink
flink-runtime_2.12
1.13.5
org.apache.flink
flink-scala_2.12
1.13.5
org.apache.flink
flink-shaded-asm-7
7.1-13.0
org.apache.flink
flink-shaded-guava
18.0-13.0
org.apache.flink
flink-shaded-jackson
2.12.1-13.0
org.apache.flink
flink-shaded-netty
4.1.49.Final-13.0
org.apache.flink
flink-shaded-zookeeper-3
3.4.14-13.0
org.apache.flink
flink-sql-parser
1.13.5
org.apache.flink
flink-sql-parser-hive
1.13.5
org.apache.flink
flink-statebackend-rocksdb_2.12
1.13.5
org.apache.flink
flink-streaming-java_2.12
1.13.5
org.apache.flink
flink-streaming-scala_2.12
1.13.5
org.apache.flink
flink-table-api-java
1.13.5
org.apache.flink
flink-table-api-java-bridge_2.12
1.13.5
org.apache.flink
flink-table-api-scala-bridge_2.12
1.13.5
org.apache.flink
flink-table-api-scala_2.12
1.13.5
org.apache.flink
flink-table-common
1.13.5
org.apache.flink
flink-table-planner-blink_2.12
1.13.5
org.apache.flink
flink-table-planner_2.12
1.13.5
org.apache.flink
flink-table-runtime-blink_2.12
1.13.5
org.apache.flink
flink-yarn_2.12
1.13.5
org.apache.flink
force-shading
1.13.5
org.apache.mesos
mesos
1.7.2
org.codehaus.janino
commons-compiler
3.0.11
org.codehaus.janino
janino
3.0.11
org.javassist
javassist
3.24.0-GA
org.objenesis
objenesis
2.1
org.reactivestreams
reactive-streams
1.0.2
org.slf4j
log4j-over-slf4j
1.7.36
org.slf4j
slf4j-api
1.7.15
5.0
ADDED
Added on 2022-01-24
A new pipeline environment for stream processing has been introduced: stream-5.0 for stream environment with flink 1.13.5.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.3
ch.qos.logback
logback-core
1.2.3
com.esotericsoftware.kryo
kryo
2.24.0
com.esotericsoftware.minlog
minlog
1.2
com.esotericsoftware.reflectasm
reflectasm
1.09
org.apache.calcite
calcite-core
1.26.0
org.apache.calcite
calcite-linq4j
1.26.0
org.apache.calcite.avatica
avatica-core
1.17.0
org.apache.commons
commons-compress
1.21
org.apache.commons
commons-lang3
3.3.2
org.apache.commons
commons-math3
3.5
org.apache.flink
flink-annotations
1.13.5
org.apache.flink
flink-cep_2.12
1.13.5
org.apache.flink
flink-clients_2.12
1.13.5
org.apache.flink
flink-connector-base
1.13.5
org.apache.flink
flink-connector-files
1.13.5
org.apache.flink
flink-container_2.12
1.13.5
org.apache.flink
flink-core
1.13.5
org.apache.flink
flink-csv
1.13.5
org.apache.flink
flink-file-sink-common
1.13.5
org.apache.flink
flink-hadoop-fs
1.13.5
org.apache.flink
flink-java
1.13.5
org.apache.flink
flink-json
1.13.5
org.apache.flink
flink-kubernetes_2.12
1.13.5
org.apache.flink
flink-mapr-fs
1.13.5
org.apache.flink
flink-mesos_2.12
1.13.5
org.apache.flink
flink-metrics-core
1.13.5
org.apache.flink
flink-optimizer_2.12
1.13.5
org.apache.flink
flink-queryable-state-client-java
1.13.5
org.apache.flink
flink-runtime-web_2.12
1.13.5
org.apache.flink
flink-runtime_2.12
1.13.5
org.apache.flink
flink-scala_2.12
1.13.5
org.apache.flink
flink-shaded-asm-7
7.1-13.0
org.apache.flink
flink-shaded-guava
18.0-13.0
org.apache.flink
flink-shaded-jackson
2.12.1-13.0
org.apache.flink
flink-shaded-netty
4.1.49.Final-13.0
org.apache.flink
flink-shaded-zookeeper-3
3.4.14-13.0
org.apache.flink
flink-sql-parser
1.13.5
org.apache.flink
flink-sql-parser-hive
1.13.5
org.apache.flink
flink-statebackend-rocksdb_2.12
1.13.5
org.apache.flink
flink-streaming-java_2.12
1.13.5
org.apache.flink
flink-streaming-scala_2.12
1.13.5
org.apache.flink
flink-table-api-java
1.13.5
org.apache.flink
flink-table-api-java-bridge_2.12
1.13.5
org.apache.flink
flink-table-api-scala-bridge_2.12
1.13.5
org.apache.flink
flink-table-api-scala_2.12
1.13.5
org.apache.flink
flink-table-common
1.13.5
org.apache.flink
flink-table-planner-blink_2.12
1.13.5
org.apache.flink
flink-table-planner_2.12
1.13.5
org.apache.flink
flink-table-runtime-blink_2.12
1.13.5
org.apache.flink
flink-yarn_2.12
1.13.5
org.apache.flink
force-shading
1.13.5
org.apache.mesos
mesos
1.7.0
org.codehaus.janino
commons-compiler
3.0.11
org.codehaus.janino
janino
3.0.11
org.javassist
javassist
3.24.0-GA
org.objenesis
objenesis
2.1
org.reactivestreams
reactive-streams
1.0.2
org.slf4j
log4j-over-slf4j
1.7.25
org.slf4j
slf4j-api
1.7.15
4.0
DEPRECATED
Deprecated on 2022-01-24
With the introduction of a new pipeline environment for stream processing the following environment has been deprecated and will be removed after 6 months: Stream-4.0 for stream environment with Apache Flink 1.10.3
Please, use the latest SDK to migrate your applications to Scala 2.12 and to this new environment: stream-5.0 for stream environment with Flink 1.10.4
4.0
ADDED
Added on 2021-06-23
A new pipeline environments for stream processing has been introduced: stream-4.0 for stream environment with Flink 1.10.3
It supports Scala 2.12 and includes a minor version upgrade for Apache Flink compared to the previous environment version.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.2.3
ch.qos.logback
logback-core
1.2.3
com.esotericsoftware.kryo
kryo
2.24.0
com.esotericsoftware.minlog
minlog
1.2
com.esotericsoftware.reflectasm
reflectasm
1.09
org.apache.calcite
calcite-core
1.21.0
org.apache.calcite
calcite-linq4j
1.21.0
org.apache.calcite.avatica
avatica-core
1.15.0
org.apache.commons
commons-compress
1.18
org.apache.commons
commons-lang3
3.3.2
org.apache.commons
commons-math3
3.5
org.apache.flink
flink-annotations
1.10.3
org.apache.flink
flink-cep_2.12
1.10.3
org.apache.flink
flink-clients_2.12
1.10.3
org.apache.flink
flink-container_2.12
1.10.3
org.apache.flink
flink-core
1.10.3
org.apache.flink
flink-hadoop-fs
1.10.3
org.apache.flink
flink-java
1.10.3
org.apache.flink
flink-mapr-fs
1.10.3
org.apache.flink
flink-mesos_2.12
1.10.3
org.apache.flink
flink-metrics-core
1.10.3
org.apache.flink
flink-metrics-jmx_2.12
1.10.3
org.apache.flink
flink-optimizer_2.12
1.10.3
org.apache.flink
flink-queryable-state-client-java
1.10.3
org.apache.flink
flink-runtime-web_2.12
1.10.3
org.apache.flink
flink-runtime_2.12
1.10.3
org.apache.flink
flink-scala_2.12
1.10.3
org.apache.flink
flink-shaded-asm-7
7.1-9.0
org.apache.flink
flink-shaded-curator
1.10.3
org.apache.flink
flink-shaded-guava
18.0-9.0
org.apache.flink
flink-shaded-jackson
2.10.1-9.0
org.apache.flink
flink-shaded-netty
4.1.39.Final-9.0
org.apache.flink
flink-sql-parser
1.10.3
org.apache.flink
flink-statebackend-rocksdb_2.12
1.10.3
org.apache.flink
flink-streaming-java_2.12
1.10.3
org.apache.flink
flink-streaming-scala_2.12
1.10.3
org.apache.flink
flink-table-api-java
1.10.3
org.apache.flink
flink-table-api-java-bridge_2.12
1.10.3
org.apache.flink
flink-table-api-scala-bridge_2.12
1.10.3
org.apache.flink
flink-table-api-scala_2.12
1.10.3
org.apache.flink
flink-table-common
1.10.3
org.apache.flink
flink-table-planner-blink_2.12
1.10.3
org.apache.flink
flink-table-planner_2.12
1.10.3
org.apache.flink
flink-table-runtime-blink_2.12
1.10.3
org.apache.flink
flink-table-uber-blink_2.12
1.10.3
org.apache.flink
flink-table-uber_2.12
1.10.3
org.apache.flink
flink-yarn_2.12
1.10.3
org.apache.flink
force-shading
1.10.3
org.apache.mesos
mesos
1.0.1
org.codehaus.janino
commons-compiler
3.0.9
org.codehaus.janino
janino
3.0.9
org.slf4j
log4j-over-slf4j
1.7.25
org.slf4j
slf4j-api
1.7.15
3.0.0
DEPRECATED
Deprecated on 2021-06-23
With the introduction of a new pipeline environment for stream processing the following environment has been deprecated and will be removed after 6 months: Stream-3.0.0 for stream environment with Apache Flink 1.10.1
Please, use the latest SDK to migrate your applications to Scala 2.12 and to this new environment: stream-4.0 for stream environment with Flink 1.10.3
3.0.0
ADDED
Added on 2020-07-28
A new pipeline environments for stream processing has been introduced to update the Flink version: Stream-3.0.0 for stream environment with Apache Flink 1.10.1
The following lists all dependencies provided by this new pipeline environment:
Changed the following archetypes to use the new Stream environment with Flink 2.2.0:
- Streaming Pipeline in Java - Streaming Pipeline in Scala
2.85.8
Archetypes
FIXED
Fixed Schema Archetype build for ARM architectures.
2.85.8
Data Archiving Library
CHANGED
The Data Archive Library has been upgraded to Flink 2.2.0.
This upgrade introduces breaking changes due to the removal of deprecated APIs in Flink 2.x. The library has been updated accordingly to align with the new APIs and runtime behavior.
Key updates:
- Source API migration - Replaced deprecated SourceFunction usage with the FLIP-27 Source API - Updated stream creation from addSource(...) to fromSource(...)
- Sink API migration - Replaced deprecated SinkFunction with the new Sink V2 API - Updated usage from addSink(...) to sinkTo(...)
- Function lifecycle changes - Updated open(Configuration) methods to open(OpenContext) where applicable
- Dependencies and imports - Updated Flink dependencies to version 2.2.0 - Updated imports to reflect API changes (e.g. removal of flink-java)
Improved tile loading performance by enhancing caching of the most recently used tile. Path matching performance has improved by around 10% as a result. To benefit from this optimization, make sure a dedicated path matcher instance per thread is created using preconfigured path matcher factories. When implementing a custom path matcher, ensure that layer loaders are created per thread.
2.85.8
Location Library
ADDED
Added AttributeAccessor.apply to the Java DSL, providing the same partition‑attribute extraction capability already available in the Scala DSL.
2.85.8
Location Library
ADDED
Added Traffic Signal attribute to Topology Attributes.
For instructions on how to access the advanced navigation attributes, see the com.here.platform.location.integration.optimizedmap.graph.PropertyMaps.TopologyAttributes class and the related methods. Added the specific Java variant through the com.here.platform.location.integration.optimizedmap.graph.javadsl.PropertyMaps.TopologyAttributes class.
2.85.8
Examples
CHANGED
Changed the following examples to use the new Stream environment with Flink 2.2.0:
Removed the com.here.platform.data.archive:data-archive_2.13 library from sdk-batch-bom_2.13 since this library is intended for Flink applications only. If you need this library, you can find it in sdk-stream-bom_2.13 or sdk-standalone-bom_2.13.
2.85.8
Batch Libraries
REMOVED
Removed the com.here.platform.data.client:kafka-support_2.13 library from sdk-batch-bom_2.13 since this library is intended for Flink applications only. If you need this library, you can find it in sdk-stream-bom_2.13 or sdk-standalone-bom_2.13.
2.85.8
Stream Libraries
ADDED
Added the following HMC schema artifacts to the SDK Bom files:
Added support for configuring max-requests-per-host for the OkHttpClient used by BaseClient. This allows controlling the maximum number of concurrent HTTP requests per host instead of relying on OkHttp’s default limit.
2.84.4
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
interactive-map-v1:1.3.4 config:1.3.4
2.84.4
Location Library
REMOVED
Removed the deprecated CurvatureHeading attribute from AdasAttributes. Please use the separate Curvature and Heading attributes instead.
2.84.4
Location Library
REMOVED
Removed no longer supported Japan catalog constant (hrn:here:data::olp-here:here-optimized-map-for-location-library-japan-2).
2.84.4
Location Library
REMOVED
Removed SimpleConnectivityTransitionProbabilityStrategy class. Please use DistanceTransitionProbabilityStrategy instead.
Removed distanceWithTransitions method. Please use the other available overload instead.
2.84.4
Tutorials
CHANGED
Updated the following tutorials to replace deprecated road-attributes with topology-attributes layer from HMC catalog, upgrade HMC catalog versions to 8185, and adopt the new topology-attributes schema:
- Read from a catalog in a batch application - Correlate Road Attributes to Segment Geometry - Use Spark connector to read and write data
2.84.4
Examples
CHANGED
Updated the following examples to replace deprecated road-attributes with topology-attributes layer from HMC catalog, upgrade HMC catalog versions to 8185 and adopt the new topology-attributes schema:
- A Compiler to lift road topology and geometry and aggregate it to higher level - A Stateful Processing Compiler to Process Input and Feedback Data - A Compiler to Compute Catalog Differences - A Compiler to Extract Pedestrian Topologies into Protobuf - A Compiler to Extract Pedestrian Topologies into GeoJSON
2.84.4
Batch Libraries
ADDED
Added the following Optimized Map schema artifacts to the SDK Bom files:
Enhanced ApiRequest.withQueryParam method to support multiple values for the same query parameter key. Now calling .withQueryParam("param", "value1").withQueryParam("param", "value2") will produce a query string like ?param=value1¶m=value2 instead of overwriting the first value.
2.83.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
olsRouting-v8 8.146.0
2.83.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support the latest versions of HERE Platform Data APIs:
olsRevGeocode-v1 1.0.0
2.83.3
Location Library
ADDED
Added toLocationLineString extension method to Scala LineString like types
2.83.3
Batch Libraries
ADDED
Added the following RIB schema artifacts to the SDK Bom files:
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.3.4
2.82.3
Location Library
CHANGED
Improved the performances of the map matchers with transitions, especially in the case of traces with dense points. This change should improve the performances of the map matching algorithm in real-world use cases by up to 50%.
2.82.3
Batch dependencies
CHANGED
Upgraded the following logback libraries from the 1.4.14 version to the 1.5.20 to fix the CVE-2024-12801, CVE-2024-12798 vulnerabilities:
Upgraded the org.apache.parquet:parquet-avro library from the 1.14.4 version to the 1.15.2 to fix the following vulnerabilities: CVE-2025-30065,CVE-2025-46762.
2.82.3
Stream dependencies
CHANGED
Upgraded the following logback libraries from the 1.4.14 version to the 1.5.20 to fix the CVE-2024-12801, CVE-2024-12798 vulnerabilities:
Upgraded the org.apache.parquet:parquet-avro library from the 1.14.4 version to the 1.15.2 to fix the following vulnerabilities: CVE-2025-30065,CVE-2025-46762.
2.81.5
Archetypes
CHANGED
Changed archetypes to use the new Batch 5.0 environment with Spark 4.0.1.
2.81.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
olsRouting-v8 8.79.1
2.81.5
Data Client Base Library
CHANGED
Updated the library to work with Spark 4.0.1.
2.81.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.3.2
2.81.5
Data Client Library
CHANGED
The Data Client Library has been updated to use Spark 4.0.1.
2.81.5
Data Processing Library
CHANGED
Changed the Data Processing Library to use Spark 4.0.1.
2.81.5
Index Compaction Library
CHANGED
The Index Compaction Library has been updated to Spark version 4.0.1
2.81.5
Location Library
CHANGED
Updated the Location Library to support Spark 4.0.1.
2.81.5
Tutorials
CHANGED
Changed the tutorials to use the new Batch 5.0 environment with Spark 4.0.1:
For more information on migrating your project to Spark 4.0.1, refer to the migration guide.
2.81.5
Examples
CHANGED
Changed examples to use the new Batch 5.0 environment with Spark 4.0.1.
2.81.5
Schemas
CHANGED
The latest v4.0.0 OM4LL Schema now use Protobuf 4.32.0.
Be sure to update the schema to the latest version to avoid compatibility issues.
2.81.5
Schemas
CHANGED
The latest v2.1.21 Real-Time Traffic Schema now use Protobuf 4.32.0.
Be sure to update the schema to the latest version to avoid compatibility issues.
2.81.5
Schemas
CHANGED
The latest v2.182.0 Reality Index Base (RiB) Schema now use Protobuf 4.32.0.
Be sure to update the schema to the latest version to avoid compatibility issues.
Upgraded the org.checkerframework:checker-qual library from the 3.33.0 version to the 3.43.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the commons-codec:commons-codec library from the 1.17.1 version to the 1.17.2.
2.81.5
Batch dependencies
CHANGED
Upgraded the commons-io:commons-io library from the 2.16.1 version to the 2.18.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.apache.curator:curator-client, org.apache.curator:curator-framework, and org.apache.curator:curator-recipes libraries from the 2.13.0 version to the 5.7.1 to fix the following direct and transitive vulnerabilities: CVE-2019-20444,CVE-2019-20445,CVE-2015-2156,CVE-2022-23305,CVE-2019-17571,CVE-2021-4104,CVE-2023-26464,CVE-2022-23302,CVE-2022-23307,CVE-2023-44981,CVE-2017-5637,CVE-2018-8012.
2.81.5
Batch dependencies
CHANGED
Upgraded the com.here.platform:environment-batch_2.13:4.0.15 to the com.here.platform:environment-batch_2.13:5.0.0 to support Spark 4.0.1.
2.81.5
Batch dependencies
CHANGED
Upgraded the com.google.errorprone:error_prone_annotations library from the 2.5.1 version to the 2.36.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the com.google.code.gson:gson library from the 2.8.9 version to the 2.11.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the com.google.guava:guava library from the 31.1.1-jre version to the 33.4.0-jre.
2.81.5
Batch dependencies
CHANGED
Upgraded the com.google.j2objc:j2objc-annotations library from the 2.8 version to the 3.0.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the following com.fasterxml.jackson.core libraries from the 2.14.2 to the 2.18.2:
Upgraded the org.jline:jline library from the 3.26.0 version to the 3.27.1.
2.81.5
Batch dependencies
CHANGED
Upgraded the joda-time:joda-time library from the 2.12.2 version to the 2.13.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.json4s:json4s-ast_2.13, org.json4s:json4s-core_2.13, and org.json4s:json4s-native_2.13 libraries from the 3.7.0-M11 version to the 4.0.7.
2.81.5
Batch dependencies
CHANGED
Upgraded the ch.qos.logback:logback-classic and ch.qos.logback:logback-core libraries from the 1.3.14 version to the 1.4.14.
2.81.5
Batch dependencies
CHANGED
Upgraded the io.dropwizard.metrics:metrics-core library from the 3.1.5 version to the 4.2.30.
2.81.5
Batch dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.118 version to the 4.1.126.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.objenesis:objenesis library from the 3.2 version to the 3.3.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-parser-combinators_2.13 library from the 2.4.1 version to the 2.4.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-xml_2.13 library from the 2.4.0 version to the 2.3.0.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.yaml:snakeyaml library from the 2.0 version to the 2.3.
2.81.5
Batch dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.5 version to the 1.1.10.7.
2.81.5
Standalone dependencies
CHANGED
Upgraded the following commons-beanutils:commons-beanutils library from the 1.9.4 version to the 1.11.0 to fix the following vulnerabilities: CVE-2023-25613, CVE-2024-25638.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.checkerframework:checker-qual library from the 3.33.0 version to the 3.43.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the commons-codec:commons-codec library from the 1.17.1 version to the 1.17.2.
2.81.5
Standalone dependencies
CHANGED
Upgraded the commons-io:commons-io library from the 2.16.1 version to the 2.18.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.apache.curator:curator-client, org.apache.curator:curator-framework, and org.apache.curator:curator-recipes libraries from the 2.13.0 version to the 5.7.1 to fix the following direct and transitive vulnerabilities: CVE-2019-20444,CVE-2019-20445,CVE-2015-2156,CVE-2022-23305,CVE-2019-17571,CVE-2021-4104,CVE-2023-26464,CVE-2022-23302,CVE-2022-23307,CVE-2023-44981,CVE-2017-5637,CVE-2018-8012.
2.81.5
Standalone dependencies
CHANGED
Upgraded the com.google.errorprone:error_prone_annotations library from the 2.5.1 version to the 2.36.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the com.google.code.gson:gson library from the 2.8.9 version to the 2.11.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the com.google.guava:guava library from the 31.1.1-jre version to the 33.4.0-jre.
2.81.5
Standalone dependencies
CHANGED
Upgraded the following org.apache.hadoop:hadoop-client library from the 3.3.6 version to the 3.4.1 to fix the following vulnerabilities: CVE-2023-25613, CVE-2024-25638
2.81.5
Standalone dependencies
CHANGED
Upgraded the com.google.j2objc:j2objc-annotations library from the 2.8 version to the 3.0.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the following com.fasterxml.jackson.core libraries from the 2.14.2 version to the 2.18.2:
Upgraded the org.jline:jline library from the 3.26.0 version to the 3.27.1.
2.81.5
Standalone dependencies
CHANGED
Upgraded the joda-time:joda-time library from the 2.12.2 version to the 2.13.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.json4s:json4s-ast_2.13, org.json4s:json4s-core_2.13, and org.json4s:json4s-native_2.13 libraries from the 3.7.0-M11 version to the 4.0.7.
2.81.5
Standalone dependencies
CHANGED
Upgraded the ch.qos.logback:logback-classic and ch.qos.logback:logback-core libraries from the 1.3.14 version to the 1.4.14.
2.81.5
Standalone dependencies
CHANGED
Upgraded the io.dropwizard.metrics:metrics-core library from the 3.1.5 version to the 4.2.30.
2.81.5
Standalone dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.118 version to the 4.1.126.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.objenesis:objenesis library from the 3.2 version to the 3.3.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-parser-combinators_2.13 library from the 2.4.1 version to the 2.4.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-xml_2.13 library from the 2.4.0 version to the 2.3.0.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.yaml:snakeyaml library from the 2.0 version to the 2.3.
2.81.5
Standalone dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.5 version to the 1.1.10.7.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.checkerframework:checker-qual library from the 3.33.0 version to the 3.43.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the commons-codec:commons-codec library from the 1.17.1 version to the 1.17.2.
2.81.5
Stream dependencies
CHANGED
Upgraded the commons-io:commons-io library from the 2.16.1 version to the 2.18.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.apache.curator:curator-client, org.apache.curator:curator-framework, and org.apache.curator:curator-recipes libraries from the 2.13.0 version to the 5.7.1 to fix the following direct and transitive vulnerabilities: CVE-2019-20444,CVE-2019-20445,CVE-2015-2156,CVE-2022-23305,CVE-2019-17571,CVE-2021-4104,CVE-2023-26464,CVE-2022-23302,CVE-2022-23307,CVE-2023-44981,CVE-2017-5637,CVE-2018-8012.
2.81.5
Stream dependencies
CHANGED
Upgraded the com.google.errorprone:error_prone_annotations library from the 2.5.1 version to the 2.36.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the com.google.code.gson:gson library from the 2.8.9 version to the 2.11.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the com.google.guava:guava library from the 31.1.1-jre version to the 33.4.0-jre.
2.81.5
Stream dependencies
CHANGED
Upgraded the com.google.j2objc:j2objc-annotations library from the 2.8 version to the 3.0.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.jline:jline library from the 3.26.0 version to the 3.27.1.
2.81.5
Stream dependencies
CHANGED
Upgraded the joda-time:joda-time library from the 2.12.2 version to the 2.13.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.json4s:json4s-ast_2.13, org.json4s:json4s-core_2.13, and org.json4s:json4s-native_2.13 libraries from the 3.7.0-M11 version to the 4.0.7.
2.81.5
Stream dependencies
CHANGED
Upgraded the ch.qos.logback:logback-classic and ch.qos.logback:logback-core libraries from the 1.3.14 version to the 1.4.14.
2.81.5
Stream dependencies
CHANGED
Upgraded the io.dropwizard.metrics:metrics-core library from the 3.1.5 version to the 4.2.30.
2.81.5
Stream dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.118 version to the 4.1.126.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.objenesis:objenesis library from the 3.2 version to the 3.3.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-parser-combinators_2.13 library from the 2.4.1 version to the 2.4.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-xml_2.13 library from the 2.4.0 version to the 2.3.0.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.yaml:snakeyaml library from the 2.0 version to the 2.3.
2.81.5
Stream dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.5 version to the 1.1.10.7.
2.80.2
Archetypes
CHANGED
Changed the archetypes to use SDK BOM with Scala 2.13 dependencies.
The latest version of archetypes generates Scala 2.13 compatible projects. If you want to use Scala 2.12, please use archetype version 1.0.1017 for the corresponding archetype (for example, batch-direct1ton-java:1.0.1017)
Make sure you update the version of sdk-batch-bom, sdk-stream-bom and sdk-standalone-bom to the latest version. The latest version can be found here.
2.80.2
Data Client Base Library
CHANGED
Changed Scala version from 2.12.20 to 2.13.16.
2.80.2
Data Client Library
ADDED
When using QueryApi.getTilesContainingFeatures method it is now possible to override the maximum value of relative resolution parameter.
Usage:
val queryApi = DataClient().queryApi(catalogHrn, settings) val startingTiles = Seq(Tile("120", TileType.QUADKEY)) val targetZoomLevel = 8 val parallelization = 1 val maxRelativeResolution = 4 val tilesAsSource: Future[Source[Seq[Tile], NotUsed]] = queryApi.getTilesContainingFeatures(layerId, startingTiles, targetZoomLevel, parallelization, Some(context), maxRelativeResolution)
val response: Future[Seq[Seq[Tile]]] = Await.result(tilesAsSource, timeout).runWith(Sink.seq[Seq[Tile]]) val tiles: Seq[Tile] = Await.result(response, timeout).flatten
2.80.2
Data Client Library
CHANGED
The Data Client Library has been updated to Scala version 2.13.16.
2.80.2
Index Compaction Library
CHANGED
The Index Compaction Library has been updated to Scala version 2.13.16.
2.80.2
Location Library
CHANGED
OLR creators and resolvers now use Topology Attributes instead of the deprecated Navigation and Road Attributes.
If you use an older map version where the Topology Attributes layer is empty, you will not receive any exceptions when creating or resolving references. Instead, you will receive incomplete results.
A new experimental API has been introduced to support the deprecated Navigation and Road Attributes layers for compatibility with older map versions. The functions linear, closedLinear, pointAlongLine, poiWithAccessPoint, and olr are available in both OlrLocationReferenceCreators and OlrLocationReferenceResolvers. These functions accept a Map Data API parameter, allowing customization of OLR creation and resolution.
TMC creators now use Topology attributes instead of deprecated Navigation Attributes.
If you use an older map version to create a TMC reference where the Topology Attributes layer is empty, you'll encounter the following exception: com.here.platform.location.referencing.tmc.LinearLocationNotRepresentedInTmcException: LinearLocation not represented in TMC..
A new experimental API has been introduced to support the deprecated Navigation Attributes layer for compatibility with older map versions. The functions tmc, extendedTmc, and piecewiseExtendedTmc in TmcLocationReferenceCreators, as well as tmc and extendedTmc in TmcLocationReferenceResolvers, accept a Map Data API parameter, enabling customization of TMC creation and resolution.
now identifies additional eligible projections to the same vertex within the search radius, in cases where the vertex geometry is intricate or curved.
This enhancement improves map matching in scenarios such as:
- Taking curved turns or turning at junctions, especially when input points are offset from the road - Traveling on roads parallel to others with opposite directions, where input points may be closer to the adjacent road - Passing over or under bridges (overpasses/underpasses) when input points are precisely located at those structures
These improvements result in more reliable map matching and geometry segment detection in areas with complex road layouts, with a minor impact on performance in the affected scenarios.
2.80.2
Location Library
CHANGED
The Scala 2.13 collections library changed the default Seq type:
- scala.Seq is now an alias for scala.collection.immutable.Seq (previously it was an alias for scala.collection.Seq).
All methods that use scala.Seq in their signatures now operate on immutable sequences.
If you have mutable sequences (e.g. scala.collection.mutable.Seq), you must explicitly convert them to immutable, for example using the .toSeq method.
> Note: .toSeq will usually create a copy of the collection, which may have > performance implications for large collections.
val mutableSeq: scala.collection.mutable.Seq[Int] = scala.collection.mutable.ArrayBuffer(1, 2, 3) val immutableSeq: scala.Seq[Int] = mutableSeq.toSeq
2.80.2
Tutorials
CHANGED
Changed the tutorials to use SDK BOM files with Scala 2.13.
For more information on migrating your project to Scala 2.13, refer to the migration guide.
2.80.2
Examples
CHANGED
Changed the examples using SDK BOM files with Scala 2.13.
For more information on migrating examples to Scala 2.13, refer to the migration guide.
Removed empty array-type query parameters from all outgoing requests
2.79.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
interactive-map-v1:1.2.11 config:1.2.11
2.79.3
Data Client Library
ADDED
When using QueryApi.getTilesContainingFeatures method it is now possible to override the maximum value of relative resolution parameter.
Usage:
val queryApi = DataClient().queryApi(catalogHrn, settings) val startingTiles = Seq(Tile("120", TileType.QUADKEY)) val targetZoomLevel = 8 val parallelization = 1 val maxRelativeResolution = 4 val tilesAsSource: Future[Source[Seq[Tile], NotUsed]] = queryApi.getTilesContainingFeatures(layerId, startingTiles, targetZoomLevel, parallelization, Some(context), maxRelativeResolution)
val response: Future[Seq[Seq[Tile]]] = Await.result(tilesAsSource, timeout).runWith(Sink.seq[Seq[Tile]]) val tiles: Seq[Tile] = Await.result(response, timeout).flatten
2.79.3
Location Library
FIXED
Fixed an issue where the relative longitude between consecutive reference points in linear and point along line OLR references could exceed the specification limit of -0.32768 to 0.32767 degrees, especially on roads near the poles due to meridian convergence — even for paths shorter than 15km. The fix enforces both the relative longitude and 15km path length constraints by adding intermediate reference points in linear references and selecting non-junction points in point along line references when necessary.
2.79.3
Location Library
ADDED
Added support for the Topology Attributes layer.
The new Topology Attributes layer consolidates all attributes currently provided by the following layers:
These existing layers will eventually be deprecated in favor of the new unified layer.
The Topology Attributes layer is available in the following catalogs:
- hrn:here:data::olp-here:here-optimized-map-for-location-library-2 (starting from version 7521) - hrn:here:data::olp-here:om4ll-gt-jpn-prod-v2 (starting from version 11) - hrn:here:data::olp-here-krmpp:om4ll-hae-kor-prod-v2 (starting from version 3)
Note: If you attempt to access the Topology Attributes layer in a catalog where its schema does not yet exist, you will encounter the following exception:
> java.lang.IllegalArgumentException: Layer 'topologyattributes' is not a > versioned layer.
However, if the catalog does contain the Topology Attributes schema but is opened with an older map version, the layer will return empty data instead of throwing an exception.
2.79.3
Location Library
ADDED
Added support for curvature and heading as separate attributes.
Adas Attributes layer now provides curvature and heading as separate attributes. The curvatureHeading attribute is deprecated in favor of the separate attributes.
The new attributes are available in the following catalogs:
- hrn:here:data::olp-here:here-optimized-map-for-location-library-2 (starting from version 7618) - hrn:here:data::olp-here:om4ll-gt-jpn-prod-v2 (starting from version 12)
Note: If you attempt to access the new attributes in a catalog where they are not available yet, you will encounter exception similar to this:
> java.lang.RuntimeException: AttributeIndex 3 (Curvature) not available in > adasattributes for TileId(1081417). Please check whether you are using an old > map version without this attribute.
2.79.3
Tutorials
CHANGED
Updated SBT version to 1.9.9. Added support for resolving artifacts published with scalaVersion and sbtVersion in their filenames. The resolver patterns now include:
This allows projects depending on sbt/Scala-specific artifacts to be correctly resolved.
2.79.3
Examples
CHANGED
Updated SBT version to 1.9.9. Added support for resolving artifacts published with scalaVersion and sbtVersion in their filenames. The resolver patterns now include:
and only in case the input point is at a road longer than 15km without any junction with accessible roads. This is a case when non-junction reference points are used to fulfill the 15km limit specified for OLR distances.
2.78.2
Location Library
FIXED
Fixed incorrect intermediate points in OLR linear location in case of very long roads.
The change affects only encoding linear location references, i.e. the following creators:
and only in case there is a road longer than 15km in the input and the end of the reference is more than 15km away from the end of this road. After the fix the distances between intermediate points are not breaching 15km limit.
2.77.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.11
2.77.3
Data Client Library
FIXED
Fixed an issue affecting partitions larger than 2GB when using ReadEngine.getDataAsSource. Although this method is intended to support large partitions, it previously failed due to internal use of arrays, which are limited to 2GB in size by the JVM.
The fix introduces a new, stream-based decoding method in the decoder:
This method accepts a Source[ByteString] as input for the encoded data and produces a Source[ByteString] of the decoded output, allowing it to handle large partitions efficiently.
Note: If you're using existing custom decoders with ReadEngine.getDataAsSource, you will need to implement this new decode method to ensure compatibility.
2.76.4
Archetypes
FIXED
Fixed Schema Archetype compatibility with Maven 3.9.1 and later.
2.76.4
Data Client Base Library
FIXED
Fixed invalid behaviour in the JSON decoder that caused nested JSON properties to be decoded with incorrect types.
2.76.4
Location Library
ADDED
Added BoundingBoxSearch, which allows to search for vertices via a bounding box.
2.76.4
Location Library
CHANGED
With the upgrade from JDK 8 to JDK 17 proximity search could sometimes return results in a different order. The following factory function is affected:
The change could also affect map matchers in rare cases.
2.76.4
Batch Libraries
ADDED
Added the com.here.account:here-oauth-client library to the SDK BOM files.
2.76.4
Stream Libraries
ADDED
Added the com.here.account:here-oauth-client library to the SDK BOM files.
2.76.4
Standalone Libraries
ADDED
Added the com.here.account:here-oauth-client library to the SDK BOM files.
2.76.4
Batch dependencies
ADDED
Added the libraries com.fasterxml.jackson.datatype:jackson-datatype-json-org:2.14.2 and com.fasterxml.jackson.module:jackson-module-scala_2.12:2.14.2.
2.76.4
Standalone dependencies
ADDED
Added the libraries com.fasterxml.jackson.datatype:jackson-datatype-json-org:2.14.2 and com.fasterxml.jackson.module:jackson-module-scala_2.12:2.14.2.
2.76.4
Stream dependencies
ADDED
Added the libraries com.fasterxml.jackson.datatype:jackson-datatype-json-org:2.14.2 and com.fasterxml.jackson.module:jackson-module-scala_2.12:2.14.2.
2.75.5
Archetypes
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Data Archiving Library
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Data Client Base Library
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.11
2.75.5
Data Client Library
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Data Client Library
ADDED
Added the com.here.platform.data.client.flink.serializers.ScalaSomeSerializer.scala class for use in Stream 6.0 applications when encountering the exception:
Unable to create serializer "com.esotericsoftware.kryo.serializers.FieldSerializer" for class: scala.Some.
Changed the minimum required Java version from 8 to 17.
2.75.5
Index Compaction Library
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Location Library
CHANGED
Changed com.here.platform.location.integration.optimizedmap.advancednavigationattributes.RailwayCrossing to include also Unspecified value.
In Scala, if you are using exhaustive match-case, you will encounter a compilation error: please ensure all match-case statements are updated to handle the new Unspecified value.
2.75.5
Location Library
ADDED
Added support for retaining only the required attributes to reduce memory usage.
Added the following functions to the OptimizedMapCatalog DSL:
Refer to the Location Library Dev Guide about cache configuration for more details.
2.75.5
Location Library
CHANGED
The withVersionedLayerReadersCache method in OptimizedMapCatalog has been deprecated. A new overload is available that also accepts a VersionedLayerReadersConfiguration, allowing consistent configuration between caches and the OptimizedMapCatalog.
For more information, see the cache configuration section in the Location Library Developer Guide.
2.75.5
Location Library
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Tutorials
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Examples
CHANGED
Changed the minimum required Java version from 8 to 17.
2.75.5
Schemas
CHANGED
Changed the minimum required Java version from 8 to 17 for the following schemas:
The client library now supports automatic calculation of message digests for integrity verification for data uploads. Digest algorithm can be used as a data integrity check to verify that the data received by server is the same data that was originally sent by the client.
You can choose one of the following Secure Hash Algorithms (SHA) or Cyclic Redundancy Check (CRC) checksum algorithms to calculate the digest value:
- CRC-32C (default) - MD5 - SHA1 - SHA256
A new configuration option ('here.platform.data-client.blobstore.digest-algorithm') allows users to choose the desired digest algorithm or disable integrity checking by setting it to NONE.
2.74.4
Location Library
CHANGED
Changed com.here.platform.location.integration.optimizedmap.advancednavigationattributes.RailwayCrossing to include also Unspecified value.
In Scala, if you are using exhaustive match-case, you will encounter a compilation error: please ensure all match-case statements are updated to handle the new Unspecified value.
2.74.4
Location Library
ADDED
Added support for retaining only the required attributes to reduce memory usage.
Added the following functions to the OptimizedMapCatalog DSL:
Refer to the Location Library Dev Guide about cache configuration for more details.
2.74.4
Location Library
CHANGED
The withVersionedLayerReadersCache method in OptimizedMapCatalog has been deprecated. A new overload is available that also accepts a VersionedLayerReadersConfiguration, allowing consistent configuration between caches and the OptimizedMapCatalog.
For more information, see the cache configuration section in the Location Library Developer Guide.
2.74.4
Schemas
ADDED
Added the ROAD_ATTRIBUTE_TRANSPORT, ROAD_ATTRIBUTE_GARAGE, ROAD_ATTRIBUTE_CAR_PARK, and ROAD_ATTRIBUTE_RESTRICTED_AREA road attributes to the sdii_v3 schema.
2.74.4
Batch Libraries
ADDED
Added the following RIB schema artifacts to the SDK Bom files:
Added details on how to handle backward compatibility issues in the message of the HERE Proto Validate plugin when a proto backward compatibility issue occurs.
2.73.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.11
2.73.5
Data Processing Library
FIXED
Fixed bug in RefTreeCompiler and in DeltaSetresolveReferences transformation that caused keys from non-subject layers to be passed to the compileInFn method or to be leaked into the DeltaSet result. This could happen during incremental compilation in case a non-subject layer in the RefTree had the same layer ID as a subject layer.
2.73.5
Batch dependencies
CHANGED
Upgraded the com.here.platform:environment-batch_2.12:4.0.11 to the com.here.platform:environment-batch_2.12:4.0.12 to support Spark 3.4.4.
2.73.5
Batch dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.113.Final version to the 4.1.118.Final to fix CVE-2025-24970 vulnerability.
2.73.5
Standalone dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.113.Final version to the 4.1.118.Final to fix CVE-2025-24970 vulnerability.
2.73.5
Stream dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.113.Final version to the 4.1.118.Final to fix CVE-2025-24970 vulnerability.
2.72.4
Archetypes
CHANGED
Changed the following archetypes to use the new Stream environment with Flink 1.19.1:
- Streaming Pipeline in Java - Streaming Pipeline in Scala
2.72.4
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.10
2.72.4
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.11
2.72.4
Data Client Library
CHANGED
The Data Client Library has been updated to Flink version 1.19.1. For more details, refer to the migration guide: Flink 1.19 migration guide
2.72.4
Data Client Library
ADDED
Added the ttl property to the ObjectStoreLayerType class, enabling setting TTL for Object Store layer.
2.72.4
Data Client Library
ADDED
Added the encryptionType property to the RawObjectStoreProperties and VersionedLayerProperties class, enabling setting type of encryption for objectstore and versioned layers during layer creation.
2.72.4
Data Processing Library
FIXED
Fixed bug in DirectMToNCompiler which caused compileInFn to be called for every input partition even in case of incremental compilation.
2.72.4
Tutorials
CHANGED
Changed the following tutorials to use the new Stream environment with Flink 1.19.1:
Upgraded the org.apache.commons:commons-lang3 library from the 3.3.2 version to the 3.12.0 version.
2.72.4
Stream dependencies
CHANGED
Upgraded the com.squareup.okhttp3 library from the 3.12.10 version to the 4.12.0 version.
2.71.8
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.10
2.71.8
Data Client Library
ADDED
Added the ttl property to the ObjectStoreLayerType class, enabling setting TTL for Object Store layer.
2.70.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.9
2.70.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.9
2.70.5
Data Client Library
ADDED
Added configuration key: here.platform.data-client.await-stream-subscription-consumption-timeout to set the timeout to wait for stream subscription to be consumed. it has the default value 1 minute (60 seconds).
2.70.5
Standalone dependencies
CHANGED
Upgraded the org.apache.avro:avro library from the 1.11.3 version to the 1.11.4.
2.70.5
Standalone dependencies
CHANGED
Upgraded the org.apache.parquet:parquet-avro library from the 1.14.1 version to the 1.14.4.
2.70.5
Standalone dependencies
CHANGED
Upgraded the following Scala libraries from the 2.12.17 version to the 2.12.20 version: - org.scala-lang:scala-compiler - org.scala-lang:scala-library - org.scala-lang:scala-reflect - org.scala-lang:scalap
2.70.5
Stream dependencies
CHANGED
Upgraded the org.apache.avro:avro library from the 1.11.3 version to the 1.11.4.
2.70.5
Stream dependencies
CHANGED
Upgraded the org.apache.parquet:parquet-avro library from the 1.14.1 version to the 1.14.4.
2.69.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.9
2.69.5
Data Client Library
ADDED
Added configuration key: here.platform.data-client.await-stream-subscription-consumption-timeout to set the timeout to wait for stream subscription to be consumed. it has the default value 1 minute (60 seconds).
2.69.5
Batch dependencies
ADDED
Added the org.checkerframework:checker-qual:3.33.0 library.
2.69.5
Batch dependencies
ADDED
Added the com.google.guava:guava:32.1.1-jre library.
2.69.5
Batch dependencies
CHANGED
Upgraded the commons-codec:commons-codec library from the 1.15 version to 1.17.1.
2.69.5
Batch dependencies
CHANGED
Upgraded the commons-io:commons-io library from the 2.11.0 version to 2.16.1.
2.69.5
Batch dependencies
CHANGED
Upgraded the org.apache.commons:commons-lang3 library from the 3.12.0 version to 3.17.0.
2.69.5
Standalone dependencies
ADDED
Added the org.checkerframework:checker-qual:3.33.0 library.
2.69.5
Standalone dependencies
ADDED
Added the com.google.guava:guava:32.1.1-jre library.
2.69.5
Standalone dependencies
ADDED
Added the com.github.luben:zstd-jni:1.5.6-2 library to align version with org.apache.parquet:parquet-avro:1.14.1.
2.69.5
Standalone dependencies
CHANGED
Upgraded the org.apache.avro:avro library from the 1.10.0 version to the 1.11.3.
2.69.5
Standalone dependencies
CHANGED
Upgraded the commons-codec:commons-codec library from the 1.15 version to 1.17.1.
2.69.5
Standalone dependencies
CHANGED
Upgraded the commons-io:commons-io library from the 2.11.0 version to 2.16.1.
2.69.5
Standalone dependencies
CHANGED
Upgraded the org.apache.commons:commons-lang3 library from the 3.12.0 version to 3.17.0.
2.69.5
Standalone dependencies
CHANGED
Upgraded the org.apache.hadoop:hadoop-client library from the 3.3.4 version to the 3.3.6.
2.69.5
Standalone dependencies
CHANGED
Upgraded the org.apache.parquet:parquet-avro library from the 1.10.1 version to the 1.14.1.
2.69.5
Stream dependencies
ADDED
Added the org.checkerframework:checker-qual:3.33.0 library.
2.69.5
Stream dependencies
ADDED
Added the com.google.guava:guava:32.1.1-jre library.
2.69.5
Stream dependencies
ADDED
Added the com.github.luben:zstd-jni:1.5.6-2 library to align version with org.apache.parquet:parquet-avro:1.14.1.
2.69.5
Stream dependencies
CHANGED
Upgraded the org.apache.avro:avro library from the 1.10.0 version to the 1.11.3.
2.69.5
Stream dependencies
CHANGED
Upgraded the commons-codec:commons-codec library from the 1.15 version to 1.17.1.
2.69.5
Stream dependencies
CHANGED
Upgraded the commons-io:commons-io library from the 2.11.0 version to 2.16.1.
2.69.5
Stream dependencies
CHANGED
Upgraded the org.apache.maven.plugins:maven-shade-plugin library from the 3.2.1 version to the 3.6.0 to support multi-release jars.
2.69.5
Stream dependencies
CHANGED
Upgraded the org.apache.parquet:parquet-avro library from the 1.10.1 version to the 1.14.1.
2.68.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
config:1.2.9
2.68.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
metadata:1.2.9 config:1.2.9
2.68.3
Data Client Library
CHANGED
Due to Akka's licensing model change, along with the outdated and potentially vulnerable Akka 2.5.32, the Data Client Library has been migrated to Apache Pekko, an open-source fork based on Akka 2.6.x.
To migrate your existing code, follow this migration path:
Added the ttlDays property to the AutomaticVersionDeletion class, enabling the setting of TTL for catalog versions.
2.68.3
Data Processing Library
FIXED
Fixed bug in outerJoin transformation which caused a Spark exception when the upstream deltaset is persisted with a storage level different from intermediateStorageLevel.
2.68.3
Location Library
CHANGED
Changed standalone data loaders API to use pekko actor system.
Migration from Akka to Pekko causes a change in the API of the following classes:
Ensure that all reference.conf files from various dependencies are appended and merged into a single file in the fat jar to avoid configuration issues. For more information, see the Data Client Developer Guide
2.68.3
Batch Libraries
ADDED
Added the following RIB schema artifacts to the SDK Bom files:
Added the com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.14.2 library.
2.68.3
Batch dependencies
ADDED
Added the com.typesafe:ssl-config-core_2.12:0.6.1 library.
2.68.3
Batch dependencies
CHANGED
Replaced all com.typesafe.akka dependencies with org.apache.pekko dependencies to align with the transition to Apache Pekko: - com.typesafe.akka:akka-http-core_2.12:10.2.7 -> org.apache.pekko:pekko-http-core_2.12:1.0.1 - com.typesafe.akka:akka-http_2.12:10.2.7 -> org.apache.pekko:pekko-http_2.12:1.0.1 - com.typesafe.akka:akka-slf4j_2.12:2.5.32 -> org.apache.pekko:pekko-slf4j_2.12:1.0.2 - com.typesafe.akka:akka-stream_2.12:2.5.32 -> org.apache.pekko:pekko-stream_2.12:1.0.2 - com.typesafe.akka:akka-actor_2.12:2.5.32 -> org.apache.pekko:pekko-actor_2.12:1.0.2
2.68.3
Batch dependencies
CHANGED
Upgraded the org.apache.maven.plugins:maven-shade-plugin library from the 3.2.1 version to the 3.6.0 to support multi-release jars.
2.68.3
Batch dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.87.Final version to the 4.1.113.Final version to fix vulnerability.
2.68.3
Batch dependencies
CHANGED
Upgraded the org.reactivestreams:reactive-streams library from the 1.0.2 version to the 1.0.4 version.
2.68.3
Batch dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-java8-compat_2.12 library from the 1.0.0 version to the 1.0.2 version.
2.68.3
Batch dependencies
CHANGED
Upgraded the com.typesafe:config library from the 1.3.0 version to the 1.4.3 version.
2.68.3
Standalone dependencies
ADDED
Added the com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.12.7 library.
2.68.3
Standalone dependencies
ADDED
Added the com.typesafe:ssl-config-core_2.12:0.6.1 library.
2.68.3
Standalone dependencies
ADDED
Added the com.github.luben:zstd-jni:1.5.6-2 library to align version with org.apache.parquet:parquet-avro:1.14.1.
2.68.3
Standalone dependencies
CHANGED
Replaced all com.typesafe.akka dependencies with org.apache.pekko dependencies to align with the transition to Apache Pekko: - com.typesafe.akka:akka-http-core_2.12:10.2.7 -> org.apache.pekko:pekko-http-core_2.12:1.0.1 - com.typesafe.akka:akka-http_2.12:10.2.7 -> org.apache.pekko:pekko-http_2.12:1.0.1 - com.typesafe.akka:akka-slf4j_2.12:2.5.32 -> org.apache.pekko:pekko-slf4j_2.12:1.0.2 - com.typesafe.akka:akka-stream_2.12:2.5.32 -> org.apache.pekko:pekko-stream_2.12:1.0.2 - com.typesafe.akka:akka-actor_2.12:2.5.32 -> org.apache.pekko:pekko-actor_2.12:1.0.2
2.68.3
Standalone dependencies
CHANGED
Upgraded the org.apache.avro:avro library from the 1.10.0 version to the 1.11.3.
2.68.3
Standalone dependencies
CHANGED
Upgraded the org.apache.hadoop:hadoop-client library from the 3.3.4 version to the 3.3.6.
2.68.3
Standalone dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.87.Final version to the 4.1.113.Final version to fix vulnerability.
2.68.3
Standalone dependencies
CHANGED
Upgraded the org.apache.parquet:parquet-avro library from the 1.10.1 version to the 1.14.1.
2.68.3
Standalone dependencies
CHANGED
Upgraded the org.reactivestreams:reactive-streams library from the 1.0.2 version to the 1.0.4 version.
2.68.3
Standalone dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-java8-compat_2.12 library from the 1.0.0 version to the 1.0.2 version.
2.68.3
Standalone dependencies
CHANGED
Upgraded the com.typesafe:config library from the 1.3.0 version to the 1.4.3 version.
2.68.3
Stream dependencies
ADDED
Added the com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.12.1 library.
2.68.3
Stream dependencies
ADDED
Added the com.typesafe:ssl-config-core_2.12:0.6.1 library.
2.68.3
Stream dependencies
ADDED
Added the com.github.luben:zstd-jni:1.5.6-2 library to align version with org.apache.parquet:parquet-avro:1.14.1.
2.68.3
Stream dependencies
CHANGED
Replaced all com.typesafe.akka dependencies with org.apache.pekko dependencies to align with the transition to Apache Pekko: - com.typesafe.akka:akka-http-core_2.12:10.2.7 -> org.apache.pekko:pekko-http-core_2.12:1.0.1 - com.typesafe.akka:akka-http_2.12:10.2.7 -> org.apache.pekko:pekko-http_2.12:1.0.1 - com.typesafe.akka:akka-slf4j_2.12:2.5.32 -> org.apache.pekko:pekko-slf4j_2.12:1.0.2 - com.typesafe.akka:akka-stream_2.12:2.5.32 -> org.apache.pekko:pekko-stream_2.12:1.0.2 - com.typesafe.akka:akka-actor_2.12:2.5.32 -> org.apache.pekko:pekko-actor_2.12:1.0.2
2.68.3
Stream dependencies
CHANGED
Upgraded the org.apache.avro:avro library from the 1.10.0 version to the 1.11.3.
2.68.3
Stream dependencies
CHANGED
Upgraded the org.apache.maven.plugins:maven-shade-plugin library from the 3.2.1 version to the 3.6.0 to support multi-release jars.
2.68.3
Stream dependencies
CHANGED
Upgraded the io.netty:netty-all library from the 4.1.87.Final version to the 4.1.113.Final version to fix vulnerability.
2.68.3
Stream dependencies
CHANGED
Upgraded the org.apache.parquet:parquet-avro library from the 1.10.1 version to the 1.14.1.
2.68.3
Stream dependencies
CHANGED
Upgraded the org.reactivestreams:reactive-streams library from the 1.0.2 version to the 1.0.4 version.
2.68.3
Stream dependencies
CHANGED
Upgraded the org.scala-lang.modules:scala-java8-compat_2.12 library from the 1.0.0 version to the 1.0.2 version.
2.68.3
Stream dependencies
CHANGED
Upgraded the com.typesafe:config library from the 1.3.0 version to the 1.4.3 version.
2.67.7
Location Library
FIXED
Fixed an issue with bounding box exterior.
In com.here.platform.location.io.scaladsl.geojson.Feature#boundingBox we are moving from clockwise to counterclockwise exterior of a bounding box polygon feature. According to GeoJSON Format specification (see https://datatracker.ietf.org/doc/html/rfc7946#section-3.1.6), Polygon exterior should be defined counterclockwise.
2.67.7
Location Library
ADDED
Added a GeoJSON feature to visualize a collection of bounding boxes.
Added new functions: com.here.platform.location.io.scaladsl.geojson.FeatureCollection#boundingBoxes com.here.platform.location.io.javadsl.geojson.FeatureCollection#boundingBoxes com.here.platform.location.io.scaladsl.geojson.Feature#boundingBoxes
New functions allow to create MultiPolygon feature for visualizing a collection of bounding boxes with the same set of properties.
2.67.7
Tutorials
ADDED
Added the Gradle resolver plugin which provides Java and Scala developers with access to HERE platform artifacts via Gradle.
2.66.7
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
Added the baseVersion parameter to the Versioned layer extension properties.
2.65.6
Data Client Library
CHANGED
Changed reference.conf in a way that kafka-connector is the default for all types of stream connections.
2.65.6
Tutorials
REMOVED
Removed the Get real-time traffic conditions for a location tutorial from HERE Data Java/Scala SDK.
2.64.5
Location Library
FIXED
Updated ProjectingInterpolator to handle paths with loops (i.e., when start and end points are located on the same vertex and start-fraction > end-fraction).
In some cases the path matchers could have returned OnRoad points connected to the previous point, but going backward on the returned path. This behavior has been changed and now connected OnRoad points can only move forward on the matched path.
All PathMatchers which use ProjectingInterpolator under the hood are affected by this change, including:
Changed zero offsets in OLR linear references into lack of offset.
According to the TISA OLR specification, either the lack of an offset or a zero offset indicate that the start (in the case of a positive offset) or the end (in the case of a negative offset) of a location lies exactly on the reference point (first or last, respectively). Previously, we returned zero offset in some cases and no offset in others. This has been changed to always returning no offset.
2.64.5
Location Library
FIXED
Fixed TISA OLR specification data format rule violation in linear references.
According to data format rule no. 5, the positive offset of a linear reference must refer to the path defined by the first two reference points, while the negative offset must refer to the path defined by the last two reference points. At the same time, according to the rule no. 1, the maximum distance between consecutive reference points is 15 km. In rare cases where the next junction is distant from a given location, you must add a non-junction reference point closer to the location. In this case, keeping both the junction as a reference point (last or first) and the non-junction (closer) intermediate reference point violates the rule no. 5, as the offset is not referring to the path between them.
We previously returned both reference points and only violated rule no. 5 in this rare case. The fix changes the behavior so that the junction is no longer a reference point and only the non-junction point is retained (fulfilling both rules no. 1 and 5).
2.64.5
Tutorials
CHANGED
Changed the following tutorials to use the new Batch environment with Spark 3.4.3:
- Path matching the sensor data to GeoJSON in Spark - Copy a catalog using the Data Processing Library - Use Spark Connector to migrate CSV data to Protobuf - Develop a Spark application - Read and write to Object store layer using Hadoop FS support in Spark - Local development and testing with CLI and Data Client Library - Read from a catalog in a batch application - Use HERE Platform Service - Use Spark Connector to read and write data
2.64.5
Batch dependencies
CHANGED
Upgraded the com.here.platform:environment-batch-4.0.1 to the com.here.platform:environment-batch-4.0.2 to support Spark 3.4.3.
2.64.5
Batch dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.4 version to the 1.1.10.5 version to fix vulnerability.
2.64.5
Standalone dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.4 version to the 1.1.10.5 version to fix vulnerability.
2.64.5
Stream dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.4 version to the 1.1.10.5 version to fix vulnerability.
2.63.7
Location Library
FIXED
Fixed an issue regarding returning unnecessary elements in Map Matching results.
This problem occurred in Map Matching using com.here.platform.location.integration.optimizedmap.mapmatching.PathMatchers.
In cases where an input observation is projected exactly at the crossing of two subsequent elements, it can lead to Map Matching results that include:
- a projection on the preceding element with a fraction of 1.0, even if it is the first observation in a sequence of matched observations - a projection on the following element with a fraction of 0.0, even if it is the last observation in a sequence of matched observations
This fix ensures that Map Matcher will not return zero-length elements as part of the response.
Because the algorithm has changed, you might observe different, but still correct, results.
2.63.7
Examples
CHANGED
Updated the A Compiler to Extract Pedestrian Topologies into Protobuf example to use Protobuf 3.19.6.
2.63.7
Schemas
CHANGED
The latest v2.8.4 OM4LL Schema now use Protobuf 3.19.6.
Be sure to update the schema to the latest version to avoid compatibility issues.
2.63.7
Schemas
CHANGED
The latest v2.1.18 Real-Time Traffic Schema now use Protobuf 3.19.6.
Be sure to update the schema to the latest version to avoid compatibility issues.
2.63.7
Schemas
CHANGED
The latest v2.114.0 Reality Index Base (RiB) Schema now use Protobuf 3.19.6.
Be sure to update the schema to the latest version to avoid compatibility issues.
Be sure to update the above-mentioned schemas to their latest versions to avoid compatibility issues.
2.63.7
Schemas
CHANGED
The latest v1.1.12 SENSORIS schema now use Protobuf 3.19.6.
Be sure to update the schema to the latest version to avoid compatibility issues.
2.63.7
Batch dependencies
CHANGED
Upgraded the following libraries: - com.github.blemale:scaffeine_2.12 from the 4.0.1 version to the 4.1.0 version - com.google.errorprone:error_prone_annotations from the 2.3.4 version to the 2.5.1 version - com.thesamet.scalapb:compilerplugin_2.12, com.thesamet.scalapb:lenses_2.12, com.thesamet.scalapb:scalapb-runtime_2.12 from the 0.10.10 version to the 0.11.15 version - org.scala-lang.modules:scala-java8-compat_2.12 from the 0.9.1 version to the 1.0.0 version
2.63.7
Batch dependencies
CHANGED
Upgraded the com.google.protobuf:protobuf-java and com.google.protobuf:protobuf-java-util libraries from the 3.11.4 version to the 3.19.6 version to fix the CVE-2021-22569 vulnerability.
2.63.7
Standalone dependencies
CHANGED
Upgraded the following libraries: - com.github.blemale:scaffeine_2.12 from the 4.0.1 version to the 4.1.0 version - com.google.errorprone:error_prone_annotations from the 2.3.4 version to the 2.5.1 version - com.thesamet.scalapb:compilerplugin_2.12, com.thesamet.scalapb:lenses_2.12, com.thesamet.scalapb:scalapb-runtime_2.12 from the 0.10.10 version to the 0.11.15 version - org.scala-lang.modules:scala-java8-compat_2.12 from the 0.9.1 version to the 1.0.0 version
2.63.7
Standalone dependencies
CHANGED
Upgraded the com.google.protobuf:protobuf-java and com.google.protobuf:protobuf-java-util libraries from the 3.11.4 version to the 3.19.6 version to fix the CVE-2021-22569 vulnerability.
2.63.7
Stream dependencies
CHANGED
Upgraded the following libraries: - com.github.blemale:scaffeine_2.12 from the 4.0.1 version to the 4.1.0 version - com.google.errorprone:error_prone_annotations from the 2.3.4 version to the 2.5.1 version - com.thesamet.scalapb:compilerplugin_2.12, com.thesamet.scalapb:lenses_2.12, com.thesamet.scalapb:scalapb-runtime_2.12 from the 0.10.10 version to the 0.11.15 version - org.scala-lang.modules:scala-java8-compat_2.12 from the 0.9.1 version to the 1.0.0 version
2.63.7
Stream dependencies
CHANGED
Upgraded the com.google.protobuf:protobuf-java and com.google.protobuf:protobuf-java-util libraries from the 3.11.4 version to the 3.19.6 version to fix the CVE-2021-22569 vulnerability.
2.62.5
Archetypes
ADDED
Added the includeOnlySourceProto configuration property to the layer-manifest-plugin which controls whether or not to include *.proto files from dependencies in the layer.fds file.
2.62.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
metadata:1.2.7 config:1.2.7
2.62.5
Location Library
FIXED
Fixed an issue with missing transitions in map matching output.
This problem occurred in Map Matching using com.here.platform.location.core.mapmatching.ProjectingInterpolator, including:
In cases where a path traverses a point near the end of a segment and a point near the beginning of the same segment, the transitions found by com.here.platform.location.core.mapmatching.HMMPathMatcher are erased by the interpolator. The output can be falsely interpreted as running backwards on the segment instead of forward and looping through a transition.
2.61.5
Data Client Library
FIXED
Fixed the problem when the connection was not closed if the requested BLOB does not exist.
2.61.5
Data Client Library
DEPRECATED
Please notice that with the upcoming release of September 2024 of the HERE SDK for Java and Scala we will stop using Akka framework. All functions which use Akka today will be migrated to use Pekko. Data Client Library will not have Akka as a dependency anymore.
This means that if your application uses any of the Akka classes which are delivered with HERE SDK for Java and Scala packages (jar files) you need to migrate your code to Pekko as well.
val layers = new CarPathMatcherLayers(optimizedMap.geometry, optimizedMap.length, optimizedMap.routingGraph, optimizedMap.restrictedManoeuvre, optimizedMap.routingRoadAccess) val pathMatcher = PathMatchers.carPathMatcherWithTransitionsGeoCoordinate
2.61.5
Tutorials
CHANGED
Changed the following tutorials to use the new Batch environment with Spark 3.4.2:
- Path matching the sensor data to GeoJSON in Spark - Copy a catalog using the Data Processing Library - Use Spark Connector to migrate CSV data to Protobuf - Develop a Spark application - Read and write to Object store layer using Hadoop FS support in Spark - Local development and testing with CLI and Data Client Library - Read from a catalog in a batch application - Use HERE Platform Service - Use Spark Connector to read and write data
2.61.5
Batch dependencies
CHANGED
Upgraded the com.here.platform:environment-batch-4.0.0 to the com.here.platform:environment-batch-4.0.1 to support Spark 3.4.2.
2.61.5
Batch dependencies
CHANGED
Upgraded the following logback libraries from the 1.3.8 version to the 1.3.14 version to fix vulnerability: - ch.qos.logback:logback-classic - ch.qos.logback:logback-core
2.61.5
Batch dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.1 version to the 1.1.10.4 version to fix vulnerability.
2.61.5
Standalone dependencies
CHANGED
Upgraded the following logback libraries from the 1.3.8 version to the 1.3.14 version to fix vulnerability: - ch.qos.logback:logback-classic - ch.qos.logback:logback-core
2.61.5
Standalone dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.1 version to the 1.1.10.4 version to fix vulnerability.
2.61.5
Stream dependencies
CHANGED
Upgraded the following logback libraries from the 1.3.8 version to the 1.3.14 version to fix vulnerability: - ch.qos.logback:logback-classic - ch.qos.logback:logback-core
2.61.5
Stream dependencies
CHANGED
Upgraded the org.xerial.snappy:snappy-java library from the 1.1.10.1 version to the 1.1.10.4 version to fix vulnerability.
2.60.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
Removed all China-related elements, since China platform is no longer available, in particular:
- China catalogs HRNs (catalogs are not available anymore) - TmcAdjacencyProviders factory (functionality for creating adjacency provider out of China TMC offset catalogs)
2.59.2
Data Client Base Library
CHANGED
The HERE SDK for Java and Scala upgraded support for Spark to version 3.4.1. This means the this version of data-client-base libraries are not compatible with the previous versions anymore.
2.59.2
Data Client Library
ADDED
Added new methods to QueryApi/FlinkQueryApi that allows adding context parameter to query composite catalogs for versioned layers.
2.58.2
Archetypes
FIXED
Fixed the Unable to resolve Artifact Service URL. Status: HTTP/1.1 429 Too Many Requests error when use the HERE platform Maven Wagon plugin.
2.58.2
Archetypes
CHANGED
Changed the following archetypes to use the new Batch environment with Spark 3.4.1:
- Direct1toN Batch Processor in Java Archetype - Direct1toN Batch Processor in Scala Archetype - Batch Processor in Java Archetype - Batch Processor in Scala Archetype - MapGroup Batch Processor in Java Archetype - MapGroup Batch Processor in Scala Archetype - Reftree Batch Processor in Java Archetype - Reftree Batch Processor in Scala Archetype
2.58.2
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
Added new method to WriteEngine that allows updating of Ttl on individual partition in a Volatile layer.
2.58.2
Location Library
CHANGED
The order of the elements returned by the proximity search can change after this release. Note that any particular order is not guaranteed by the library.
2.58.2
Location Library
CHANGED
Map matching can sometimes match exactly the end or the start of a segment. In these cases, the library can choose any of the equivalent points, i.e. the start of the next segment or the end of the previous one. The selection of a particular point out of the equivalent ones can change after this release. Note that any particular selection is not guaranteed by the library.
2.58.2
Location Library
CHANGED
Weighers defined in com.here.platform.location.integration.optimizedmap.internal.TileWeighers, which are needed to configure the layers in com.here.platform.location.integration.optimizedmap.OptimizedMapLayers and are used to estimate the cache memory occupation, are returning exactly the same numbers as before this release, but after this release there can be sometimes some memory optimization carried out in case of empty data fields, which is not taken into account by the weighers. Thus, weighers can very rarely slightly overestimate the memory consumed.
2.58.2
Tutorials
CHANGED
Changed the following tutorials to use the new Batch environment with Spark 3.4.1:
- Path matching the sensor data to GeoJSON in Spark - Copy a catalog using the Data Processing Library - Use Spark Connector to migrate CSV data to Protobuf - Develop a Spark application - Read and write to Object store layer using Hadoop FS support in Spark - Local development and testing with CLI and Data Client Library - Read from a catalog in a batch application - Use HERE Platform Service - Use Spark Connector to read and write data
Changed the following examples to use the new Batch environment with Spark 3.4.1:
- A Compiler to lift road topology and geometry and aggregate it to higher level - A Compiler to Compute Catalog Differences - A Compiler to Extract Pedestrian Topologies into GeoJSON - A Compiler to Extract Pedestrian Topologies into Protobuf - A Stateful Processing Compiler to Process Input and Feedback Data - Using DeltaSets to Extract Pedestrian Topologies into GeoJSON - An Incremental Validation Pipeline to Verify Road Topology content with Scalatest DSL - Compacting Index Layer Data in Parquet Format - Compacting Index Layer Data in Protobuf Format - Infer Stop Signs From Sensors
2.58.2
Batch dependencies
REMOVED
Removed the org.apache.commons:commons-lang3 library from the sdk-dep-common file because of different versions of that library specified in the batch and stream environments.
Now this dependency is specified separately for the batch, stream and standalone dep files: 1. sdk-dep-batch_2.12: org.apache.commons:commons-lang3:3.12.0 2. sdk-dep-standalone_2.12: org.apache.commons:commons-lang3:3.12.0 3. sdk-dep-stream_2.12: org.apache.commons:commons-lang3:3.3.2
2.58.2
Batch dependencies
CHANGED
Upgraded the following io.circe libraries from the 0.10.0 to 0.14.1 version: - io.circe:circe-core_2.12 - io.circe:circe-generic_2.12 - io.circe:circe-parser_2.12
2.58.2
Batch dependencies
CHANGED
Upgraded the com.here.platform:environment-batch-3.0.0 to the com.here.platform:environment-batch-4.0.0 to support Spark 3.4.1.
The following libraries were upgraded to align with the batch-4.0 environment:
Upgraded the com.google.code.gson:gson library from the 2.8.6 version to the 2.8.9 version to fix vulnerabilities.
2.58.2
Standalone dependencies
REMOVED
Removed the org.apache.commons:commons-lang3 library from the sdk-dep-common file because of different versions of that library specified in the batch and stream environments.
Now this dependency is specified separately for the batch, stream and standalone dep files: 1. sdk-dep-batch_2.12: org.apache.commons:commons-lang3:3.12.0 2. sdk-dep-standalone_2.12: org.apache.commons:commons-lang3:3.12.0 3. sdk-dep-stream_2.12: org.apache.commons:commons-lang3:3.3.2
2.58.2
Standalone dependencies
CHANGED
Upgraded the following akka libraries from the 10.1.12 version to the 10.2.7 version to fix vulnerability: - com.typesafe.akka:akka-http-core_2.12 - com.typesafe.akka:akka-http_2.12
2.58.2
Standalone dependencies
CHANGED
Upgraded the following io.circe libraries from the 0.10.0 to 0.14.1 version: - io.circe:circe-core_2.12 - io.circe:circe-generic_2.12 - io.circe:circe-parser_2.12
2.58.2
Standalone dependencies
CHANGED
Upgraded the org.apache.commons:commons-lang3 library from the 3.3.2 version to the 3.12.0 version to fix vulnerabilities.
2.58.2
Standalone dependencies
CHANGED
Upgraded the com.google.code.gson:gson library from the 2.8.6 version to the 2.8.9 version to fix vulnerabilities.
2.58.2
Standalone dependencies
CHANGED
Upgraded the org.apache.hadoop:hadoop-client library from the 2.7.3 version to the 3.3.4 version.
2.58.2
Standalone dependencies
CHANGED
Upgraded the following jackson libraries from the 2.12.1 version to the 2.12.7 version to align with the org.apache.hadoop:hadoop-client library: - com.fasterxml.jackson.core:jackson-annotations - com.fasterxml.jackson.core:jackson-core - com.fasterxml.jackson.core:jackson-databind - com.fasterxml.jackson.core:jackson-dataformat-yaml - com.fasterxml.jackson.core:jackson-datatype-jsr30
2.58.2
Stream dependencies
REMOVED
Removed the org.apache.commons:commons-lang3 library from the sdk-dep-common file because of different versions of that library specified in the batch and stream environments.
Now this dependency is specified separately for the batch, stream and standalone dep files: 1. sdk-dep-batch_2.12: org.apache.commons:commons-lang3:3.12.0 2. sdk-dep-standalone_2.12: org.apache.commons:commons-lang3:3.12.0 3. sdk-dep-stream_2.12: org.apache.commons:commons-lang3:3.3.2
2.58.2
Stream dependencies
CHANGED
Upgraded the following io.circe libraries from the 0.10.0 to 0.14.1 version: - io.circe:circe-core_2.12 - io.circe:circe-generic_2.12 - io.circe:circe-parser_2.12
2.58.2
Stream dependencies
CHANGED
Upgraded the com.google.code.gson:gson library from the 2.8.6 version to the 2.8.9 version to fix vulnerabilities.
2.57.3
Archetypes
REMOVED
Removed *_proto-*-empty.jar and *_json-*-empty.jar files from the Schema Archetype.
2.57.3
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
AllowListFilter now supports specifying a catalog ID with an empty list of layers to signify that any layer in that catalog will match the filter. A full list of desired layers previously needed to be provided, which would be bothersome to maintain as the set of required input layers evolved.
This can be used to accept any layer from a catalog, with or without an additional partition name filter.
2.57.3
Data Processing Library
ADDED
Added a new API in the Retriever component to allow users to download a payload as an InputStream.
Please note that for TmcAdjacencyProviders only the deprecated API is available.
2.57.3
Location Library
REMOVED
Remove deprecated methods from OptimizedMapCatalog, use the DSL methods instead.
2.57.3
Location Library
DEPRECATED
Deprecated OptimizedMapLayers.RoutingGraphConfiguration in favor of OptimizedMapLayers.RoutingGraphLayerConfiguration.
Deprecated OptimizedMapLayers.RestrictedManoeuvreConfiguration in favor of OptimizedMapLayers.RestrictedManoeuvreLayerConfiguration.
2.57.3
Location Library
ADDED
Added support for LocalRoad.ParkingAisle attribute in NavigationAttributes.
2.56.2
Data Processing Library
ADDED
Added compressedSize field to Partition.Meta. For backward compatibility the field isn't retrieved by default, but the set of additional fields an application wants to populate can be configured on a per-catalog basis in application.conf. For example:
here.platform.data-processing.driver.catalogs { default { // Additional metadata fields queried and included in the input Meta objects. // Valid values are: checksum, size, compressedSize additionalFields = [checksum, size] }
// Configuration overrides for specific catalogs IDs. // For the output catalog, regardless of the configuration, the checksum field is always // included in additionalFields because it is needed by the library itself to implement its // incremental publishing. overrides { // Partial overrides indexed by catalog ID. // "input-catalog-1" { // no optional metadata fields additionalFields = [] }
"output" { // metadata fields for the output layers used as input. The metadata will in practice // always include the checksum field, which is mandatory for the output metadata and used // to implement incremental publishing. additionalFields = [compressedSize] } } }
This change introduced a small backward incompatibility for Scala users using Partition.Meta.unapply, due to the additional optional compressedSize field.
2.56.2
Location Library
ADDED
Added support for LocalRoad.ParkingAisle attribute in NavigationAttributes.
2.55.5
Location Library
DEPRECATED
Deprecate the data-loader module.
For more information about the new APIs, see the Developer Guide:
Please notice that the following configuration properties for the flink connector have been removed now.
If you still use it please replace it as described below.
- Usage of olp.index.query-parallelism should be replaced by olp.connector.query-parallelism
- Usage of olp.version.query-parallelism should be replaced by olp.connector.query-parallelism
2.51.5
Data Client Library
REMOVED
Please notice that the following methods have been removed now.
Please notice this is valid for Java only.
If you still use it please replace it as described below.
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.blobCrc(layer: String, blob: scaladsl.NewPartition.BufferedBlob): CompletionStage[Optional[String]] needs to be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.blobCrc(layer: String, blob: BufferedBlob): CompletionStage[Optional[String]]
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.blobChecksum(layer: String, blob: scaladsl.NewPartition.BufferedBlob): CompletionStage[Optional[String]] needs to be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.blobChecksum(layer: String, blob: BufferedBlob): CompletionStage[Optional[String]]
2.51.5
Data Client Library
ADDED
Added support of BOOL countMode to the existing Interactive Map Layer endpoints methods:
Fixed The response payload was too large errors when downloading data exceeding 50MB. Now, they're getting split into multiple requests. Fix implemented in methods:
Fixed URL too long errors when too many IDs were provided in a single request. Now, they're getting split into multiple requests. Fix implemented in methods:
Added versioning support for interactive map layers with the attribute versionsToKeep. the attribute is of type integer between 1 and 1,000,000,000. When the attribute is set to 1 this means that versioning is disabled for the underlying layer.
2.50.4
Data Client Library
CHANGED
Changed the context parameter for Java bindings for interactive map layers from InteractiveMapContext to Optional[InteractiveMapContext] inside:
The attribute is available starting with the following versions of Optimized Map for Location Library:
- hrn:here:data::olp-here:here-optimized-map-for-location-library-2 version 5060 - hrn:here:data::olp-here:here-optimized-map-for-location-library-japan-2 version 85 - hrn:here-cn:data::olp-cn-here:here-optimized-map-for-location-library-china-2 version 10 - hrn:here-cn:data::olp-cn-here:here-optimized-map-for-location-library-china-2-staging version 34
2.49.2
Archetypes
FIXED
Fixed the org.apache.http.impl.client.DefaultRedirectStrategy.<init>([Ljava/lang/String;)V error when use the HERE platform Maven Wagon plugin with Intellij IDEA.
2.49.2
Location Library
REMOVED
Removed deprecated TMC methods which were not forcing addition of internal primary location to TMC reference in case the precise TMC information is needed (only companion object methods in Scala and static methods in Java):
Fixed an issue in TMC reference creation which resulted in a precise TMC information exceeding TMC reference for more than 100 m. Affected all TMC creators, namely:
Fixed an issue with resolving TMC references with precise TMC info, when the problem length is greater than the full reference length. The output location is trimmed to prevent exceeding the TMC reference in this case.
Also, when a precise TMC info with a nonpositive problem length is used, an exception is thrown, since this input is invalid.
Changed the Get real-time traffic conditions for a location tutorial to use the new HERE Traffic Flow catalog.
2.48.3
Archetypes
FIXED
Fixed the compatibility issue between Maven 3.9.0 and Maven Wagon throwing the "AbstractMethodError: Receiver class com.here.platform.artifact.maven.wagon.layout.HereRepositoryLayout does not define or inherit an implementation of the resolved method 'abstract java.util.List getChecksumAlgorithmFactories()' of interface org.eclipse.aether.spi.connector.layout.RepositoryLayout" error.
2.48.3
Data Client Library
ADDED
There were added new optional parameters to catalog configuration for location-aware access control.
| Property | Description | | ------------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | areaScheme | The HERE Resource Name (HRN) of the area scheme used across the catalog. If the value is not set than no area scheme is applied to the catalog. | | subsetRestrictions | Indicates if the subsetRestrictions for a catalog is enabled or not. subsetRestrictions can only be enabled for catalogs that are defined within projects. It requires area scheme being set. If catalog subsetRestrictions are disabled, supported layer's subsetRestrictions will be disabled by default. |
Please note that the only area scheme currently available is hrn:here:areascheme::olp-here:default-countries.
Furthermore, you can control the subset restictions per versioned and volatile layer if enabled on catalog level. For that you should pass these new optional parameters when defining the layerType of a layer as
| Property | Description | | ------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | secureHandles | A boolean flag which indicates if the layer metadata and blob are in mode of secure data handles support. It requires catalog area scheme to be set and supports only heretile partitioning of the layer. | | subsetRestrictions | A boolean flag which indicates if the subsetRestrictions for a layer is enabled or not. subsetRestrictions can only be enabled for layers of catalogs that are defined within projects. It requires area scheme of the catalog being set. Supported layer subsetRestrictions are enabled by default when subsetRestrictions is enabled for the catalog. Layer subsetRestrictions requires catalog subsetRestrictions to be enabled. If catalog subsetRestrictions are disabled, supported layer's subsetRestrictions will be disabled by default. Supported only for layers with heretile partitioning. |
There are also added 4 new functions of AdminApi to get information about area subsets as there are
- getSubsets: Get the list of all accessible subsets which match the optional areaId filter - getSubsetsAsSource: Get the list of all accessible subsets which match the optional areaId filter as an Akka Source - getSubset: Get the details of a subset - getSubsetsFingerprint: Get a fingerprint that represents the accessible subset configuration
2.48.3
Data Client Library
CHANGED
Please note that all specific layer types are objects now. This was necessary for VersionedLayerType and VolatileLayerType due to the introduction of new parameters for location-aware access control.
However, we decided to align the other specific layer types as well.
Therefore please notice this backward-incompatible change. Unfortunately, you need to change your code as follows:
Added possibility for versioned layers only to specify output catalog dependencies in spark-support with the method LayerDataFrameWriter.withDependencies. Bellow a sample code how to do:
val df: DataFrame = .. val dependencies: Seq[VersionDependency] = .. df.writeLayer(catalogHRN, versionedLayerId) .withDependencies(dependencies) .save()
If not provided the dependencies will be empty by default.
2.48.3
Examples
DELETED
Deleted the following Data Archiving Library examples:
- Archiving SDII stream data in Protobuf - Archiving SENSORIS stream data in Parquet
2.48.3
Examples
CHANGED
Updated the following Data Archiving Library examples to run them locally using Maven:
- Archiving SDII Stream Data in Avro format - Archiving SDII stream data in Parquet - Archiving Sensoris Stream Data in Protobuf format
Added SamplingLogger, a ContextAwareLogger with sampling capabilities that reduce clutter and costs incurred when the same log message is produced a large number of times, while retaining the information a few samples provide.
2.47.2
Location Library
CHANGED
Changed high-level-v2 API OptimizedMapLayers provided by the new OptimizedMapCatalog that replaces the high-level API based on Data Loaders (CatalogFactory) by introducing last tile optimization.
This optimization is expected to bring a 30% performance improvement with respect to the previous Data Loaders in multi-threaded applications and a 50% improvement in the previous versions of OptimizedMapLayers.
2.47.2
Location Library
CHANGED
Changed the following map matcher parameters to improve the behavior on very sparse data:
- The limit on iterations in the TransitionProbabilityStrategies.distanceWithTransitions while connecting distant points was removed and replaced with a road distance limit of approximately 30km. - The probability assigned to any transition to or from an Unknown has been lowered to avoid disconnections for sparse points.
2.47.2
Location Library
CHANGED
Deprecate SimpleConnectivityTransitionProbabilityStrategy in favor of DistanceTransitionProbabilityStrategy and TransitionProbabilityStrategies.connectivity in favor of TransitionProbabilityStrategies.directDistance.
2.47.2
Location Library
CHANGED
Changed the OptimizedMapLayers provided by the new OptimizedMapCatalog v2 high level API with lazy requests to the config service that are delayed after initialization until the first use.
Fixed an issue when dependencies are not included in layer.fds in case the messages are not used in the main message.
2.46.5
Data Client Library
ADDED
Added and optional parameter to listObjects and listObjectsAsCollection functions of ReadEngine and FlinkReadEngine to define the internal page size.
Background:
As a user you always get the full list either as a Source or a List. However, the default page size is 1000 and if you have an ObjectStore folder which has 1 million objects then it would fire a 1000 requests. This is slow. So, if you already know or you suspect that there is a large number of objects you can optimize the runtime very much by defining a higher value for the pageSize parameter.
2.46.5
Data Client Library
ADDED
A new feature was added which allows you to subscribe to changes of an interactive map layer. For further reading please see the Data Client Library Developer Guide.
2.46.5
Location Library
FIXED
Fixed an issue with too long OpenLR references for point along a line.
OpenLR standard requires the distances between reference points to be smaller than 15km. In some cases of point along a line reference longer distances were produced. This change is fixing that and implementing an algorithm of choosing invalid (i.e. non-junction) nodes as first and last reference points in case valid points are too far from the access point or from each other.
The algorithm chooses always the most distant invalid nodes possible (stretches the reference up to 15km if there are no valid nodes closer) and prefers choosing one valid and one invalid node over two invalid ones whenever possible. It also keeps the access point in the middle of the reference in extreme case of need to chose two invalid nodes (as first and last).
2.46.5
Tutorials
ADDED
Added the Implement GeoJSON Renderer tutorial that demonstrates how to implement the GeoJSON rendering plugin using the Data Inspector.
2.46.5
Tutorials
ADDED
Added the Publish Protobuf schema to the platform tutorial that demonstrates how to generate, build, extend and publish Protobuf schema to the platform.
2.46.5
Tutorials
CHANGED
Updated the Develop a Flink application and Develop a Spark application tutorials with the information about Maven archetypes.
2.46.5
Tutorials
CHANGED
Updated the Subscribe to catalog and layer-level changes tutorial to use olp catalog layer notification commands.
2.45.7
Data Client Library
REMOVED
The following functions have been removed after end of deprecation notice period:
Added a new DSL for constructing OptimizedMapCatalog. In order to avoid direct usage of other libraries apart from location library as far as possible, a new DSL was added to construct OptimizedMapCatalog. It makes sure that in the compile time the user won't pass both external caches and cache configuration. The DSL is almost identical in Java and Scala, since it uses a universal DSL pattern (multiple builder classes).
2.45.7
Location Library
DEPRECATED
Deprecated the OptimizedMapCatalog API based on apply methods in Scala and single builder in Java. Instead, use new DSL consistent for Scala and Java.
2.45.7
Tutorials
CHANGED
Path matching in Spark tutorial has been updated to use new Location Library OptimizedMapCatalog DSL instead of the deprecated API.
2.45.7
Tutorials
FIXED
Fixed the Extract Apache Hadoop section in the Bring your data into HERE platform using an object store layer tutorial returning the Cannot create symlink error for Windows users.
2.45.7
Examples
CHANGED
Location Library examples have been updated to use new OptimizedMapCatalog DSL instead of the deprecated API.
2.44.4
Archetypes
FIXED
Fixed the problem of the wrong 3.6.0 version of protoc being used when running the layer-manifest-plugin. The correct 3.11.4 version is now used in all HERE plugins.
2.44.4
Data Client Library
CHANGED
Changed API's return type to return list of updated features while calling api to update feature modifications from flink pipelines, cli and hadoop fs.
2.44.4
Tutorials
ADDED
Added a Publish JSON schema to the platform that demonstrates how to generate, build, and publish JSON schema to the platform.
2.44.4
Examples
CHANGED
The examples that were using the Location Library Data Loaders, with the exception of the OnTheFlyCompiledPropertyMapExample have been updated to use the new OptimizedMapCatalog available in the location-integration-optimized-map-dcl2 module as documented in the Location Library developer guide in the section "High Level API v2"
2.43.5
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs:
Adds a forceStateless option for DeltaSet transformations, that can force any transformation to be stateless. This will avoid the overhead incurred by the state, but the transformation will not be able to track dependencies between partitions during an incremental run. In practice, this means that in an incremental run, the DeltaSet has to process all upstream partitions, whether they changed or not, unless it can determine that the upstream DeltaSet did not change at all.
2.43.5
Location Library
ADDED
Introduced new experimental Apis based on OptimizedMapLayers for LocationReferenceCreators and LocationReferenceResolvers which allow multi-version caching.
2.43.5
Tutorials
CHANGED
Changed the Develop Flink application tutorial to use the PipelineContext for getting information about input catalogs.
2.43.5
Stream dependencies
ADDED
Added com.google.errorprone:error_prone_annotations:2.3.4 library to sdk-dep-common file to fix dependency conflicts in the com.google.protobuf:protobuf-java-util:3.11.4 library.
2.43.5
Stream dependencies
CHANGED
Upgraded the com.google.code.findbugs:jsr305 version from 1.3.9 to 3.0.2 to align versions com.google.protobuf:protobuf-java-util:3.11.4 library.
2.43.5
Stream dependencies
CHANGED
Upgraded the com.google.protobuf:protobuf-java and com.google.protobuf:protobuf-java-util versions from 3.6.0 to 3.11.4.
2.43.5
Stream dependencies
CHANGED
Upgraded the com.thesamet.scalapb:compilerplugin_$\{scala.compat.version\}, com.thesamet.scalapb:lenses_$\{scala.compat.version\} and com.thesamet.scalapb:scalapb-runtime_$\{scala.compat.version\} versions from 0.8.0 to 0.10.10.
Note that all messages are now preserving unknown fields by default. This results in an additional parameter to the case class. This may break your code if you are using pattern matching and expecting a specific number of parameters. Use the of(your, case, class, parameters) static method if you do not want to specify the unknownFields parameter when creating an instance of the case class.
See the scalapb changelog to get more information about changes in the scalapb library.
2.43.5
Standalone dependencies
ADDED
Added com.google.errorprone:error_prone_annotations:2.3.4 library to sdk-dep-common file to fix dependency conflicts in the com.google.protobuf:protobuf-java-util:3.11.4 library.
2.43.5
Standalone dependencies
CHANGED
Upgraded the com.google.code.findbugs:jsr305 version from 1.3.9 to 3.0.2 to align versions com.google.protobuf:protobuf-java-util:3.11.4 library.
2.43.5
Standalone dependencies
CHANGED
Upgraded the com.google.protobuf:protobuf-java and com.google.protobuf:protobuf-java-util versions from 3.6.0 to 3.11.4.
2.43.5
Standalone dependencies
CHANGED
Upgraded the com.thesamet.scalapb:compilerplugin_$\{scala.compat.version\}, com.thesamet.scalapb:lenses_$\{scala.compat.version\} and com.thesamet.scalapb:scalapb-runtime_$\{scala.compat.version\} versions from 0.8.0 to 0.10.10.
Note that all messages are now preserving unknown fields by default. This results in an additional parameter to the case class. This may break your code if you are using pattern matching and expecting a specific number of parameters. Use the of(your, case, class, parameters) static method if you do not want to specify the unknownFields parameter when creating an instance of the case class.
See the scalapb changelog to get more information about changes in the scalapb library.
2.43.5
Batch dependencies
ADDED
Added com.google.errorprone:error_prone_annotations:2.3.4 library to sdk-dep-common file to fix dependency conflicts in the com.google.protobuf:protobuf-java-util:3.11.4 library.
2.43.5
Batch dependencies
CHANGED
Upgraded the com.google.code.findbugs:jsr305 version from 1.3.9 to 3.0.2 to align versions com.google.protobuf:protobuf-java-util:3.11.4 library.
2.43.5
Batch dependencies
CHANGED
Upgraded the com.google.protobuf:protobuf-java and com.google.protobuf:protobuf-java-util versions from 3.6.0 to 3.11.4.
2.43.5
Batch dependencies
CHANGED
Upgraded the com.thesamet.scalapb:compilerplugin_$\{scala.compat.version\}, com.thesamet.scalapb:lenses_$\{scala.compat.version\} and com.thesamet.scalapb:scalapb-runtime_$\{scala.compat.version\} versions from 0.8.0 to 0.10.10.
Note that all messages are now preserving unknown fields by default. This results in an additional parameter to the case class. This may break your code if you are using pattern matching and expecting a specific number of parameters. Use the of(your, case, class, parameters) static method if you do not want to specify the unknownFields parameter when creating an instance of the case class.
See the scalapb changelog to get more information about changes in the scalapb library.
2.42.4
Data Client Library
ADDED
Added support for postFeatureModifications API to update features in an interactive map layer. This api accepts featureModificationList which contains a list of FeatureModification objects. As each FeatureModification contains & action details if features exist/doesn't exist, this API allows users to define different actions on different features in single api call.
2.42.4
Data Client Library
CHANGED
Spark schema derivation process was updated to throw exception and interrupt job in case of any failures during schema infer
2.42.4
Data Processing Library
FIXED
Fixed bug that caused IllegalArgumentExceptions when Default.PreviousRunId inputs were used for multiple runs without a monotonically non-decreasing sequence of input versions.
2.42.4
Location Library
FIXED
Fixes an issue in the recently introduced methods:
In particular, it fixes the calculation of the hazardDistance1 of the PreciseTMCInformation of TMCLocationReference when an incident doesn't include TMC primary location, that is, when useInternalPrimaryLocation is false.
2.41.4
Location Library
ADDED
The following function overloads have been added with an extra geometry parameter:
The execution time of the path matcher created by PathMatchers.carPathMatcherWithTransitions and PathMatchers.unrestrictedPathMatcherWithTransitions was reduced by up to 50% for sparse probes using a patent pending algorithm.
Use the corresponding overloads with the geometry parameter instead.
2.41.4
Tutorials
REMOVED
Removed the Getting live weather conditions for a location tutorial from HERE Data Java/Scala SDK.
2.41.4
Stream dependencies
CHANGED
Now the platform profile in sdk-stream-bom_2.12 automatically excludes any application.properties file there might be in the resources folder from the fat JAR, to avoid shadowing the application.properties file made available by the Pipeline service. To revert this behavior please use a custom profile.
2.40.0.7
Location Library
ADDED
Introduced new experimental constructors based on OptimizedMapLayers for RoadAttributes, NavigationAttributes, AdvancedNavigationAttributes and AdasAttributes, which allow multi-version caching.
2.40.0.7
Location Library
ADDED
New implementations have been added for Extended TMC Reference creation and resolution, namely:
The new methods correctly implement the TISA standard by measuring the hazardDistance field of the PreciseTMCInformation always from a the so called "Spatial reference point", located at the beginning of the Internal Primary location.
Fixed issues with failing downloads and uploads of schemas. The operations failing with 408, 429, 500, 502, 503 or 504 errors now are automatically retried up to 5 times.
2.39.0.5
Archetypes
REMOVED
Removed Scala 2.11 support from the sdii_archive_v1 schema as of version 2.2.26.
2.39.0.5
Archetypes
REMOVED
Removed Scala 2.11 support from the sdii_v3 schema as of version 4.2.19.
2.39.0.5
Archetypes
REMOVED
Removed Scala 2.11 support from the sensoris-specification_v1_2_2 schema as of version 1.1.4.
2.39.0.5
Data Client Library
DEPRECATED
Be advised that the following configuration properties for the flink connector are deprecated now. These deprecated properties will be removed after 6 months from the release date, therefore replacing the usage of deprecated properties with alternative property is necessary for its users.
- Usage of olp.index.query-parallelism should be replaced by olp.connector.query-parallelism
- Usage of olp.version.query-parallelism should be replaced by olp.connector.query-parallelism
2.39.0.5
Data Processing Library
ADDED
Added a new configuration option here.platform.data-processing.driver.allowEmptyPayloads, which, if set to true, allows the compiler to publish payloads that have 0 bytes. Previously, all DPL compilers rejected publishing empty blobs, which remains the default behavior.
2.39.0.5
Location Library
FIXED
Fix GeoCoordinates.pointForFraction, wrongly returning false when two identical points whose type does not implement proper equality are passed.
2.39.0.5
Tutorials
ADDED
Added a tutorial that demonstrates how to develop and debug Spark applications.
2.39.0.5
Tutorials
ADDED
Added a tutorial that demonstrates how to run Spark applications on the platform. The tutorial shows how to monitor the application using Grafana, Splunk, Spark UI, and Platform Billing Page.
2.38.0.9
Data Client Library
ADDED
Added support for reading & writing Json, Csv and Text data from versioned layer using the Spark Connector.
2.38.0.9
Data Client Library
DEPRECATED
Be advised that the following methods are marked deprecated now. These deprecated methods will be removed after 6 months from the release date, therefore replacing the usage of deprecated methods with alternative methods is necessary for its users.
For Java
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.blobCrc(layer: String, blob: scaladsl.NewPartition.BufferedBlob): CompletionStage[Optional[String]] should be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.blobCrc(layer: String, blob: BufferedBlob): CompletionStage[Optional[String]]
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.blobChecksum(layer: String, blob: scaladsl.NewPartition.BufferedBlob): CompletionStage[Optional[String]] should be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.blobChecksum(layer: String, blob: BufferedBlob): CompletionStage[Optional[String]]
Fixed parsing of AllowListFilters, so that the partitions parameter can be left out like catalogsAndLayers instead of forcing the user to specify an empty array. This introduces a small backward incompatibility if an AllowListFilterParam object is explicitly built, because both catalogsAndLayers and partitions are now optional:
Before:
val catalogsAndLayers = Map("hmc" -> Seq("topology-geometry")) val partitions = Set("23618358", "23618359") val param = AllowListFilterParam(Some(catalogsAndLayers), partitions)
After:
val catalogsAndLayers = Map("hmc" -> Seq("topology-geometry")) val partitions = Set("23618358", "23618359") val param = AllowListFilterParam(Some(catalogsAndLayers), Some(partitions))
2.38.0.9
Location Library
ADDED
Introduced new experimental module location-integration-optimized-map-dcl2 which allows multi-version caching. It brings a new experimental class OptimizedMapCatalog which can be used to construct some of the high level factories:
Added a tutorial that demonstrates how to run Flink applications on the platform. The tutorial shows how to monitor the application using Grafana, Splunk, Flink UI, and Platform Billing Page.
2.38.0.9
Tutorials
ADDED
Added a tutorial that demonstrates how to develop and debug Flink applications.
2.37.0.5
Data Client Library
ADDED
Added support for reading & writing Json, Csv and Text data from volatile layer using the Spark Connector.
2.37.0.5
Data Client Library
ADDED
Added the configuration property query-by-parts to control the behaviour of QueryApi.queryIndex and QueryApi.queryIndexAsIterator methods (See chapter on Configuration).
2.37.0.5
Data Client Library
REMOVED
Removed the following deprecated methods from the FlinkQueryApi:
Added the function queryIndexParts to FlinkQueryApi.
2.37.0.5
Location Library
FIXED
Fixed non-deterministic behaviour of LocationReferenceCreators.tmc resolver: in case of several matching tmc codes for linear location exist, the shortest one is given priority.
2.36.0.3
Data Client Library
REMOVED
Removed the deprecated parameter olp.connector.flink.v2.
2.36.0.3
Data Client Library
DEPRECATED
Be advised that the following methods are marked deprecated now. These deprecated methods will be removed after 6 months from the release date, therefore replacing the usage of deprecated methods with alternative methods is necessary for its users.
For Scala
- Usage of com.here.platform.data.client.engine.scaladsl.ReadEngine.getObjectDataAsBytes(layerId: String, key: String, range: ByteRange = AllBytes): Future[Array[Byte]] should be replaced by com.here.platform.data.client.engine.scaladsl.ReadEngine.getObjectDataAsBytes2(layerId: String, key: String, applyDecompression: Boolean, range: ByteRange = AllBytes): Future[Array[Byte]]
- Usage of com.here.platform.data.client.engine.scaladsl.ReadEngine.getObjectDataAsSource(layerId: String, key: String, range: ByteRange = AllBytes): Future[Source[ByteString, NotUsed]] should be replaced by com.here.platform.data.client.engine.scaladsl.ReadEngine.getObjectDataAsSource2(layerId: String, key: String, applyDecompression: Boolean, range: ByteRange = AllBytes): Future[Source[ByteString, NotUsed]]
- Usage of com.here.platform.data.client.engine.scaladsl.WriteEngine.uploadObject(layerId: String, key: String, blob: Blob, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Future[Done] should be replaced by com.here.platform.data.client.engine.scaladsl.WriteEngine.uploadObject2(layerId: String, key: String, blob: Blob, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Future[Done]
- Usage of com.here.platform.data.client.engine.scaladsl.WriteEngine.startUploadObject(layerId: String, key: String, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Future[ObjectMultipartToken] should be replaced by com.here.platform.data.client.engine.scaladsl.WriteEngine.startUploadObject2(layerId: String, key: String, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Future[ObjectMultipartToken]
- Usage of com.here.platform.data.client.engine.scaladsl.WriteEngine.simpleUploadObject(layerId: String, key: String, data: ByteString, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Future[Done] should be replaced by com.here.platform.data.client.engine.scaladsl.WriteEngine.simpleUploadObject2(layerId: String, key: String, data: ByteString, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Future[Done]
- Usage of com.here.platform.data.client.flink.scaladsl.FlinkWriteEngine.uploadObject(layerId: String, key: String, blob: Blob, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Unit should be replaced by com.here.platform.data.client.flink.scaladsl.FlinkWriteEngine.uploadObject2(layerId: String, key: String, blob: Blob, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Unit
- Usage of com.here.platform.data.client.flink.scaladsl.FlinkReadEngine.getObjectDataAsBytes(layerId: String, key: String, range: ByteRange = AllBytes): Array[Byte] should be replaced by com.here.platform.data.client.flink.scaladsl.FlinkReadEngine.getObjectDataAsBytes2(layerId: String, key: String, applyDecompression: Boolean, range: ByteRange = AllBytes): Array[Byte]
For Java
- Usage of com.here.platform.data.client.engine.javadsl.ReadEngine.getObjectDataAsSource(layerId: String, key: String, range: ByteRange = AllBytes): Future[Array[Byte]] should be replaced by com.here.platform.data.client.engine.javadsl.ReadEngine.getObjectDataAsBytes2(layerId: String, key: String, applyDecompression: Boolean, range: ByteRange = AllBytes): Future[Array[Byte]]
- Usage of com.here.platform.data.client.engine.javadsl.ReadEngine.getObjectDataAsSource(layerId: String, key: String, range: ByteRange = AllBytes): Future[Source[ByteString, NotUsed]] should be replaced by com.here.platform.data.client.engine.javadsl.ReadEngine.getObjectDataAsSource2(layerId: String, key: String, applyDecompression: Boolean, range: ByteRange = AllBytes): Future[Source[ByteString, NotUsed]]
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.uploadObject(layerId: String, key: String, blob: Blob, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Future[Done] should be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.uploadObject2(layerId: String, key: String, blob: Blob, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Future[Done]
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.startUploadObject(layerId: String, key: String, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Future[ObjectMultipartToken] should be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.startUploadObject2(layerId: String, key: String, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Future[ObjectMultipartToken]
- Usage of com.here.platform.data.client.engine.javadsl.WriteEngine.simpleUploadObject(layerId: String, key: String, data: ByteString, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Future[Done] should be replaced by com.here.platform.data.client.engine.javadsl.WriteEngine.simpleUploadObject2(layerId: String, key: String, data: ByteString, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Future[Done]
- Usage of com.here.platform.data.client.flink.javadsl.FlinkWriteEngine.uploadObject(layerId: String, key: String, blob: Blob, contentType: Option[ContentType] = None, contentEncoding: Option[HttpEncoding] = None): Unit should be replaced by com.here.platform.data.client.flink.javadsl.FlinkWriteEngine.uploadObject2(layerId: String, key: String, blob: Blob, contentType: Option[String] = None, contentEncoding: Option[ContentEncoding] = None): Unit
- Usage of com.here.platform.data.client.flink.javadsl.FlinkReadEngine.getObjectDataAsBytes(layerId: String, key: String, range: ByteRange = AllBytes): Array[Byte] should be replaced by com.here.platform.data.client.flink.javadsl.FlinkReadEngine.getObjectDataAsBytes2(layerId: String, key: String, applyDecompression: Boolean, range: ByteRange = AllBytes): Array[Byte]
2.36.0.3
Data Client Library
REMOVED
Removed the following deprecated methods from the QueryApi:
Added GeoCoordinateOperations to Point feature and LineStringOperations to LineString feature.
2.36.0.3
Stream dependencies
FIXED
Fixed misalignment between Batch Environment 3.0.0 and corresponding SDK Dependency file, both use 3.1.5 version of the io.dropwizard.metrics:metrics-core library.
2.36.0.3
Stream dependencies
FIXED
Fixed misalignment between com.fasterxml.jackson.core:jackson-databind library in the sdk-dep-standalone file and environment-stream-5.0.0 file both use 2.12.1 version of the com.fasterxml.jackson.core:jackson-databind library. Fixed critical vulnerability.
2.36.0.3
Stream dependencies
REMOVED
Removed the org.json4s:json4s-jackson:3.5.3 library from the sdk-dep-common bom file to fix dependencies conflicts with com.fasterxml.jackson.core:jackson-databind library.
2.36.0.3
Standalone dependencies
FIXED
Fixed misalignment between Batch Environment 3.0.0 and corresponding SDK Dependency file, both use 3.1.5 version of the io.dropwizard.metrics:metrics-core library.
2.36.0.3
Standalone dependencies
FIXED
Fixed misalignment between com.fasterxml.jackson.core:jackson-databind library in the sdk-dep-standalone file and sdk-dep-stream file both use 2.12.1 version of the com.fasterxml.jackson.core:jackson-databind library. Fixed critical vulnerability.
2.36.0.3
Standalone dependencies
REMOVED
Removed the org.json4s:json4s-jackson:3.5.3 library from the sdk-dep-common bom file to fix dependencies conflicts with com.fasterxml.jackson.core:jackson-databind library.
2.36.0.3
Batch dependencies
FIXED
Fixed misalignment between Batch Environment 3.0.0 and corresponding SDK Dependency file, both use 3.1.5 version of the io.dropwizard.metrics:metrics-core library.
2.36.0.3
Batch dependencies
FIXED
Fixed misalignment between com.fasterxml.jackson.core:jackson-databind library in the sdk-dep-batch file and environment-batch-3.0.0 both use 2.6.7.3 version of the com.fasterxml.jackson.core:jackson-databind library.
2.36.0.3
Batch dependencies
REMOVED
Removed the org.json4s:json4s-jackson:3.5.3 library from the sdk-dep-common bom file to fix dependencies conflicts with com.fasterxml.jackson.core:jackson-databind library.
2.35.0.2
Archetypes
CHANGED
Schema Archetype now includes HERE Data SDK for Java and Scala Bill of Material file. The versions for the schemas included in the SDK can be resolved automatically
2.35.0.2
Archetypes
CHANGED
Changed the streaming archetype to use the new stream 5.0 environment. Archetype version 1.0.784 is the last released version with the stream 4.0 support.
2.35.0.2
Archetypes
REMOVED
Scala 2.11 bindings support has been removed from Schema Archetype. Archetype version 2.1.12 is the last released version with the support of Scala 2.11.
2.35.0.2
Data Archiving Library
REMOVED
The Data Archiving Library has removed the artifact com.here.platform.dal.data-archive_2.11 for Scala 2.11, and it is no longer supported.
2.35.0.2
Data Archiving Library
REMOVED
The Data Archiving Library removed the deprecated merge API and corresponding support. You should use the Index Compaction Library if you want to compact the index layer.
2.35.0.2
Data Client Base Library
REMOVED
Entity retry-policy and method parseConfigs in ApiConfigurationProfile removed. Use parseConfig method instead and request entity in config file.
2.35.0.2
Data Client Base Library
REMOVED
Method withQueryParam(@unused name: String, values: MapValues) removed due to deprecation period. Please use withQueryParam(params: Map[String, String]) method instead.
Removed the deprecated parameter olp.connector.volatile.reader.v2.
2.35.0.2
Index Compaction Library
REMOVED
The Index Compaction Library has removed the artifact com.here.platform.index.compaction.index-compaction-batch_2.11 for Scala 2.11, and it is no longer supported.
2.35.0.2
Tutorials
ADDED
Added a tutorial that demonstrates how to subscribe to the notifications for catalog and layer-level changes.
2.35.0.2
Tutorials
ADDED
Added tutorial that demonstrates how to retrieve real-time traffic data using the HERE Real Time Traffic catalog.
2.35.0.2
Tutorials
CHANGED
Upgraded "Run a Stream Application with Pipeline API" tutorial to use stream-5.0.
2.35.0.2
Examples
REMOVED
The Data Archiving Library Examples removed the deprecated merge API and corresponding support. You should use the Index Compaction Library if you want to compact the index layer.
2.35.0.2
Examples
CHANGED
Changed the Data Archive and Location examples to use the new stream-5.0 environment.
Changed the supported pipeline environment from stream-4.0 to stream-5.0 for Scala 2.12.
2.34.0.4
Data Client Base Library
ADDED
Added configurable flag 'auto-shutdown' in 'reference.conf' for HTTP client.
2.34.0.4
Data Client Base Library
UPDATED
Following api was updated: Config Api 1.1.7 to 1.1.10
2.34.0.4
Location Library
ADDED
Added boundingBoxOf method to the HereTileResolver, which returns a bounding box for the specified Tile ID.
2.34.0.4
Location Library
CHANGED
Improved the map matching quality, avoiding unnecessary detours in some rare cases.
2.34.0.4
Location Library
FIXED
Fixed ExponentialProbabilityDistribution for negative inputs. We now correctly return LogProbability(NegativeInfinity) for negative inputs.
2.34.0.4
Tutorials
ADDED
Added tutorial that demonstrates how to use HereTileResolver class from Location Library to calculate TileIDs for certain area queries.
2.34.0.4
Tutorials
ADDED
Added tutorial that demonstrates how to retrieve live weather data using the HERE Live Weather catalogs.
2.33.0.3
Data Processing Library
FIXED
When a batch pipeline is upgraded to the Scala 2.12 variant of the Data Processing Library, if incremental compilation is applicable and the output catalog is not empty and contains a state published by the same Data Processing Library version, but the Scala 2.11 variant, reading the state fails because the serialized classes are not binary compatible. This was fixed by including the Scala binary version in the fingerprints. Switching between 2.11 and 2.12 between compilations will now correctly fallback to full compilation.
2.32.0.9
Archetypes
ADDED
Added backwards compatibility check on nested messages of .proto files.
2.32.0.9
Data Client Base Library
REMOVED
Removed the following deprecated code BaseClient.Builder().
2.32.0.9
Data Client Library
ADDED
Integrating interactive map layers with Flink pipelines using Flink connector is now supported via the Data Client Library.
Flink connector implements the standard Flink interfaces that allow you to create source Tables for reading, and sink Tables for writing to interactive map layers. Hence, you can use both relational APIs that Flink supports: Table API and SQL API. In addition, you can convert a Table to a DataStream and use the Flink DataStream API.
Fixed an issue with versions incompatibility between scala-maven-plugin 4.1.1 and Maven 3.8.*. The version of scala-maven-plugin was upgraded to 4.5.4.
2.31.0
Data Client Base Library
REMOVED
Inheritance from API trait is no longer available. If you create your own API with inheritance from trait API - creation new instance using BaseClient.of[] is no longer available. Remove inheritance from API and use new instead.
2.31.0
Data Client Base Library
FIXED
Project scope is not mandatory but optional again.
2.31.0
Data Client Base Library
REMOVED
Removed ExecutionContext as implicit argument from execute... methods from ApiRequest. Now BaseClient will use ExecutionContext, provided during client instance creation. You still can provide separate execution context for BodyDeserializer.
For example, to explicit providing different execution contexts:
val generalExecutionContext = ??? val serializingExecutionContext = ??? val deserializingExecutionContext = ???
val client = BaseClient()(generalExecutionContext) val metadataApi = client.of[MetadataApi] val request = metadataApi.getChanges(catalogHrn, None, layerId)
val dependencySerializer: BodySerializer[Dependencies] = { implicit val exec: ExecutionContext = serializingExecutionContext jsonBodySerializer } val versionResponseDeserializer: BodyDeserializer[VersionsResponse] = { implicit val exec: ExecutionContext = deserializingExecutionContext jsonBodyDeserializer }
// NOW: // no need to provide general ExecutionContext, as it was already provided during client instance creation metadataApi .compatibleVersions(catalogHrn, Dependencies())(dependencySerializer) .executeToEntity()(versionResponseDeserializer)
If you use same ExecutionContext for general purposes and for serialization/deserialization - changes will not affect you, but anyway keep in mind that method signature will be changed:
implicit val executionContext: ExecutionContext = ???
val client = BaseClient() val metadataApi = client.of[MetadataApi] val request = metadataApi.getChanges(catalogHrn, None, layerId)
Removed the following deprecated parameter olp.connector.payload-decoding
2.31.0
Data Client Library
ADDED
This release of the Spark Connector fully supports all operations for interactiv map layers (IML): Read, write (created and update) as well as deletion of data. Spark Connectors provide a tool to help facilitate your data analysis, consumption and processing via Spark. OLP data connectors integrate OLP proprietary catalogs and layers with the industry standard formats of Flink (TableSource) and Spark (DataFrame). Whereas before you needed to implement this functionality yourself, now you can use these connectors to leverage the full functionality of searching, filtering, mapping, sorting and more offered by standard Apache Flink and Spark frameworks. Spend less time writing low level pipeline/data integration code and more time on your use case specific business logic.
Removed the following deprecated configuration entity credentials.legacy-evaluation-order.
2.31.0
Data Client Library
REMOVED
Removed the following deprecated configuration entity use-muti-part-upload-from.
2.31.0
Data Client Library
REMOVED
Removed the deprecated Java method CatalogConfiguration.createJava.
2.31.0
Data Client Library
DEPRECATED
The following methods are deprecated and should be replace by according builder() methods.
- com.here.platform.data.client.model.Layer#createJava should be replaced by com.here.platform.data.client.model.Layer#builder. - com.here.platform.data.client.model.Replication#createJava should be replaced by com.here.platform.data.client.model.Replication#builder.
2.30.0
Data Client Base Library
DEPRECATED
The com.here.platform.data.client.base.http.IOExecutionContext is deprecated and will be removed.
2.30.0
Data Client Base Library
ADDED
With this change we give the user the option to define his own execution contexts. There can be defined two such contexts, one is used for execution of tasks and futures of data client base library, whereas the other is passed to the underlying OkHttp stack. The contexts are passed to the BaseClient instance:
@param exec the Scala execution context which should be used for execution of internal Futures of Data Client Base library; default is Scala's ExecutionContext.global
@param ioExecutorService the Java executor service which is used by underlying OkHttp stack; default is an internal thread pool which is created by OkHttp's Dispatcher()
##### Note:
- The com.here.platform.data.client.base.http.IOExecutionContext is deprecated and will be removed.
- Please note that this change is backward-incompatible if you directly use BodySerializer. This is because in the BodySerializer there cannot have multiple functions with same signatur that differ only by implicit parameter type.
Usage example in Scala:
object WorkingWithBaseClientContexts {
implicit val myCustomExecutionContext = ExecutionContext.global implicit val myIOExecutorService: ExecutorService = ExecutionContext.fromExecutorService(ForkJoinPool.commonPool())
def main(args: Array[String]): Unit = {
val client = BaseClient() // this takes the implicit contexts val configApi = client.of[ConfigApi]
val result: CatalogsResultBase = configApi .getCatalogs(verbose = Some(false)) .toEntity()
The data client has introduced a new methods that supports additional metadata calls to work with interactive map layers.
The methods have been added to QueryApi.
Usage:
val layer = "test-im-layer" val bbox = BoundingBox(22.689013, 56.218811, 23.648524, 57.284241) val tileId = "023232121" val tileType = TileType.QUADKEY
/* returns hexbins for a bounding box. Please note that this function will return the hexbins for the smallest quadkey that contains the bounding box. This means you might get more hexbins than anticipated. */ val hexBins = queryApi.getHexBinsByBbox(layer, bbox, Set.empty, Some(1), None, None, None, None, None)
/* returns quadbins for a quadkey. This time the output is exactly what you requested. */ val quadBins = queryApi.getQuadBinsByTileId(layer, tileId, tileType, Set.empty, Some(1), None, None)
2.30.0
Data Client Library
DEPRECATED
Be advised that the following methods are marked deprecated now. These deprecated methods will be removed after 6 months from the release date, therefore replacing the usage of deprecated methods with alternative methods is necessary for its users.
For Scala
- Usage of com.here.platform.data.client.scaladsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, partId: Option[String]): Future[Iterator[IndexPartition]] should be replaced by com.here.platform.data.client.scaladsl.QueryApi.queryIndexAsIterator(layer: String, queryString: Option[String], partId: Option[String]): Future[Iterator[IndexPartition]]
- Usage of com.here.platform.data.client.scaladsl.QueryApi.queryIndex(layer: String, queryString: String, partId: Option[String]): Future[Source[IndexPartition, NotUsed]] should be replaced by com.here.platform.data.client.scaladsl.QueryApi.queryIndex(layer: String, queryString: Option[String], partId: Option[String]): Future[Source[IndexPartition, NotUsed]]
- Usage of com.here.platform.data.client.flink.scaladsl.FlinkQueryApi.queryIndexAsIterator(layer: String, queryString: String): Iterator[IndexPartition] should be replaced by com.here.platform.data.client.flink.scaladsl.FlinkQueryApi.queryIndexAsIterator(layer: String, queryString: Option[String]): Iterator[IndexPartition]
- Usage of com.here.platform.data.client.flink.scaladsl.FlinkQueryApi.queryIndex(layer: String, queryString: String): SourceFunction[IndexPartition] should be replaced by com.here.platform.data.client.flink.scaladsl.FlinkQueryApi.queryIndex(layer: String, queryString: Option[String]): SourceFunction[IndexPartition]
- Usage of com.here.platform.data.client.flink.scaladsl.FlinkQueryApi.queryIndexAsStream(layer: String, queryString: String, parts: Option[Int] = None)(implicit env: StreamExecutionEnvironment): DataStream[IndexPartition] should be replaced by com.here.platform.data.client.flink.scaladsl.FlinkQueryApi.queryIndexAsStream(layer: String, queryString: Option[String], parts: Option[Int] = None)(implicit env: StreamExecutionEnvironment): DataStream[IndexPartition]
For Java
- Usage of com.here.platform.data.client.javadsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, partId: String): CompletionStage[JIterator[IndexPartition]] should be replaced by com.here.platform.data.client.javadsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, partId: Optional[String]): CompletionStage[JIterator[IndexPartition]]
- Usage of com.here.platform.data.client.javadsl.QueryApi.queryIndex(layer: String, queryString: String, partId: String): CompletionStage[JSource[IndexPartition, NotUsed]] should be replaced by com.here.platform.data.client.javadsl.QueryApi.queryIndex(layer: String, queryString: String, partId: Optional[String]): CompletionStage[JSource[IndexPartition, NotUsed]]
- Usage of com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndexAsIterator(layer: String, queryString: String): JIterator[IndexPartition] should be replaced by com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndexAsIterator(layer: String, queryString: Optional[String]): JIterator[IndexPartition]
- Usage of com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndex(layer: String, queryString: String): SourceFunction[IndexPartition] should be replaced by com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndex(layer: String, queryString: Optional[String]): SourceFunction[IndexPartition]
- Usage of com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndexAsStream(env: StreamExecutionEnvironment, layer: String, queryString: String): DataStream[IndexPartition] should be replaced by com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndexAsStream(env: StreamExecutionEnvironment, layer: String, queryString: Optional[String]): DataStream[IndexPartition]
- Usage of com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndexAsStream(env: StreamExecutionEnvironment, layer: String, queryString: String, parts: Int): DataStream[IndexPartition] should be replaced by com.here.platform.data.client.flink.javadsl.FlinkQueryApi.queryIndexAsStream(env: StreamExecutionEnvironment, layer: String, queryString: Optional[String], parts: Int): DataStream[IndexPartition]
2.30.0
Data Client Library
ADDED
Added option to check/ignore invalid partitions in Spark connector via the options:
When the check is enabled, the checksum of the partition will be verified. And, if olp.connector.ignore-invalid-partitions is set to true the connector will log a warning message. Otherwise, it will throw an exception.
When the layer digest attribute is undefined and the partition checksum is not, this option:
- olp.connector.default-checksum(default="MD5") can be used to specify which algorithm to use in this case. By default Spark connector uses "MD5" but the values "SHA-1" and "SHA-256" can be also used.
2.30.0
Data Client Library
ADDED
Added option to set the overall timeout in milliseconds that is applied for reading the partitions in Spark connector via the spark option olp.connector.read-timeout. Default value is 60000 milliseconds.
2.29.0
Archetypes
CHANGED
Downgraded the maven-shade-plugin from 3.2.4 to 3.2.1 to align with the version used in SDK BOM files.
2.29.0
Data Client Base Library
ADDED
Added scope support at CredentialsModels, which allows defining scope for project.
2.29.0
Data Client Library
ADDED
Added olp.connector.metadata-columns parameter for flink connector. This parameter (by default it is false) should be set to true in order to add metadata to flink connector schema. Works only for new version of connector (see the olp.connector.flink.v2 option)
2.29.0
Data Client Library
ADDED
Added olp.connector.flink.v2 parameter for flink connector. This parameter (by default it is false) should be set to true in order to use new version of flink connector, which differs from the old version in terms of metadata columns. New connector will not provide/require metadata by default (this behaviour could be changed by using olp.connector.metadata-columns option). Also it will have another order of some metadata columns. The old version of connector is deprecated. After the deprecation period the new version of the connector will be used by default.
2.29.0
Data Client Library
DEPRECATED
olp.connector.flink.v2 parameter for flink connector is deprecated. This parameter should be set to true in order to use new version of flink connector. After deprecation period new version will be used by default and this parameter will be removed.
2.29.0
Data Client Library
ADDED
Added support for custom (foreign) members in the Feature GeoJSON object.
2.29.0
Data Client Library
DEPRECATED
Be advised that the following methods are marked deprecated now. These deprecated methods will be removed after 6 months from the release date, therefore replacing the usage of deprecated methods with alternative methods is necessary for its users.
For Scala
- Usage of com.here.platform.data.client.scaladsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, isHugeQuery: Boolean = false): Future[Iterator[IndexPartition]] should be replaced by com.here.platform.data.client.scaladsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, partId: Option[String]): Future[Iterator[IndexPartition]]
- Usage of com.here.platform.data.client.scaladsl.QueryApi.queryIndex(layer: String, queryString: String, isHugeQuery: Boolean = false): Future[Source[IndexPartition, NotUsed]] should be replaced by com.here.platform.data.client.scaladsl.QueryApi.queryIndex(layer: String, queryString: String, partId: Option[String]): Future[Source[IndexPartition, NotUsed]]
For Java
- Usage of com.here.platform.data.client.javadsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, isHugeQuery: Boolean): CompletionStage[JIterator[IndexPartition]] should be replaced by com.here.platform.data.client.javadsl.QueryApi.queryIndexAsIterator(layer: String, queryString: String, partId: String): CompletionStage[JIterator[IndexPartition]]
- Usage of com.here.platform.data.client.javadsl.QueryApi.queryIndex(layer: String, queryString: String, isHugeQuery: Boolean): CompletionStage[JSource[IndexPartition, NotUsed]] should be replaced by com.here.platform.data.client.javadsl.QueryApi.queryIndex(layer: String, queryString: String, partId: String): CompletionStage[JSource[IndexPartition, NotUsed]]
2.29.0
Examples
CHANGED
Downgraded the maven-shade-plugin from 3.2.4 to 3.2.1 to align with the version used in SDK BOM files.
2.28.0
Archetypes
CHANGED
Changed the archetypes to use SDK BOM with Scala 2.12 dependencies.
The latest version of archetypes generates Scala 2.12 compatible projects. If you want to use Scala 2.11, please use the following versions of archetypes:
Make sure you update the version of sdk-batch-bom, sdk-stream-bom and sdk-standalone-bom to the latest version. The latest version can be found here.
2.28.0
Archetypes
FIXED
Fixed an issue where users with the 32-bit JDK experienced Protobuf compilation errors.
2.28.0
Archetypes
CHANGED
Added better error handling to protoc-scala-maven-plugin and protoc-scala-maven-plugin_2.12 plugins for the cases when plugin configuration is invalid.
2.28.0
Data Archiving Library
CHANGED
The Data Archive Library has changed the artifact name from com.here.platform.data.archive.data-archive to com.here.platform.data.archive.data-archive_2.11 and com.here.platform.data.archive.data-archive_2.12 for Scala 2.11 and Scala 2.12 respectively.
2.28.0
Data Client Library
FIXED
Fixed uploading an empty blob to durable volume.
2.28.0
Data Client Library
DEPRECATED
Method isLayerType in LayerType class is deprecated.
2.28.0
Data Client Library
ADDED
Added olp.connector.volatile.reader.v2 parameter for spark volatile reader. This parameter (by default it is false) should be set to true in order to use new version of spark volatile reader, which differs from the old version in terms of metadata columns. New reader will not provide mt_dataHandle and mt_metadata for volatile layer. The old version of reader is deprecated. After the deprecation period the new version of the reader will be used by default.
2.28.0
Data Client Library
DEPRECATED
olp.connector.volatile.reader.v2 parameter for spark volatile reader is deprecated. This parameter should be set to true in order to use new version of spark volatile reader. After deprecation period new version will be used by default and this parameter will be removed.
2.28.0
Data Client Library
FIXED
Fixed GeoJSON models with validations.
2.28.0
Data Processing Library
FIXED
Under certain circumstances, user-provided partitioners were applied to DPL-internal state partition keys, which could lead to unexpected exceptions if the partitioner would throw on some keys.
2.28.0
Index Compaction Library
CHANGED
The Index Compaction Library has changed the artifact name from com.here.platform.index.compaction.index-compaction-batch to com.here.platform.index.compaction.index-compaction-batch_2.11 and com.here.platform.index.compaction.index-compaction-batch_2.12 for Scala 2.11 and Scala 2.12 respectively.
2.28.0
Examples
CHANGED
Changed the examples using SDK BOM files with Scala 2.12.
To use the SDK BOM files with Scala 2.11, do the following:
* Use the Scala 2.11 BOM files:
* sdk-batch-bom instead of sdk-batch-bom_2.12 * sdk-stream-bom instead of sdk-stream-bom_2.12 * sdk-standalone-bom instead of sdk-standalone-bom_2.12
* Change scala.compat.version property to 2.11.
* Make sure you update Scala dependencies of examples to Scala 2.11 (for example pipeline-runner-java_2.12 -> pipeline-runner-java_2.11) * Different pipeline environments should be used to run the examples, stream-3.0.0 instead of stream-4.0 and batch-2.1.0 instead of batch-3.0.0
2.28.0
Dependencies
ADDED
Scala 2.12 is now supported by Data SDK for Java & Scala. Scala 2.12 SDK-BOM files contain _2.12 suffixes:
Added blocking methods for API requests. Now you are able to use:
val client = BaseClient() val configApi = client.of[ConfigApi]
val result: CatalogsResultBase = configApi.getCatalogs(verbose = Some(false)).toEntity()
println(s"response: $result")
New configuration parameter blocking-timeout is introduced to setup blocking timeout for each level. The default value is 5 minutes. You can change it using configuration file or programmatically.
2.27.0
Data Client Base Library
DEPRECATED
retry-policy entity in configuration is deprecated. Please use new one instead:
Removed the need to use shutdown explicitly. Now you can omit shutdown line:
val client = BaseClient() client.shutdown()
2.27.0
Data Client Library
ADDED
Added support for the objectstore layer in FlinkReadEngine and FlinkWriteEngine. With the addition of this support users will be able to upload and download data from the objectstore layer using flink-support package.
2.27.0
Data Client Library
ADDED
Added a new configuration property publish.kafka-publish-parallelism which determines with how many threads events are published to Kafka in parallel. Please put this property in your application.conf file if you wanna use some other value than default. The default value is 2048.
Event ordering is guaranteed only in case of 1, which has a huge performance impact.
The http user agent header of Data Client has been changed
- from DataClient/x.y.z (Java/a.b.c_d) - to DataClient/x.y.z (Java/a.b.c_d) (Scala/r.s.t). - where - x.y.z is the version of the Data Client - a.b.c_d is the version of the Java VM which is currently running it - r.s.t is the version of the Scala compiler which built it
This means you can see now in the logs the Scala compiler version that was used to build this Data Client library.
Example for new http user agent header: DataClient/1.6.10 (Java/1.8.0_252) (Scala/2.11.12)
2.27.0
Data Client Library
ADDED
This release adds a new layer type: Interactive Map. This library enables users to access Interactive Map layer through various operations. Data Client supported operations are:
- Create interactive-map layer - Read data - Write data - Delete data
This release also include Data Engine and Flink-Support for Interactive Map Layer. The data engines support includes operations such as:
- Export layer data - Upload large data
2.27.0
Location Library
ADDED
Added the following values to the SupplementalGeometry navigation attribute:
For instructions on how to access the navigation attributes, see the com.here.platform.location.integration.optimizedmap.graph.PropertyMaps.NavigationAttributes class and the related methods. Added the specific Java variant through the com.here.platform.location.integration.optimizedmap.graph.javadsl.PropertyMaps.NavigationAttributes class.
2.26.0
Archetypes
FIXED
Changed protoc-scala-maven-plugin_2.12 (HERE's Maven plugin) to support the backwards compatibility of the Scala bindings API between Scala 2.11 and 2.12.
2.26.0
Archetypes
FIXED
Fixed API backwards compatibility issues between Scala 2.11 and 2.12 bindings generated by Schema Archetype.
2.26.0
Data Client Base Library
ADDED
Added streamingContent to HttpResponse, so that we can support getting directly the byte stream from the OkHttp response, and hence support data streaming in the DCBL APIs.
As an example, with BlobApi you will be able to use .executeToInputStream():
val client = BaseClient() val blobApi = client.of[BlobApi]
val result: Future[InputStream] = blobApi.getBlob(someHrn, someLayer, someDataHandle).executeToInputStream()
This change will not break your code. The logic inside checks the existence of kafka-support module and in case of its absence will override connector type to http-connector until kafka-support module will add to dependencies.
This doesn't touch flink users, because kafka-support module was included in flink-support module. The spark-support module will no longer contain kafka library.
2.26.0
Data Processing Library
ADDED
The DeltaContext now allows the construction of disjoint union of not only two, but two or more DeltaSets.
2.26.0
Index Compaction Library
ADDED
Added a failure-rate-threshold value to the configuration of Index Compaction Library to calculate, log, and verify that compaction failure rate is below the maximum failure rate expected by the user. Default threshold is 1.0, which means the compaction job fails only if compaction for all keyGroups fail. Note that compaction is an optimization for cost and performance. Failure of compaction will not affect data consistency in Index Layer.
2.26.0
Schemas
FIXED
Protobuf partition decoding in the HERE platform portal was fixed in these latest SDII schema versions: * SDII v3 Message Schema v4.2.5. * SDII v3 MessageList Schema v4.2.5. * SDII Archive Schema v2.2.6.
2.26.0
Schemas
FIXED
Protobuf partition decoding in the HERE platform portal was fixed in SENSORIS schema v1.1.3.
2.26.0
Schemas
FIXED
Scala 2.12 bindings API is now backwards compatible with the Scala 2.11 one in these latest SDII schema versions: * SDII v3 Message Schema v4.2.6. * SDII v3 MessageList Schema v4.2.6. * SDII Archive Schema v2.2.7.
2.26.0
Schemas
FIXED
Scala 2.12 bindings API is now backwards compatible with the Scala 2.11 one in SENSORIS schema v1.1.4.
2.25.0
Data Client Base Library
ADDED
Updated Data Client Base Library to support following versions of HERE Platform Data APIs: - interactive-map-v1-openapi.yml: 1.0.0
Data Client Base Library supports Interactive map layer operations.
Added a new flag to the Settings named forceRawData. If settings are passed to read or write engines then this new flag determines if the raw data handling is enforced or not.
The default value is false. In this case the behavior is driven by existing parameters like layer configuration.
If the flag is true then
- in case of read engine the data is read in raw format (bytes) and no gunzip is applied regardless of layer configuration, - in case of write engine the data is written in raw format (bytes) and no gzip is applied regardless of layer configuration.
2.25.0
Location Library
CHANGED
Added methods you can use to check whether a PropertyMap contains a value for a given key:
Changed GeometryTile to support precomputed lengths from the Optimized Map for Location Library to speed-up the decoding. The straightLineDistanceCalculator was removed from the fields to be passed in construction. The distance calculator is now passed to each TiledGeometryPropertyMap.
2.25.0
Location Library
CHANGED
IncidenceGraphs now contain methods to check whether a graph contains a given vertex or edge:
- Scala: IncidenceGraph.containsVertex and IncidenceGraph.containsEdge - Java: IncidenceGraph.containsVertex and IncidenceGraph.containsEdge
If you implemented your own IncidenceGraph this will be a breaking change for your code that can be fixed implementing the two new methods as well.
2.25.0
Examples
REMOVED
Data Validation Library, Data Validation Schemas and Data Validation Examples have been removed from HERE Data Java/Scala SDK
2.25.0
Schemas
FIXED
SDII Scala 2.12 module dependency conflicts were fixed in the latest schema versions: * SDII v3 Message Schema v4.2.4. * SDII v3 MessageList Schema v4.2.4. * SDII Archive Schema v2.2.4.
2.24.0
Archetypes
ADDED
Both the schema archetype and HERE Maven plugins have been updated to support generation of the new Scala 2.12 bindings. This change is in preparation for Scala 2.12 on HERE Platform.
Schema owners are encouraged to update their schema projects to generate Scala 2.12 bindings. In order to upgrade, follow the instructions in the migration guide.
2.24.0
Data Client Base Library
DEPRECATED
Deprecate builder for scala BaseClient.
2.24.0
Data Client Base Library
FIXED
Data Client Base Library can use multiple BaseClient instances.
2.24.0
Data Client Library
ADDED
Added olp.connector.force-raw-data configuration parameter on producer/consumer side in flink connector which allows disabling encoding/decoding logic for avro, protobuf, parquet content types and use raw data directly. By default, this parameter is set as false.
2.24.0
Data Client Library
FIXED
Fixed an issue where pipelines crash with sdii serialization exception.
2.24.0
Data Client Library
ADDED
Added olp.connector.force-raw-data configuration parameter on producer/consumer side in flink connector which allows disabling encoding/decoding logic for avro, protobuf, parquet content types and use raw data directly. By default, this parameter is set as false.
2.24.0
Data Client Library
DEPRECATED
olp.connector.payload-decoding parameter for flink and spark connector is deprecated. This parameter was applicable only for source/read side. The new parameter olp.connector.force-raw-data (by default it is false) should be set in true for forcing raw data usage (disabling transformation from/to parquet, avro, protobuf) and is applicable for both source/read and sink/write sides.
2.24.0
Index Compaction Library
BUG-FIX
The correct data size is now represented for layers with gzip content encoding during the compaction process in Index Compaction Library. This fix restores correct functionality of the compaction process for index layers with gzip content encoding by addressing a bug where an error would be incorrectly thrown for suspected overflow due to negative data-size value.
2.24.0
Location Library
CHANGED
Improved the performance of the getAll method for the Apache Flink variant of com.here.platform.location.dataloader.core.TileLoader/DataLoader when running on a limited number of CPUs.
2.24.0
Location Library
OTHER
In the next release, the Location Library will add methods you can use to check whether a PropertyMap contains a value for a given key:
The latest SDII schemas now include the new Scala 2.12 bindings. They can be used in your project using the following artifact ids: * SDII v3 Message Schema v4.2.0 sdii_message_v3_scala_2.12 * SDII v3 MessageList Schema v4.2.0: sdii_message_list_v3_scala_2.12 * SDII Archive Schema v2.2.0: sdii_archive_v1_scala_2.12
2.24.0
Schemas
ADDED
SENSORIS schema v1.1.0 now includes the new Scala 2.12 bindings. They can be used in your project using the sensoris-specification_v1_1_0_scala_2.12 artifact id.
2.23.0
Data Client Base Library
UPDATED
Updated Data Client Base Library to support following versions of HERE platform Data APIs:
Fixed an issue where reading partitions larger than ~135 MB in size from a compressed layer caused an error with the error message: "Ranges different than AllBytes are not supported for compressed layers".
2.23.0
Data Client Library
FIXED
Fixed an issue where listing a single file from the hadoop-fs-support using spark-sql returns empty result.
2.23.0
Data Client Library
REMOVED
Following up the changelog notice in release 2.20, the deprecated optional field packageType in VolatileVolume class was removed from the JSON parser as the Data API does not have it anymore.
2.23.0
Data Client Library
CHANGED
We rolled back the usage of Kafka client with OAuth2. We found there is a JVM classloader problem when using this Kafka client with OAuth2 in conjuction with Flink 1.10 and then performing HERE platform pipeline restart.
2.23.0
Data Processing Library
ADDED
The following useful built-in presets were added to OneToMany to ease the implementation of many typically used key transformation patterns:
- OneToMany.toChildren - OneToMany.toDescendants
2.23.0
Data Processing Library
FIXED
Fixed bug in batch-validation's publishAndAggregateByLevel transformation that caused an exception if the test DeltaSet contained the root tile (tile ID 1).
2.23.0
Data Processing Library
CHANGED
In the DeltaSets programming abstraction, the mapKeys and flatMapKeys transformations can now specify partial inverse functions. This is particularly useful because the Data Processing Library can call the inverse functions on values that are of the key type, but are never produced by the mapping function. For such values, it may not be convenient or even possible to define a correct inverse. This problem can now be solved by restricting the domain of the inverse function to only those keys for which the inverse can be correctly defined.
For example, OneToOne[Int, String](_.toString, _.toInt) is incorrect, because the inverse is not correctly defined for all strings. Instead, a partial function should be used: OneToOne[Int, String](_.toString, \{ case s: String if s forall Character.isDigit => s.toInt \})
This change brings a minor backward incompatibility with the previous version of DPL: if the OneToOne, OneToMany, ManyToOne, or ManyToMany relation is defined in a place where DeltaSet transformations are not imported, a partial function must be used for the inverse even if the inverse is defined on all keys. For example, OneToOne(_.toInt, _.toString) would have to be replaced by OneToOne(_.toInt, PartialFunction(_.toString)).
2.23.0
Location Library
ADDED
The Location Library now offers PropertyMaps.overlappingRangeBasedProperty, a factory method for on-the-fly compiling PropertyMaps from range-based HERE Map Content attributes with overlapping ranges.
If the attribute you are trying to compile contains overlapping ranges, you can use this method instead of existing methods like PropertyMaps.rangeBasedProperty which only support non-overlapping ranges.
2.23.0
Location Library
REMOVED
A few implementation details were found to be mistakenly exposed. Since they don't pertain to the intended user-facing API and are likely to change in the near future, they were removed from the public scope. This applies to following class members:
- In class StandaloneCatalog: - field dataClientSettings, - field timeout, - field actorSystem. - In class StandaloneCatalogFactory: - field timeout, - field optionalDataClientSettings.
Existing code shouldn't be affected by the removal but, in the very hypothetical case where these fields were used in your code, please keep in mind that the values they reference are not different from the values passed at construction time.
Added the olp permission access delete command to delete the access filter attached to the user or app.
18.1.2
ADDED
Added the olp permission access filter create command to create an access filter.
18.1.2
ADDED
Added the olp permission access filter delete command to delete the access filter.
18.1.2
ADDED
Added the olp permission access filter update command to update a specified access filter.
18.1.2
FIXED
Fixed olp.bat startup script on Windows where JAVA_HOME and PATH pointed to different Java versions, causing incorrect JVM flags to be applied. The Java executable is now resolved from JAVA_HOME (or PATH as fallback) before the version check, so the same java.exe is used for both version detection and JAR execution.
18.1.2
FIXED
Fixed a performance issue in olp catalog layer partition get and olp local catalog layer partition get that prevented partitions from being fetched concurrently.
18.1.2
REMOVED
Removed support for publishing OLP CLI GraalVM native image.
18.1.2
CHANGED
Changed the olp permission access filter list command to list the access filter HRNs available to be attached to any user, app or realm.
18.1.2
CHANGED
Changed the olp permission access filter show command to display the details of an access filter includes type in the output.
18.1.2
CHANGED
Changed the olp permission access set command to support attaching the access filter to any user or app in the realm.
18.1.2
CHANGED
Changed the olp permission access show command to support display the access filter attached to an user or app.
18.0.27
CHANGED
Changed the olp pipeline egress rule history show command to use dedicated filter parameters (--rule-id, --destination, --principal, --action) instead of a generic [filter] argument for more precise filtering of actions applied to egress rules.
18.0.27
ADDED
Added the --parallelism parameter to the olp catalog layer partition get and olp catalog layer partition put commands to speed up downloading and uploading multiple partitions.
18.0.19
ADDED
Added the following command to create pipeline egress rules in batches:
- olp pipeline egress rule batch create
18.0.19
ADDED
Added the following commands to display information about the pipeline egress rules:
- olp pipeline egress rule list - olp pipeline egress rule show
18.0.19
CHANGED
Changed the --extends <catalog-hrn,layer-id[,baseVersion]> parameter to also support Interactive Map Layers in the olp catalog layer add command.
18.0.19
REMOVED
Removed the --destination-type parameter for the olp pipeline egress rule create command.
18.0.11
ADDED
Added the following set of commands for the pipeline egress rule management:
Added the following command for displaying list of changes applied to egress rules within the realm:
- olp pipeline egress rule history show
18.0.11
FIXED
Fixed the issue for CLI when running commands in parallel erases the content of olpcli.ini.
18.0.11
REMOVED
Removed the --marketplace-ready flag for the olp catalog update command.
18.0.11
CHANGED
Updated OLP CLI to use Spark 4.0.1.
17.5.44
ADDED
Added the --external-id parameter to the olp permission report command to only include permissions derived from a plan or resource plan attached to the realm with the associated external ID.
17.5.44
ADDED
Added the --with-external-id parameter to the olp permission report command to display external ID values of associated plans or resource plans if applicable in the output.
17.5.44
FIXED
Fixed the issue where the olp catalog layer show command fetching IML catalog layer details did not include reference composite IML catalog information in interactiveMapProperties.
17.5.44
CHANGED
Changed the --input parameter for olp catalog layer partition put, olp catalog layer stream put, and olp catalog layer stream ingest commands to support a source directory, single file, or non-recursive filename glob pattern for uploading files.
17.5.44
CHANGED
Updated OLP CLI to use Scala 2.13.
17.5.35
ADDED
Added the --check parameter to the olp catalog update command to validate inputs and display the configuration that would be applied without making any changes.
17.5.35
ADDED
Added the --json parameter to the olp catalog update command display the command result in JSON format.
17.5.35
ADDED
Added --check parameter for olp catalog create to validate inputs and print the configuration that would be applied without making changes.
17.5.35
FIXED
Fixed the description of the --change parameter in the olp catalog layer partition list command to accurately reflect its behavior when partitions are created or deleted between the specified versions.
17.5.23
CHANGED
Changed the olp catalog layer partition list command to include two additional fields in the output:
- metadata: optional user-defined fields that can store extra metadata about this index record. - fields: collection of index fields of the index partition.
This is specific only to index layers and does not affect other layers.
17.5.23
ADDED
Added the olp credentials show command to display information about the application associated with the credentials file.
17.5.17
ADDED
Added the --filter <glob-pattern>, --output <outputDir> and --delimiter <character> parameters to the catalog layer object get command, allowing download multiple objects from an object store layer.
17.5.6
ADDED
Added the olp ratelimit rule list command to display rate limit rules associated with identities.
17.5.6
ADDED
Added the olp ratelimit endpoint list command to display rate limit endpoints associated with rate limiting rules.
17.5.6
ADDED
Added the olp ratelimit endpoint show command to display rate limit endpoints associated with rate limiting rules.
17.5.6
ADDED
Added the olp ratelimit rule show command to provide details of rate limit rule referred by ruleHrn for the given identity.
17.5.6
CHANGED
Changed the olp identity provider enable command to support --with-password-login option for enabling password login along with SSO login.
17.3.3
CHANGED
Changed the generation of the dataHandle property when publishing partitions to volatile layers with the olp catalog layer partition put command. Now deterministic ID is generated instead of UUID.
17.3.3
CHANGED
Changed the minimum required Java version from 8 to 17.
17.3.3
CHANGED
Changed the --email parameter in the olp pipeline create command to be mandatory.
17.3.3
FIXED
Fixed incorrect behavior of the following commands when object store layer properties were not parsed from the config file and default values were used instead:
- olp catalog create - olp catalog update
17.3.3
FIXED
Fixed incorrect apt-get installation procedure in OLP CLI documentation.
17.2.39
CHANGED
Changed the default output of the olp pipeline version job show command to return information about input and output catalogs, including their identifiers, HRNs, processing types, and versions.
17.2.28
ADDED
Added support for the --encryption-type parameter for versioned and object store layers in the olp catalog layer add command.
17.2.28
ADDED
Added the --schedule and --processing parameters to the olp pipeline version upgrade command, allowing update the scheduler settings when upgrading the pipeline version.
17.2.9
FIXED
Fixed behavior of the olp catalog layer stream get and olp local catalog layer stream get commands when --output parameter is used and partition with a specific name is downloaded multiple times. Instead of overriding the partition file with the latest event, new files will be created using the following naming pattern:
partitionName partitionName_1 partitionName_2
17.2.9
ADDED
Added support for additional file formats in the --data parameter of the olp catalog layer feature put command. Previously, it only supported FeatureCollection objects provided via GeoJSON files.
Now, it supports:
- GeoJson – Files containing either Feature or FeatureCollection objects. - Json Line – Files containing multiple Feature objects, each separated by a new line.
17.1.41
ADDED
Added support for the --ttl parameter for object store layers in the olp catalog layer add and olp catalog layer update commands.
17.1.25
ADDED
Added the following commands for identity provider templates:
Added the following commands for identity provider metadata:
- olp identity provider metadata validate: Validates and parses a metadata XML file
17.1.25
ADDED
Added the following commands for identity provider templates:
- olp identity provider template list: Returns list of supported identity provider templates
17.1.17
ADDED
Added the --service-id-alias-only parameter to the olp permission report command to display service alias instead of service ID in the output.
17.1.17
ADDED
Added the --service-id-alias parameter to the olp permission report command to only include permissions associated with the specified service alias.
17.1.17
CHANGED
Changed error messages returned by the olp pipeline create and olp pipeline template create commands when required parameters are used incorrectly.
17.1.17
CHANGED
Changed the default output of some pipeline template and pipeline version commands to return the following deprecation message when using a deprecated runtime environment:
The above changes affected the following commands:
- olp pipeline template create - olp pipeline template show - olp pipeline version activate - olp pipeline version cancel - olp pipeline version copy - olp pipeline version create - olp pipeline version deactivate - olp pipeline version pause - olp pipeline version resume - olp pipeline version show - olp pipeline version wait
17.1.17
FIXED
Fixed an issue with incorrect visualization of verbose output for the olp project show command.
17.1.3
ADDED
Added the --ttl parameter to the olp catalog create and olp catalog update commands, allowing users to specify the number of days after which catalog versions are automatically deleted.
17.0.26
ADDED
Added the --linkable-to parameter to the olp permission report command, allowing for reporting the permissions that are linkable to a specific project (if projectHRN is specified as parameter) or any project in the realm (if realmHRN is specified as parameter).
17.0.14
CHANGED
Changed verbose and quiet outputs for the olp pipeline move commands to align with other OLP CLI commands.
17.0.14
FIXED
Fixed an issue where the API token provided via the HERE_TOKEN environment variable was not used when running catalog-related commands.
17.0.6
ADDED
Added the --context parameter to the olp catalog layer partition list and olp catalog layer partition get commands, allowing for the listing and downloading of partitions on composite layers.
17.0.6
ADDED
Added the --extends <base-catalog-hrn,layer-id[,baseVersion]> parameter to the olp catalog layer add command, allowing a layer's content to be based on an existing layer from the base catalog.
17.0.6
FIXED
Fixed an ArrayIndexOutOfBoundsException error when users provide the --runtime-config parameter of the olp pipeline version create command with key-value pairs separated by multiple spaces. The OLP CLI now correctly handles multiple spaces between key-value pairs without throwing any errors.
17.0.6
REMOVED
Removed the partitions type from the --subscription-area parameter of the olp catalog layer notification create command.
17.0.6
CHANGED
Changed the behavior of the olp catalog layer update command to throw an error when attempting to update the TTL property for a volatile layer. Previously, users could run this command with the --ttl parameter, but no changes were made.
16.3.113
ADDED
Added support for setting the HERE_TOKEN environment variable to reuse the API token. This enhancement speeds up OLP CLI operations in scripts by avoiding repeated token retrieval.
16.3.100
ADDED
Added functionality to execute OLP CLI commands inside Java and Scala applications. Users can now seamlessly integrate OLP CLI into their Scala and Java projects for enhanced flexibility and compatibility.
Added the olp api service show command to show service information for given service ID or service ID alias.
16.3.100
FIXED
Fixed issue causing failure of the olp pipeline version create command when the --stream-config parameter was enclosed in single quotes ("akka.lookup.timeout='10 s'"). Now, the command executes successfully regardless of single quotes usage.
16.3.75
ADDED
Added the following set of commands for the role management:
- olp role list - olp role show - olp role assignment list - olp role assignment add - olp role assignment remove - olp role assignment entity list
Changed the output file names for the olp catalog layer feature get command when --ids or --all parameter is specified with the --output parameter. Now the file names have the following structure:
- When --ids is specified together with --output parameter: <layer_id>_features_ids_<timestamp in yyyyMMdd_HHmmss format>.geojson. Example: topology_features_ids_20240223_130916.geojson. - When --all parameter is specified: <layer_id>_features_all_<timestamp in yyyyMMdd_HHmmss format>.geojson. Example: topology_features_all_20240223_130916.geojson.
16.3.58
CHANGED
Changed the olp pipeline environment list command as follows:
- Showed maximum overhead memory for each runtime environment. - Re-arranged the columns to display description column after name column.
16.3.42
ADDED
Added optional --garbage-collector-profile parameter to enable garbage collector profile selection. The following commands were updated:
- olp pipeline template create - olp pipeline version create - olp pipeline version copy
16.3.42
ADDED
Added optional --supervisor-additional-overhead-memory parameter to specify additional overhead memory for supervisor. The following commands were updated:
- olp pipeline template create - olp pipeline version create - olp pipeline version copy
16.3.42
ADDED
Added optional --worker-additional-overhead-memory parameter to specify additional overhead memory for worker. The following commands were updated:
- olp pipeline template create - olp pipeline version create - olp pipeline version copy
16.3.42
CHANGED
Changed the olp pipeline environment list command to show available garbage collector profiles for each runtime environment.
Fixed the olp catalog layer partition get command with the --decode true flag returning the Failed to download partitions error for large-sized partitions.
16.3.5
ADDED
Added the olp permission report command. It allows the user to get a detailed report on permissions assigned to the User, App, Group, or Realm either directly or indirectly.
16.3.5
FIXED
Fixed a problem where the user receives GeoJson through the olp catalog layer feature get command in a different form than it was when originally uploaded. The update fixes this problem to ensure that the user receives the same GeoJson that was previously uploaded to the feature.
16.3.5
FIXED
Fixed the credentials validation not detecting errors when invalid olpcli.ini file is used. The following errors are now returned:
- Invalid configuration file .here/olpcli.ini. The [section name] section is empty - Invalid entry in the configuration file .here/olpcli.ini. Parse error at line [line number] - value of the "property name" property is missing - Invalid entry in the configuration file .here/olpcli.ini. The "property name" property in the [section name] section is present more than once
16.2.61
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.2.61
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.2.61
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.2.61
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.2.61
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
16.2.57
ADDED
Added command suggestions for typo corrections.
16.2.57
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.2.57
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.2.57
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.2.57
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.2.57
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
16.2.48
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.2.48
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.2.48
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.2.48
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.2.48
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
16.2.39
ADDED
Added the following commands to manage devices:
- olp device show: Returns details of a device account with the specified device account HRN. - olp device update: Updates details of a device account. - olp device find: Returns details of a device account by the identity provider HRN and external ID. - olp device delete: Deletes a device account.
16.2.39
ADDED
Added the possibility to delete a versioned layer in olp catalog layer delete command. Deleting a versioned layer will permanently and irrevocably delete both the data and the metadata associated with the layer.
16.2.39
ADDED
Added the --only-layer-schema parameter to the olp schema list command. This parameter allows choosing whether the response should contain non-layer schemas or not. When set to false, both layer and non-layer schemas are returned.
16.2.39
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.2.39
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.2.39
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.2.39
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.2.39
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
16.2.27
ADDED
Added information about provisioning objects to olp service add command that a user adding a service might use for defining provisioning feature for his service.
16.2.27
CHANGED
Changed the olp project resource link, olp project resource unlink, olp resource project add, olp resource project remove, olp resource link availability create, olp resource link availability delete commands to use with a schema HRN without version
16.2.27
CHANGED
Updated the olp service commands with the --scope parameter. Now you can work with services within the project.
16.2.27
FIXED
Fixed the olp pipeline template create command to allow pipeline template creation with the same input/output catalog for the batch environment.
16.2.27
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.2.27
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.2.27
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.2.27
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.2.27
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
16.2.5
ADDED
Added the --project parameter to the olp project access grant command that allows to attach policies to the project itself, effectively attaching them to all present and future members.
16.2.5
ADDED
Added the --project parameter to the olp project access revoke command that allows to detach policies that were previously attached directly to the project with olp project access grant --project.
16.2.5
ADDED
Added the --project parameter to the olp project access show that lists policies that were attached directly to the project with olp project access grant --project.
16.2.5
FIXED
Fixed the error that occurred when a command parameter was recognized as one of the values of the preceding command parameter.
This fix affects the following commands:
- olp app manager add - olp catalog layer feature delete - olp catalog layer feature get - olp catalog layer feature list - olp catalog layer notification create - olp catalog layer notification delete - olp catalog layer partition get - olp catalog layer update - olp catalog permission grant - olp catalog create - olp group admin add - olp group admin remove - olp group member add - olp group member remove - olp project access grant - olp project access revoke - olp project admin add - olp project admin remove - olp project project - olp schema permission grant
16.2.5
FIXED
Fixed the olp resource project list command returning the Invalid HRN service for requested resource error when the specified resource is neither a catalog nor a schema. Now the command returns a list of projects for all resource types, such as flow pipelines, flow pipeline templates, and so on.
16.2.5
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.2.5
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.2.5
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.2.5
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.2.5
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
16.1.1
ADDED
Added the --default-new-member-policies parameter to the olp project update command that defines default policies for new project members.
16.1.1
ADDED
Added the --scope-access parameter to the olp project update command that defines the scope of access that is allowed when operating within this project's scope (through using a project-scoped token).
16.1.1
FIXED
Fixed the olp catalog layer partition list command so that it does not show partition metadata from the startVersion when the --change <startVersion[:endVersion]> parameter is specified. Now the start version is exclusive and the end version is inclusive.
16.1.1
CHANGED
Changed the olp project resource availability list command to return schemas HRNs with versions.
16.1.1
CHANGED
Changed the olp project resource availability list command by removing the default value of the --limit parameter to enable displaying all the resources available for linking when this parameter is not used.
16.1.1
CHANGED
Changed the olp catalog layer partition list command output to include the dataHandle property for the versioned and volatile layers.
16.1.1
CHANGED
Changed the human-readable output of some resources listing commands by applying the following table formatting:
- All acronyms formatted in uppercase. - No header displayed for one-column tables. - No additional info printed before tables (for example, Available catalogs:).
The above changes affected the following commands:
- olp catalog dependency list - olp catalog layer notification list - olp catalog layer subscription list - olp catalog permission list - olp credentials list - olp group admin list - olp org app list - olp org group list - olp org invitation list - olp org trust list - olp org user list - olp project admin list - olp project policy list - olp project resource list - olp project resource availability list - olp resource action list - olp resource link availability list - olp resource project list
16.1.1
CHANGED
Changed the human-readable output of some resources listing commands by displaying supplementary information after the table (for example, Use olp catalog show <catalog HRN> to display more information about a catalog), only when appropriate.
The above changes affected the following commands:
- olp app list - olp catalog list - olp catalog dependency list - olp catalog layer feature list - olp catalog layer object list - olp catalog layer partition list - olp catalog layer subscription list - olp org trust list - olp pipeline list - olp pipeline profile list - olp pipeline template list - olp pipeline version job list - olp pipeline version list - olp project access list - olp project policy list - olp project resource availability list - olp project list - olp resource link availability list - olp schema list - olp service list
16.1.1
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
16.1.1
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
16.1.1
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
16.1.1
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
16.1.1
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
16.1.1
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
14.0.19
ADDED
Added an optional --batch-size parameter to the olp catalog layer feature update command to optimize large feature modification files uploading.
14.0.19
ADDED
Added the --change startVersion:[endVersion] parameter to the olp catalog layer partition list command, that lists the partitions that have been changed in the specified range of versions.
14.0.19
ADDED
Added the --force parameter to the olp credentials import command that allows importing app credentials even if a profile with the specified name exists. As a result, the imported profile replaces the original one.
14.0.19
ADDED
Added the olp credentials update command that updates the scope of the credentials.properties file or a profile in the olpcli.ini file.
14.0.19
CHANGED
olp local commands no longer require credentials nor an internet connection, except for:
- olp local inspect, olp local catalog inspect and olp local catalog layer inspect. - olp local serverwithout--offline-mode. - olp local catalog layer getwith--decode=true. - olp local catalog layer putwith--encode=true.
14.0.19
FIXED
Fixed the olp catalog layer feature update command returning the OutOfMemoryError: Java heap space error while uploading large feature modification files.
14.0.19
CHANGED
Changed the default batch size used by the olp catalog layer feature put command to optimize large feature files uploading. Now batch size 1000 is used by default.
14.0.19
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
14.0.19
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
14.0.19
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
14.0.19
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
14.0.19
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
14.0.19
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
14.0.9
REMOVED
Parameter --replicate has been removed from olp catalog create command. Use the --replication parameter instead.
14.0.9
FIXED
Fixed the olp catalog layer feature put command returning the OutOfMemoryError: Java heap space error while uploading large feature files.
14.0.9
FIXED
Fixed the olp local inspect and olp local catalog inspect commands returning the Cannot install local inspector. To download the inspector file, use a non-project-scope app error while downloading the local inspector with a project scope.
14.0.9
CHANGED
Changed the olp catalog layer partition and olp local catalog layer partition commands to allow users to update dependency without data upload if the --dependency parameter is specified without the --partition or --input parameters.
14.0.9
CHANGED
Changed the olp catalog layer partition and olp local catalog layer partition commands to increment the metadata version of the catalog if neither --partition nor --input parameters are specified.
14.0.9
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
14.0.9
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
14.0.9
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
14.0.9
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
14.0.9
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
14.0.9
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
13.0.25
ADDED
Added two service commands:
- service manifest show: Returns a manifest file for a specified location service. - service openapi show: Returns an OpenAPI specification for a specified location service.
13.0.25
ADDED
Added optional --supervisor-units-profile and --worker-units-profile parameters to the olp pipeline template create command to enable resource profiles selection.
13.0.25
ADDED
Added optional --supervisor-units-profile and --worker-units-profile parameters to the olp pipeline version copy command to enable resource profiles selection.
13.0.25
ADDED
Added optional --supervisor-units-profile and --worker-units-profile parameters to the olp pipeline version create command to enable resource profiles selection.
13.0.25
ADDED
Added the olp pipeline profile list command that returns a list of available resource profiles.
13.0.25
ADDED
Added a retry mechanism to the olp catalog layer add command to enable automatic retries if a Service API call failed with the 409 response code and the Another modifying operation is being executed at the same time error.
13.0.25
CHANGED
Changed the olp pipeline environment list command to show available resource profiles for each runtime environment.
13.0.25
CHANGED
Changed the olp project policy list and olp project policy show commands output to show the resource-creation-access-all-project-resources platform policy that provides granular control for access creation.
13.0.25
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
13.0.25
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
13.0.25
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
13.0.25
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
13.0.25
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
13.0.25
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
13.0.1
ADDED
Added the following set of commands for the layer-level subscriptions management:
Changed the commands output, warnings and error messages. Now all the last messages on the line do not end with periods, acronyms are formatted in uppercase, and HRNs are highlighted, when appropriate.
13.0.1
DEPRECATED
Deprecated the --marketplace-ready flag for the olp catalog update command.
13.0.1
FIXED
Fixed the olp catalog layer feature get command returning incomplete data.
13.0.1
FIXED
Fixed the olp service show command returning incomplete Customization data (missing serviceHrn).
13.0.1
CHANGED
Moved subscription commands olp catalog layer subscripton to notification group olp catalog layer notification.
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
13.0.1
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
13.0.1
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
13.0.1
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
13.0.1
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
13.0.1
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
Now, in the case of uploading compressed data, the user receives uncompressed data by default when running the olp catalog layer object get command.
12.3.39
FIXED
Fixed the olp local inspect, olp local catalog inspect, and olp local catalog layer inspect commands returning the Unable to make protected void java.net.URLClassLoader.addURL(java.net.URL) accessible error for Java versions 9 and higher.
12.3.39
CHANGED
Changed CLI Homebrew package dependency from Java 8 to Java 17.
12.3.39
FIXED
Fixed the olp catalog layer partition put command returning the NoClassDefFoundError error for Java versions 9 and higher if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
12.3.39
REMOVED
Removed the deprecated olp project resources list, olp project resources link, and olp project resources unlink commands.
Use the following commands instead:
olp project resource list olp project resource link olp project resource unlink
12.3.39
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
12.3.39
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
12.3.39
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
12.3.39
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
12.3.39
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
12.3.39
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
12.3.26
FIXED
Fixed the problem when the olp catalog layer feature update command does not update features.
12.3.26
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
12.3.26
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
12.3.26
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
12.3.26
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
12.3.26
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
12.3.26
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
12.3.26
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
12.3.26
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
12.3.13
ADDED
Added support for configuring replication with a JSON configuration file for the olp catalog create command. This option is available if neither the --replicate nor --replication parameter is passed and the replication property is configured in the JSON file.
12.3.13
ADDED
Added the optional --replication parameter to the olp catalog create command for enabling replication regions selection.
12.3.13
ADDED
Added the olp schema generate command to generate a json or proto schema.
12.3.13
ADDED
Added the olp schema package command to validate and build a generated schema.
12.3.13
ADDED
Added the olp schema put command to validate and upload a schema to the platform.
12.3.13
CHANGED
All commands follow HTTP redirects in case an underline service request returned a 3XX response.
12.3.13
DEPRECATED
Deprecated the --replicate parameter for the olp catalog create command. The support of this parameter will be discontinued in February 2023. Use the --replication parameter instead.
12.3.13
FIXED
Fixed the olp local inspect command returning the Cannot install local inspector. error if the OLP CLI has been installed using the apt or Homebrew package managers.
12.3.13
FIXED
Fixed the following commands returning the is not valid key value data. error:
- olp pipeline version create - olp catalog layer partition put - olp pipeline template create
12.3.13
FIXED
Fixed the issue of long-running downloads and uploads failing with Token Validation Failure error.
12.3.13
CHANGED
Changed the olp local inspect command returning the error message when a project-scope app is used.
12.3.13
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
12.3.13
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
12.3.13
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
12.3.13
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
12.3.13
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
12.3.13
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
12.3.13
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
12.3.13
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
12.2.5
ADDED
Added the optional --type parameter in the olp schema list command to apply filtering based on the schema type: json or proto
12.2.5
CHANGED
Now --schema parameter can be set to olp catalog layer update for Interactive Map Layer.
12.2.5
CHANGED
Changed the olp schema show command to show a list of relevant validators depending on the schema type and added a type field that indicates whether the schema is proto or json.
12.2.5
ADDED
Added the olp catalog layer feature update command to update GeoJSON features in the interactive map layer.
12.2.5
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
12.2.5
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
12.2.5
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
12.2.5
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
12.2.5
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
12.2.5
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
12.2.5
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
12.2.5
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
12.1.17
FIXED
Fixed the olp version update command returning the line 45: xit: command not found error.
12.1.17
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
12.1.17
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
12.1.17
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
12.1.17
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
12.1.17
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
12.1.17
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
12.1.17
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
12.1.17
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
12.1.2
ADDED
Added subresource support in the form of an optional --external-id parameter to the olp project resource link, olp project resource unlink and olp project resource link commands.
12.1.2
ADDED
Added the Credentials section [profile default] in the configuration file .here/olpcli.ini does not exist. warning to help identify misconfiguration when the profile default section of the olpcli.ini configuration file is missing and the default .here/credentials.properties file is present.
12.1.2
CHANGED
Changed the olp schema delete command to accept HRNs without versions. If the schema HRN without version provided the command deletes all the versions of the schema. The schemas with multiple versions need additional --force flag to confirm the deletion. A single version can be removed without the --force flag.
12.1.2
ADDED
Added possibility to use --schema parameter in catalog layer add command and schema option in the catalog configuration file for catalog create and catalog update commands for Interactive Map Layer
12.1.2
ADDED
The OLP CLI can be installed with apt, a package manager for Debian-based distributions. To install the latest version of OLP CLI, run the following commands:
Fixed the olp credentials list command returning the ERROR: JSONObject["appId"] not found. error in case when some entries were missing in the profile default section of the olpcli.ini configuration file. The message has been changed to Invalid entry in the configuration file .here/olpcli.ini. The [Name of missing entry] property in the [profile default] section is missing.
12.1.2
CHANGED
Changed the functionality of the --filename parameter in theolp secret update command. This parameter is now used to update the file name where the secrets should be stored on the platform. The previous functionality of the --filename parameter has been replaced by the--secret-content parameter, which specifies the path to the secret file.
12.1.2
FIXED
Fixed the olp catalog layer show command with the --quiet parameter returning the ERROR: JSONObject["scheme"] not found. error.
12.1.2
FIXED
Fixed the olp version show command returning the ERROR: Can't obtain information about latest OLP CLI version. error when the olpcli.ini configuration file and the default .here/credentials.properties file are missing or invalid. Now the command doesn't return any error messages, only information about the current OLP CLI version is returned.
12.1.2
ADDED
The OLP CLI can be installed with Homebrew, a package manager for macOS and Linux. To install the latest version of OLP CLI, run the following command: brew install heremaps/olp-cli/olp.
12.1.2
ADDED
The OLP CLI can be installed with winget, a package manager for Windows. To install the latest version of OLP CLI, run the following command: winget install HERE.OLPCLI.
12.1.2
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
12.1.2
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
12.1.2
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
12.1.2
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
12.1.2
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
12.1.2
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
12.1.2
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
12.1.2
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
11.1.0
ADDED
Added the optional --filename parameter to the olp secret create command that specifies the name of the file where the secret is stored on the platform. If the --filename parameter is not specified, the credentials file name is used by default. For the older versions of the OLP CLI not supporting the --filename parameter, the secret is always stored in the credentials file.
11.1.0
ADDED
Added the optional --with-latest-checkpoint parameter to the olp pipeline version activate command that activates a stream pipeline using the latest checkpoint from within that pipeline. If no checkpoint is found under the specified pipeline, no action is taken and an error is displayed.
11.1.0
ADDED
Added the following commands for linked resources management in OLP projects:
- olp project resource list to list all resources in and referenced by the project - olp project resource link to link a resource to a project - olp project resource unlink to unlink a resource from a project
11.1.0
CHANGED
Changed the olp project resource link availability list command to olp project resource availability list.
The latest OLP CLI version that supports olp project resource link availability list command is 10.5.133 version.
11.1.0
DEPRECATED
Deprecated the olp project resources list, olp project resources link, and olp project resources unlink commands. The support of these commands will be discontinued in October 2022.
Use the following commands instead:
- olp project resource list - olp project resource link - olp project resource unlink
11.1.0
FIXED
Fixed the misleading error message ERROR: Neither .here/credentials.properties nor .here/olpcli.ini can be found or accessed. that appeared when some entries were missing in the credentials.properties file. The message has been changed to Invalid credentials file .here/credentials.properties. The [Name of missing entry] property is missing.
11.1.0
FIXED
Fixed the verbose output of the olp credentials list command. Now records in the command output are aligned with the output header.
11.1.0
CHANGED
Error messages returned by the olp credentials list, olp credentials import, and olp credentials delete commands when invalid credentials or config files are used have been improved. They now contain the path to the credentials file, the source of the credentials file (OLP CLI command parameter, environment variable), and additional info about the error.
11.1.0
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
11.1.0
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
11.1.0
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
11.1.0
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
11.1.0
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
11.1.0
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
11.1.0
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
11.1.0
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.5.125
ADDED
Added the olp pipeline snapshot list command that returns a list of Flink application savepoints for the specified pipeline.
10.5.125
ADDED
Added the olp pipeline snapshot show command to display details of a snapshot.
10.5.125
ADDED
Added the olp pipeline verion operation list command that returns the list of all operations completed or pending for a pipeline version.
10.5.125
ADDED
Added --snapshot-id parameter to the olp pipeline version activate command to start the Flink application from the specified savepoint.
10.5.125
FIXED
Fixed the olp pipeline move command with the --quiet parameter returning the ERROR: JSONObject["source"] not found. error.
10.5.125
CHANGED
Updated the Pipeline Workflows with information on how to deploy a pipeline within the project.
10.5.125
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.5.125
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.125
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.125
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the olp local inspect command fails with the following errors:
ERROR: Cannot install local inspector. ERROR: object is not an instance of declaring class
10.5.125
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.125
KNOWN ISSUE
After the OLP CLI installation with the apt package manager, the catalog layer partition put command fails with the NoClassDefFoundError if parameters --content-encoding or --digest have been used previously for adding layers to catalogs.
10.5.125
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can occur with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols in the Windows console.
10.5.125
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
Added the --deep parameter to the olp catalog layer object list command, which allows listing objects recursively.
10.5.98
FIXED
Fixed the olp project resource link availability list command returning the limit must be Integer between 0 and 100 inclusive error in case the limit parameter is greater than 100.
10.5.98
ADDED
A glob filter was added to the set of available filters in the local copy commands to easily copy subsets of objectstore layers based on glob patterns.
Added the list of artifacts and the documentation link to the output of the olp schema show command.
10.5.98
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.5.98
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.98
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.98
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.98
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.5.98
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.5.83
ADDED
Added the --retry parameter to the olp catalog create command, which allows performing retries for this command if catalog creation has failed with the 403 response code and the These credentials do not authorize access error.
10.5.83
FIXED
Fixed an issue where the OLP CLI returned debug logs by default with Java version 11 and above.
10.5.83
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.5.83
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.83
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.83
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.83
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.5.83
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.5.72
ADDED
Added the following set of commands for layer-level notification management:
Fixed the incorrect error code returned by the OLP CLI while using invalid configuration files. Now, instead of error code 3, error code 2 is returned.
10.5.72
FIXED
Fixed a JSON decoding error for the olp service add command with different service major versions in the id and version fields of manifest.md. Now the error returned by the Platform is shown.
10.5.72
FIXED
Fixed missing Update the OLP CLI section in the Get Started chapter of the OLP CLI documentation.
10.5.72
ADDED
Added a new section to Project Workflow showing how to update an existing policy.
10.5.72
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.5.72
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.72
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.72
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.72
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.5.72
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.5.51
FIXED
Fixed an issue with the org app list --manager --csv command failing with the 'Resource not found` error for an existing app.
10.5.51
CHANGED
Changed the olp project resources list command, so that the active field appears in the response.
10.5.51
ADDED
Added the --cross-realm parameter to the olp resource project list command, which allows outputting projects from different realms if there is a valid cross-realm trust established between the home project/realm and those other realms.
Added an example to the API Workflow how to get project-scoped API token.
10.5.51
ADDED
Added the olp project policy update command to update the existing policy.
10.5.51
FIXED
Fixed the misleading error message returned by the olp catalog create and olp catalog update commands with a config file containing invalid stream layer properties.
10.5.51
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.5.51
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.51
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.51
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.51
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.5.51
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.5.39
FIXED
Fixed the issue with the command line parameters starting with @ symbol.
10.5.39
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.39
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.39
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.39
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.5.39
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.5.24
ADDED
Added the --force parameter to the olp schema delete command, allowing you to force delete a schema even if it is linked to a project.
Added an optional --decode parameter to the olp local catalog layer partition get and olp local catalog layer stream get commands. The new parameter makes partition decoding a simple task: partition content is decoded from protobuf and converted to JSON on-the-fly.
10.5.24
ADDED
Added an optional --encode parameter to the olp local catalog layer partition put and olp local catalog layer stream put commands. The new parameter makes partition encoding a simple task: partition content is encoded from JSON and converted to protobuf on-the-fly.
10.5.24
FIXED
Fixed an issue where the olp catalog layer object list command was not listed in the standard output after executing the --help option.
The exit code of the interactions with non-existing catalogs was changed. When you are executing a command on a catalog that does not exist, the OLP CLI returns a new exit code - 4. Examples of such commands:
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.5.24
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.5.24
KNOWN ISSUE
The local inspection commands:
- olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.5.24
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.5.24
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.5.24
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.4.9
ADDED
Added the following set of commands for app domain management:
* olp app domain add <app HRN>
* olp app domain delete <app HRN>
* olp app domain show <app HRN> <trusted domain URI>
Added an extra field trustedDomainsEnabled to the output of the olp app show command that indicates whether trusted domains are enabled/disabled for the app.
Added a new parameter --trusted domains <enable\|disable> to the olp app update command. This optional parameter enables, or disables, trusted domains for the application.
Added the error message The schema resource type is not supported by the command. for the olp resource link availability update command when using schema as a resource.
10.4.9
ADDED
Extended the olp resources link availability create and olp resources link availability delete commands to support schemas. You can now provide a schema HRN to create/delete link availability for the schema.
10.4.9
ADDED
Added the following command that allows listing the runtime environments currently enabled for the customer or their organization.
* olp pipeline environment list [filter] [command parameters]
The required --actions parameter for the olp resource link availability create command is optional now. If the action is not specified, the read action for the pipeline-template type and the readResource action for other resource types is set.
10.4.9
CHANGED
Extended the olp app show command to list all the roles assigned to an app.
10.4.9
CHANGED
Changed the error message in case the wrong <cluster type> parameter was provided in the olp pipeline tempalte create command from Unsupported runtime environment <cluster type> to <br/>ERROR: Service returned error 400 while requesting PipelineTemplatesApi#createPipelineTemplate(PipelineTemplate)<br/>Response: \{<br/> "templateOptions": null,<br/> "code": "E1000",<br/> "message": "\{validation.error\}",<br/> "messageTemplate": "\{validation.error\}",<br/> "errors": [\{<br/> "templateOptions": \{\},<br/> "code": null,<br/> "field": "/runtimeEnvironment",<br/> "message": "\{runtime.environment.values\}",<br/> "messageTemplate": "\{runtime.environment.values\}",<br/> "errors": [],<br/> "status": null,<br/> "invalidValue": "<cluster type>"<br/> \}],<br/> "status": 400<br/>\}<br/>
10.4.9
ADDED
Extended the olp project resources link and olp project resources unlink commands to support schemas. You can now provide a schema HRN to link/unlink a schema to/from a project. The schema resource has only the readResource action supported.
10.4.9
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.4.9
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.4.9
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.4.9
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.4.9
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.4.9
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.3.1
ADDED
Added a new parameter --content-type <content type> to the olp catalog layer object put command. This optional parameter allows specifying the content type of the data that is to be uploaded, such as application/json and text/plain.
Added a new parameter --content-encoding <encoding type> to the olp catalog layer object put command. This optional parameter allows specifying the content encoding of the data that is to be uploaded, such as gzip and compress.
Fixed the issue that caused the olp pipeline version create command with the --runtime-config parameter that contains values with spaces to throw java.lang.ArrayIndexOutOfBoundsException due to invalid processing of the parameter value.
To pass a value that contains spaces, one should enclose it with single quotes '. For instance, olp pipeline version create ... --runtime-config "datePattern='yyyy-MM-dd HH:mm:ss.SSS'".
10.3.1
FIXED
Fixed the misleading error message in the output of the OLP CLI commands. The message appeared when neither the [default] profile in olpcli.ini nor the credentials.properties file were found in the ~/.here/ directory.
10.3.1
CHANGED
Extended the olp resource project add and olp resource project remove commands to support schemas. You can now provide a schema HRN to add/remove a schema to/from a project.
10.3.1
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.3.1
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.3.1
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.3.1
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.3.1
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.3.1
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.0.36
ADDED
Added the following command that allows listing the permissions of users, apps, and groups across all organizations associated with a schema.
Fixed an issue when the catalog-related commands failed with the error java.lang.IllegalAccessError: class com.typesafe.sslconfig.ssl.DefaultHostnameVerifier (in unnamed module @0x48140564) cannot access class sun.security.util.HostnameChecker (in module java.base) because module java.base does not export sun.security.util to unnamed module @0x48140564 when using JDK 16.
10.0.36
FIXED
Fixed an issue when the olp catalog layer partitions get command with the --decode true flag failed with timeout for more than one partition.
10.0.36
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.0.36
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.0.36
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.0.36
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.0.36
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.0.36
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
10.0.9
ADDED
Added the following set of commands for feature management of an interactive map layer:
* olp catalog layer feature list: displays the list of features in an interactive map layer
* olp catalog layer feature get: retrieves features from an interactive map layer
* olp catalog layer feature put: uploads features to an interactive map layer
* olp catalog layer feature delete: deletes features from an interactive map layer
The OLP CLI has changed the artifact name from com.here.platform.cli to com.here.platform.cli_2.11 and com.here.platform.cli_2.12 for Scala 2.11 and Scala 2.12 respectively.
10.0.9
ADDED
The OLP CLI was updated with Scala 2.12 libraries and dependencies:
Deprecated the runtime environment (cluster type) batch-2.0.0 for the pipeline template create command.
10.0.9
DEPRECATED
Deprecated the runtime environment (cluster type) batch-2.1.0 for the pipeline template create command.
10.0.9
DEPRECATED
Deprecated the runtime environment (cluster type) stream-3.0.0 for the pipeline template create command.
10.0.9
FIXED
Fixed an issue where the OLP CLI Windows installer downloaded from the platform portal was one version behind the latest one.
10.0.9
FIXED
Fixed the olp catalog layer stream put command issue that caused partitions being published without sorting them lexicographically when the --input directory contained subdirectories.
10.0.9
ADDED
Added the following set of commands for the organization management : * olp org group list * olp org app list * olp org user list * olp org invitation list
Removed support of the deprecated runtime environment (cluster type) stream-2.0.0 for the olp pipeline template create command.
10.0.9
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
10.0.9
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
10.0.9
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
10.0.9
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
10.0.9
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
10.0.9
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
9.3.9
ADDED
Added an --always-project-scope <true\|false> parameter to the olp app scope set command. This optional parameter indicates whether an app should be locked to the default project scope.
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
9.3.9
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
9.3.9
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
9.3.9
KNOWN ISSUE
Disabled the possibility to add object store layers to local catalogs.
9.3.9
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
9.3.9
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
9.2.17
ADDED
Added the following command that allows listing the permissions of users, apps, and groups across all organizations associated with a catalog.
Added the following set of commands for the policy management of the project : * olp project policy create <project HRN> --config <path to config file> * olp project policy show <project HRN> <policy HRN> * olp project policy list <project HRN> * olp project policy delete <project HRN> <policy HRN>
The support of the olp catalog permission revoke command without either of the <--read|--write|--manage|--cross-realm> permission flag is ended.
9.2.17
REMOVED
The support of the --data-in-mbps and --data-out-mbps parameters for the olp catalog layer add and olp catalog layer update commands has ended. Instead, use the --data-in and --data-out parameters as a more convenient and granular way to control stream layer throughput.
9.2.17
REMOVED
The support of the --output-catalog <version number> and --omit-catalog-versions parameters for the olp pipeline version activate command has ended.
9.2.17
REMOVED
The support of the olp schema permission revoke command without either of the <--read|--modify|--share|--cross-realm> permission flag is ended.
9.2.17
CHANGED
Updated the following commands to add an optional --policy parameter: * olp project access list <project HRN> * olp project access grant <project HRN> * olp project access revoke <project HRN>
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
9.2.17
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
9.2.17
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
9.2.17
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
9.2.17
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
8.0.154
FIXED
Fixed an issue of not being able to create/read/update/delete apps when using default-scoped credentials.
8.0.154
FIXED
Fixed an issue where the olp catalog update command with --marketplace-ready <true\|false> timed out with an error message - error_polling_task_in_progress, even though the catalog update succeeded. Now, in case of a timeout, the update operation fails with this message: The marketplaceReady flag was not updated because the operation didn't complete in 650s. The operation timed out.
8.0.154
CHANGED
The olp catalog update command with --marketplace-ready flag uses Marketplace v2 API instead of Marketplace v1 API.
8.0.154
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
8.0.154
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
8.0.154
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
8.0.154
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
8.0.154
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
8.0.130
CHANGED
Changed the recommendation in the output of the olp catalog layer show command with the stream layer type: Use catalog layer stream get <catalog HRN> <layer ID> to<br/>download partitions from the stream layer.
8.0.130
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
8.0.130
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
8.0.130
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
8.0.130
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
8.0.130
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
8.0.85
ADDED
Added the following set of commands for third party secret management operations: * olp secret create: creates a secret * olp secret delete: deletes a secret * olp secret disable: disables a secret * olp secret enable: enables a secret * olp secret list: displays secrets * olp secret update: updates a secret
8.0.85
CHANGED
Changed the output file name for the olp catalog layer partition get command when using --decode true with --all or --output parameters. The following name pattern is used: <partition-name>-decoded.json.
8.0.85
CHANGED
Changed the output file name for the olp catalog layer stream get command when using --decode true with --output parameter. The following name pattern is used: <partition-name>-decoded.json.
8.0.85
CHANGED
Changed the output of the olp version show command with the --quiet parameter. Use --quiet to display the version of the OLP CLI tool currently installed on your computer.
8.0.85
FIXED
Fixed an issue with the olp version show command. In case of wrong credentials or network problems, the command failed to return the version of the installed OLP CLI app.
8.0.85
FIXED
Fixed an incorrect expiresAt value for olp api token get command using seconds instead of milliseconds to calculate the new value.
8.0.85
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
8.0.85
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
8.0.85
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
8.0.85
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
8.0.85
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
8.0.61
ADDED
Added the following set of commands for blobs management in an object store layer: * olp catalog layer object get: retrieves blobs from the object store layer * olp catalog layer object put: creates blobs in the object store layer * olp catalog layer object copy: copies blobs in the object store layer * olp catalog layer object delete: deletes blobs from the object store layer * olp catalog layer object list: displays blobs in the object store layer
8.0.61
ADDED
Added a new layer type parameter to the olp catalog layer add command: * --objectstore The new layer is of type object store.
8.0.61
FIXED
Fixed the issue that caused an olp pipeline template create command with --default-runtime-config parameter that contains values with spaces to throw the java.lang.ArrayIndexOutOfBoundsException due to invalid processing of parameter value. Now values with spaces should be quoted with single quotes.
8.0.61
FIXED
Fixed a mismatch between the Config API response and the output of the olp catalog show --json and catalog layer show --json commands by: * Including the created field in OLP CLI commands output. * Including the partitioningScheme filed. * Displaying layer and volume types in OLP CLI output in lowercase. Please note, OLP CLI JSON output still does not include all fields from Config API: * catalog layer show --json command output does not include hrn of the layer; * catalog show --json command output does not include coverage and contacts for catalog;
8.0.61
CHANGED
Extended the JSON output of the olp service show command to include new fields added to the service registry for enrolled services:
* olp service show <HRN> --json
The above command outputs the following new fields:
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
8.0.61
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
8.0.61
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
8.0.61
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
8.0.61
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
8.0.39
ADDED
olp local catalog copy create supports an additional regex filter, that copies all partitions that match a given regular expression, as the following snippet shows:
Note: Currently the platform supports this feature only for catalogs.
8.0.39
CHANGED
Changed the default value of --minimum-version in olp local catalog copy create. Previously, --minimum-version defaulted to the latest version of the catalog, which forced users to use both --minimum-version and --version to copy an old version of a catalog, like in the following snippet:
# without --minimum-version it would fail because --minimum-version can't be greater than --version olp local catalog copy create hrn:here:data::olp-here:rib-2 --minimum-version 1000 --version 1000
Since this release, --minimum-version defaults to --version, which simplifies the use-case above:
# if --minimum-version is not provided, it will default to --version olp local catalog copy create hrn:here:data::olp-here:rib-2 --version 1000
The new default value does not change the behavior of existing scripts.
8.0.39
FIXED
Fixed issue that prevented the graphical inspection of volatile layers in the map view if the catalog did not have at least a versioned layer and a version. This is fixed in all the following commands: - olp catalog inspect - olp catalog layer inspect - olp local inspect - olp local catalog inspect - olp local catalog layer inspect
8.0.39
CHANGED
Updated the following command to add an optional --actions parameter:
* olp project resources link <project HRN> <resource HRN>
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
8.0.39
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
8.0.39
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
8.0.39
KNOWN ISSUE
The olp catalog layer partition get command does not produce any output when trying to to write to stdout the content of the partition that contains non-ASCII symbols. Similar problems with non-ASCII symbols can appear with other commands. This is a Windows-specific problem related to the peculiarity of rendering UTF-8 symbols on Windows console.
8.0.39
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
8.0.15
ADDED
Added new parameters to the olp catalog layer update command: * --ttl The layer's time-to-live or expiry time in milliseconds. * Maximum value: 7 days (604800000 ms); * Minimum value: 1 minute (60000 ms); * Default value: 1 hour (3600000 ms). The --ttl parameter applicable only for index and stream layers. TTL changes can take some time, so any data in the process of expiration per previous TTL may expire before the new TTL changes are applied. * --digest <md5\|sha-1\|sha-256> The digest algorithm to use to calculate the checksum for the layer. Possible values are md5, sha-1, sha-256. The --digest parameter applicable only for index and versioned layers. Note that --digest cannot be updated once set. If this parameter has been already specified for olp catalog layer add or olp catalog layer update commands, it cannot be changed. * --content-type <layer data type> The content type of the layer, such as application/vnd.geo+json and text/plain. The default value is application/x-protobuf. The --content-type parameter applicable only for stream layer. * --content-encoding <encoding type> The content encoding of the layer, such as gzip. If this parameter is specified, all data in a layer is compressed by the specified algorithm. The default value is Uncompressed, which means no compression. The --content-encoding parameter is applicable only for stream layers. * --data-in <size><KB\|MB> The maximum throughput for incoming data in the layer. * Maximum value: 32MB (32,800 KBps maximum or 32,768 KBps rounded up to the nearest 100th); * Minimum value: 100KB (can only be a multiple of 100 KBps); * Default value: 1MB, if no scale parameters are set; otherwise it is calculated by the HERE platform; * If the unit value is omitted, MB will be used by default; The --data-in parameter is applicable only for stream layers. * --data-out <size><KB\|MB> The maximum throughput for outgoing data in the layer. * Maximum value: 64MB (65,500 KBps maximum or 65,536 KBps rounded up to the nearest 100th); * Minimum value: 100KB (can only be a multiple of 100 KBps); * Default value: 4MB, if no scale parameters are set; otherwise it is calculated by the HERE platform; * If the unit value is omitted, MB will be used by default; The --data-out parameter is applicable only for stream layers.
The update of content type(--content-type), content encoding(--content-encoding), or content schema definition(--schema) for a layer with data in it can lead to irrecoverable data inconsistency. Any such changes could adversely impact downstream consumers of the data.
8.0.15
ADDED
Added an optional --decode parameter to the olp catalog layer partition get and olp catalog layer stream get commands. The new parameter makes partition decoding a simple task: partition content is decoded from protobuf and converted to JSON on-the-fly.
8.0.15
ADDED
Added an optional --encode parameter to the olp catalog layer partition put and olp catalog layer stream put commands. The new parameter makes partition encoding a simple task: partition content is encoded from JSON and converted to protobuf on-the-fly.
8.0.15
ADDED
Added the following set of commands for the default scope management of the application : * olp app scope set <application hrn> <project hrn> * olp app scope show <application hrn> * olp app scope remove <application hrn>
Fixed the issue that caused an olp catalog layer partition put command to throw the error with the message: ERROR: Partition publishing failed. \{"error":"fields is required in your request body"\}. The error appeared only in case partitions were uploaded to an index layer using the index configuration from index.properties and not all files in the input directory were matching the patterns from the index.properties file.
8.0.15
REMOVED
Removed the --package-type parameter from the catalog layer add command.
8.0.15
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
8.0.15
KNOWN ISSUE
The --encode parameter of the olp catalog layer partition put and olp catalog layer stream put commands is not working correctly when publishing decoded JSON partitions downloaded from the HERE platform portal.
8.0.15
KNOWN ISSUE
Volatile layers cannot be graphically inspected in the map view if the catalog does not have any versioned layers and at least one version. This affects all inspect commands: - olp catalog inspect - olp catalog layer inspect - olp local inspect - olp local catalog inspect - olp local catalog layer inspect Volatile partitions are shown correctly and can be decoded in the list view of the Data Inspector.
8.0.15
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
8.0.15
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.238
ADDED
Added new parameters to the olp catalog layer add command: * --data-in <size><KB\|MB> The maximum throughput for incoming data in the stream layer. * Maximum value: 32MB (32,800 KBps maximum or 32,768 KBps rounded up to nearest 100th); * Minimum value: 100KB (Can only be multiple of 100 KBps); * Default value: 1MB, if no scale parameters are set; otherwise it is calculated by the HERE platform. * --data-out <size><KB\|MB> The maximum throughput for outgoing data in the stream layer. * Maximum value: 64MB (65,500 KBps maximum or 65,536 KBps rounded up to nearest 100th); * Minimum value: 100KB (Can only be multiple of 100 KBps); * Default value: 4MB, if no scale parameters are set; otherwise it is calculated by the HERE platform. The parameters accept integer numbers as value and support modifiers to switch from KB to MB and vice versa. If KB/MB modifier not specified, MB is used by default.
Updated olp catalog layer show command output to display values of data-out/data-in.
7.1.238
CHANGED
Changed the default values for stream-layer-related --data-out-mbps/--data-in-mbps/--parallelization parameters for the catalog layer add command. The default value for --data-out-mbps was changed from 8 to 4, for --data-in-mbps - from 4 to 1, and for --parallelization - from 4 to 1.
7.1.238
DEPRECATED
Marked the stream-layer-related data-in-mbps/data-out-mbps parameters as deprecated for the olp catalog layer add command. The new data-in/data-out parameters should be used instead.
7.1.238
FIXED
Fixed an issue with the CLI returning ERROR: Neither credentials.properties nor olpcli.ini can be found or accessed. in case the here.user.id property is missing. Now when CLI commands use the here.user.id property, the commands are executed and a warning message is shown.
List of commands that use here.user.id: 1. project create 2. catalog create 3. service add 4. key access create
If you execute these commands without here.user.id, you get the following warnings: 1. For project create command : WARNING: The project was not shared with the associated user account.. 2. For catalog create command : WARNING: The catalog was not shared with the associated user account.. 3. For add service command : WARNING: The service was not shared with the associated user account. 4. For key access create command : WARNING: The access key was not shared with the associated user account.
7.1.238
FIXED
Fixed a problem with the old version of the CLI jar not being deleted during the version update command on Windows, in case the CLI is located in a folder accessible only with admin rights.
7.1.238
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.238
KNOWN ISSUE
Volatile layers cannot be graphically inspected in the map view if the catalog does not have any versioned layers and at least one version. This affects all inspect commands: - olp catalog inspect - olp catalog layer inspect - olp local inspect - olp local catalog inspect - olp local catalog layer inspect Volatile partitions are shown correctly and can be decoded in the list view of the Data Inspector.
7.1.238
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
7.1.238
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.224
ADDED
Added a new --cross-realm flag to the olp catalog permission grant command that allows granting catalog permissions (--read, --write, --manage, --share) to users, apps, or groups from different realms.
7.1.224
ADDED
Added a new --cross-realm flag to the olp catalog permission revoke command that allows revoking catalog permissions (--read, --write, --manage, --share) from users, apps, or groups from different realms.
Note that the olp catalog permission revoke command does not accept any of the --read\|--write\|--manage\|--share flags if --cross-realm is passed.
7.1.224
ADDED
Added a new --multi-region flag to olp pipeline version create command that determines whether the Multi-Region Failover feature is enabled for the created pipeline version.
7.1.224
ADDED
Added a new set of commands to quickly inspect platform hosted catalogs and local catalogs: - olp catalog inspect <catalog hrn> - olp catalog layer inspect <catalog hrn> <layer id> - olp local inspect - olp local catalog inspect <local catalog hrn> - olp local catalog layer inspect <local catalog hrn> <layer id> The local variants are not available in the HERE Platform China. For more information on these new commands, check the OLP CLI documentation.
7.1.224
FIXED
Fixed the issue that caused an olp catalog layer stream put command to throw the error with the message Request was malformed: EntityStreamSizeException: actual entity size exceeded content length limit in case partitions were uploaded to a stream layer.
7.1.224
FIXED
Fixed project delete command that now removes all orphaned artifact resources if there are no more catalogs, schemas or pipelines existing in the project.
7.1.224
CHANGED
Improved validation of the --dependency parameter of the olp catalog partition put command. Now an error is thrown in case the direct parameter is different from true or false.
7.1.224
ADDED
Added local versions of the olp catalog commands. For more information about local data and how to use it together with the CLI, check the HERE Data SDK for Java & Scala Tutorials.
7.1.224
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.224
KNOWN ISSUE
Volatile layers cannot be graphically inspected in the map view if the catalog does not have any versioned layers and at least one version. This affects all inspect commands: - olp catalog inspect - olp catalog layer inspect - olp local inspect - olp local catalog inspect - olp local catalog layer inspect Volatile partitions are shown correctly and can be decoded in the list view of the Data Inspector.
7.1.224
KNOWN ISSUE
The local inspection commands: - olp local inspect - olp local catalog inspect - olp local catalog layer inspect are not available in the HERE Platform China environment.
7.1.224
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.204
ADDED
Added the following set of commands for access key management: * olp app key access list: displays access keys * olp app key access create: creates an access key * olp app key access delete: removes an access key * olp app key access enable: enable access keys * olp app key access disable: disable an access key
7.1.204
ADDED
Added the following set of commands for API key management: * olp app key api list: displays API keys * olp app key api create: creates an API key * olp app key api update: updates an API key * olp app key api delete: removes an API key * olp app key api enable: enables an API key * olp app key api disable: disables an API key
7.1.204
ADDED
Added the following set of commands for basic app management operations: * olp app create: creates an app. * olp app show: shows the details of an app. * olp app update: updates an app. * olp app delete: deletes an app. * olp app list: lists all apps which your app has access to.
7.1.204
ADDED
Added the following set of commands for controlling manager access to applications: * olp app manager add: adds a manager * olp app manager remove: removes a manager * olp app manager list: displays managers
7.1.204
DEPRECATED
The stream-2.0.0 (with Apache Flink 1.7.1) environment is now deprecated. From now on, use the pipeline template create command with the <cluster-type> parameter set to stream-3.0.0 (with Apache Flink 1.10.1). Existing stream pipelines that use the stream-2.0.0 run-time environment will continue to operate normally until November 2020.
7.1.204
FIXED
Fixed a problem with the following parameters when passing a space-separated string with multiple key-value pairs: - The -–metadata parameter in the layer partition put command. - The --default-runtime-config parameter in the pipeline template create command. - The --runtime-config parameter in the pipeline version create command. - The --stream-config parameter in the pipeline version create command.
7.1.204
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.204
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.166
ADDED
Added support for a new stream-3.0.0 cluster type to the pipeline template create command.
7.1.166
ADDED
Added support for a new group member type - invite. Now group member list accepts --type parameter with value invite, this allow to display only group members with type invite.
7.1.166
CHANGED
Changed the streamProperties minimum value for --data-out-mbps (dataOutThroughputMbps) and --data-in-mbps (dataInThroughputMbps) parameters in the catalog layer add command. The minimum value was changed from 0 to 1.
7.1.166
FIXED
Fixed a problem with the group member list command. It failed with error message ERROR: Can not construct instance of com.here.platform.cli.aaa.group.management.model.Member$EntityTypeEnum,<br/>problem: Unexpected value 'invite' when trying to get list of group members that contains new user invite entries.
7.1.166
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.166
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.146
ADDED
Added a new property metadataMinimumVersion to the catalog JSON schema to improve your monitoring experience during catalog metadata versions deletion. The property defines what is the earliest metadata version available for the catalog. For catalogs without any versioned layer or metadata version the value for metadataMinimumVersion is -1.
shell script<br/>olp catalog show <catalog Hrn> --json<br/>
The new property is also present as metadata minimum version in the output from: shell script<br/>olp catalog show <catalog Hrn><br/>
7.1.146
ADDED
Added an optional parameter --parallelization <number of Kafka partitions> to the catalog layer add command for stream layers. It represents the number of Kafka partitions for a stream layer. The minimum and maximum values are 1 and 32 correspondingly, and the default is set to 4. If this parameter is set, then the --data-in-mbps <size in Mbps> and --data-out-mbps <size in Mbps> parameters can be omitted.
7.1.146
CHANGED
Parameter --auto-version-deletion is applicable for the catalog create command only with parameter --config <config file>, where the <config file> contains definition at least for one versioned layer.
7.1.146
CHANGED
Changed the streamProperties section format in the human-readable output of the catalog layer show command. It was:
Fixed a problem with the catalog layer partition get --all command. It failed when trying to get all the data from a volatile layer that contained partitions deleted due to the layer's TTL (time to live) configuration. In this case, the entire download process exited with ERROR: Failed to download partitions. after encountering the first deleted partition. Now, the download process proceeds by skipping any deleted partitions and logging them to the standard error output, and the command exits with a non-zero code.
7.1.146
FIXED
Fixed a problem with the Windows Installer always redirecting you to the Global Portal after being prompted to download a newer CLI version. Now, you can choose to download the OLP CLI from either the Global Portal or the China Portal.
7.1.146
FIXED
Fixed a problem with the version update command that failed with error 403 Forbidden when using app credentials with a default project scope configured. Now, version update and version show have been updated to ignore the default application scope setting.
7.1.146
CHANGED
Changed the default behavior of the project create command. Now, both the user who creates a project and the associated app are granted permissions to access this project through the OLP portal and OLP CLI. You can override this behavior with the --skip-sharing-with-user flag to revoke project access from the user.
7.1.146
CHANGED
Changed the JSON output of the catalog show command by replacing the "notificationsEnabled": "true" property with the "notifications": \{"enabled": true\} object.
7.1.146
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.146
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.115
ADDED
Added two optional parameters to the catalog layer add command for volatile layers – --storage-capacity <size in MB> and --data-redundancy <single-instance\|multi-instance>.
7.1.115
DEPRECATED
Deprecated the optional parameter --package-type for the volatile layer in the catalog layer add command. Use the new --storage-capacity <size in MB> option instead.
7.1.115
CHANGED
Changed the error message from Nor xxx/.here/credentials.properties neither<br/>xxx/.here/olpcli.ini exist or can't be accessed. to Neither<br/>xxx/.here/credentials.properties nor xxx/.here/olpcli.ini can be found or accessed. that is shown in case credentials.properties and olpcli.ini are not present in the .here directory.
7.1.115
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.115
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.97
ADDED
Added an installer to simplify the CLI setup for Windows users. You can download it from the new CLI page.
7.1.97
CHANGED
CLI is no longer distributed together with Java/Scala examples. You can now download it from the new CLI page.
7.1.97
FIXED
With the introduction of a default project scope for apps, the concept of permission sharing for the catalog creation use case becomes irrelevant. Since the CLI is not aware of the scope of the catalog create operation, a warning is now shown instead of an error being thrown if sharing fails. Despite the error, the catalog create operation is not affected as the catalog is still created for the app.
7.1.97
ADDED
Added a new option to catalog commands enabling you to manage storage expenses more efficiently by defining an automatic version deletion rule for versioned catalogs. Use olp catalog create --auto-version-deletion <number of latest versions to keep> to limit the number of versions to keep for new catalogs. Use olp catalog update --auto-version-deletion <number of latest versions to keep> to modify version auto-deletion settings for existing catalogs. Use olp catalog update --auto-version-deletion off to disable automatic version deletion for catalogs. Use the olp catalog show --json command and the automaticVersionDeletion.numberOfValuesToKeep value to find out catalog's auto-deletion setting.
Added a new catalog version delete <catalog hrn> <version> [options] command that allows you to optimize storage costs. With the new command, you can set a minimum version for all versioned layers of the catalog. Those versions of metadata that are less than <version> will be permanently deleted.
7.1.97
ADDED
Added the possibility to revoke permissions for a catalog granularly. Added 3 new flags for the catalog permission revoke command: --read, --write, --manage.
Pass a --read, --write, or --manage flag to the catalog permission revoke command for individual users, apps, or groups for a better catalog access control.
7.1.97
ADDED
Added the possibility to revoke permissions for a schema granularly. Added 3 new flags for the schema permission revoke command: --read, --modify, --share.
Pass a --read, --modify, or --share flag to the schema permission revoke command for individual users, apps, or groups for a better schema access control.
7.1.97
DEPRECATED
The catalog permission revoke command without either of the <--read|--write|--manage> permission flag is deprecated. The support of the command without the above-mentioned flags will be ended in August 2020.
In order to use the catalog revoke command in the current version of CLI you should change the revoke command used in the previous versions:
The schema permission revoke command without either of the <--read|--modify|--share> permission flag is deprecated. The support of the command without the above-mentioned flags will be ended in August 2020.
In order to use the schema revoke command in the current version of CLI you should change the revoke command used in the previous versions:
Fixed a problem with the catalog layer stream ingest command when trying to ingest data to an unexisting layer. In this case, an error was thrown with the message: ERROR: Service returned error 404 while requesting IngestionApi#ingestData.
7.1.97
KNOWN ISSUE
The olp catalog dependency list command produces duplicate HRNs for each catalog – with and without a realm. This is the side effect of HRN migration to the new format. Duplicates are planned to be removed after July 2020.
7.1.97
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.62
FIXED
Fixed the issue where an app with a default scope could not perform olp<br/>project resources list, olp project resources link and olp project<br/>resources unlink commands.
7.1.62
FIXED
Fixed an issue that caused the catalog layer partition get command to shrink command output in case of writing partition content to stdout.
7.1.62
ADDED
Added a new --replicate flag to the catalog create command. It defines if the catalog should be replicated in the backup region.
7.1.62
ADDED
Added a new --digest <md5>\|<sha-1>\|<sha-256> parameter to the catalog layer add command that allows you to specify the digest algorithm when creating an index layer. Added a partition checksum value to the catalog layer partition list command output for index layers.
7.1.62
FIXED
Fixed the issue causing the catalog layer ingest command to throw an error message ERROR: Service returned error 403 while requesting ResourcesApi#resourceAPI(String,String,String) in case of ingesting data to the scoped catalog.
7.1.62
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.19
CHANGED
description parameter marked as required for catalog create and catalog layer add commands.
7.1.19
ADDED
Added a new service version list command that allows listing all the versions of a location service.
7.1.19
CHANGED
Changed resolution order for credentials: olpcli.ini credentials are read before credentials.properties.
7.1.19
FIXED
Fixed an issue that caused the catalog layer partition get command to throw an exception with the message ERROR: Failed to download partitions. ERROR: An exception<br/>was thrown during command execution: java.lang.NegativeArraySizeException in case of downloading files with size more than 2Gb.
7.1.19
KNOWN ISSUE
CI scripts parsing catalog HRNs from the olp catalog list command may fail after the 2.9 release. The reason is that the format of HRNs has changed. For more information please see OLP Release Announcements
7.1.19
KNOWN ISSUE
CI scripts parsing schema HRNs from the olp schema list command may fail after the 2.10 release. The reason is that the format of HRNs has changed. For more information please see OLP Release Announcements
7.1.19
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
7.1.19
KNOWN ISSUE
Currently, in the catalog layer stream get command, the --consumer-group option does not work. This issue will be addressed in a future release.
6.0.103
ADDED
Added optional --scope <project_hrn> parameter for catalog show, catalog create, catalog delete, catalog list, catalog update, catalog layer add, catalog layer delete, catalog layer show, catalog layer update, catalog layer partition put, catalog layer partition get, catalog layer partition list, catalog layer stream put and catalog layer stream get to specify the project's scope.
6.0.103
ADDED
Added optional --scope <project_hrn> parameter for pipeline create, pipeline delete, pipeline list, pipeline show, pipeline update, pipeline template create, pipeline template delete, pipeline template<br/>list, pipeline template show, pipeline version activate, pipeline version<br/>cancel, pipeline version copy, pipeline version create, pipeline version<br/>deactivate, pipeline version delete, pipeline version list, pipeline<br/>version pause, pipeline version resume, pipeline version show and pipeline version upgrade to specify the project's scope.
6.0.103
ADDED
The schema commands now support HRNs with a realm.
6.0.103
ADDED
Added support of the new runtime environment (cluster type) batch-2.1.0 for the pipeline template create command.
6.0.103
ADDED
Added new commands to manage access to OLP projects: project access grant, project access revoke, project access list.
6.0.103
ADDED
Added new commands to manage administration of OLP projects: project admin add, project admin list, project admin remove.
6.0.103
ADDED
Added new commands to manage linked resources in OLP projects: project resources link, project resources unlink, project resources list.
6.0.103
ADDED
Added optional --scope <project_hrn> parameter for schema list, schema show, schema delete, schema get commands to specify the project's scope.
6.0.103
ADDED
Added one more schedule option to the pipeline version activate command. With the new --schedule time:cron-expression parameter, you can activate batch pipelines on a time-based schedule.
6.0.103
ADDED
Added optional --scope <project_hrn> parameter for api token get command to specify the project's scope and get a scoped token.
6.0.103
ADDED
Added an optional --processing <changes\|force> parameter to the pipeline version activate command. The new parameter describes the processing type for a time-based schedule. Use force to run immediately on the given cron schedule or changes (used by default) to first check for changes in the input catalog before running on the cron schedule. This parameter is only applicable for time-based scheduling, that is, when the --schedule time:cron-expression parameter is used.
6.0.103
ADDED
Added new commands to create and manage OLP projects: project create, project list, project update, project show and project delete.
6.0.103
CHANGED
Changed mandatory <groupId> to optional parameter for pipeline create, pipeline template create.
6.0.103
FIXED
Fixed an issue that caused the piped catalog show --json and catalog update --config - commands to return Requested Marketplace Catalog not found: HRN = <hrn> message.
6.0.103
FIXED
Fixed an issue that caused the pipeline version create command with --stream-config taskmanager.numberOfTaskSlots=2 parameter to fail validation in pipeline service with error "The value for slots must be an integer". The pipeline-service API expects value 2 as Integer, not as String.
6.0.103
FIXED
Fixed an issue with the pipeline version show command not showing the date of the next run attempt for time-based batch pipeline jobs.
6.0.103
FIXED
Fixed an issue that caused the olp pipeline version log level set command to ignore Log4j properties for parent loggers.
6.0.103
FIXED
Fixed broken help message formatting shown in case an invalid command is entered.
6.0.103
FIXED
Fixed incorrect handling of cyrillic symbols in catalog summary and description.
6.0.103
FIXED
Fixed an issue where the pipeline version job show or pipeline version job list command didn't show the time-schedule execution mode for time-based batch pipeline jobs.
6.0.103
KNOWN ISSUE
CI scripts parsing catalog HRNs from the olp catalog list command may fail after the 2.9 release. The reason is that the format of HRNs has changed. For more information please see OLP Release Announcements
6.0.103
KNOWN ISSUE
CI scripts parsing schema HRNs from the olp schema list command may fail after the 2.10 release. The reason is that the format of HRNs has changed. For more information please see OLP Release Announcements
6.0.103
KNOWN ISSUE
In the macOS Terminal application, the "Solarized Dark" color preset does not display output correctly. This is because the "bright black" color is the same as the Terminal's background.
6.0.103
KNOWN ISSUE
Currently, in the catalog layer stream get command, the --consumer-group option does not work. This issue will be addressed in a future release.
An existing pipeline environment for batch processing has been changed: batch-4.3 for batch environment with Spark 3.4.4 and Scala 2.13.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.5.20
ch.qos.logback
logback-core
1.5.20
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.13
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.13
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.github.java-diff-utils
java-diff-utils
4.15
io.netty
netty-all
4.1.126.Final
io.netty
netty-buffer
4.1.126.Final
io.netty
netty-codec
4.1.126.Final
io.netty
netty-codec-dns
4.1.126.Final
io.netty
netty-codec-http
4.1.126.Final
io.netty
netty-codec-http2
4.1.126.Final
io.netty
netty-codec-socks
4.1.126.Final
io.netty
netty-common
4.1.126.Final
io.netty
netty-handler
4.1.126.Final
io.netty
netty-handler-proxy
4.1.126.Final
io.netty
netty-resolver
4.1.126.Final
io.netty
netty-resolver-dns
4.1.126.Final
io.netty
netty-transport
4.1.126.Final
io.netty
netty-transport-classes-epoll
4.1.126.Final
io.netty
netty-transport-classes-kqueue
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-unix-common
4.1.126.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.java.dev.jna
jna
5.9.0
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-avro_2.13
3.4.4
org.apache.spark
spark-catalyst_2.13
3.4.4
org.apache.spark
spark-core_2.13
3.4.4
org.apache.spark
spark-graphx_2.13
3.4.4
org.apache.spark
spark-hive-thriftserver_2.13
3.4.4
org.apache.spark
spark-hive_2.13
3.4.4
org.apache.spark
spark-kubernetes_2.13
3.4.4
org.apache.spark
spark-kvstore_2.13
3.4.4
org.apache.spark
spark-launcher_2.13
3.4.4
org.apache.spark
spark-mesos_2.13
3.4.4
org.apache.spark
spark-mllib-local_2.13
3.4.4
org.apache.spark
spark-mllib_2.13
3.4.4
org.apache.spark
spark-network-common_2.13
3.4.4
org.apache.spark
spark-network-shuffle_2.13
3.4.4
org.apache.spark
spark-repl_2.13
3.4.4
org.apache.spark
spark-sketch_2.13
3.4.4
org.apache.spark
spark-sql_2.13
3.4.4
org.apache.spark
spark-streaming_2.13
3.4.4
org.apache.spark
spark-tags_2.13
3.4.4
org.apache.spark
spark-unsafe_2.13
3.4.4
org.apache.spark
spark-yarn_2.13
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jline
jline
3.21.0
org.jline
jline-builtins
3.21.0
org.jline
jline-reader
3.21.0
org.jline
jline-remote-ssh
3.21.0
org.jline
jline-remote-telnet
3.21.0
org.jline
jline-style
3.21.0
org.jline
jline-terminal
3.21.0
org.jline
jline-terminal-jansi
3.21.0
org.jline
jline-terminal-jna
3.21.0
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.13
3.7.0-M11
org.json4s
json4s-core_2.13
3.7.0-M11
org.json4s
json4s-jackson_2.13
3.7.0-M11
org.json4s
json4s-scalap_2.13
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.13.16
org.scala-lang
scala-reflect
2.13.16
org.scala-lang.modules
scala-collection-compat_2.13
2.7.0
org.scala-lang.modules
scala-parallel-collections_2.13
1.0.4
org.scala-lang.modules
scala-parser-combinators_2.13
2.1.1
org.scala-lang.modules
scala-xml_2.13
2.1.0
org.scalanlp
breeze-macros_2.13
2.1.0
org.scalanlp
breeze_2.13
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.13
2.8.0
org.typelevel
cats-kernel_2.13
2.8.0
org.typelevel
spire-macros_2.13
0.18.0
org.typelevel
spire-platform_2.13
0.18.0
org.typelevel
spire-util_2.13
0.18.0
org.typelevel
spire_2.13
0.18.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.3
DEPRECATED
Deprecated on 2026-01-01
With the introduction of a new pipeline environment for batch processing the following environment has been deprecated and will be removed after 12 months: batch-4.3 for batch environment with Spark 3.4.4 and Scala 2.13. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
5.0
ADDED
Added on 2025-11-25
A new pipeline environment for batch processing has been introduced: batch-5.0 for batch environment with Spark 4.0.1.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.epfl.scala
bsp4j
2.1.0-M5
ch.qos.logback
logback-classic
1.5.20
ch.qos.logback
logback-core
1.5.20
com.amazonaws
aws-java-sdk-core
1.12.781
com.amazonaws
aws-java-sdk-sts
1.12.781
com.clearspring.analytics
stream
2.9.8
com.esotericsoftware
kryo-shaded
4.0.3
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.18.2
com.fasterxml.jackson.core
jackson-core
2.18.2
com.fasterxml.jackson.core
jackson-databind
2.18.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.18.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.18.2
com.fasterxml.jackson.module
jackson-module-scala_2.13
2.18.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.javaparser
javaparser-core
3.2.12
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.6-9
com.github.wendykierp
JTransforms
3.1
com.google.android
annotations
4.1.1.4
com.google.api.grpc
proto-google-common-protos
2.41.0
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.11.0
com.google.crypto.tink
tink
1.16.0
com.google.errorprone
error_prone_annotations
2.36.0
com.google.flatbuffers
flatbuffers-java
24.3.25
com.google.guava
failureaccess
1.0.2
com.google.guava
guava
33.4.0-jre
com.google.guava
listenablefuture
9999.0-empty-to-avoid-conflict-with-guava
com.google.j2objc
j2objc-annotations
3.0.0
com.google.protobuf
protobuf-java-util
4.29.3
com.ibm.icu
icu4j
76.1
com.lihaoyi
ammonite-compiler-interface_2.13.16
3.0.1
com.lihaoyi
ammonite-compiler_2.13.16
3.0.1
com.lihaoyi
ammonite-interp-api_2.13.16
3.0.1
com.lihaoyi
ammonite-interp_2.13.16
3.0.1
com.lihaoyi
ammonite-repl-api_2.13.16
3.0.1
com.lihaoyi
ammonite-repl_2.13.16
3.0.1
com.lihaoyi
ammonite-runtime_2.13.16
3.0.1
com.lihaoyi
ammonite-terminal_2.13
3.0.1
com.lihaoyi
ammonite-util_2.13
3.0.1
com.lihaoyi
ammonite_2.13.16
3.0.1
com.lihaoyi
fansi_2.13
0.5.0
com.lihaoyi
fastparse_2.13
3.1.1
com.lihaoyi
geny_2.13
1.1.1
com.lihaoyi
mainargs_2.13
0.7.5
com.lihaoyi
os-lib_2.13
0.11.2
com.lihaoyi
pprint_2.13
0.9.0
com.lihaoyi
requests_2.13
0.9.0
com.lihaoyi
scalaparse_2.13
3.1.1
com.lihaoyi
sourcecode_2.13
0.4.3-M1
com.lihaoyi
ujson_2.13
4.0.2
com.lihaoyi
upack_2.13
4.0.2
com.lihaoyi
upickle-core_2.13
4.0.2
com.lihaoyi
upickle-implicits_2.13
4.0.2
com.lihaoyi
upickle_2.13
4.0.2
com.ning
compress-lzf
1.1.2
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
4.1.2
com.tdunning
json
1.8
com.thesamet.scalapb
lenses_2.13
0.11.17
com.thesamet.scalapb
scalapb-runtime_2.13
0.11.17
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.13
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.9.0
commons-codec
commons-codec
1.17.2
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.18.0
commons-lang
commons-lang
2.6
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
2.0.2
io.dropwizard.metrics
metrics-core
4.2.30
io.dropwizard.metrics
metrics-graphite
4.2.30
io.dropwizard.metrics
metrics-jmx
4.2.30
io.dropwizard.metrics
metrics-json
4.2.30
io.dropwizard.metrics
metrics-jvm
4.2.30
io.fabric8
kubernetes-client
7.1.0
io.fabric8
kubernetes-client-api
7.1.0
io.fabric8
kubernetes-httpclient-vertx
7.1.0
io.fabric8
kubernetes-model-admissionregistration
7.1.0
io.fabric8
kubernetes-model-apiextensions
7.1.0
io.fabric8
kubernetes-model-apps
7.1.0
io.fabric8
kubernetes-model-autoscaling
7.1.0
io.fabric8
kubernetes-model-batch
7.1.0
io.fabric8
kubernetes-model-certificates
7.1.0
io.fabric8
kubernetes-model-common
7.1.0
io.fabric8
kubernetes-model-coordination
7.1.0
io.fabric8
kubernetes-model-core
7.1.0
io.fabric8
kubernetes-model-discovery
7.1.0
io.fabric8
kubernetes-model-events
7.1.0
io.fabric8
kubernetes-model-extensions
7.1.0
io.fabric8
kubernetes-model-flowcontrol
7.1.0
io.fabric8
kubernetes-model-gatewayapi
7.1.0
io.fabric8
kubernetes-model-metrics
7.1.0
io.fabric8
kubernetes-model-networking
7.1.0
io.fabric8
kubernetes-model-node
7.1.0
io.fabric8
kubernetes-model-policy
7.1.0
io.fabric8
kubernetes-model-rbac
7.1.0
io.fabric8
kubernetes-model-resource
7.1.0
io.fabric8
kubernetes-model-scheduling
7.1.0
io.fabric8
kubernetes-model-storageclass
7.1.0
io.fabric8
zjsonpatch
7.1.0
io.get-coursier
class-path-util_2.13
0.1.4
io.get-coursier
dependency-interface_2.13
0.2.3
io.get-coursier
dependency_2.13
0.2.3
io.get-coursier
interface
1.0.19
io.github.java-diff-utils
java-diff-utils
4.15
io.jsonwebtoken
jjwt-api
0.12.6
io.jsonwebtoken
jjwt-impl
0.12.6
io.jsonwebtoken
jjwt-jackson
0.12.6
io.netty
netty-all
4.1.126.Final
io.netty
netty-buffer
4.1.126.Final
io.netty
netty-codec
4.1.126.Final
io.netty
netty-codec-dns
4.1.126.Final
io.netty
netty-codec-http
4.1.126.Final
io.netty
netty-codec-http2
4.1.126.Final
io.netty
netty-codec-socks
4.1.126.Final
io.netty
netty-common
4.1.126.Final
io.netty
netty-handler
4.1.126.Final
io.netty
netty-handler-proxy
4.1.126.Final
io.netty
netty-resolver
4.1.126.Final
io.netty
netty-resolver-dns
4.1.126.Final
io.netty
netty-tcnative-boringssl-static
2.0.73.Final
io.netty
netty-tcnative-boringssl-static
2.0.73.Final
io.netty
netty-tcnative-boringssl-static
2.0.73.Final
io.netty
netty-tcnative-boringssl-static
2.0.73.Final
io.netty
netty-tcnative-boringssl-static
2.0.73.Final
io.netty
netty-tcnative-classes
2.0.73.Final
io.netty
netty-transport
4.1.126.Final
io.netty
netty-transport-classes-epoll
4.1.126.Final
io.netty
netty-transport-classes-kqueue
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-unix-common
4.1.126.Final
io.vertx
vertx-auth-common
4.5.12
io.vertx
vertx-core
4.5.12
io.vertx
vertx-web-client
4.5.12
io.vertx
vertx-web-common
4.5.12
jakarta.activation
jakarta.activation-api
2.1.3
jakarta.annotation
jakarta.annotation-api
2.1.1
jakarta.inject
jakarta.inject-api
2.0.1
jakarta.servlet
jakarta.servlet-api
5.0.0
jakarta.validation
jakarta.validation-api
3.0.2
jakarta.ws.rs
jakarta.ws.rs-api
3.0.0
jakarta.xml.bind
jakarta.xml.bind-api
4.0.2
javax.jdo
jdo-api
3.0.1
javax.servlet
javax.servlet-api
4.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.13.0
net.openhft
zero-allocation-hashing
0.26ea0
net.razorvine
pickle
1.5
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.9
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.13.1
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
18.1.0
org.apache.arrow
arrow-memory-core
18.1.0
org.apache.arrow
arrow-memory-netty
18.1.0
org.apache.arrow
arrow-memory-netty-buffer-patch
18.1.0
org.apache.arrow
arrow-vector
18.1.0
org.apache.avro
avro
1.12.0
org.apache.avro
avro-ipc
1.12.0
org.apache.avro
avro-mapred
1.12.0
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.12.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.13.0
org.apache.curator
curator-client
5.7.1
org.apache.curator
curator-framework
5.7.1
org.apache.curator
curator-recipes
5.7.1
org.apache.datasketches
datasketches-java
6.1.1
org.apache.datasketches
datasketches-memory
3.0.2
org.apache.derby
derby
10.16.1.1
org.apache.derby
derbyshared
10.16.1.1
org.apache.derby
derbytools
10.16.1.1
org.apache.hadoop
hadoop-annotations
3.4.1
org.apache.hadoop
hadoop-auth
3.4.1
org.apache.hadoop
hadoop-aws
3.4.1
org.apache.hadoop
hadoop-client
3.4.1
org.apache.hadoop
hadoop-client-api
3.4.1
org.apache.hadoop
hadoop-client-runtime
3.4.1
org.apache.hadoop
hadoop-common
3.4.1
org.apache.hadoop
hadoop-hdfs-client
3.4.1
org.apache.hadoop
hadoop-mapreduce-client-common
3.4.1
org.apache.hadoop
hadoop-mapreduce-client-core
3.4.1
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.4.1
org.apache.hadoop
hadoop-yarn-api
3.4.1
org.apache.hadoop
hadoop-yarn-client
3.4.1
org.apache.hadoop
hadoop-yarn-common
3.4.1
org.apache.hive
hive-beeline
2.3.10
org.apache.hive
hive-cli
2.3.10
org.apache.hive
hive-common
2.3.10
org.apache.hive
hive-exec
2.3.10
org.apache.hive
hive-jdbc
2.3.10
org.apache.hive
hive-metastore
2.3.10
org.apache.hive
hive-serde
2.3.10
org.apache.hive
hive-service-rpc
4.0.0
org.apache.hive
hive-shims
2.3.10
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.10
org.apache.hive.shims
hive-shims-common
2.3.10
org.apache.hive.shims
hive-shims-scheduler
2.3.10
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.3
org.apache.logging.log4j
log4j-api
2.24.3
org.apache.logging.log4j
log4j-core
2.24.3
org.apache.logging.log4j
log4j-layout-template-json
2.24.3
org.apache.logging.log4j
log4j-to-slf4j
2.24.3
org.apache.orc
orc-core
2.1.3
org.apache.orc
orc-format
1.1.1
org.apache.orc
orc-mapreduce
2.1.3
org.apache.orc
orc-shims
2.1.3
org.apache.parquet
parquet-column
1.15.2
org.apache.parquet
parquet-common
1.15.2
org.apache.parquet
parquet-encoding
1.15.2
org.apache.parquet
parquet-format-structures
1.15.2
org.apache.parquet
parquet-hadoop
1.15.2
org.apache.parquet
parquet-jackson
1.15.2
org.apache.spark
spark-avro_2.13
4.0.1
org.apache.spark
spark-catalyst_2.13
4.0.1
org.apache.spark
spark-common-utils_2.13
4.0.1
org.apache.spark
spark-connect-client-jvm_2.13
4.0.1
org.apache.spark
spark-connect-common_2.13
4.0.1
org.apache.spark
spark-connect_2.13
4.0.1
org.apache.spark
spark-core_2.13
4.0.1
org.apache.spark
spark-graphx_2.13
4.0.1
org.apache.spark
spark-hive-thriftserver_2.13
4.0.1
org.apache.spark
spark-hive_2.13
4.0.1
org.apache.spark
spark-kubernetes_2.13
4.0.1
org.apache.spark
spark-kvstore_2.13
4.0.1
org.apache.spark
spark-launcher_2.13
4.0.1
org.apache.spark
spark-mllib-local_2.13
4.0.1
org.apache.spark
spark-mllib_2.13
4.0.1
org.apache.spark
spark-network-common_2.13
4.0.1
org.apache.spark
spark-network-shuffle_2.13
4.0.1
org.apache.spark
spark-repl_2.13
4.0.1
org.apache.spark
spark-sketch_2.13
4.0.1
org.apache.spark
spark-sql-api_2.13
4.0.1
org.apache.spark
spark-sql_2.13
4.0.1
org.apache.spark
spark-streaming_2.13
4.0.1
org.apache.spark
spark-tags_2.13
4.0.1
org.apache.spark
spark-unsafe_2.13
4.0.1
org.apache.spark
spark-variant_2.13
4.0.1
org.apache.spark
spark-yarn_2.13
4.0.1
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.16.0
org.apache.ws.xmlschema
xmlschema-core
2.3.1
org.apache.xbean
xbean-asm9-shaded
4.26
org.apache.yetus
audience-annotations
0.12.0
org.apache.zookeeper
zookeeper
3.9.3
org.apache.zookeeper
zookeeper-jute
3.9.3
org.bouncycastle
bcprov-jdk18on
1.80
org.checkerframework
checker-qual
3.43.0
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.mojo
animal-sniffer-annotations
1.24
org.codehaus.woodstox
stax2-api
4.2.2
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.eclipse.lsp4j
org.eclipse.lsp4j.generator
0.20.1
org.eclipse.lsp4j
org.eclipse.lsp4j.jsonrpc
0.20.1
org.eclipse.xtend
org.eclipse.xtend.lib
2.28.0
org.eclipse.xtend
org.eclipse.xtend.lib.macro
2.28.0
org.eclipse.xtext
org.eclipse.xtext.xbase.lib
2.28.0
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
3.0.6
org.glassfish.hk2
hk2-locator
3.0.6
org.glassfish.hk2
hk2-utils
3.0.6
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
3.0.6
org.glassfish.jaxb
jaxb-core
4.0.5
org.glassfish.jaxb
jaxb-runtime
4.0.5
org.glassfish.jersey.containers
jersey-container-servlet
3.0.16
org.glassfish.jersey.containers
jersey-container-servlet-core
3.0.16
org.glassfish.jersey.core
jersey-client
3.0.16
org.glassfish.jersey.core
jersey-common
3.0.16
org.glassfish.jersey.core
jersey-server
3.0.16
org.glassfish.jersey.inject
jersey-hk2
3.0.16
org.javassist
javassist
3.30.2-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jline
jansi-core
3.27.1
org.jline
jline
3.27.1
org.jline
jline-builtins
3.27.1
org.jline
jline-native
3.27.1
org.jline
jline-reader
3.27.1
org.jline
jline-remote-ssh
3.27.1
org.jline
jline-remote-telnet
3.27.1
org.jline
jline-style
3.27.1
org.jline
jline-terminal
3.27.1
org.jline
jline-terminal-ffm
3.27.1
org.jline
jline-terminal-jansi
3.27.1
org.jline
jline-terminal-jna
3.27.1
org.jline
jline-terminal-jni
3.27.1
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.13
4.0.7
org.json4s
json4s-core_2.13
4.0.7
org.json4s
json4s-jackson-core_2.13
4.0.7
org.json4s
json4s-jackson_2.13
4.0.7
org.json4s
json4s-scalap_2.13
4.0.7
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.3
org.roaringbitmap
RoaringBitmap
1.3.0
org.rocksdb
rocksdbjni
9.8.4
org.scala-lang
scala-library
2.13.16
org.scala-lang
scala-reflect
2.13.16
org.scala-lang.modules
scala-collection-compat_2.13
2.7.0
org.scala-lang.modules
scala-parallel-collections_2.13
1.2.0
org.scala-lang.modules
scala-parser-combinators_2.13
2.4.0
org.scala-lang.modules
scala-xml_2.13
2.3.0
org.scalameta
common_2.13
4.9.7
org.scalanlp
breeze-macros_2.13
2.1.0
org.scalanlp
breeze_2.13
2.1.0
org.slf4j
jcl-over-slf4j
2.0.16
org.slf4j
jul-to-slf4j
2.0.16
org.slf4j
log4j-over-slf4j
2.0.16
org.slf4j
slf4j-api
2.0.16
org.snakeyaml
snakeyaml-engine
2.9
org.threeten
threeten-extra
1.8.0
org.tpolecat
typename_2.13
1.1.0
org.tukaani
xz
1.10
org.typelevel
algebra_2.13
2.8.0
org.typelevel
cats-kernel_2.13
2.8.0
org.typelevel
spire-macros_2.13
0.18.0
org.typelevel
spire-platform_2.13
0.18.0
org.typelevel
spire-util_2.13
0.18.0
org.typelevel
spire_2.13
0.18.0
org.wildfly.common
wildfly-common
1.5.4.Final
org.wildfly.openssl
wildfly-openssl
2.2.5.Final
org.wildfly.openssl
wildfly-openssl-java
2.2.5.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
2.2.2.SP01
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
2.2.2.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
2.2.2.Final
org.xerial.snappy
snappy-java
1.1.10.7
org.yaml
snakeyaml
2.3
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
software.amazon.awssdk
bundle
2.24.6
stax
stax-api
1.0.1
4.3
ADDED
Added on 2025-10-28
A new pipeline environment for batch processing has been introduced: batch-4.3 for batch environment with Spark 3.4.4 and Scala 2.13.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.4.14
ch.qos.logback
logback-core
1.4.14
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.13
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.13
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.github.java-diff-utils
java-diff-utils
4.15
io.netty
netty-all
4.1.126.Final
io.netty
netty-buffer
4.1.126.Final
io.netty
netty-codec
4.1.126.Final
io.netty
netty-codec-dns
4.1.126.Final
io.netty
netty-codec-http
4.1.126.Final
io.netty
netty-codec-http2
4.1.126.Final
io.netty
netty-codec-socks
4.1.126.Final
io.netty
netty-common
4.1.126.Final
io.netty
netty-handler
4.1.126.Final
io.netty
netty-handler-proxy
4.1.126.Final
io.netty
netty-resolver
4.1.126.Final
io.netty
netty-resolver-dns
4.1.126.Final
io.netty
netty-transport
4.1.126.Final
io.netty
netty-transport-classes-epoll
4.1.126.Final
io.netty
netty-transport-classes-kqueue
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-unix-common
4.1.126.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.java.dev.jna
jna
5.9.0
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-avro_2.13
3.4.4
org.apache.spark
spark-catalyst_2.13
3.4.4
org.apache.spark
spark-core_2.13
3.4.4
org.apache.spark
spark-graphx_2.13
3.4.4
org.apache.spark
spark-hive-thriftserver_2.13
3.4.4
org.apache.spark
spark-hive_2.13
3.4.4
org.apache.spark
spark-kubernetes_2.13
3.4.4
org.apache.spark
spark-kvstore_2.13
3.4.4
org.apache.spark
spark-launcher_2.13
3.4.4
org.apache.spark
spark-mesos_2.13
3.4.4
org.apache.spark
spark-mllib-local_2.13
3.4.4
org.apache.spark
spark-mllib_2.13
3.4.4
org.apache.spark
spark-network-common_2.13
3.4.4
org.apache.spark
spark-network-shuffle_2.13
3.4.4
org.apache.spark
spark-repl_2.13
3.4.4
org.apache.spark
spark-sketch_2.13
3.4.4
org.apache.spark
spark-sql_2.13
3.4.4
org.apache.spark
spark-streaming_2.13
3.4.4
org.apache.spark
spark-tags_2.13
3.4.4
org.apache.spark
spark-unsafe_2.13
3.4.4
org.apache.spark
spark-yarn_2.13
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jline
jline
3.21.0
org.jline
jline-builtins
3.21.0
org.jline
jline-reader
3.21.0
org.jline
jline-remote-ssh
3.21.0
org.jline
jline-remote-telnet
3.21.0
org.jline
jline-style
3.21.0
org.jline
jline-terminal
3.21.0
org.jline
jline-terminal-jansi
3.21.0
org.jline
jline-terminal-jna
3.21.0
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.13
3.7.0-M11
org.json4s
json4s-core_2.13
3.7.0-M11
org.json4s
json4s-jackson_2.13
3.7.0-M11
org.json4s
json4s-scalap_2.13
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.13.16
org.scala-lang
scala-reflect
2.13.16
org.scala-lang.modules
scala-collection-compat_2.13
2.7.0
org.scala-lang.modules
scala-parallel-collections_2.13
1.0.4
org.scala-lang.modules
scala-parser-combinators_2.13
2.1.1
org.scala-lang.modules
scala-xml_2.13
2.1.0
org.scalanlp
breeze-macros_2.13
2.1.0
org.scalanlp
breeze_2.13
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.13
2.8.0
org.typelevel
cats-kernel_2.13
2.8.0
org.typelevel
spire-macros_2.13
0.18.0
org.typelevel
spire-platform_2.13
0.18.0
org.typelevel
spire-util_2.13
0.18.0
org.typelevel
spire_2.13
0.18.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.0
CHANGED
Updated on 2025-09-29
An existing pipeline environment for batch processing has been changed: batch-4.0 for batch environment with Spark 3.4.4.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.3.14
ch.qos.logback
logback-core
1.3.14
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.126.Final
io.netty
netty-buffer
4.1.126.Final
io.netty
netty-codec
4.1.126.Final
io.netty
netty-codec-dns
4.1.126.Final
io.netty
netty-codec-http
4.1.126.Final
io.netty
netty-codec-http2
4.1.126.Final
io.netty
netty-codec-socks
4.1.126.Final
io.netty
netty-common
4.1.126.Final
io.netty
netty-handler
4.1.126.Final
io.netty
netty-handler-proxy
4.1.126.Final
io.netty
netty-resolver
4.1.126.Final
io.netty
netty-resolver-dns
4.1.126.Final
io.netty
netty-transport
4.1.126.Final
io.netty
netty-transport-classes-epoll
4.1.126.Final
io.netty
netty-transport-classes-kqueue
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-unix-common
4.1.126.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-avro_2.12
3.4.4
org.apache.spark
spark-catalyst_2.12
3.4.4
org.apache.spark
spark-core_2.12
3.4.4
org.apache.spark
spark-graphx_2.12
3.4.4
org.apache.spark
spark-hive-thriftserver_2.12
3.4.4
org.apache.spark
spark-hive_2.12
3.4.4
org.apache.spark
spark-kubernetes_2.12
3.4.4
org.apache.spark
spark-kvstore_2.12
3.4.4
org.apache.spark
spark-launcher_2.12
3.4.4
org.apache.spark
spark-mesos_2.12
3.4.4
org.apache.spark
spark-mllib-local_2.12
3.4.4
org.apache.spark
spark-mllib_2.12
3.4.4
org.apache.spark
spark-network-common_2.12
3.4.4
org.apache.spark
spark-network-shuffle_2.12
3.4.4
org.apache.spark
spark-repl_2.12
3.4.4
org.apache.spark
spark-sketch_2.12
3.4.4
org.apache.spark
spark-sql_2.12
3.4.4
org.apache.spark
spark-streaming_2.12
3.4.4
org.apache.spark
spark-tags_2.12
3.4.4
org.apache.spark
spark-unsafe_2.12
3.4.4
org.apache.spark
spark-yarn_2.12
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.1
CHANGED
Updated on 2025-11-25
An existing pipeline environment for batch processing has been changed: batch-4.1 for batch environment with Spark 3.4.4.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.5.20
ch.qos.logback
logback-core
1.5.20
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.126.Final
io.netty
netty-buffer
4.1.126.Final
io.netty
netty-codec
4.1.126.Final
io.netty
netty-codec-dns
4.1.126.Final
io.netty
netty-codec-http
4.1.126.Final
io.netty
netty-codec-http2
4.1.126.Final
io.netty
netty-codec-socks
4.1.126.Final
io.netty
netty-common
4.1.126.Final
io.netty
netty-handler
4.1.126.Final
io.netty
netty-handler-proxy
4.1.126.Final
io.netty
netty-resolver
4.1.126.Final
io.netty
netty-resolver-dns
4.1.126.Final
io.netty
netty-transport
4.1.126.Final
io.netty
netty-transport-classes-epoll
4.1.126.Final
io.netty
netty-transport-classes-kqueue
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-unix-common
4.1.126.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-avro_2.12
3.4.4
org.apache.spark
spark-catalyst_2.12
3.4.4
org.apache.spark
spark-core_2.12
3.4.4
org.apache.spark
spark-graphx_2.12
3.4.4
org.apache.spark
spark-hive-thriftserver_2.12
3.4.4
org.apache.spark
spark-hive_2.12
3.4.4
org.apache.spark
spark-kubernetes_2.12
3.4.4
org.apache.spark
spark-kvstore_2.12
3.4.4
org.apache.spark
spark-launcher_2.12
3.4.4
org.apache.spark
spark-mesos_2.12
3.4.4
org.apache.spark
spark-mllib-local_2.12
3.4.4
org.apache.spark
spark-mllib_2.12
3.4.4
org.apache.spark
spark-network-common_2.12
3.4.4
org.apache.spark
spark-network-shuffle_2.12
3.4.4
org.apache.spark
spark-repl_2.12
3.4.4
org.apache.spark
spark-sketch_2.12
3.4.4
org.apache.spark
spark-sql_2.12
3.4.4
org.apache.spark
spark-streaming_2.12
3.4.4
org.apache.spark
spark-tags_2.12
3.4.4
org.apache.spark
spark-unsafe_2.12
3.4.4
org.apache.spark
spark-yarn_2.12
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.1
DEPRECATED
Deprecated on 2025-12-01
With the introduction of a new pipeline environment for batch processing the following environment has been deprecated and will be removed after 12 months: batch-4.1 for batch environment with Spark 3.4.4 and Scala 2.12. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
4.1
CHANGED
Updated on 2025-09-29
An existing pipeline environment for batch processing has been changed: batch-4.1 for batch environment with Spark 3.4.4.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.4.14
ch.qos.logback
logback-core
1.4.14
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.126.Final
io.netty
netty-buffer
4.1.126.Final
io.netty
netty-codec
4.1.126.Final
io.netty
netty-codec-dns
4.1.126.Final
io.netty
netty-codec-http
4.1.126.Final
io.netty
netty-codec-http2
4.1.126.Final
io.netty
netty-codec-socks
4.1.126.Final
io.netty
netty-common
4.1.126.Final
io.netty
netty-handler
4.1.126.Final
io.netty
netty-handler-proxy
4.1.126.Final
io.netty
netty-resolver
4.1.126.Final
io.netty
netty-resolver-dns
4.1.126.Final
io.netty
netty-transport
4.1.126.Final
io.netty
netty-transport-classes-epoll
4.1.126.Final
io.netty
netty-transport-classes-kqueue
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-epoll
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-kqueue
4.1.126.Final
io.netty
netty-transport-native-unix-common
4.1.126.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-avro_2.12
3.4.4
org.apache.spark
spark-catalyst_2.12
3.4.4
org.apache.spark
spark-core_2.12
3.4.4
org.apache.spark
spark-graphx_2.12
3.4.4
org.apache.spark
spark-hive-thriftserver_2.12
3.4.4
org.apache.spark
spark-hive_2.12
3.4.4
org.apache.spark
spark-kubernetes_2.12
3.4.4
org.apache.spark
spark-kvstore_2.12
3.4.4
org.apache.spark
spark-launcher_2.12
3.4.4
org.apache.spark
spark-mesos_2.12
3.4.4
org.apache.spark
spark-mllib-local_2.12
3.4.4
org.apache.spark
spark-mllib_2.12
3.4.4
org.apache.spark
spark-network-common_2.12
3.4.4
org.apache.spark
spark-network-shuffle_2.12
3.4.4
org.apache.spark
spark-repl_2.12
3.4.4
org.apache.spark
spark-sketch_2.12
3.4.4
org.apache.spark
spark-sql_2.12
3.4.4
org.apache.spark
spark-streaming_2.12
3.4.4
org.apache.spark
spark-tags_2.12
3.4.4
org.apache.spark
spark-unsafe_2.12
3.4.4
org.apache.spark
spark-yarn_2.12
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.1
CHANGED
Updated on 2025-07-16
An existing pipeline environment for batch processing has been changed: batch-4.1 for batch environment with Spark 3.4.4.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.4.14
ch.qos.logback
logback-core
1.4.14
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.118.Final
io.netty
netty-buffer
4.1.118.Final
io.netty
netty-codec
4.1.118.Final
io.netty
netty-codec-http
4.1.118.Final
io.netty
netty-codec-http2
4.1.118.Final
io.netty
netty-codec-socks
4.1.118.Final
io.netty
netty-common
4.1.118.Final
io.netty
netty-handler
4.1.118.Final
io.netty
netty-handler-proxy
4.1.118.Final
io.netty
netty-resolver
4.1.118.Final
io.netty
netty-transport
4.1.118.Final
io.netty
netty-transport-classes-epoll
4.1.118.Final
io.netty
netty-transport-classes-kqueue
4.1.118.Final
io.netty
netty-transport-native-epoll
4.1.118.Final
io.netty
netty-transport-native-epoll
4.1.118.Final
io.netty
netty-transport-native-kqueue
4.1.118.Final
io.netty
netty-transport-native-kqueue
4.1.118.Final
io.netty
netty-transport-native-unix-common
4.1.118.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-avro_2.12
3.4.4
org.apache.spark
spark-catalyst_2.12
3.4.4
org.apache.spark
spark-core_2.12
3.4.4
org.apache.spark
spark-graphx_2.12
3.4.4
org.apache.spark
spark-hive-thriftserver_2.12
3.4.4
org.apache.spark
spark-hive_2.12
3.4.4
org.apache.spark
spark-kubernetes_2.12
3.4.4
org.apache.spark
spark-kvstore_2.12
3.4.4
org.apache.spark
spark-launcher_2.12
3.4.4
org.apache.spark
spark-mesos_2.12
3.4.4
org.apache.spark
spark-mllib-local_2.12
3.4.4
org.apache.spark
spark-mllib_2.12
3.4.4
org.apache.spark
spark-network-common_2.12
3.4.4
org.apache.spark
spark-network-shuffle_2.12
3.4.4
org.apache.spark
spark-repl_2.12
3.4.4
org.apache.spark
spark-sketch_2.12
3.4.4
org.apache.spark
spark-sql_2.12
3.4.4
org.apache.spark
spark-streaming_2.12
3.4.4
org.apache.spark
spark-tags_2.12
3.4.4
org.apache.spark
spark-unsafe_2.12
3.4.4
org.apache.spark
spark-yarn_2.12
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.0
DEPRECATED
Deprecated on 2025-07-01
With the introduction of a new pipeline environment for batch processing the following environment has been deprecated and will be removed after 12 months: batch-4.0 for batch environment with Spark 3.4.4. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
4.1
ADDED
Added on 2025-05-28
A new pipeline environment for batch processing has been introduced: batch-4.1 for batch environment with Spark 3.4.4 and Java 17.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.4.14
ch.qos.logback
logback-core
1.4.14
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.118.Final
io.netty
netty-buffer
4.1.118.Final
io.netty
netty-codec
4.1.118.Final
io.netty
netty-codec-http
4.1.118.Final
io.netty
netty-codec-http2
4.1.118.Final
io.netty
netty-codec-socks
4.1.118.Final
io.netty
netty-common
4.1.118.Final
io.netty
netty-handler
4.1.118.Final
io.netty
netty-handler-proxy
4.1.118.Final
io.netty
netty-resolver
4.1.118.Final
io.netty
netty-transport
4.1.118.Final
io.netty
netty-transport-classes-epoll
4.1.118.Final
io.netty
netty-transport-classes-kqueue
4.1.118.Final
io.netty
netty-transport-native-epoll
4.1.118.Final
io.netty
netty-transport-native-epoll
4.1.118.Final
io.netty
netty-transport-native-kqueue
4.1.118.Final
io.netty
netty-transport-native-kqueue
4.1.118.Final
io.netty
netty-transport-native-unix-common
4.1.118.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-catalyst_2.12
3.4.4
org.apache.spark
spark-core_2.12
3.4.4
org.apache.spark
spark-graphx_2.12
3.4.4
org.apache.spark
spark-hive-thriftserver_2.12
3.4.4
org.apache.spark
spark-hive_2.12
3.4.4
org.apache.spark
spark-kubernetes_2.12
3.4.4
org.apache.spark
spark-kvstore_2.12
3.4.4
org.apache.spark
spark-launcher_2.12
3.4.4
org.apache.spark
spark-mesos_2.12
3.4.4
org.apache.spark
spark-mllib-local_2.12
3.4.4
org.apache.spark
spark-mllib_2.12
3.4.4
org.apache.spark
spark-network-common_2.12
3.4.4
org.apache.spark
spark-network-shuffle_2.12
3.4.4
org.apache.spark
spark-repl_2.12
3.4.4
org.apache.spark
spark-sketch_2.12
3.4.4
org.apache.spark
spark-sql_2.12
3.4.4
org.apache.spark
spark-streaming_2.12
3.4.4
org.apache.spark
spark-tags_2.12
3.4.4
org.apache.spark
spark-unsafe_2.12
3.4.4
org.apache.spark
spark-yarn_2.12
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.0
CHANGED
Updated on 2025-03-31
An existing pipeline environment for batch processing has been changed: batch-4.0 for batch environment with Spark 3.4.4.
Please visit official Apache Spark documentation page to check Spark 3.4.4 release notes.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.3.14
ch.qos.logback
logback-core
1.3.14
com.amazonaws
aws-java-sdk-bundle
1.12.781
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.118.Final
io.netty
netty-buffer
4.1.118.Final
io.netty
netty-codec
4.1.118.Final
io.netty
netty-codec-http
4.1.118.Final
io.netty
netty-codec-http2
4.1.118.Final
io.netty
netty-codec-socks
4.1.118.Final
io.netty
netty-common
4.1.118.Final
io.netty
netty-handler
4.1.118.Final
io.netty
netty-handler-proxy
4.1.118.Final
io.netty
netty-resolver
4.1.118.Final
io.netty
netty-transport
4.1.118.Final
io.netty
netty-transport-classes-epoll
4.1.118.Final
io.netty
netty-transport-classes-kqueue
4.1.118.Final
io.netty
netty-transport-native-epoll
4.1.118.Final
io.netty
netty-transport-native-epoll
4.1.118.Final
io.netty
netty-transport-native-kqueue
4.1.118.Final
io.netty
netty-transport-native-kqueue
4.1.118.Final
io.netty
netty-transport-native-unix-common
4.1.118.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-catalyst_2.12
3.4.4
org.apache.spark
spark-core_2.12
3.4.4
org.apache.spark
spark-graphx_2.12
3.4.4
org.apache.spark
spark-hive-thriftserver_2.12
3.4.4
org.apache.spark
spark-hive_2.12
3.4.4
org.apache.spark
spark-kubernetes_2.12
3.4.4
org.apache.spark
spark-kvstore_2.12
3.4.4
org.apache.spark
spark-launcher_2.12
3.4.4
org.apache.spark
spark-mesos_2.12
3.4.4
org.apache.spark
spark-mllib-local_2.12
3.4.4
org.apache.spark
spark-mllib_2.12
3.4.4
org.apache.spark
spark-network-common_2.12
3.4.4
org.apache.spark
spark-network-shuffle_2.12
3.4.4
org.apache.spark
spark-repl_2.12
3.4.4
org.apache.spark
spark-sketch_2.12
3.4.4
org.apache.spark
spark-sql_2.12
3.4.4
org.apache.spark
spark-streaming_2.12
3.4.4
org.apache.spark
spark-tags_2.12
3.4.4
org.apache.spark
spark-unsafe_2.12
3.4.4
org.apache.spark
spark-yarn_2.12
3.4.4
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
3.0
REMOVED
Removed on 2025-02-25
The deprecated pipeline environment batch-3.0 for batch processing with Spark 2.4.7 has been removed. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
2.1.0
REMOVED
Removed on 2025-02-25
The deprecated pipeline environment batch-2.1.0 for batch processing with Spark 2.4.2 has been removed. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
2.0.0
REMOVED
Removed on 2025-02-25
The deprecated pipeline environment batch-2.0.0 for batch processing with Spark 2.4.2 has been removed. For more information on how to migrate to the latest pipeline environment, please refer to this migration guide.
4.0
CHANGED
Updated on 2025-02-25
An existing pipeline environment for batch processing has been changed: batch-4.0 for batch environment with Spark 3.4.3.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.3.14
ch.qos.logback
logback-core
1.3.14
com.amazonaws
aws-java-sdk-bundle
1.12.638
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.17.1
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.16.1
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.27
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.113.Final
io.netty
netty-buffer
4.1.113.Final
io.netty
netty-codec
4.1.113.Final
io.netty
netty-codec-http
4.1.113.Final
io.netty
netty-codec-http2
4.1.113.Final
io.netty
netty-codec-socks
4.1.113.Final
io.netty
netty-common
4.1.113.Final
io.netty
netty-handler
4.1.113.Final
io.netty
netty-handler-proxy
4.1.113.Final
io.netty
netty-resolver
4.1.113.Final
io.netty
netty-transport
4.1.113.Final
io.netty
netty-transport-classes-epoll
4.1.113.Final
io.netty
netty-transport-classes-kqueue
4.1.113.Final
io.netty
netty-transport-native-epoll
4.1.113.Final
io.netty
netty-transport-native-epoll
4.1.113.Final
io.netty
netty-transport-native-kqueue
4.1.113.Final
io.netty
netty-transport-native-kqueue
4.1.113.Final
io.netty
netty-transport-native-unix-common
4.1.113.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.4
org.apache.avro
avro-ipc
1.11.4
org.apache.avro
avro-mapred
1.11.4
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.27.1
org.apache.commons
commons-configuration2
2.11.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.17.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.12.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-catalyst_2.12
3.4.3
org.apache.spark
spark-core_2.12
3.4.3
org.apache.spark
spark-graphx_2.12
3.4.3
org.apache.spark
spark-hive-thriftserver_2.12
3.4.3
org.apache.spark
spark-hive_2.12
3.4.3
org.apache.spark
spark-kubernetes_2.12
3.4.3
org.apache.spark
spark-kvstore_2.12
3.4.3
org.apache.spark
spark-launcher_2.12
3.4.3
org.apache.spark
spark-mesos_2.12
3.4.3
org.apache.spark
spark-mllib-local_2.12
3.4.3
org.apache.spark
spark-mllib_2.12
3.4.3
org.apache.spark
spark-network-common_2.12
3.4.3
org.apache.spark
spark-network-shuffle_2.12
3.4.3
org.apache.spark
spark-repl_2.12
3.4.3
org.apache.spark
spark-sketch_2.12
3.4.3
org.apache.spark
spark-sql_2.12
3.4.3
org.apache.spark
spark-streaming_2.12
3.4.3
org.apache.spark
spark-tags_2.12
3.4.3
org.apache.spark
spark-unsafe_2.12
3.4.3
org.apache.spark
spark-yarn_2.12
3.4.3
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
4.0.5
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.0
CHANGED
Updated on 2024-06-26
An existing pipeline environment for batch processing has been changed: batch-4.0 for batch environment with Spark 3.4.3.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.3.14
ch.qos.logback
logback-core
1.3.14
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.15
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.11.0
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.21
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.87.Final
io.netty
netty-buffer
4.1.87.Final
io.netty
netty-codec
4.1.87.Final
io.netty
netty-codec-http
4.1.87.Final
io.netty
netty-codec-http2
4.1.87.Final
io.netty
netty-codec-socks
4.1.87.Final
io.netty
netty-common
4.1.87.Final
io.netty
netty-handler
4.1.87.Final
io.netty
netty-handler-proxy
4.1.87.Final
io.netty
netty-resolver
4.1.87.Final
io.netty
netty-transport
4.1.87.Final
io.netty
netty-transport-classes-epoll
4.1.87.Final
io.netty
netty-transport-classes-kqueue
4.1.87.Final
io.netty
netty-transport-native-epoll
4.1.87.Final
io.netty
netty-transport-native-epoll
4.1.87.Final
io.netty
netty-transport-native-kqueue
4.1.87.Final
io.netty
netty-transport-native-kqueue
4.1.87.Final
io.netty
netty-transport-native-unix-common
4.1.87.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.3
org.apache.avro
avro-ipc
1.11.3
org.apache.avro
avro-mapred
1.11.3
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.22
org.apache.commons
commons-configuration2
2.8.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.12.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.7
org.apache.orc
orc-mapreduce
1.8.7
org.apache.orc
orc-shims
1.8.7
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-catalyst_2.12
3.4.3
org.apache.spark
spark-core_2.12
3.4.3
org.apache.spark
spark-graphx_2.12
3.4.3
org.apache.spark
spark-hive-thriftserver_2.12
3.4.3
org.apache.spark
spark-hive_2.12
3.4.3
org.apache.spark
spark-kubernetes_2.12
3.4.3
org.apache.spark
spark-kvstore_2.12
3.4.3
org.apache.spark
spark-launcher_2.12
3.4.3
org.apache.spark
spark-mesos_2.12
3.4.3
org.apache.spark
spark-mllib-local_2.12
3.4.3
org.apache.spark
spark-mllib_2.12
3.4.3
org.apache.spark
spark-network-common_2.12
3.4.3
org.apache.spark
spark-network-shuffle_2.12
3.4.3
org.apache.spark
spark-repl_2.12
3.4.3
org.apache.spark
spark-sketch_2.12
3.4.3
org.apache.spark
spark-sql_2.12
3.4.3
org.apache.spark
spark-streaming_2.12
3.4.3
org.apache.spark
spark-tags_2.12
3.4.3
org.apache.spark
spark-unsafe_2.12
3.4.3
org.apache.spark
spark-yarn_2.12
3.4.3
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
3.1.0
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.5
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.0
CHANGED
Updated on 2024-03-21
An existing pipeline environment for batch processing has been changed: batch-4.0 for batch environment with Spark 3.4.2.
The following lists all dependencies provided by this pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.3.14
ch.qos.logback
logback-core
1.3.14
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.15
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.11.0
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.21
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.87.Final
io.netty
netty-buffer
4.1.87.Final
io.netty
netty-codec
4.1.87.Final
io.netty
netty-codec-http
4.1.87.Final
io.netty
netty-codec-http2
4.1.87.Final
io.netty
netty-codec-socks
4.1.87.Final
io.netty
netty-common
4.1.87.Final
io.netty
netty-handler
4.1.87.Final
io.netty
netty-handler-proxy
4.1.87.Final
io.netty
netty-resolver
4.1.87.Final
io.netty
netty-transport
4.1.87.Final
io.netty
netty-transport-classes-epoll
4.1.87.Final
io.netty
netty-transport-classes-kqueue
4.1.87.Final
io.netty
netty-transport-native-epoll
4.1.87.Final
io.netty
netty-transport-native-epoll
4.1.87.Final
io.netty
netty-transport-native-kqueue
4.1.87.Final
io.netty
netty-transport-native-kqueue
4.1.87.Final
io.netty
netty-transport-native-unix-common
4.1.87.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.3
org.apache.avro
avro-ipc
1.11.3
org.apache.avro
avro-mapred
1.11.3
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.22
org.apache.commons
commons-configuration2
2.8.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.12.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.6
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.2
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.6
org.apache.orc
orc-mapreduce
1.8.6
org.apache.orc
orc-shims
1.8.6
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.13.0
org.apache.spark
spark-catalyst_2.12
3.4.2
org.apache.spark
spark-core_2.12
3.4.2
org.apache.spark
spark-graphx_2.12
3.4.2
org.apache.spark
spark-hive-thriftserver_2.12
3.4.2
org.apache.spark
spark-hive_2.12
3.4.2
org.apache.spark
spark-kubernetes_2.12
3.4.2
org.apache.spark
spark-kvstore_2.12
3.4.2
org.apache.spark
spark-launcher_2.12
3.4.2
org.apache.spark
spark-mesos_2.12
3.4.2
org.apache.spark
spark-mllib-local_2.12
3.4.2
org.apache.spark
spark-mllib_2.12
3.4.2
org.apache.spark
spark-network-common_2.12
3.4.2
org.apache.spark
spark-network-shuffle_2.12
3.4.2
org.apache.spark
spark-repl_2.12
3.4.2
org.apache.spark
spark-sketch_2.12
3.4.2
org.apache.spark
spark-sql_2.12
3.4.2
org.apache.spark
spark-streaming_2.12
3.4.2
org.apache.spark
spark-tags_2.12
3.4.2
org.apache.spark
spark-unsafe_2.12
3.4.2
org.apache.spark
spark-yarn_2.12
3.4.2
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
3.1.0
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.4
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
4.0
ADDED
Added on 2023-12-19
A new pipeline environment for batch processing has been introduced: batch-4.0 for batch environment with spark 3.4.1.
The following lists all dependencies provided by this new pipeline environment:
Group ID
Artifact ID
Version
ch.qos.logback
logback-classic
1.3.8
ch.qos.logback
logback-core
1.3.8
com.clearspring.analytics
stream
2.9.6
com.esotericsoftware
kryo-shaded
4.0.2
com.esotericsoftware
minlog
1.3.0
com.esotericsoftware
reflectasm
1.11.3
com.fasterxml.jackson.core
jackson-annotations
2.14.2
com.fasterxml.jackson.core
jackson-core
2.14.2
com.fasterxml.jackson.core
jackson-databind
2.14.2
com.fasterxml.jackson.dataformat
jackson-dataformat-yaml
2.14.2
com.fasterxml.jackson.datatype
jackson-datatype-jsr310
2.14.2
com.fasterxml.jackson.module
jackson-module-scala_2.12
2.14.2
com.fasterxml.woodstox
woodstox-core
5.4.0
com.github.joshelser
dropwizard-metrics-hadoop-metrics2-reporter
0.1.2
com.github.luben
zstd-jni
1.5.2-5
com.github.wendykierp
JTransforms
3.1
com.google.code.findbugs
jsr305
3.0.0
com.google.code.gson
gson
2.8.9
com.google.crypto.tink
tink
1.7.0
com.google.flatbuffers
flatbuffers-java
1.12.0
com.google.guava
failureaccess
1.0.1
com.google.guava
guava
32.1.1-jre
com.google.protobuf
protobuf-java
2.5.0
com.jolbox
bonecp
0.8.0.RELEASE
com.ning
compress-lzf
1.1.2
com.squareup.okhttp3
logging-interceptor
4.12.0
com.squareup.okhttp3
okhttp
4.12.0
com.squareup.okio
okio
3.6.0
com.squareup.okio
okio-jvm
3.6.0
com.sun.istack
istack-commons-runtime
3.0.8
com.tdunning
json
1.8
com.thoughtworks.paranamer
paranamer
2.8
com.twitter
chill-java
0.10.0
com.twitter
chill_2.12
0.10.0
com.univocity
univocity-parsers
2.9.1
com.zaxxer
HikariCP
4.0.3
commons-cli
commons-cli
1.5.0
commons-codec
commons-codec
1.15
commons-collections
commons-collections
3.2.2
commons-dbcp
commons-dbcp
1.4
commons-io
commons-io
2.11.0
commons-lang
commons-lang
2.6
commons-logging
commons-logging
1.1.3
commons-pool
commons-pool
1.5.4
dev.ludovic.netlib
arpack
3.0.3
dev.ludovic.netlib
blas
3.0.3
dev.ludovic.netlib
lapack
3.0.3
io.airlift
aircompressor
0.21
io.dropwizard.metrics
metrics-core
4.2.15
io.dropwizard.metrics
metrics-graphite
4.2.15
io.dropwizard.metrics
metrics-jmx
4.2.15
io.dropwizard.metrics
metrics-json
4.2.15
io.dropwizard.metrics
metrics-jvm
4.2.15
io.fabric8
kubernetes-client
6.4.1
io.fabric8
kubernetes-client-api
6.4.1
io.fabric8
kubernetes-httpclient-okhttp
6.4.1
io.fabric8
kubernetes-model-admissionregistration
6.4.1
io.fabric8
kubernetes-model-apiextensions
6.4.1
io.fabric8
kubernetes-model-apps
6.4.1
io.fabric8
kubernetes-model-autoscaling
6.4.1
io.fabric8
kubernetes-model-batch
6.4.1
io.fabric8
kubernetes-model-certificates
6.4.1
io.fabric8
kubernetes-model-common
6.4.1
io.fabric8
kubernetes-model-coordination
6.4.1
io.fabric8
kubernetes-model-core
6.4.1
io.fabric8
kubernetes-model-discovery
6.4.1
io.fabric8
kubernetes-model-events
6.4.1
io.fabric8
kubernetes-model-extensions
6.4.1
io.fabric8
kubernetes-model-flowcontrol
6.4.1
io.fabric8
kubernetes-model-gatewayapi
6.4.1
io.fabric8
kubernetes-model-metrics
6.4.1
io.fabric8
kubernetes-model-networking
6.4.1
io.fabric8
kubernetes-model-node
6.4.1
io.fabric8
kubernetes-model-policy
6.4.1
io.fabric8
kubernetes-model-rbac
6.4.1
io.fabric8
kubernetes-model-scheduling
6.4.1
io.fabric8
kubernetes-model-storageclass
6.4.1
io.fabric8
zjsonpatch
0.3.0
io.netty
netty-all
4.1.87.Final
io.netty
netty-buffer
4.1.87.Final
io.netty
netty-codec
4.1.87.Final
io.netty
netty-codec-http
4.1.87.Final
io.netty
netty-codec-http2
4.1.87.Final
io.netty
netty-codec-socks
4.1.87.Final
io.netty
netty-common
4.1.87.Final
io.netty
netty-handler
4.1.87.Final
io.netty
netty-handler-proxy
4.1.87.Final
io.netty
netty-resolver
4.1.87.Final
io.netty
netty-transport
4.1.87.Final
io.netty
netty-transport-classes-epoll
4.1.87.Final
io.netty
netty-transport-classes-kqueue
4.1.87.Final
io.netty
netty-transport-native-epoll
4.1.87.Final
io.netty
netty-transport-native-epoll
4.1.87.Final
io.netty
netty-transport-native-kqueue
4.1.87.Final
io.netty
netty-transport-native-kqueue
4.1.87.Final
io.netty
netty-transport-native-unix-common
4.1.87.Final
jakarta.annotation
jakarta.annotation-api
1.3.5
jakarta.servlet
jakarta.servlet-api
4.0.3
jakarta.validation
jakarta.validation-api
2.0.2
jakarta.ws.rs
jakarta.ws.rs-api
2.1.6
jakarta.xml.bind
jakarta.xml.bind-api
2.3.2
javax.activation
activation
1.1.1
javax.jdo
jdo-api
3.0.1
javax.transaction
jta
1.1
javax.transaction
transaction-api
1.1
javolution
javolution
5.5.1
jline
jline
2.14.6
joda-time
joda-time
2.12.2
net.openhft
zero-allocation-hashing
0.9
net.razorvine
pickle
1.3
net.sf.jpam
jpam
1.1
net.sf.opencsv
opencsv
2.3
net.sf.py4j
py4j
0.10.9.7
net.sf.supercsv
super-csv
2.2.0
net.sourceforge.f2j
arpack_combined_all
0.1
org.antlr
antlr-runtime
3.5.2
org.antlr
antlr4-runtime
4.9.3
org.antlr
ST4
4.0.4
org.apache.arrow
arrow-format
11.0.0
org.apache.arrow
arrow-memory-core
11.0.0
org.apache.arrow
arrow-memory-netty
11.0.0
org.apache.arrow
arrow-vector
11.0.0
org.apache.avro
avro
1.11.2
org.apache.avro
avro-ipc
1.11.2
org.apache.avro
avro-mapred
1.11.2
org.apache.commons
commons-collections4
4.4
org.apache.commons
commons-compress
1.22
org.apache.commons
commons-configuration2
2.8.0
org.apache.commons
commons-crypto
1.1.0
org.apache.commons
commons-lang3
3.12.0
org.apache.commons
commons-math3
3.6.1
org.apache.commons
commons-text
1.10.0
org.apache.curator
curator-client
2.13.0
org.apache.curator
curator-framework
2.13.0
org.apache.curator
curator-recipes
2.13.0
org.apache.derby
derby
10.14.2.0
org.apache.hadoop
hadoop-annotations
3.3.6
org.apache.hadoop
hadoop-auth
3.3.6
org.apache.hadoop
hadoop-aws
3.3.6
org.apache.hadoop
hadoop-client
3.3.6
org.apache.hadoop
hadoop-client-api
3.3.6
org.apache.hadoop
hadoop-client-runtime
3.3.6
org.apache.hadoop
hadoop-common
3.3.6
org.apache.hadoop
hadoop-hdfs-client
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-common
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-core
3.3.6
org.apache.hadoop
hadoop-mapreduce-client-jobclient
3.3.6
org.apache.hadoop
hadoop-yarn-api
3.3.6
org.apache.hadoop
hadoop-yarn-client
3.3.6
org.apache.hadoop
hadoop-yarn-common
3.3.6
org.apache.hadoop
hadoop-yarn-server-web-proxy
3.3.4
org.apache.hive
hive-beeline
2.3.9
org.apache.hive
hive-cli
2.3.9
org.apache.hive
hive-common
2.3.9
org.apache.hive
hive-exec
2.3.9
org.apache.hive
hive-jdbc
2.3.9
org.apache.hive
hive-llap-common
2.3.9
org.apache.hive
hive-metastore
2.3.9
org.apache.hive
hive-serde
2.3.9
org.apache.hive
hive-service-rpc
3.1.3
org.apache.hive
hive-shims
2.3.9
org.apache.hive
hive-storage-api
2.8.1
org.apache.hive.shims
hive-shims-0.23
2.3.9
org.apache.hive.shims
hive-shims-common
2.3.9
org.apache.hive.shims
hive-shims-scheduler
2.3.9
org.apache.httpcomponents
httpclient
4.5.14
org.apache.httpcomponents
httpcore
4.4.16
org.apache.ivy
ivy
2.5.1
org.apache.logging.log4j
log4j-api
2.19.0
org.apache.logging.log4j
log4j-core
2.19.0
org.apache.logging.log4j
log4j-to-slf4j
2.19.0
org.apache.mesos
mesos
1.11.0
org.apache.orc
orc-core
1.8.4
org.apache.orc
orc-mapreduce
1.8.4
org.apache.orc
orc-shims
1.8.4
org.apache.parquet
parquet-column
1.12.3
org.apache.parquet
parquet-common
1.12.3
org.apache.parquet
parquet-encoding
1.12.3
org.apache.parquet
parquet-format-structures
1.12.3
org.apache.parquet
parquet-hadoop
1.12.3
org.apache.parquet
parquet-jackson
1.12.3
org.apache.spark
spark-catalyst_2.12
3.4.1
org.apache.spark
spark-core_2.12
3.4.1
org.apache.spark
spark-graphx_2.12
3.4.1
org.apache.spark
spark-hive-thriftserver_2.12
3.4.1
org.apache.spark
spark-hive_2.12
3.4.1
org.apache.spark
spark-kubernetes_2.12
3.4.1
org.apache.spark
spark-kvstore_2.12
3.4.1
org.apache.spark
spark-launcher_2.12
3.4.1
org.apache.spark
spark-mesos_2.12
3.4.1
org.apache.spark
spark-mllib-local_2.12
3.4.1
org.apache.spark
spark-mllib_2.12
3.4.1
org.apache.spark
spark-network-common_2.12
3.4.1
org.apache.spark
spark-network-shuffle_2.12
3.4.1
org.apache.spark
spark-repl_2.12
3.4.1
org.apache.spark
spark-sketch_2.12
3.4.1
org.apache.spark
spark-sql_2.12
3.4.1
org.apache.spark
spark-streaming_2.12
3.4.1
org.apache.spark
spark-tags_2.12
3.4.1
org.apache.spark
spark-unsafe_2.12
3.4.1
org.apache.spark
spark-yarn_2.12
3.4.1
org.apache.thrift
libfb303
0.9.3
org.apache.thrift
libthrift
0.14.1
org.apache.xbean
xbean-asm9-shaded
4.22
org.apache.yetus
audience-annotations
0.5.0
org.apache.zookeeper
zookeeper
3.6.3
org.apache.zookeeper
zookeeper-jute
3.6.3
org.codehaus.jackson
jackson-core-asl
1.9.13
org.codehaus.jackson
jackson-mapper-asl
1.9.13
org.codehaus.janino
commons-compiler
3.1.9
org.codehaus.janino
janino
3.1.9
org.codehaus.woodstox
stax2-api
4.2.1
org.datanucleus
datanucleus-api-jdo
4.2.4
org.datanucleus
datanucleus-core
4.1.17
org.datanucleus
datanucleus-rdbms
4.1.19
org.datanucleus
javax.jdo
3.2.0-m3
org.fusesource.leveldbjni
leveldbjni-all
1.8
org.glassfish.hk2
hk2-api
2.6.1
org.glassfish.hk2
hk2-locator
2.6.1
org.glassfish.hk2
hk2-utils
2.6.1
org.glassfish.hk2
osgi-resource-locator
1.0.3
org.glassfish.hk2.external
aopalliance-repackaged
2.6.1
org.glassfish.hk2.external
jakarta.inject
2.6.1
org.glassfish.jaxb
jaxb-runtime
2.3.2
org.glassfish.jersey.containers
jersey-container-servlet
2.36
org.glassfish.jersey.containers
jersey-container-servlet-core
2.36
org.glassfish.jersey.core
jersey-client
2.36
org.glassfish.jersey.core
jersey-common
2.36
org.glassfish.jersey.core
jersey-server
2.36
org.glassfish.jersey.inject
jersey-hk2
2.36
org.javassist
javassist
3.25.0-GA
org.jctools
jctools-core
3.1.0
org.jetbrains
annotations
17.0.0
org.jetbrains.kotlin
kotlin-stdlib
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-common
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk7
1.9.10
org.jetbrains.kotlin
kotlin-stdlib-jdk8
1.9.10
org.jodd
jodd-core
5.0.13
org.json4s
json4s-ast_2.12
3.7.0-M11
org.json4s
json4s-core_2.12
3.7.0-M11
org.json4s
json4s-jackson_2.12
3.7.0-M11
org.json4s
json4s-scalap_2.12
3.7.0-M11
org.lz4
lz4-java
1.8.0
org.objenesis
objenesis
3.2
org.roaringbitmap
RoaringBitmap
0.9.38
org.roaringbitmap
shims
0.9.38
org.rocksdb
rocksdbjni
7.9.2
org.scala-lang
scala-library
2.12.17
org.scala-lang
scala-reflect
2.12.17
org.scala-lang.modules
scala-collection-compat_2.12
2.7.0
org.scala-lang.modules
scala-parser-combinators_2.12
2.1.1
org.scala-lang.modules
scala-xml_2.12
2.1.0
org.scalanlp
breeze-macros_2.12
2.1.0
org.scalanlp
breeze_2.12
2.1.0
org.slf4j
jcl-over-slf4j
2.0.6
org.slf4j
jul-to-slf4j
2.0.6
org.slf4j
log4j-over-slf4j
2.0.7
org.slf4j
slf4j-api
2.0.6
org.threeten
threeten-extra
1.7.1
org.tukaani
xz
1.9
org.typelevel
algebra_2.12
2.0.1
org.typelevel
cats-kernel_2.12
2.6.1
org.typelevel
spire-macros_2.12
0.17.0
org.typelevel
spire-platform_2.12
0.17.0
org.typelevel
spire-util_2.12
0.17.0
org.typelevel
spire_2.12
0.17.0
org.wildfly.openssl
wildfly-openssl
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-java
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-linux-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-macosx-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-solaris-x86_64
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-i386
1.1.3.Final
org.wildfly.openssl
wildfly-openssl-windows-x86_64
1.1.3.Final
org.xerial.snappy
snappy-java
1.1.10.1
org.yaml
snakeyaml
2.0
oro
oro
2.0.8
pl.edu.icm
JLargeArrays
1.5
stax
stax-api
1.0.1
3.0
DEPRECATED
Deprecated on 2023-12-19
With the introduction of a new pipeline environment for batch processing the following environment has been deprecated and will be removed after 6 months: batch-3.0 for batch environment with Spark 2.4.7
Please, use the latest SDK to migrate your applications to this new environment: batch-4.0 for batch environment with Spark 3.4.1
2.1.0
DEPRECATED
Deprecated on 2021-06-23
With the introduction of a new pipeline environment for batch processing the following environment has been deprecated and will be removed after 6 months: batch-2.1.0 for batch environment with Spark 2.4.2
Please, use the latest SDK to migrate your applications to Scala 2.12 and to this new environment: batch-3.0 for batch environment with Spark 2.4.7
2.1.0
ADDED
Added on 2019-12-18
A new pipeline environments for batch processing has been introduced to update the Spark version: batch-2.1.0 for batch environment with Spark 2.4.2
The following lists all dependencies provided by this new pipeline environment: