Pipeline environments

Pipeline Environments supported by SDK 2.88.6

The platform offers different pipeline runtime environments. The SDK 2.88.6 is compatible with two of these environments. When you create a pipeline to deploy your SDK-based application in the platform, you should select one of these two depending on the processing framework you chose during development of your application:

The following lists the dependencies provided by these two pipeline environments. Note, that these packages are loaded by the pipeline's Java Virtual Machine (JVM) and take precedence over any other application-provided package.

For more details see how to Include the SDK in Your Project.

Environment for Batch Processing 5.0

Group IDArtifact IDVersion
at.yawk.lz4lz4-java1.10.2
ch.epfl.scalabsp4j2.1.0-M5
ch.qos.logbacklogback-classic1.5.20
ch.qos.logbacklogback-core1.5.20
com.amazonawsaws-java-sdk-core1.12.781
com.amazonawsaws-java-sdk-sts1.12.781
com.clearspring.analyticsstream2.9.8
com.esotericsoftwarekryo-shaded4.0.3
com.esotericsoftwareminlog1.3.0
com.esotericsoftwarereflectasm1.11.3
com.fasterxml.jackson.corejackson-annotations2.18.6
com.fasterxml.jackson.corejackson-core2.18.6
com.fasterxml.jackson.corejackson-databind2.18.6
com.fasterxml.jackson.dataformatjackson-dataformat-yaml2.18.6
com.fasterxml.jackson.datatypejackson-datatype-jsr3102.18.6
com.fasterxml.jackson.modulejackson-module-scala_2.132.18.6
com.fasterxml.woodstoxwoodstox-core5.4.0
com.github.javaparserjavaparser-core3.2.12
com.github.joshelserdropwizard-metrics-hadoop-metrics2-reporter0.1.2
com.github.lubenzstd-jni1.5.6-9
com.github.wendykierpJTransforms3.1
com.google.androidannotations4.1.1.4
com.google.api.grpcproto-google-common-protos2.41.0
com.google.code.findbugsjsr3053.0.0
com.google.code.gsongson2.11.0
com.google.crypto.tinktink1.16.0
com.google.errorproneerror_prone_annotations2.36.0
com.google.flatbuffersflatbuffers-java24.3.25
com.google.guavafailureaccess1.0.2
com.google.guavaguava33.4.0-jre
com.google.guavalistenablefuture9999.0-empty-to-avoid-conflict-with-guava
com.google.j2objcj2objc-annotations3.0.0
com.google.protobufprotobuf-java-util4.29.3
com.ibm.icuicu4j76.1
com.lihaoyiammonite-compiler-interface_2.13.163.0.1
com.lihaoyiammonite-compiler_2.13.163.0.1
com.lihaoyiammonite-interp-api_2.13.163.0.1
com.lihaoyiammonite-interp_2.13.163.0.1
com.lihaoyiammonite-repl-api_2.13.163.0.1
com.lihaoyiammonite-repl_2.13.163.0.1
com.lihaoyiammonite-runtime_2.13.163.0.1
com.lihaoyiammonite-terminal_2.133.0.1
com.lihaoyiammonite-util_2.133.0.1
com.lihaoyiammonite_2.13.163.0.1
com.lihaoyifansi_2.130.5.0
com.lihaoyifastparse_2.133.1.1
com.lihaoyigeny_2.131.1.1
com.lihaoyimainargs_2.130.7.5
com.lihaoyios-lib_2.130.11.2
com.lihaoyipprint_2.130.9.0
com.lihaoyirequests_2.130.9.0
com.lihaoyiscalaparse_2.133.1.1
com.lihaoyisourcecode_2.130.4.3-M1
com.lihaoyiujson_2.134.0.2
com.lihaoyiupack_2.134.0.2
com.lihaoyiupickle-core_2.134.0.2
com.lihaoyiupickle-implicits_2.134.0.2
com.lihaoyiupickle_2.134.0.2
com.ningcompress-lzf1.1.2
com.squareup.okiookio-jvm3.6.0
com.sun.istackistack-commons-runtime4.1.2
com.tdunningjson1.8
com.thesamet.scalapblenses_2.130.11.17
com.thesamet.scalapbscalapb-runtime_2.130.11.17
com.thoughtworks.paranamerparanamer2.8
com.twitterchill-java0.10.0
com.twitterchill_2.130.10.0
com.univocityunivocity-parsers2.9.1
com.zaxxerHikariCP4.0.3
commons-clicommons-cli1.9.0
commons-codeccommons-codec1.17.2
commons-collectionscommons-collections3.2.2
commons-dbcpcommons-dbcp1.4
commons-iocommons-io2.18.0
commons-langcommons-lang2.6
commons-poolcommons-pool1.5.4
dev.ludovic.netlibarpack3.0.3
dev.ludovic.netlibblas3.0.3
dev.ludovic.netliblapack3.0.3
io.airliftaircompressor2.0.3
io.dropwizard.metricsmetrics-core4.2.30
io.dropwizard.metricsmetrics-graphite4.2.30
io.dropwizard.metricsmetrics-jmx4.2.30
io.dropwizard.metricsmetrics-json4.2.30
io.dropwizard.metricsmetrics-jvm4.2.30
io.fabric8kubernetes-client7.1.0
io.fabric8kubernetes-client-api7.1.0
io.fabric8kubernetes-httpclient-vertx7.1.0
io.fabric8kubernetes-model-admissionregistration7.1.0
io.fabric8kubernetes-model-apiextensions7.1.0
io.fabric8kubernetes-model-apps7.1.0
io.fabric8kubernetes-model-autoscaling7.1.0
io.fabric8kubernetes-model-batch7.1.0
io.fabric8kubernetes-model-certificates7.1.0
io.fabric8kubernetes-model-common7.1.0
io.fabric8kubernetes-model-coordination7.1.0
io.fabric8kubernetes-model-core7.1.0
io.fabric8kubernetes-model-discovery7.1.0
io.fabric8kubernetes-model-events7.1.0
io.fabric8kubernetes-model-extensions7.1.0
io.fabric8kubernetes-model-flowcontrol7.1.0
io.fabric8kubernetes-model-gatewayapi7.1.0
io.fabric8kubernetes-model-metrics7.1.0
io.fabric8kubernetes-model-networking7.1.0
io.fabric8kubernetes-model-node7.1.0
io.fabric8kubernetes-model-policy7.1.0
io.fabric8kubernetes-model-rbac7.1.0
io.fabric8kubernetes-model-resource7.1.0
io.fabric8kubernetes-model-scheduling7.1.0
io.fabric8kubernetes-model-storageclass7.1.0
io.fabric8zjsonpatch7.1.0
io.get-coursierclass-path-util_2.130.1.4
io.get-coursierdependency-interface_2.130.2.3
io.get-coursierdependency_2.130.2.3
io.get-coursierinterface1.0.19
io.github.java-diff-utilsjava-diff-utils4.15
io.jsonwebtokenjjwt-api0.12.6
io.jsonwebtokenjjwt-impl0.12.6
io.jsonwebtokenjjwt-jackson0.12.6
io.nettynetty-all4.1.133.Final
io.nettynetty-buffer4.1.133.Final
io.nettynetty-codec4.1.133.Final
io.nettynetty-codec-dns4.1.133.Final
io.nettynetty-codec-http4.1.133.Final
io.nettynetty-codec-http24.1.133.Final
io.nettynetty-codec-socks4.1.133.Final
io.nettynetty-common4.1.133.Final
io.nettynetty-handler4.1.133.Final
io.nettynetty-handler-proxy4.1.133.Final
io.nettynetty-resolver4.1.133.Final
io.nettynetty-resolver-dns4.1.133.Final
io.nettynetty-tcnative-boringssl-static2.0.77.Final
io.nettynetty-tcnative-classes2.0.77.Final
io.nettynetty-transport4.1.133.Final
io.nettynetty-transport-classes-epoll4.1.133.Final
io.nettynetty-transport-classes-kqueue4.1.133.Final
io.nettynetty-transport-native-epoll4.1.133.Final
io.nettynetty-transport-native-kqueue4.1.133.Final
io.nettynetty-transport-native-unix-common4.1.133.Final
io.vertxvertx-auth-common4.5.12
io.vertxvertx-core4.5.12
io.vertxvertx-web-client4.5.12
io.vertxvertx-web-common4.5.12
jakarta.activationjakarta.activation-api2.1.3
jakarta.annotationjakarta.annotation-api2.1.1
jakarta.injectjakarta.inject-api2.0.1
jakarta.servletjakarta.servlet-api5.0.0
jakarta.validationjakarta.validation-api3.0.2
jakarta.ws.rsjakarta.ws.rs-api3.0.0
jakarta.xml.bindjakarta.xml.bind-api4.0.2
javax.jdojdo-api3.0.1
javax.servletjavax.servlet-api4.0.1
javax.transactionjta1.1
javax.transactiontransaction-api1.1
javolutionjavolution5.5.1
jlinejline2.14.6
joda-timejoda-time2.13.0
net.openhftzero-allocation-hashing0.26ea0
net.razorvinepickle1.5
net.sf.jpamjpam1.1
net.sf.opencsvopencsv2.3
net.sf.py4jpy4j0.10.9.9
net.sf.supercsvsuper-csv2.2.0
net.sourceforge.f2jarpack_combined_all0.1
org.antlrantlr-runtime3.5.2
org.antlrantlr4-runtime4.13.1
org.antlrST44.0.4
org.apache.arrowarrow-format18.1.0
org.apache.arrowarrow-memory-core18.1.0
org.apache.arrowarrow-memory-netty18.1.0
org.apache.arrowarrow-memory-netty-buffer-patch18.1.0
org.apache.arrowarrow-vector18.1.0
org.apache.avroavro1.12.1
org.apache.avroavro-ipc1.12.1
org.apache.avroavro-mapred1.12.1
org.apache.commonscommons-collections44.4
org.apache.commonscommons-compress1.27.1
org.apache.commonscommons-configuration22.12.0
org.apache.commonscommons-crypto1.1.0
org.apache.commonscommons-lang33.17.0
org.apache.commonscommons-math33.6.1
org.apache.commonscommons-text1.13.0
org.apache.curatorcurator-client5.7.1
org.apache.curatorcurator-framework5.7.1
org.apache.curatorcurator-recipes5.7.1
org.apache.datasketchesdatasketches-java6.1.1
org.apache.datasketchesdatasketches-memory3.0.2
org.apache.derbyderby10.16.1.1
org.apache.derbyderbyshared10.16.1.1
org.apache.derbyderbytools10.16.1.1
org.apache.hadoophadoop-annotations3.4.1
org.apache.hadoophadoop-auth3.4.1
org.apache.hadoophadoop-aws3.4.1
org.apache.hadoophadoop-client3.4.1
org.apache.hadoophadoop-client-api3.4.1
org.apache.hadoophadoop-client-runtime3.4.1
org.apache.hadoophadoop-common3.4.1
org.apache.hadoophadoop-hdfs-client3.4.1
org.apache.hadoophadoop-mapreduce-client-common3.4.1
org.apache.hadoophadoop-mapreduce-client-core3.4.1
org.apache.hadoophadoop-mapreduce-client-jobclient3.4.1
org.apache.hadoophadoop-yarn-api3.4.1
org.apache.hadoophadoop-yarn-client3.4.1
org.apache.hadoophadoop-yarn-common3.4.1
org.apache.hivehive-beeline2.3.10
org.apache.hivehive-cli2.3.10
org.apache.hivehive-common2.3.10
org.apache.hivehive-exec2.3.10
org.apache.hivehive-jdbc2.3.10
org.apache.hivehive-metastore2.3.10
org.apache.hivehive-serde2.3.10
org.apache.hivehive-service-rpc4.0.0
org.apache.hivehive-shims2.3.10
org.apache.hivehive-storage-api2.8.1
org.apache.hive.shimshive-shims-0.232.3.10
org.apache.hive.shimshive-shims-common2.3.10
org.apache.hive.shimshive-shims-scheduler2.3.10
org.apache.httpcomponentshttpclient4.5.14
org.apache.httpcomponentshttpcore4.4.16
org.apache.ivyivy2.5.3
org.apache.logging.log4jlog4j-api2.24.3
org.apache.logging.log4jlog4j-core2.24.3
org.apache.logging.log4jlog4j-layout-template-json2.24.3
org.apache.logging.log4jlog4j-to-slf4j2.24.3
org.apache.orcorc-core2.1.3
org.apache.orcorc-format1.1.1
org.apache.orcorc-mapreduce2.1.3
org.apache.orcorc-shims2.1.3
org.apache.parquetparquet-column1.15.2
org.apache.parquetparquet-common1.15.2
org.apache.parquetparquet-encoding1.15.2
org.apache.parquetparquet-format-structures1.15.2
org.apache.parquetparquet-hadoop1.15.2
org.apache.parquetparquet-jackson1.15.2
org.apache.sparkspark-avro_2.134.0.1
org.apache.sparkspark-catalyst_2.134.0.1
org.apache.sparkspark-common-utils_2.134.0.1
org.apache.sparkspark-connect-client-jvm_2.134.0.1
org.apache.sparkspark-connect-common_2.134.0.1
org.apache.sparkspark-connect_2.134.0.1
org.apache.sparkspark-core_2.134.0.1
org.apache.sparkspark-graphx_2.134.0.1
org.apache.sparkspark-hive-thriftserver_2.134.0.1
org.apache.sparkspark-hive_2.134.0.1
org.apache.sparkspark-kubernetes_2.134.0.1
org.apache.sparkspark-kvstore_2.134.0.1
org.apache.sparkspark-launcher_2.134.0.1
org.apache.sparkspark-mllib-local_2.134.0.1
org.apache.sparkspark-mllib_2.134.0.1
org.apache.sparkspark-network-common_2.134.0.1
org.apache.sparkspark-network-shuffle_2.134.0.1
org.apache.sparkspark-repl_2.134.0.1
org.apache.sparkspark-sketch_2.134.0.1
org.apache.sparkspark-sql-api_2.134.0.1
org.apache.sparkspark-sql_2.134.0.1
org.apache.sparkspark-streaming_2.134.0.1
org.apache.sparkspark-tags_2.134.0.1
org.apache.sparkspark-unsafe_2.134.0.1
org.apache.sparkspark-variant_2.134.0.1
org.apache.sparkspark-yarn_2.134.0.1
org.apache.thriftlibfb3030.9.3
org.apache.thriftlibthrift0.23.0
org.apache.ws.xmlschemaxmlschema-core2.3.1
org.apache.xbeanxbean-asm9-shaded4.26
org.apache.yetusaudience-annotations0.12.0
org.apache.zookeeperzookeeper3.9.5
org.apache.zookeeperzookeeper-jute3.9.3
org.bouncycastlebcprov-jdk18on1.84
org.checkerframeworkchecker-qual3.43.0
org.codehaus.janinocommons-compiler3.1.9
org.codehaus.janinojanino3.1.9
org.codehaus.mojoanimal-sniffer-annotations1.24
org.codehaus.woodstoxstax2-api4.2.2
org.datanucleusdatanucleus-api-jdo4.2.4
org.datanucleusdatanucleus-core4.1.17
org.datanucleusdatanucleus-rdbms4.1.19
org.datanucleusjavax.jdo3.2.0-m3
org.eclipse.lsp4jorg.eclipse.lsp4j.generator0.20.1
org.eclipse.lsp4jorg.eclipse.lsp4j.jsonrpc0.20.1
org.eclipse.xtendorg.eclipse.xtend.lib2.28.0
org.eclipse.xtendorg.eclipse.xtend.lib.macro2.28.0
org.eclipse.xtextorg.eclipse.xtext.xbase.lib2.28.0
org.fusesource.leveldbjnileveldbjni-all1.8
org.glassfish.hk2hk2-api3.0.6
org.glassfish.hk2hk2-locator3.0.6
org.glassfish.hk2hk2-utils3.0.6
org.glassfish.hk2osgi-resource-locator1.0.3
org.glassfish.hk2.externalaopalliance-repackaged3.0.6
org.glassfish.jaxbjaxb-core4.0.5
org.glassfish.jaxbjaxb-runtime4.0.5
org.glassfish.jersey.containersjersey-container-servlet3.0.17
org.glassfish.jersey.containersjersey-container-servlet-core3.0.17
org.glassfish.jersey.corejersey-client3.0.17
org.glassfish.jersey.corejersey-common3.0.17
org.glassfish.jersey.corejersey-server3.0.17
org.glassfish.jersey.injectjersey-hk23.0.17
org.javassistjavassist3.30.2-GA
org.jctoolsjctools-core4.0.5
org.jetbrainsannotations17.0.0
org.jetbrains.kotlinkotlin-stdlib1.9.10
org.jetbrains.kotlinkotlin-stdlib-common1.9.10
org.jetbrains.kotlinkotlin-stdlib-jdk71.9.10
org.jetbrains.kotlinkotlin-stdlib-jdk81.9.10
org.jlinejansi-core3.27.1
org.jlinejline3.27.1
org.jlinejline-builtins3.27.1
org.jlinejline-native3.27.1
org.jlinejline-reader3.27.1
org.jlinejline-remote-ssh3.27.1
org.jlinejline-remote-telnet3.27.1
org.jlinejline-style3.27.1
org.jlinejline-terminal3.27.1
org.jlinejline-terminal-ffm3.27.1
org.jlinejline-terminal-jansi3.27.1
org.jlinejline-terminal-jna3.27.1
org.jlinejline-terminal-jni3.27.1
org.joddjodd-core5.0.13
org.json4sjson4s-ast_2.134.0.7
org.json4sjson4s-core_2.134.0.7
org.json4sjson4s-jackson-core_2.134.0.7
org.json4sjson4s-jackson_2.134.0.7
org.json4sjson4s-scalap_2.134.0.7
org.objenesisobjenesis3.3
org.roaringbitmapRoaringBitmap1.3.0
org.rocksdbrocksdbjni9.8.4
org.scala-langscala-library2.13.16
org.scala-langscala-reflect2.13.16
org.scala-lang.modulesscala-collection-compat_2.132.7.0
org.scala-lang.modulesscala-parallel-collections_2.131.2.0
org.scala-lang.modulesscala-parser-combinators_2.132.4.0
org.scala-lang.modulesscala-xml_2.132.3.0
org.scalametacommon_2.134.9.7
org.scalanlpbreeze-macros_2.132.1.0
org.scalanlpbreeze_2.132.1.0
org.slf4jjcl-over-slf4j2.0.16
org.slf4jjul-to-slf4j2.0.16
org.slf4jlog4j-over-slf4j2.0.16
org.slf4jslf4j-api2.0.16
org.snakeyamlsnakeyaml-engine2.9
org.threetenthreeten-extra1.8.0
org.tpolecattypename_2.131.1.0
org.tukaanixz1.10
org.typelevelalgebra_2.132.8.0
org.typelevelcats-kernel_2.132.8.0
org.typelevelspire-macros_2.130.18.0
org.typelevelspire-platform_2.130.18.0
org.typelevelspire-util_2.130.18.0
org.typelevelspire_2.130.18.0
org.wildfly.commonwildfly-common1.5.4.Final
org.wildfly.opensslwildfly-openssl2.2.5.Final
org.wildfly.opensslwildfly-openssl-java2.2.5.Final
org.wildfly.opensslwildfly-openssl-linux-x86_642.2.2.SP01
org.wildfly.opensslwildfly-openssl-macosx-x86_642.2.2.Final
org.wildfly.opensslwildfly-openssl-windows-x86_642.2.2.Final
org.xerial.snappysnappy-java1.1.10.7
org.yamlsnakeyaml2.3
orooro2.0.8
pl.edu.icmJLargeArrays1.5
software.amazon.awssdkbundle2.41.30
staxstax-api1.0.1

Known vulnerabilities

There are the following known vulnerabilities in the environment-batch_2.13:

LibraryVulnerabilitiesNotes
org.apache.derby/derby:10.16.1.1CVE-2022-46337This issue cannot be resolved because the secure dependency version requires Java 21, which is not supported in the current environment.
org.apache.hive/hive-jdbc:2.3.10CVE-2021-34538This issue cannot be resolved because the secure dependency version includes changes that would break compatibility with the current 2.3.10 version.

Environment for Stream Processing 7.0

Group IDArtifact IDVersion
ch.qos.logbacklogback-classic1.2.13
ch.qos.logbacklogback-core1.2.13
com.esotericsoftwarekryo5.6.2
com.esotericsoftwareminlog1.3.1
com.esotericsoftwarereflectasm1.11.9
com.google.code.findbugsjsr3051.3.9
com.ververicaforstjni0.1.8
com.ververicafrocksdbjni8.10.0-ververica-1.0
commons-clicommons-cli1.5.0
commons-collectionscommons-collections3.2.2
commons-iocommons-io2.15.1
org.apache.commonscommons-compress1.26.0
org.apache.commonscommons-lang33.18.0
org.apache.commonscommons-math33.6.1
org.apache.commonscommons-text1.10.0
org.apache.flinkflink-annotations2.2.0
org.apache.flinkflink-cep2.2.0
org.apache.flinkflink-clients2.2.0
org.apache.flinkflink-connector-base2.2.0
org.apache.flinkflink-connector-datagen2.2.0
org.apache.flinkflink-connector-files2.2.0
org.apache.flinkflink-container2.2.0
org.apache.flinkflink-core2.2.0
org.apache.flinkflink-core-api2.2.0
org.apache.flinkflink-csv2.2.0
org.apache.flinkflink-datastream2.2.0
org.apache.flinkflink-datastream-api2.2.0
org.apache.flinkflink-dstl-dfs2.2.0
org.apache.flinkflink-file-sink-common2.2.0
org.apache.flinkflink-hadoop-fs2.2.0
org.apache.flinkflink-json2.2.0
org.apache.flinkflink-kubernetes2.2.0
org.apache.flinkflink-metrics-core2.2.0
org.apache.flinkflink-queryable-state-client-java2.2.0
org.apache.flinkflink-rpc-akka-loader2.2.0
org.apache.flinkflink-rpc-core2.2.0
org.apache.flinkflink-runtime2.2.0
org.apache.flinkflink-runtime-web2.2.0
org.apache.flinkflink-shaded-asm-99.6-20.0
org.apache.flinkflink-shaded-force-shading20.0
org.apache.flinkflink-shaded-guava33.4.0-jre-20.0
org.apache.flinkflink-shaded-jackson2.18.2-20.0
org.apache.flinkflink-shaded-netty4.1.100.Final-20.0
org.apache.flinkflink-shaded-zookeeper-33.7.2-20.0
org.apache.flinkflink-sql-gateway-api2.2.0
org.apache.flinkflink-statebackend-changelog2.2.0
org.apache.flinkflink-statebackend-common2.2.0
org.apache.flinkflink-statebackend-forst2.2.0
org.apache.flinkflink-statebackend-rocksdb2.2.0
org.apache.flinkflink-streaming-java2.2.0
org.apache.flinkflink-table-api-bridge-base2.2.0
org.apache.flinkflink-table-api-java2.2.0
org.apache.flinkflink-table-api-java-bridge2.2.0
org.apache.flinkflink-table-common2.2.0
org.apache.flinkflink-table-planner-loader2.2.0
org.apache.flinkflink-table-runtime2.2.0
org.apache.flinkflink-yarn2.2.0
org.apache.logging.log4jlog4j-1.2-api2.24.3
org.apache.logging.log4jlog4j-api2.24.3
org.apache.logging.log4jlog4j-core2.24.3
org.apache.logging.log4jlog4j-layout-template-json2.24.3
org.apache.logging.log4jlog4j-slf4j-impl2.24.3
org.javassistjavassist3.24.0-GA
org.lz4lz4-java1.8.0
org.objenesisobjenesis3.4
org.slf4jlog4j-over-slf4j1.7.36
org.slf4jslf4j-api1.7.36
org.snakeyamlsnakeyaml-engine2.6
org.xerial.snappysnappy-java1.1.10.7
tools.profilerasync-profiler2.9

Known vulnerabilities

There are the following known vulnerabilities in the environment-stream:

LibraryVulnerabilitiesNotes
ch.qos.logback/logback-core:1.2.13CVE-2024-12801
CVE-2024-12798
The issue has been fixed in Logback 1.3.x. However, it requires SLF4J 2, which is not currently supported by Flink.
org.lz4/lz4-java:1.8.0CVE-2025-12183This issue has been resolved in version 1.8.1 of the library. At the moment, the latest Flink version still depends on version 1.8.0.