Standalone deployment

The simplest way to create a standalone Docker deployment for self-managed servers is by running Flink with Docker Compose similarly to the way described in How to run HERE Anonymizer Self-Hosted locally in Docker.

As HERE Anonymizer Self-Hosted is an Apache Flink application, the basic running pattern is running a single JobManager with one or more TaskManagers. The JobManager is the main point of configuration, where all the configuration parameters should be set.

In most cases, the TaskManager should be configured through JobManager address. However, depending on the authentication methods used when connecting to source and sink URIs, TaskManager nodes might expect to have credentials files, certificate files, and other files properly mounted (corresponding to paths of SINK_URI and SOURCE_URI of JobManager configuration).

This is a sample configuration for a JobManager and a TaskManager in a standalone Docker deployment:

jobmanager:
  image: here-anonymizer:latest
  # ...
  command: standalone-job --job-classname com.here.anonymization.opa.flink.MainStream
  environment:
    - ANONYMIZATION_CONFIG_FILE=/opt/anonymization.conf
    - SOURCE_URI=rabbit://user:pass@host:5672/input?keyFile=/cert/client.pem&crtFile=/cert/client.crt&caFile=/cert/ca.pem
    - SOURCE_FORMAT=HERE_PROBE
    - SINK_URI=rabbit://user:pass@host:5672/input?keyFile=/cert/client.pem&crtFile=/cert/client.crt&caFile=/cert/ca.pem
    - SINK_FORMAT=HERE_PROBE
    - |
      FLINK_PROPERTIES=
      jobmanager.rpc.address: jobmanager
      parallelism.default: 1

taskmanager:
  image: here-anonymizer:latest
  # ...
  volumes:
    - /home/me/here-anon/certs-for-rabbit:/cert
  environment:
    TASK_MANAGER_NUMBER_OF_TASK_SLOTS: 1
    JOB_MANAGER_RPC_ADDRESS: jobmanager
    FLINK_PROPERTIES: |
      parallelism.default: 1