How to access monitoring and metrics in HERE Anonymizer Self-Hosted
Apache Flink metrics
You can access an Apache Flink dashboard at the IP address mapped to jobmanager-ui. For example, you can access the dashboard of a local
instance at http://localhost:8081/.
This browser-accessible dashboard offers a large quantity of built-in Flink and Java VM metrics.
See Monitoring Apache Flink Applications for a detailed explanation of existing counters and what the values of these counters can tell you about the health of your Flink application.
Anonymizer metrics
HERE Anonymizer Self-Hosted registers its counters using Flink's metrics system. The following counters are available at the Flink dashboard:
| Processing step | Metric name | Data object | Description |
|---|---|---|---|
| Decoding | HERE_decoding_message_info_all | Message | Number of messages received and successfully decoded |
| Decoding | HERE_decoding_message_dropped_corrupted | Message | Number of received messages that could not be decoded |
| Decoding | HERE_decoding_chunk_info_all | Chunk | Number of chunks received and successfully decoded |
| Decoding | HERE_decoding_point_info_all | Point | Number of points received and successfully decoded |
| Decoding | HERE_decoding_event_info_all | Event | Number of events received and successfully decoded |
| Anonymization | HERE_cleaning_point_dropped_timestamp_duplicate | Point | Number of points dropped because other points duplicated their timestamps in the same trace |
| Anonymization | HERE_cleaning_point_dropped_invalid_timestamp | Point | Number of points dropped because their timestamps were ahead of the system clock |
| Anonymization | HERE_anonymization_trace_info_all | Trace | Number of traces reaching the anonymization step |
| Anonymization | HERE_anonymization_trace_notify_destination_unsuccessfully_obfuscated | Trace | Number of input traces that weren't end cut more than at the last anonymization |
| Anonymization | HERE_anonymization_trace_unsuccessfully_obfuscated | Trace | Number of input traces that weren't start cut more than required |
| Anonymization | HERE_anonymization_point_dropped_invalid_timestamp_trace_state | Point | Number of points dropped because chunks were received in wrong temporal order |
| Anonymization | HERE_anonymization_point_dropped_sampling_rate | Point | Number of points dropped to adjust the sampling rate to the configured value |
| Anonymization | HERE_anonymization_point_dropped_start | Point | Number of points dropped by start cutting strategy |
| Anonymization | HERE_anonymization_point_dropped_end | Point | Number of points dropped by end cutting strategy |
| Anonymization | HERE_anonymization_point_dropped_gap | Point | Number of points dropped to create a gap in the data |
| Anonymization | HERE_anonymization_point_dropped_stay_point | Point | Number of points dropped to obfuscate a stay point |
| Anonymization | HERE_anonymization_point_dropped_zero_speed | Point | Number of points dropped due to zero speed |
| Anonymization | HERE_anonymization_point_dropped_by_other_reason | Point | Number of points dropped for other reasons |
| Anonymization | HERE_anonymization_point_notify_stay_point_detected | Point | Number of points detected as stay point |
| Anonymization | HERE_anonymization_point_dropped_origin | Point | Number of points dropped from origin by origin-destination obfuscation. |
| Anonymization | HERE_anonymization_point_dropped_destination | Point | Number of points dropped from destination by origin-destination obfuscation |
| Anonymization | HERE_anonymization_area_notify_stay_point_detected | Area | Number of areas detected as stay point |
| Anonymization | HERE_anonymization_area_notify_stay_point_predicted | Area | Number of areas predicted as stay point |
| Anonymization | HERE_anonymization_point_dropped_chunk_has_too_few_points | Point | Number of points dropped as number of points in output chunk didn't meet threshold |
| Anonymization | HERE_anonymization_point_dropped_license_regions | Point | Number of points dropped as they are out of the areas defined by the product license |
| Anonymization | HERE_anonymization_point_dropped_region_selection_by_exclusion | Point | Number of points dropped as they are in the customer-defined excluded regions |
| Anonymization | HERE_anonymization_point_dropped_region_selection_outside_inclusion | Point | Number of points dropped as they are not in the customer-defined included regions |
| Anonymization | HERE_anonymization_point_dropped_poi_proximity | Point | Number of points dropped as they are in the proximity of a sensitive POI |
| Anonymization | HERE_anonymization_point_info_whitelisted_area | Point | Number of points passed-through because they are in a whitelisted area |
| Anonymization | HERE_anonymization_event_info_by_type_keep | Event | Number of events passed-through because they are configured to be kept |
| Anonymization | HERE_anonymization_event_dropped_by_type_drop | Event | Number of events dropped as they are configured to be dropped |
| Anonymization | HERE_anonymization_event_dropped_regular | Event | Number of events dropped during the anonymization process |
| Anonymization | HERE_anonymization_point_info_out_of_density_areas | Point | Number of points out of the density areas (only if Density-aware anonymization enabled) |
| Output | HERE_output_message_info_all | Message | Number of messages output by the pipeline |
| Output | HERE_output_chunk_info_all | Chunk | Number of chunks output by the pipeline |
| Output | HERE_output_point_info_all | Point | Number of points output by the pipeline |
| Output | HERE_output_event_info_all | Event | Number of events output by the pipeline |
| Output | HERE_output_webhook_succeed | Webhook | Number successful webhook execution notifications. Available only if WEBHOOK_URL is configured. |
| Output | HERE_output_webhook_failed | Webhook | Number of failed webhook execution notification. Available only if WEBHOOK_URL is configured. |
| Management | HERE_anonymization_management_events_total | License and/or Config | Number of update attempts |
| Management | HERE_anonymization_management_events_licence_update_attempts | License | Number of license update attempts |
| Management | HERE_anonymization_management_events_licence_update_failed | License | Number of failed license update attempts |
| Management | HERE_anonymization_management_events_config_update_attempts | Config | Number of config update attempts |
| Management | HERE_anonymization_management_events_config_update_failed | Config | Number of failed config update attempts |
Note
Management counters are only available if you configured a management queue.
Alert metrics
If any alert configuration is applied, the additional metrics will be available for each defined alert ID.
| Processing step | Metric name | Data object | Description |
|---|---|---|---|
| Output | HERE_output_alert_ALERT_ID_message_info_all | Message | Number of messages output by the alert handler with alert ID. |
| Output | HERE_output_alert_ALERT_ID_chunk_info_all | Chunk | Number of chunks output by the alert handler with alert ID. |
| Output | HERE_output_alert_ALERT_ID_point_info_all | Point | Number of points output by the alert handler with alert ID. |
| Output | HERE_output_alert_ALERT_ID_event_info_all | Event | Number of events output by the alert handler with alert ID. |
AWS metrics
AWS EKS provides a metrics API which offers a set of metrics in the Prometheus format. This means that you can install a Prometheus instance in your Kubernetes cluster and further process the metrics data or watch it using the Prometheus UI.
Additionally, AWS EKS offers a dashboard which shows Kubernetes-level data.
To learn more, see Metrics for Amazon EKS and Kubernetes.
Azure metrics
In Azure, you can use the Azure Monitor to monitor the health and performance of your AKS cluster. The tool offers a variety of charts and counters as well as a Prometheus API.
To learn more, see Monitor AKS with Azure Monitor.
Updated yesterday