Introduction to the Pipelines API

The HERE platform uses data processing pipelines to process data from HERE geospatial resources and custom client resources to produce new, useful data products.
Data processing pipelines of different types can be deployed and managed on the platform using the Pipelines API.

Why use the Pipelines API

The Pipelines API offers you the following:

  1. Support for batch and stream data processing

    The Pipelines API is built to handle large volumes of geospatial data, allowing for efficient data processing at scale.
    It can manage a high throughput of data, making it suitable for the Apache Flink applications that require immediate insights
    and for the Apache Spark applications that work with large, pre-existing datasets.

  2. Automation

    With the Pipelines API you can customize the execution mode of the pipeline, so that it only processes the data when certain conditions are met.
    Also, it is possible to configure pipeline to automatically restart after a failure.
    All this helps to organize the data processing workflows with minimal downtime and reduce the need for manual intervention.

  3. Scalability

    By managing the amount of resources (CPUs, RAM size, and disk space) that are allocated to your data processing pipeline,
    you can avoid bottlenecks and maximize its productivity. This helps in managing workloads and reducing idle times.

  4. Integration with HERE Services

    Pipelines API is integrated with other HERE location services and APIs, making it easier to build complex location-based applications.


Did this page help you?