Introduction to the Pipelines API
The HERE platform uses data processing pipelines to process data from HERE geospatial resources and custom client resources to produce new, useful data products. Data processing pipelines of different types can be deployed and managed on the platform using the Pipelines API.
Why use the Pipelines API
The Pipelines API offers you the following:
-
Support for batch and stream data processing
The Pipelines API is built to handle large volumes of geospatial data, allowing for efficient data processing at scale. It can manage a high throughput of data, making it suitable for the Apache Flink applications that require immediate insights and for the Apache Spark applications that work with large, pre-existing datasets. -
Automation
With the Pipelines API you can customize the execution mode of the pipeline, so that it only processes the data when certain conditions are met Also, it is possible to configure pipeline to automatically restart after a failure. All this helps to organize the data processing workflows with minimal downtime and reduce the need for manual intervention. -
Scalability
By managing the amount of resources (CPUs, RAM size, and disk space) that are allocated to your data processing pipeline, you can avoid bottlenecks and maximize its productivity. This helps in managing workloads and reducing idle times. -
Integration with HERE Services
Pipelines API is integrated with other HERE location services and APIs, making it easier to build complex location-based applications.
HERE data privacy by design
For the terms and conditions covering this documentation, see the HERE Documentation License.
HERE is committed to bringing and working with your data both safely and securely in HERE Workspace.
HERE’s proprietary access management services offer granular controls at the organization, project, group, user, and application ID levels, ensuring industry standard, privacy organization, and ISO compliant levels of protection. For more information about HERE Workspace access management controls, see the Identity and Access Management Guide.
In addition to granular access management controls, all Workspace services must pass security compliance checks before launching and on an on-going basis. For more information about HERE Workspace data security, see the Get Started with HERE Workspace guide.
For more information on HERE data security and durability best practices, see the Data API.
For more information on how data privacy is of fundamental importance to HERE and our customers, see the HERE Privacy Charter.
Updated 2 days ago