StreamApi

Type Aliases

AutoOffsetResetEnum

AutoOffsetResetEnum: "latest" | "earliest" | "none"

KafkaProtocolVersionEnum

KafkaProtocolVersionEnum: "0.10"

Functions

consumeData

  • consumeData(builder: RequestBuilder, params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}): Promise<Response>
  • Consumes data from a layer. Returns messages from a stream layer formatted similar to a Partition object. If the data size is less than 1 MB, the data field will be populated. If the data size is greater than 1 MB, a data handle will be returned pointing to the object stored in the Blob store. The base path to be used is the value of 'nodeBaseURL' returned from /subscribe POST request.

    summary
    Consumes data from a layer

    Parameters

    • params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}
      • layerId: string
      • Optional mode?: "serial" | "parallel"
      • Optional subscriptionId?: string
      • Optional xCorrelationId?: string

    Returns Promise<Response>

deleteSubscription

  • deleteSubscription(builder: RequestBuilder, params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}): Promise<Response>
  • Deletes a subscription to a layer (topic). This operation removes the subscription from the service. The base path to use is the value of 'nodeBaseURL' returned from /subscribe POST request.

    summary
    Delete subscription to a layer

    Parameters

    • params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}
      • layerId: string
      • Optional mode?: "serial" | "parallel"
      • Optional subscriptionId?: string
      • Optional xCorrelationId?: string

    Returns Promise<Response>

doCommitOffsets

  • doCommitOffsets(builder: RequestBuilder, params: {</span>commitOffsets<span class="typedoc-tsd-signature-symbol">: </span><a href="sdk-for-typescript-interfaces-olp_sdk_dataservice_api-streamapi-commitoffsetsrequest" class="typedoc-tsd-signature-type" data-tsd-kind="Interface">CommitOffsetsRequest</a><span class="typedoc-tsd-signature-symbol">; </span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}): Promise<Response>
  • After reading data, you should commit the offset of the last message read from each partition so that your application can resume reading new messages from the correct partition in the event that there is a disruption to the subscription, such as an application crash. An offset can also be useful if you delete a subscription then recreate a subscription for the same layer, because the new subscription can start reading data from the offset. To read messages already committed, use the /seek endpoint, then use /partitions. The base path to use is the value of 'nodeBaseURL' returned from /subscribe POST request.

    summary
    Commits offsets of the last message read

    Parameters

    • params: {</span>commitOffsets<span class="typedoc-tsd-signature-symbol">: </span><a href="sdk-for-typescript-interfaces-olp_sdk_dataservice_api-streamapi-commitoffsetsrequest" class="typedoc-tsd-signature-type" data-tsd-kind="Interface">CommitOffsetsRequest</a><span class="typedoc-tsd-signature-symbol">; </span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}
      • commitOffsets: CommitOffsetsRequest
      • layerId: string
      • Optional mode?: "serial" | "parallel"
      • Optional subscriptionId?: string
      • Optional xCorrelationId?: string

    Returns Promise<Response>

endpoint

  • endpoint(builder: RequestBuilder, params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}): Promise<StreamLayerEndpointResponse>
  • Returns a list of Kafka Broker URL's, client ID (required to enforce quotas), and Group ID prefix. Type is set to a consumer.

    summary
    Expose the endpoint to consume the data of the layer directly

    Parameters

    • params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}
      • layerId: string

endpointByConsumer

  • endpointByConsumer(builder: RequestBuilder, params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>type<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">"producer"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"consumer"</span><span class="typedoc-tsd-signature-symbol">}): Promise<StreamLayerEndpointResponse>
  • Exposes the endpoint to use to produce and consume the data of the layer directly, per type of user - consumer or producer. It returns a list of Kafka Broker URL's, client ID (required to enforce quotas), and Group ID prefix.

    summary
    Exposes the endpoint to use to produce and consume the data of the layer directly

    Parameters

    • params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>type<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">"producer"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"consumer"</span><span class="typedoc-tsd-signature-symbol">}
      • layerId: string
      • type: "producer" | "consumer"

seekToOffset

  • seekToOffset(builder: RequestBuilder, params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>seekOffsets<span class="typedoc-tsd-signature-symbol">: </span><a href="sdk-for-typescript-interfaces-olp_sdk_dataservice_api-streamapi-seekoffsetsrequest" class="typedoc-tsd-signature-type" data-tsd-kind="Interface">SeekOffsetsRequest</a><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}): Promise<Response>
  • Enables you to start reading data from a specified offset. You can move the message pointer to any offset in the layer (topic). Message consumption will start from that offset. Once you seek to an offset, there is no returning to the initial offset, unless the initial offset is saved. The base path to use is the value of 'nodeBaseURL' returned from /subscribe POST request.

    summary
    Seek to predefined offset.

    Parameters

    • params: {</span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>seekOffsets<span class="typedoc-tsd-signature-symbol">: </span><a href="sdk-for-typescript-interfaces-olp_sdk_dataservice_api-streamapi-seekoffsetsrequest" class="typedoc-tsd-signature-type" data-tsd-kind="Interface">SeekOffsetsRequest</a><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>xCorrelationId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">}
      • layerId: string
      • Optional mode?: "serial" | "parallel"
      • seekOffsets: SeekOffsetsRequest
      • Optional subscriptionId?: string
      • Optional xCorrelationId?: string

    Returns Promise<Response>

subscribe

  • subscribe(builder: RequestBuilder, params: {</span>consumerId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionProperties<span class="typedoc-tsd-signature-symbol">?: </span><a href="sdk-for-typescript-interfaces-olp_sdk_dataservice_api-streamapi-consumerproperties" class="typedoc-tsd-signature-type" data-tsd-kind="Interface">ConsumerProperties</a><span class="typedoc-tsd-signature-symbol">}): Promise<Response>
  • Enables message consumption from a specific stream layer (topic). Use the base path returned from the API Lookup service. Note: For mode = parallel, one unit of parallelism currently equals 1 MBps inbound or 2 MBps outbound, whichever is greater, rounded up to the nearest integer. The number of subscriptions within the same group cannot exceed the parallelism allowed. For more details see Get Data from a Stream Layer.

    summary
    Enable message consumption from a specific stream layer.

    Parameters

    • params: {</span>consumerId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>layerId<span class="typedoc-tsd-signature-symbol">: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>mode<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">"serial"</span><span class="typedoc-tsd-signature-symbol"> | </span><span class="typedoc-tsd-signature-type">"parallel"</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionId<span class="typedoc-tsd-signature-symbol">?: </span><span class="typedoc-tsd-signature-type">string</span><span class="typedoc-tsd-signature-symbol">; </span>subscriptionProperties<span class="typedoc-tsd-signature-symbol">?: </span><a href="sdk-for-typescript-interfaces-olp_sdk_dataservice_api-streamapi-consumerproperties" class="typedoc-tsd-signature-type" data-tsd-kind="Interface">ConsumerProperties</a><span class="typedoc-tsd-signature-symbol">}
      • Optional consumerId?: string
      • layerId: string
      • Optional mode?: "serial" | "parallel"
      • Optional subscriptionId?: string
      • Optional subscriptionProperties?: ConsumerProperties

    Returns Promise<Response>