Data assets

Published when a data asset change processing batch makes progress, before the batch finishes.

Payload

object

id string

Required

Identifies the event.

minLength = 1
time string

Timestamp of when the occurrence happened. Must adhere to RFC 3339.

minLength = 1, format = "date-time"
type string

Required

Data asset change processing batch progressed.

default = "com.qlik.v1.data-asset.data.change-processing.progressed"
source string

Required

Identifies the context in which an event happened.

minLength = 1, format = "uri-reference"
specversion string

Required

The version of the CloudEvents specification which the event uses.

minLength = 1
datacontenttype string

Content type of the data value. Must adhere to RFC 2046 format.

minLength = 1, default = "application/json"
userid string

Unique identifier for the user related to the event.
updates array of objects

Updates of qemServer object
Show updates properties
- path string
  
  updated item path
- newvalue string
  
  new value at given path
- oldvalue string
  
  original value at given path
authtype string

Representing the type of principal that triggered the occurrence.
tenantid string

Required

Unique identifier for the tenant related to the event.
authclaims string

A JSON string representing claims of the principal that triggered the event
tracestate string

A comma-delimited list of key-value pairs.
traceparent string

Contains a version, trace ID, span ID, and trace options.
toplevelresourceid string

Unique identifier referring to integration application related to the event.
data object
Show data properties
- appId string
  
  Unique identifier for the app related to the event.
  
  format = "uid"
- dataSets array of objects
  
  Show dataSets properties
  
  dataSetId string
  
  Unique identifier for the data set related to the item.
  
  updateEndedAt string
  
  Timestamp of when the change processing update for the data set ended. Must adhere to RFC 3339.
  
  format = "date-time"
  
  updateSuccess boolean
  
  Indicates whether the change processing update for this data set succeeded.
  
  updateStartedAt string
  
  Timestamp of when the change processing update for the data set started. Must adhere to RFC 3339.
  
  format = "date-time"
  
  dataSetSecureQRI string
  
  Secure QRI (Qlik resource identifier) of the data set related to the item. It identifies the data set's underlying resource without exposing connection details.
  
  recordOperationCounters object
  
  Show recordOperationCounters properties
  
  numberOfDeletes number
  
  Number of rows deletions in the specific change processing batch.
  
  numberOfInserts number
  
  Number of rows inserts in the specific change processing batch.
  
  numberOfUpdates number
  
  Number of rows updates in the specific change processing batch.
- consumption object
  
  Show consumption properties
  
  totalBytes number
  
  Harmonized total bytes property, same value as totalBytesProcessed.
  
  totalBytesProcessed number
  
  Total bytes in a specific change processing operation.
- dataAssetId string
  
  Unique identifier for the data asset related to the event.
- dataAssetType string
  
  Type of the data asset the change processing batch belongs to (e.g. STORAGE).
- notChargeable boolean
  
  When this field is set to true the event should be discarded from consumption metrics.
- sourceDataProvider string
  
  Identifies the source system that produced the data (one of STITCH, REPLICATE, QCDI, OTHER).
- notChargeableReason string
  
  Description for why the event is set to notChargeable.
- changeProcessingEndedAt string
  
  Timestamp of when the change processing batch ended. Must adhere to RFC 3339.
  
  format = "date-time"
- changeProcessingStartedAt string
  
  Timestamp of when the change processing batch started. Must adhere to RFC 3339.
  
  format = "date-time"
- dataAssetChangeCountersDelta object
  
  Show dataAssetChangeCountersDelta properties
  
  numberOfDeletes number
  
  Number of rows deletions in the specific change processing batch.
  
  numberOfInserts number
  
  Number of rows inserts in the specific change processing batch.
  
  numberOfUpdates number
  
  Number of rows updates in the specific change processing batch.

com.qlik.v1.data-asset.data.change-processing.progressed

Example payload of the "Data asset change processing batch progressed" event

{
  "id": "A234-1234-1234",
  "time": "2018-10-30T07:06:22Z",
  "type": "com.qlik.v1.data-asset.data.change-processing.progressed",
  "source": "com.qlik/my-service",
  "specversion": "1.0",
  "datacontenttype": "application/json",
  "userid": "id123",
  "updates": [
    {}
  ],
  "authtype": "string",
  "tenantid": "id123",
  "authclaims": "string",
  "tracestate": "string",
  "traceparent": "string",
  "toplevelresourceid": "id123",
  "data": {
    "appId": "id123",
    "dataSets": [
      {
        "dataSetId": "id123",
        "updateEndedAt": "2018-10-30T07:06:22Z",
        "updateSuccess": true,
        "updateStartedAt": "2018-10-30T07:06:22Z",
        "dataSetSecureQRI": "qri:db:snowflake://Bh__CEOO2-D2Ty2f5egzjobOWnrxe6Cl8hHjJ6G08KE#w7OWgEHpy-iUi4EVNEGGQ6bJwU3FT6RdX38hbbrpJlM",
        "recordOperationCounters": {
          "numberOfDeletes": 30,
          "numberOfInserts": 10,
          "numberOfUpdates": 20
        }
      }
    ],
    "consumption": {
      "totalBytes": 30000,
      "totalBytesProcessed": 30000
    },
    "dataAssetId": "id123",
    "dataAssetType": "STORAGE",
    "notChargeable": false,
    "sourceDataProvider": "STITCH",
    "notChargeableReason": "Transform to QCS",
    "changeProcessingEndedAt": "2018-10-30T07:06:22Z",
    "changeProcessingStartedAt": "2018-10-30T07:06:22Z",
    "dataAssetChangeCountersDelta": {
      "numberOfDeletes": 30,
      "numberOfInserts": 10,
      "numberOfUpdates": 20
    }
  }
}