Skip to main content

Datometry Documentation

Prepare a Log Uploader Configuration File

You specify which Hyper-Q log files to upload to Azure Blob storage using a configuration file that you create. You can either create the file using a text editor on your local computer and upload it, or you can create it in place on the Hyper-Q VM.

Procedure
  1. In a text editor, create a file and name it az_blob_append.ini.

  2. Create a configuration with which to upload the Hyper-Q log files to Azure Blob storage.

    See Log Upload Configuration File Parameters for a list of configuration parameters and Example Log Uploader Configuration Fileconfiguration file.

  3. Save in UTF-8 format and close the file.

Log Upload Configuration File Parameters

When you prepare your configuration file, you set parameters and values to provide data for the uploading of Hyper-Q log files to Azure Blob storage.

Table 21. Log Upload Configuration Parameters

Parameter

Description

prefix

(Optional) A string that is prefixed to the blob name. You can use this to prepend a hostname or other identifier to duplicate files. Additionally, you can add a trailing slash (/) to replicate a file system directory path.

By default, prefix is an empty string.

account_url

HTTPS URL to the destination storage account. Anything after the trailing slash (/) is ignored.

For example: https://dtm-log.blob.core.windows.net/

container_name

Name of the Blob storage container you intend to use for storage.

account_key

(Optional) This parameter is required if you are authenticating using a Storage Account Key.

To learn more, see the Microsoft Azure article Choose how to authorize access to blob data in the Azure portal.

storage_access_signature

(Optional) This parameter is required if you are authenticating using a SAS token.

Important

Do not enclose the parameter value in quotes.

To learn more, see the Microsoft Azure article Create SAS tokens for Document Translation processing.

client_id

(Optional) The Client ID to use for User Managed Identities. This parameter is required if you are authenticating using User Managed Identities.

To learn more, see the Microsoft Azure article What are managed identities for Azure resources?



Example Log Uploader Configuration File

This is an example az_blob_append.ini configuration file.

[/opt/datometry/logs/error_log*.csv] 
prefix=myhost/error_logs/ 
account_url=https://dtm-log.blob.core.windows.net/ 
container_name=logs 
; account_key=optional_storage_account_key 
storage_access_signature=storage_access_signature 
; client_id=optional_managed_identity_client_id_for_user_assigned_identities 

[/opt/datometry/logs/default_tracer*.csv] 
prefix=myhost/default_tracer/ 
account_url=https://dtm-log.blob.core.windows.net/ 
container_name=logs 
account_key=optional_storage_account_key 
 
[/opt/datometry/logs/another_file_using_managed_identities] 
prefix=myhost/another_file/ 
account_url=https://dtm-log.blob.core.windows.net/ 
container_name=logs