Skip to main content

Datometry Documentation

About Hyper-Q Log Files

You can collect log files for Hyper-Q. Checking the log files can help you identify sources of failure.

By default, Hyper-Q log files are in the directory /opt/datometry/logs. The available log files are:

  • default_tracer-DATE_TIME.csv contains trace messages.

  • error_log-DATE_TIME.csv contains critical startup messages as well as errors at run time.

  • system_info-DATE_TIME.csv contains global system activity messages.

At startup and at midnight new log files are created with the current date and time as part of the filename. The date and time format is YYYY-MM-DD HH:MM:SS. For example: 2021-04-23T18-32-14. Log entries in the Hyper-Q logs are always in the Universal Time Coordinated (UTC).

Note

There are default locations for log files, but you can change these locations. If you change the location of a log file from its default location, ensure that you maintain a record of the new location. To confirm the location of the Hyper-Q log files for your deployment, look at the “general”.log_dir = path parameter in the dtm.ini configuration file. The file is located at: /opt/datometry/config/dtm.ini

To learn how to collect log events for Hyper-Q VM, and parse them using Azure Monitor, see Hyper-Q Monitoring and Alerting Using Azure Analytics and Telegraf Data Collector.

Log File Disk Requirements

Log files grow in size without bounds and can quickly consume quite a lot of disk space. You should monitor your log file usage, and have an awareness of how much disk space the Hyper-Q log files occupy.

A common solution to this situation is to keep only the most recent log files on the Hyper-Q VM disk, and to archive older log files to a secondary storage solution. By storing all archived logs in a separate location, you secure them against data loss.