mikacur/MRS-operation-guide-lts
1
0
Fork 0
forked from docs/mapreduce-service
Code Pull Requests Activity
MRS-operation-guide-lts/doc/component-operation-guide-lts/source/using_tez/log_overview.rst
proposalbot d31d5b10fe Changes to mrs_operation-guide-lts from docs/doc-exports#515 (MRS comp-lts 2.0.3 
Reviewed-by: Kacur, Michal <michal.kacur@t-systems.com>
Co-authored-by: proposalbot <proposalbot@otc-service.com>
Co-committed-by: proposalbot <proposalbot@otc-service.com>
2023-01-19 16:53:12 +00:00

8.8 KiB
Raw Permalink Blame History

original_name

mrs_01_2071.html

Log Overview

Log Description

Log path: The default save path of Tez logs is /var/log/Bigdata/tez/role name.

TezUI: /var/log/Bigdata/tez/tezui (run logs) and /var/log/Bigdata/audit/tez/tezui (audit logs)

Log archive rule: The automatic compression and archiving function of Tez is enabled. By default, when the size of a log file exceeds 20 MB (which is adjustable), the log file is automatically compressed. The naming rule of the compressed log file is as follows: <Original log file name>-<yyyy-mm-dd_hh-mm-ss>.[ID].log.zip A maximum of 20 latest compressed files are retained. The number of compressed files and compression threshold can be configured.

Table 1 Tez log list
Log Type Name Description
Run log tezui.out Log file that records TezUI running environment information
tezui.log Run log of the TezUI process
tezui-omm-<Date>-gc.log.<No.> GC log of the TezUI process
prestartDetail.log Work logs generated before the TezUI is started
check-serviceDetail.log Log file that records whether the TezUI service starts successfully
postinstallDetail.log Work logs after the TezUI is installed
startDetail.log Startup log of the TezUI process
stopDetail.log Stop log of the TezUI process
Audit log tezui-audit.log TezUI audit log

Log Level

Table 2 <mrs_01_2071__en-us_topic_0000001173789436_t91045e1a946a46b4bac39028af62f3ad> describes the log levels supported by TezUI.

Levels of run logs are ERROR, WARN, INFO, and DEBUG from the highest to the lowest priority. Run logs of equal or higher levels are recorded. The higher the specified log level, the fewer the logs recorded.

Table 2 Log levels
Level Description
ERROR Logs of this level record error information about system running.
WARN Exception information about the current event processing
INFO Logs of this level record normal running status information about the system and events.
DEBUG Logs of this level record the system information and system debugging information.

To modify log levels, perform the following operations:

  1. Log in to Manager.
  2. Choose Cluster > Service > Tez > Configuration.
  3. Select All Configurations.
  4. In the navigation pane, choose TezUI > Log.
  5. Select a desired log level.
  6. Click Save. In the dialog box that is displayed, click OK to save the configuration.
  7. Click Instance, select the TezUI role, choose More > Restart Instance, enter the user password, and click OK in the dialog box that is displayed.
  8. Wait until the instance is restarted for the configuration to take effect.

Log Format

The following table lists the Tez log formats.

Table 3 Log formats
Log Type Format Example
Run log <yyyy-MM-dd HH:mm:ss,SSS><Thread that generates the log><Location of the log event> 2020-07-31 11:44:21,378 | INFO | TezUI-health-check | Start health check | com.XXX.tez.HealthCheck.run(HealthCheck.java:30)
Audit logs <yyyy-MM-dd HH:mm:ss,SSS><Thread that generates the log>< Location of the log event > 2018-12-24 12:16:25,319 | INFO | HiveServer2-Handler-Pool: Thread-185 | UserName=hive UserIP=10.153.2.204 Time=2018/12/24 12:16:25 Operation=CloseSession Result=SUCCESS Detail= | org.apache.hive.service.cli.thrift.ThriftCLIService.logAuditEvent(ThriftCLIService.java:434)