vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/mrs/component-operation-guide-lts/mrs_01_1118.html
Yang, Tong 3f5759eed2 MRS comp-lts 2.0.38.SP20 version 
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Yang, Tong <yangtong2@huawei.com>
Co-committed-by: Yang, Tong <yangtong2@huawei.com>
2023-01-19 17:08:45 +00:00

6.9 KiB
Raw Permalink Blame History

Viewing Historical Job Information

Scenario

Query the execution status and execution duration of a Loader job during routine maintenance. You can perform the following operations on the job:

  • Dirty Data: Query data that fails to be processed or data that is filtered out during job execution, and check which source data does not meet transformation or cleaning rules.
  • Logs: Query log information about job execution in MapReduce.

Prerequisites

You have obtained the username and password for logging in to the Loader WebUI.

Procedure

  1. Access the Loader web UI.

    1. Log in to FusionInsight Manager. For details, see Accessing FusionInsight Manager.
    2. Choose Cluster > Name of the desired cluster > Services > Loader.
    3. Click LoaderServer(Node name, Active). The Loader web UI is displayed.
      Figure 1 Loader web UI

  2. Query historical records of a Loader job.

    1. Locate the row that contains the job to be viewed.
    2. As shown in the following figure, click History to view the job execution history.
      Figure 2 Viewing historical records
      Table 1 Parameters

      Name

      Description

      Rows/Files Read

      Indicates the number of rows (files) read from the input source.

      Rows/Files Written

      Number of rows (files) written to the output source.

      Rows/Files Overridden
      • Indicates the number of bad rows (files) recorded during transformation. The input format is incorrect, so transformation cannot be performed.
      • Number of rows that are skipped after filtering conditions are configured during conversion.

Parent topic: Job Management