SHOW-LOAD-PROFILE

Name

SHOW LOAD PROFILE

Description

该语句是用来查看导入操作的Profile信息，该功能需要用户打开 Profile 设置，0.15 之前版本执行下面的设置：

SET is_report_success=true;

0.15 及之后的版本执行下面的设置：

SET [GLOBAL] enable_profile=true;

语法：

show load profile "/";
 
show load profile "/[queryId]"

这个命令会列出当前保存的所有导入 Profile。每行对应一个导入。其中 QueryId 列为导入作业的 ID。这个 ID 也可以通过 SHOW LOAD 语句查看拿到。我们可以选择我们想看的 Profile 对应的 QueryId，查看具体情况

Example

1. 列出所有的 Load Profile

   mysql> show load profile "/";
   +---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
   | QueryId | User | DefaultDb | SQL  | QueryType | StartTime           | EndTime             | TotalTime | QueryState |
   +---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
   | 10441   | N/A  | N/A       | N/A  | Load      | 2021-04-10 22:15:37 | 2021-04-10 22:18:54 | 3m17s     | N/A        |
   +---------+------+-----------+------+-----------+---------------------+---------------------+-----------+------------+
   2 rows in set (0.00 sec)

2. 查看有导入作业的子任务概况：

   mysql> show load profile "/10441";
   +-----------------------------------+------------+
   | TaskId                            | ActiveTime |
   +-----------------------------------+------------+
   | 980014623046410a-88e260f0c43031f1 | 3m14s      |
   +-----------------------------------+------------+

3. 查看指定子任务的 Instance 概况

   mysql> show load profile "/10441/980014623046410a-88e260f0c43031f1";
   +-----------------------------------+------------------+------------+
   | Instances                         | Host             | ActiveTime |
   +-----------------------------------+------------------+------------+
   | 980014623046410a-88e260f0c43031f2 | 10.81.85.89:9067 | 3m7s       |
   | 980014623046410a-88e260f0c43031f3 | 10.81.85.89:9067 | 3m6s       |
   | 980014623046410a-88e260f0c43031f4 | 10.81.85.89:9067 | 3m10s      |
   | 980014623046410a-88e260f0c43031f5 | 10.81.85.89:9067 | 3m14s      |
   +-----------------------------------+------------------+------------+

4. 继续查看某一个具体的 Instance 上各个算子的详细 Profile

   mysql> show load profile "/10441/980014623046410a-88e260f0c43031f1/980014623046410a-88e260f0c43031f5"\G
    
   *************************** 1. row ***************************
    
   Instance:
    
         ┌-----------------------------------------┐
    
         │[-1: OlapTableSink]                      │
    
         │(Active: 2m17s, non-child: 70.91)        │
    
         │  - Counters:                            │
    
         │      - CloseWaitTime: 1m53s             │
    
         │      - ConvertBatchTime: 0ns            │
    
         │      - MaxAddBatchExecTime: 1m46s       │
    
         │      - NonBlockingSendTime: 3m11s       │
    
         │      - NumberBatchAdded: 782            │
    
         │      - NumberNodeChannels: 1            │
    
         │      - OpenTime: 743.822us              │
    
         │      - RowsFiltered: 0                  │
    
         │      - RowsRead: 1.599729M (1599729)    │
    
         │      - RowsReturned: 1.599729M (1599729)│
    
         │      - SendDataTime: 11s761ms           │
    
         │      - TotalAddBatchExecTime: 1m46s     │
    
         │      - ValidateDataTime: 9s802ms        │
    
         └-----------------------------------------┘
    
                              │
    
   ┌-----------------------------------------------------┐
    
   │[0: BROKER_SCAN_NODE]                                │
    
   │(Active: 56s537ms, non-child: 29.06)                 │
    
   │  - Counters:                                        │
    
   │      - BytesDecompressed: 0.00                      │
    
   │      - BytesRead: 5.77 GB                           │
    
   │      - DecompressTime: 0ns                          │
    
   │      - FileReadTime: 34s263ms                       │
    
   │      - MaterializeTupleTime(*): 45s54ms             │
    
   │      - NumDiskAccess: 0                             │
    
   │      - PeakMemoryUsage: 33.03 MB                    │
    
   │      - RowsRead: 1.599729M (1599729)                │
    
   │      - RowsReturned: 1.599729M (1599729)            │
    
   │      - RowsReturnedRate: 28.295K sec               │
    
   │      - TotalRawReadTime(*): 1m20s                   │
    
   │      - TotalReadThroughput: 30.39858627319336 MB/sec│
    
   │      - WaitScannerTime: 56s528ms                    │
    
   └-----------------------------------------------------┘

Keywords

SHOW, LOAD, PROFILE

Best Practice