Skip to content

Monitoring

Ozan Tezcan edited this page May 9, 2021 · 4 revisions

Resql provides read-only tables for monitoring. You can observe cluster status, RAM capacity, disk usage of the nodes etc. Also, you can monitor client info e.g connection time, prepared statements, connection addresses.

Tables

Table Description
resql_log Cluster-wide log table, node list, log about adding/removing node to/from cluster
resql_clients Info about connected clients
resql_nodes Nodes, connection status, machine stats
resql_statements Prepared statements

Sample output from resql_log

resql> SELECT * FROM resql_log
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| id | date                | level | log                                                                                           |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 0  | 2021-05-09 01:03:14 | INFO  | Cluster init.                                                                                 |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 3  | 2021-05-09 01:03:14 | INFO  | Term[1] : [node0:leader]                                                                      |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 4  | 2021-05-09 01:03:14 | INFO  | Term start                                                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 7  | 2021-05-09 01:03:14 | INFO  | Adding node : [tcp://[email protected]:7601]                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 8  | 2021-05-09 01:03:14 | INFO  | Term[1] : [node0:leader] [node1:follower]                                                     |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 18 | 2021-05-09 01:03:14 | INFO  | Adding node : [tcp://[email protected]:7602]                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 19 | 2021-05-09 01:03:14 | INFO  | Term[1] : [node0:leader] [node1:follower] [node2:follower]                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 24 | 2021-05-09 01:03:14 | INFO  | Adding node : [tcp://[email protected]:7603]                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 25 | 2021-05-09 01:03:14 | INFO  | Term[1] : [node0:leader] [node1:follower] [node2:follower] [node3:follower]                   |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 30 | 2021-05-09 01:03:14 | INFO  | Adding node : [tcp://[email protected]:7604]                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 31 | 2021-05-09 01:03:14 | INFO  | Term[1] : [node0:leader] [node1:follower] [node2:follower] [node3:follower] [node4:follower]  |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 35 | 2021-05-09 01:03:14 | INFO  | Term[2] : [node0:follower] [node1:leader] [node2:follower] [node3:follower] [node4:follower]  |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 37 | 2021-05-09 01:03:18 | INFO  | Term start                                                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 50 | 2021-05-09 01:03:55 | ERROR | Remove node[node10] : Node does not exists.                                                   |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 55 | 2021-05-09 01:04:05 | INFO  | Node[node0] will be removed from the cluster                                                  |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 56 | 2021-05-09 01:04:05 | INFO  | Term[2] : [node1:leader] [node2:follower] [node3:follower] [node4:follower]                   |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+
| 60 | 2021-05-09 01:04:15 | ERROR | Remove node[node0] : Node does not exists.                                                    |
+----+---------------------+-------+-----------------------------------------------------------------------------------------------+

Sample output from resql_clients

resql> SELECT * FROM resql_clients
+----------------+-----------+----------+----------------+-----------------+---------------------+------+
| client_name    | client_id | sequence | local          | remote          | connect_time        | resp |
+----------------+-----------+----------+----------------+-----------------+---------------------+------+
| gQS0SnOialYh50 | 11        | 4        | 127.0.0.1:7601 | 127.0.0.1:59546 | 2021-05-09 04:03:18 | null |
+----------------+-----------+----------+----------------+-----------------+---------------------+------+
| g_506FP0       | 40        | 0        | 127.0.0.1:7601 | 127.0.0.1:59558 | 2021-05-09 04:03:18 | null |
+----------------+-----------+----------+----------------+-----------------+---------------------+------+

Sample output from resql_nodes

resql> SELECT * FROM resql_nodes

Row number          : 0 

name                : node4 
connected           : true 
role                : follower 
urls                : tcp://[email protected]:7604 
version             : 0.0.17-latest 
git_branch          : dev 
git_commit          : ea8f342 
machine             : Linux 5.4.0-72-generic x86_64 
arch                : 64 
pid                 : 29849 
current_time        : 09-05-2021 04:05 
start_date          : 09-05-2021 04:03 
start_time          : 1620522194099 
uptime_seconds      : 151 
uptime_days         : 0 
cpu_sys             : 1.024037 
cpu_user            : 1.200216 
network_recv_bytes  : 42471 
network_send_bytes  : 10799 
network_recv        : 41.48 KB 
network_send        : 10.55 KB 
total_memory_bytes  : 33508593664 
total_memory        : 31.21 GB 
used_memory_bytes   : 6135808 
used_memory         : 5.85 MB 
fsync_count         : 29 
fsync_max_ms        : 29.512344 
fsync_average_ms    : 8.908262 
snapshot_success    : true 
snapshot_size_bytes : 40960 
snapshot_size       : 40.00 KB 
snapshot_max_ms     : 0.001000 
snapshot_average_ms : 0.001000 
dir                 : /tmp/node4 
disk_used_bytes     : 67215719 
disk_used           : 64.10 MB 
disk_free_bytes     : 23494537216 
disk_free           : 21.88 GB 
--------------------------

Row number          : 1 

name                : node1 
connected           : true 
role                : leader 
urls                : tcp://[email protected]:7601 
version             : 0.0.17-latest 
git_branch          : dev 
git_commit          : ea8f342 
machine             : Linux 5.4.0-72-generic x86_64 
arch                : 64 
pid                 : 29849 
current_time        : 09-05-2021 04:05 
start_date          : 09-05-2021 04:03 
start_time          : 1620522194049 
uptime_seconds      : 161 
uptime_days         : 0 
cpu_sys             : 1.067285 
cpu_user            : 1.243333 
network_recv_bytes  : 49304 
network_send_bytes  : 130571 
network_recv        : 48.15 KB 
network_send        : 127.51 KB 
total_memory_bytes  : 33508593664 
total_memory        : 31.21 GB 
used_memory_bytes   : 6135808 
used_memory         : 5.85 MB 
fsync_count         : 30 
fsync_max_ms        : 7.186787 
fsync_average_ms    : 3.553254 
snapshot_success    : true 
snapshot_size_bytes : 40960 
snapshot_size       : 40.00 KB 
snapshot_max_ms     : 0.001000 
snapshot_average_ms : 0.001000 
dir                 : /tmp/node1 
disk_used_bytes     : 67215719 
disk_used           : 64.10 MB 
disk_free_bytes     : 23492616192 
disk_free           : 21.88 GB 
--------------------------

Sample output from resql_statements

resql> SELECT * FROM resql_statements
+-----+-----------+-------------+-------------------------------------------+
| id  | client_id | client_name | sql                                       |
+-----+-----------+-------------+-------------------------------------------+
| 161 | 158       | JavaClient1 | INSERT INTO key_value VALUES(?, ?);       |
+-----+-----------+-------------+-------------------------------------------+
| 162 | 158       | JavaClient1 | DELETE FROM key_value WHERE key = ?;      |
+-----+-----------+-------------+-------------------------------------------+
| 163 | 158       | JavaClient1 | SELECT value from key_value WHERE key = ? |
+-----+-----------+-------------+-------------------------------------------+
| 164 | 159       | JavaClient2 | SELECT * FROM key_value WHERE value > ?   |
+-----+-----------+-------------+-------------------------------------------+
Clone this wiki locally