DataNode Metrics

Metric Name Description Unit CDH Version
alerts Alerts events CDH3, CDH4
block_checksum_op_avg_time Block Checksum Average Time ms CDH3, CDH4
block_checksum_op_num_ops Block Checksum Operations operations CDH3, CDH4
block_reports_avg_time Block Reports Average Time ms CDH3, CDH4
block_reports_num_ops Block Reports Operations operations CDH3, CDH4
block_verification_failures Block Verification Failures failures CDH3, CDH4
blocks_read Blocks Read blocks CDH3, CDH4
blocks_removed Blocks Removed blocks CDH3, CDH4
blocks_replicated Blocks Replicated blocks CDH3, CDH4
blocks_verified Blocks Verified blocks CDH3, CDH4
blocks_written Blocks Written blocks CDH3, CDH4
bytes_read Number of bytes read bytes CDH3, CDH4
bytes_written Bytes Written bytes CDH3, CDH4
cgroup_mem_page_cache Page cache usage of the role's cgroup bytes CDH3, CDH4
cgroup_mem_rss Resident memory of the role's cgroup bytes CDH3, CDH4
cgroup_mem_swap Swap usage of the role's cgroup bytes CDH3, CDH4
cgroup_read_bytes Bytes read from all disks by the role's cgroup bytes CDH3, CDH4
cgroup_read_ios Number of read I/O operations from all disks by the role's cgroup ios CDH3, CDH4
cgroup_total_cpu_system CPU usage of the role's cgroup seconds CDH3, CDH4
cgroup_total_cpu_user User Space CPU usage of the role's cgroup seconds CDH3, CDH4
cgroup_write_bytes Bytes written to all disks by the role's cgroup bytes CDH3, CDH4
cgroup_write_ios Number of write I/O operations to all disks by the role's cgroup ios CDH3, CDH4
copy_block_op_avg_time Copy Block Average Time ms CDH3, CDH4
copy_block_op_num_ops Copy Block Operations operations CDH3, CDH4
dfs_capacity Total configured HDFS storage capacity bytes CDH3, CDH4
dfs_capacity_used Storage space used by HDFS files bytes CDH3, CDH4
dfs_capacity_used_non_hdfs Storage space used by non-HDFS files bytes CDH3, CDH4
events_critical Critical Events events CDH3, CDH4
events_important Important Events events CDH3, CDH4
events_informational Informational Events events CDH3, CDH4
fd_max Maximum number of file descriptors file descriptors CDH3, CDH4
fd_open Open file descriptors file descriptors CDH3, CDH4
get_block_info_avg_time Get Block Info Average Time ms CDH3
get_block_info_num_ops Get Block Info Operations operations CDH3
get_block_local_path_info_avg_time Get Block Local Path Info Average Time ms CDH3, CDH4
get_block_local_path_info_num_ops Get Block Local Path Info Operations operations CDH3, CDH4
get_block_meta_data_info_avg_time Get Block Metadata Info Average Time ms CDH3
get_block_meta_data_info_num_ops Get Block Metadata Info Operations operations CDH3
get_protocol_version_avg_time Get Protocol Version Average Time ms CDH3
get_protocol_version_num_ops Get Protocol Version Operations operations CDH3
heartbeats_avg_time Heartbeat Average Time ms CDH3, CDH4
heartbeats_num_ops Heartbeats operations CDH3, CDH4
host_health The health of the host on which the role runs kaiser health CDH3, CDH4
host_subject_status_1 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_10 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_2 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_3 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_4 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_5 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_6 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_7 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_8 Field containing subject specific status information subject status CDH3, CDH4
host_subject_status_9 Field containing subject specific status information subject status CDH3, CDH4
jvm_blocked_threads Blocked threads threads CDH3, CDH4
jvm_gc_count Number of garbage collections garbage collections CDH3, CDH4
jvm_gc_time_ms Total time spent garbage collecting (ms) ms CDH3, CDH4
jvm_heap_committed_mb Total amount of committed heap memory (MB) MB CDH3, CDH4
jvm_heap_used_mb Total amount of used heap memory (MB) MB CDH3, CDH4
jvm_max_memory_mb Maximum allowed memory (MB) MB CDH3, CDH4
jvm_new_threads New threads threads CDH3, CDH4
jvm_non_heap_committed_mb Total amount of committed non-heap memory (MB) MB CDH3, CDH4
jvm_non_heap_used_mb Total amount of used non-heap memory (MB) MB CDH3, CDH4
jvm_runnable_threads Runnable threads threads CDH3, CDH4
jvm_terminated_threads Terminated threads threads CDH3, CDH4
jvm_timed_waiting_threads Timed waiting threads threads CDH3, CDH4
jvm_total_threads Total threads threads CDH3, CDH4
jvm_waiting_threads Waiting threads threads CDH3, CDH4
kaiser_health Health value computed by Cloudera Manager kaiser health CDH3, CDH4
log_error Logged Errors messages CDH3, CDH4
log_fatal Logged Fatals messages CDH3, CDH4
log_info Logged Infos messages CDH3, CDH4
log_warn Logged Warnings messages CDH3, CDH4
login_failure_avg_time Average Failed Login Time ms CDH3, CDH4
login_failure_num_ops Login Failures operations CDH3, CDH4
login_success_avg_time Average Successful Login Time ms CDH3, CDH4
login_success_num_ops Login Successes operations CDH3, CDH4
read_block_op_avg_time Read Block Average Time ms CDH3, CDH4
read_block_op_num_ops Read Block Operations operations CDH3, CDH4
reads_from_local_client Reads From Local Clients operations CDH3, CDH4
reads_from_remote_client Reads From Remote Clients operations CDH3, CDH4
recover_block_avg_time Recover Block Average Time ms CDH3
recover_block_num_ops Recover Block Operations operations CDH3
replace_block_op_avg_time Replace Block Operation Average Time ms CDH3, CDH4
replace_block_op_num_ops Replace Block Operations operations CDH3, CDH4
role_start_time Role start time timestamp CDH3, CDH4
rpc_authentication_failures RPC Authentication Failures failures CDH3, CDH4
rpc_authentication_successes RPC Authentication Successes successes CDH3, CDH4
rpc_authorization_failures RPC Authorization Failures failures CDH3, CDH4
rpc_authorization_successes RPC Authorization Successes successes CDH3, CDH4
rpc_call_queue_length RPC Call Queue Length items CDH3, CDH4
rpc_num_open_connections Open RPC Connections connections CDH3, CDH4
rpc_processing_time_avg_time Average RPC Processing Time ms CDH3, CDH4
rpc_processing_time_num_ops RPCs Processed operations CDH3, CDH4
rpc_queue_time_avg_time Average RPC Queue Time ms CDH3, CDH4
rpc_queue_time_num_ops RPCs Queued operations CDH3, CDH4
rpc_received_bytes RPC Received Bytes bytes CDH3, CDH4
rpc_sent_bytes RPC Sent Bytes bytes CDH3, CDH4
scm_health Health value computed by Cloudera Manager SCM health CDH3, CDH4
scm_health_reason Reason for health value computed by Cloudera Manager SCM health reason CDH3, CDH4
scm_process_state Process State according to Cloudera Manager SCM process state CDH3, CDH4
scm_role_state Role state according to Cloudera Manager SCM role state CDH3, CDH4
slave_master_connectivity Indicates whether the master node detects the slave as connected master connectivity CDH3, CDH4
start_block_recovery_avg_time Start Block Recovery Average Time ms CDH3
start_block_recovery_num_ops Start Block Recovery Operations operations CDH3
subject_status_1 Field containing subject specific status information subject status CDH3, CDH4
subject_status_10 Field containing subject specific status information subject status CDH3, CDH4
subject_status_2 Field containing subject specific status information subject status CDH3, CDH4
subject_status_3 Field containing subject specific status information subject status CDH3, CDH4
subject_status_4 Field containing subject specific status information subject status CDH3, CDH4
subject_status_5 Field containing subject specific status information subject status CDH3, CDH4
subject_status_6 Field containing subject specific status information subject status CDH3, CDH4
subject_status_7 Field containing subject specific status information subject status CDH3, CDH4
subject_status_8 Field containing subject specific status information subject status CDH3, CDH4
subject_status_9 Field containing subject specific status information subject status CDH3, CDH4
total_cpu_system Total System CPU seconds CDH3, CDH4
total_cpu_user Total CPU user time seconds CDH3, CDH4
unexpected_exits Unexpected rocess exits unexpected exits CDH3, CDH4
update_block_avg_time Update Block Average Time ms CDH3
update_block_num_ops Update Block Operations operations CDH3
volume_failures Volume failures volumes CDH3, CDH4
web_metrics_collection_duration Web Server Responsiveness ms CDH3, CDH4
web_metrics_collection_status Web Metric Collection Status metric collection status CDH3, CDH4
write_block_op_avg_time Write Block Average Time ms CDH3, CDH4
write_block_op_num_ops Write Block Operations operations CDH3, CDH4
writes_from_local_client Writes From Local Clients operations CDH3, CDH4
writes_from_remote_client Writes From Remote Clients operations CDH3, CDH4
blocks_get_local_path_info Blocks Get Local Path Info operations CDH4
blocks_total Total blocks blocks CDH4
datanode_namenode_connections_bad NameNode connections in a bad state connections CDH4
datanode_namenode_connections_good NameNode connections in a good state connections CDH4
datanode_namenode_connections_unknown NameNode connections in a unknown state connections CDH4
delete_block_pool_avg_time Delete Block Pool Average Time ms CDH4
delete_block_pool_num_ops Delete Block Pool Operations operations CDH4
flush_nanos_avg_time Average Disk Flush Time nanos CDH4
flush_nanos_num_ops Disk Flushes operations CDH4
fsync_count File Fsync Count operations CDH4
fsync_nanos_avg_time Average Disk Fsync Time nanos CDH4
fsync_nanos_num_ops Disk Fsyncs operations CDH4
get_hdfs_blocks_metadata_avg_time Get HDFS Blocks Metadata Average Time ms CDH4
get_hdfs_blocks_metadata_num_ops Get HDFS Blocks Metadata Operations operations CDH4
get_replica_visible_length_avg_time Get Replica Visible Length Average Time ms CDH4
get_replica_visible_length_num_ops Get Replica Visible Length Operations operations CDH4
init_replica_recovery_avg_time Init Replica Recovery Average Time ms CDH4
init_replica_recovery_num_ops Init Replica Recovery Operations operations CDH4
metrics_dropped_pub_all Dropped Metrics Updates By All Sinks updates CDH4
metrics_num_active_sinks Active Metrics Sinks Count sinks CDH4
metrics_num_active_sources Active Metrics Sources Count sources CDH4
metrics_num_all_sinks All Metrics Sinks Count sinks CDH4
metrics_num_all_sources All Metrics Sources Count sources CDH4
metrics_publish_avg_time Metrics Publish Average Time ms CDH4
metrics_publish_num_ops Metrics Publish Operations operations CDH4
metrics_snapshot_avg_time Metrics Snapshot Average Time ms CDH4
metrics_snapshot_num_ops Metrics Snapshot Average Operations operations CDH4
packet_ack_round_trip_time_nanos_avg_time Packet Ack Round Trip Average Time nanos CDH4
packet_ack_round_trip_time_nanos_num_ops Packet Ack Round Trip Operations operations CDH4
refresh_namenodes_avg_time Refresh NameNodes Average Time ms CDH4
refresh_namenodes_num_ops Refresh NameNodes Operations operations CDH4
send_data_packet_blocked_on_network_nanos_avg_time Send Data Packet Blocked On Network Average Time nanos CDH4
send_data_packet_blocked_on_network_nanos_num_ops Send Data Packet Blocked On Network Operations operations CDH4
send_data_packet_transfer_nanos_avg_time Send Data Packet Transfer Average Time nanos CDH4
send_data_packet_transfer_nanos_num_ops Send Data Packet Transfer Operations operations CDH4
update_replica_under_recovery_avg_time Update Replica Under Recovery Average Time ms CDH4
update_replica_under_recovery_num_ops Update Replica Under Recovery Operations operations CDH4
xceiver_count Transceiver Count transceivers CDH4