Skip to content

Instantly share code, notes, and snippets.

@gspncr

gspncr/new-relic-snmp-demo.md

Last active October 1, 2020 17:49
Show Gist options
  • Save gspncr/9ae22ba2a22b623e0b00e0a0f5e95a82 to your computer and use it in GitHub Desktop.
Save gspncr/9ae22ba2a22b623e0b00e0a0f5e95a82 to your computer and use it in GitHub Desktop.
Download ZIP
New Relic 💙 SNMP
Raw
new-relic-snmp-demo.md

Demo SNMP and New Relic Setup

Assumptions: Ubuntu 18 and New Relic Infra already installed.

Install SNMP, SNMP daemon, optionally mibs downloader

sudo apt install snmpd snmp snmp-mibs-downloader

Replace snmpd.conf with contents of below file. Really we are just commenting out line 15 and uncommenting line 17. Adding line 64 and line 185.

sudo vi /etc/snmp/snmpd.conf

SNMPD needs a restart to read the new config.

sudo systemctl restart snmpd

Use this test string and it should give the same output as if you did command uname -a so if it doesn't work then something is wrong.

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.2.1.1.1.0

Now install New Relic Integration SNMP

sudo apt-get install nri-snmp

Navigate to the integrations folder and new snmp .template files are there. You can just use the ones I supplier below though.

cd /etc/newrelic-infra/integrations.d

Before we setup the config let's set up what mibs to collect. Use the template or just c + p my example below.

sudo vi snmp-config.yml

Populate with the file I provided or use your own from the template file. This is telling the integration to run against the mibs we provided.

sudo vi /etc/newrelic-infra/integrations.d/snmp-config.yml

In New Relic Data Explorer you should be seeing the event SNMPSample exists. If not, check infra agent logs.

Raw
other-snmp-commands.md

Other SNMP Commands (Ubuntu)

System uptime:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.2.1.1.3.0

Memory

Total swap size:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.3.0

Available swap space:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.4.0

Total system memory:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.5.0

Total used memory:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.6.0

Total memory free:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.11.0

Total shared memory:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.13.0

Total buffered memory:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.4.14.0

Total cached memory:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 1.3.6.1.4.1.2021.4.15.0

Disk

Disk mount path:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.2.1

Partition path:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.3.1

kB partition size:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.6.1

kB available space on partition:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.7.1

kB used space on partition:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.8.1

% used space on partition:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.9.1

% used inodes on partition:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.9.1.10.1

CPU

1 min CPU Load:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.10.1.3.1

5 min CPU Load:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.10.1.3.2

15 min CPU Load:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.10.1.3.3

% user CPU Load:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.9.0

raw user CPU time:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.50.0

% of system CPU time:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.10.0

raw system CPU time:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.52.0

% of idle CPU time:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.11.0

raw idle CPU time:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.53.0

raw nice CPU time:

snmpget -u bootstrap -l authPriv -a MD5 -x DES -A password -X password 127.0.0.1 .1.3.6.1.4.1.2021.11.51.0

reference

Raw
snmp-config.yml
integration_name: com.newrelic.snmp
instances:
- name: NR-SNMP-MIB
command: metrics
arguments:
snmp_host: localhost
snmp_port: 161
username: bootstrap
auth_passphrase: password
priv_passphrase: password
auth_protocol: MD5
priv_protocol: DES
community: public
v2: false
v3: true
collection_files: "/etc/newrelic-infra/integrations.d/snmp-metrics.yml"
labels:
key1: ok
- name: NR-SNMP-MIB-inv
command: inventory
arguments:
snmp_host: localhost
snmp_port: 161
community: public
collection_files: "/etc/newrelic-infra/integrations.d/snmp-metrics.yml"
labels:
key1: ok
Raw
snmp-metrics.yml
collect:
- device: NR-SNMP-MIB
metric_sets:
- name: scalar metrics
type: scalar
event_type: SNMPSample
metrics:
- metric_name: myLocalHost
oid: .1.3.6.1.2.1.1.1.0
- metric_name: uptime
oid: .1.3.6.1.2.1.1.3.0
- metric_name: totalSystemMemory
oid: .1.3.6.1.4.1.2021.4.5.0
- metric_name: totalSwapSize
oid: .1.3.6.1.4.1.2021.4.3.0
- metric_name: availableSwapSize
oid: .1.3.6.1.4.1.2021.4.4.0
- metric_name: totalUsedMemory
oid: .1.3.6.1.4.1.2021.4.6.0
- metric_name: totalAvailableMemory
oid: .1.3.6.1.4.1.2021.4.11.0
- metric_name: totalSharedMemory
oid: .1.3.6.1.4.1.2021.4.13.0
- metric_name: totalBufferedMemory
oid: .1.3.6.1.4.1.2021.4.14.0
- metric_name: totalCachedMemory
oid: .1.3.6.1.4.1.2021.4.15.0
- metric_name: diskMountPath
oid: .1.3.6.1.4.1.2021.9.1.2.1
- metric_name: partitionPath
oid: .1.3.6.1.4.1.2021.9.1.3.1
- metric_name: partitionSize
oid: .1.3.6.1.4.1.2021.9.1.6.1
- metric_name: availablePartitionSpace
oid: .1.3.6.1.4.1.2021.9.1.7.1
- metric_name: usedPartitionSpace
oid: .1.3.6.1.4.1.2021.9.1.8.1
- metric_name: percentageUsedPartitionSpace
oid: .1.3.6.1.4.1.2021.9.1.9.1
- metric_name: percentageUsedPartitionInodes
oid: .1.3.6.1.4.1.2021.9.1.10.1
- metric_name: oneMinCPULoad
oid: .1.3.6.1.4.1.2021.10.1.3.1
- metric_name: fiveMinCPULoad
oid: .1.3.6.1.4.1.2021.10.1.3.2
- metric_name: fifteenMinCPULoad
oid: .1.3.6.1.4.1.2021.10.1.3.3
- metric_name: percentUserCPULoad
oid: .1.3.6.1.4.1.2021.11.9.0
- metric_name: rawUserCPUTime
oid: .1.3.6.1.4.1.2021.11.50.0
- metric_name: percentSystemCPUTime
oid: .1.3.6.1.4.1.2021.11.10.0
- metric_name: rawSystemCPUTime
oid: .1.3.6.1.4.1.2021.11.52.0
- metric_name: percentIdleCPUTime
oid: .1.3.6.1.4.1.2021.11.11.0
- metric_name: rawIdleCPUTime
oid: .1.3.6.1.4.1.2021.11.53.0
- metric_name: rawNiceCPUTime
oid: .1.3.6.1.4.1.2021.11.51.0
Raw
snmpd.conf
###############################################################################
#
# EXAMPLE.conf:
# An example configuration file for configuring the Net-SNMP agent ('snmpd')
# See the 'snmpd.conf(5)' man page for details
#
# Some entries are deliberately commented out, and will need to be explicitly activated
#
###############################################################################
#
# AGENT BEHAVIOUR
#
# Listen for connections from the local system only
#agentAddress udp:127.0.0.1:161
# Listen for connections on all interfaces (both IPv4 *and* IPv6)
agentAddress udp:161,udp6:[::1]:161
###############################################################################
#
# SNMPv3 AUTHENTICATION
#
# Note that these particular settings don't actually belong here.
# They should be copied to the file /var/lib/snmp/snmpd.conf
# and the passwords changed, before being uncommented in that file *only*.
# Then restart the agent
# createUser authOnlyUser MD5 "remember to change this password"
# createUser authPrivUser SHA "remember to change this one too" DES
# createUser internalUser MD5 "this is only ever used internally, but still change the password"
# If you also change the usernames (which might be sensible),
# then remember to update the other occurances in this example config file to match.
###############################################################################
#
# ACCESS CONTROL
#
# system + hrSystem groups only
view systemonly included .1.3.6.1.2.1.1
view systemonly included .1.3.6.1.2.1.25.1
# Full access from the local host
rocommunity public localhost
# Default access to basic system info
rocommunity public default -V systemonly
# rocommunity6 is for IPv6
rocommunity6 public default -V systemonly
# Full access from an example network
# Adjust this network address to match your local
# settings, change the community string,
# and check the 'agentAddress' setting above
rocommunity secret 10.0.0.0/16
# Full read-only access for SNMPv3
rouser authOnlyUser
rwuser bootstrap priv
rwuser demo priv # Full write access for encrypted requests
# Remember to activate the 'createUser' lines above
#rwuser authPrivUser priv
# It's no longer typically necessary to use the full 'com2sec/group/access' configuration
# r[ow]user and r[ow]community, together with suitable views, should cover most requirements
###############################################################################
#
# SYSTEM INFORMATION
#
# Note that setting these values here, results in the corresponding MIB objects being 'read-only'
# See snmpd.conf(5) for more details
sysLocation Sitting on the Dock of the Bay
sysContact Me <gspencer@example.org>
# Application + End-to-End layers
sysServices 72
#
# Process Monitoring
#
# At least one 'mountd' process
proc mountd
# No more than 4 'ntalkd' processes - 0 is OK
proc ntalkd 4
# At least one 'sendmail' process, but no more than 10
proc sendmail 10 1
# Walk the UCD-SNMP-MIB::prTable to see the resulting output
# Note that this table will be empty if there are no "disk" entries in the snmpd.conf file
#
# System Load
#
# Unacceptable 1-, 5-, and 15-minute load averages
load 12 10 5
# Walk the UCD-SNMP-MIB::laTable to see the resulting output
# Note that this table *will* be populated, even without a "load" entry in the snmpd.conf file
###############################################################################
#
# ACTIVE MONITORING
#
# send SNMPv1 traps
trapsink localhost public
# send SNMPv2c traps
#trap2sink localhost public
# send SNMPv2c INFORMs
#informsink localhost public
# Note that you typically only want *one* of these three lines
# Uncommenting two (or all three) will result in multiple copies of each notification.
#
# Event MIB - automatically generate alerts
#
# Remember to activate the 'createUser' lines above
iquerySecName internalUser
rouser internalUser
# generate traps on UCD error conditions
defaultMonitors yes
# generate traps on linkUp/Down
linkUpDownNotifications yes
###############################################################################
#
# EXTENDING THE AGENT
#
#
# Arbitrary extension commands
#
extend test1 /bin/echo Hello, world!
extend-sh test2 echo Hello, world! ; echo Hi there ; exit 35
#extend-sh test3 /bin/sh /tmp/shtest
# Note that this last entry requires the script '/tmp/shtest' to be created first,
# containing the same three shell commands, before the line is uncommented
# Walk the NET-SNMP-EXTEND-MIB tables (nsExtendConfigTable, nsExtendOutput1Table
# and nsExtendOutput2Table) to see the resulting output
# Note that the "extend" directive supercedes the previous "exec" and "sh" directives
# However, walking the UCD-SNMP-MIB::extTable should still returns the same output,
# as well as the fuller results in the above tables.
#
# "Pass-through" MIB extension command
#
#pass .1.3.6.1.4.1.8072.2.255 /bin/sh PREFIX/local/passtest
#pass .1.3.6.1.4.1.8072.2.255 /usr/bin/perl PREFIX/local/passtest.pl
# Note that this requires one of the two 'passtest' scripts to be installed first,
# before the appropriate line is uncommented.
# These scripts can be found in the 'local' directory of the source distribution,
# and are not installed automatically.
# Walk the NET-SNMP-PASS-MIB::netSnmpPassExamples subtree to see the resulting output
#
# AgentX Sub-agents
#
# Run as an AgentX master agent
master agentx
# Listen for network connections (from localhost)
# rather than the default named socket /var/agentx/master
#agentXSocket tcp:localhost:705
createUser bootstrap MD5 password DES
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment