Automated SNMP Agent Tester
The #1 Standard for SNMP Testing
SNMP managers and agents can communicate with one another because they share a common understanding of the data being exchanged (MIBs) and use the same mechanism to exchange that data (SNMP protocol). Hence, to ensure interoperability, an agent must be tested to check if its data matches the MIB definition, and if it adheres to the data exchange mechanisms (Get/GetNext/Set/GetBulk operations) specified in the SNMP protocol.
The SimpleTester™ is the industry leading SNMP test tool that automatically exercises SNMP v1, v2C, and v3 agents. All types of SNMP Agents (standalone, proxies, sub-agents) implementing one or more standard, experimental or private MIBs can be exhaustively tested, within minutes.
As the number of MIBs, MIB variables and instances supported by an SNMP agent grows, it can take weeks or even months to manually test each variable using tools like a typical MIB Browser. This is where the SimpleTester is most useful. The SimpleTester is an "SNMP Expert" program that will intelligently interpret MIB files, SNMP protocol specifications, and all the MIB objects supported by the agent. Using this knowledge, it automates the testing process to complete weeks worth of manual testing - in just minutes.
The SimpleTester contains syntax tests, semantic tests, performance tests, and other utilities.
The predefined syntax tests check for MIB and SNMP protocol compliance for any MIB by sending hundreds of different Get/GetNext/Set/GetBulk requests and analyzing the response for each and every MIB object supported by the agent. With each test result, reference is given to the RFC which specifies the behavior being tested.
The semantic tests include over 1100 tests to validate the semantics of popular MIBs like MIB-II, RMON and SNMPv3. These tests further ensure that the agent has implemented the behavior of each MIB object properly. For example, in MIB-II if 2000 octets are sent to the agent, its ifInOctets for the corresponding interface should at least increment by that amount. The tests can be easily customized by making changes to configuration files. In addition, the source code of all the 1100+ tcl scripts is also available for perusal. The framework is also fully documented to allow users to easily add their own test suites.
The performance tests measure the agent's ability to handle a stream of requests, one after another, and its ability to handle a set of requests all at once. With these tests the SimpleTester is measuring response times and creates a report which indicates the shortest, the longest, and the average response time given the number of messages sent and received.
The test suite structure support is fully extensible. Users can develop and add their own semantic test suites using the test suite builder which has a very easy to use graphical user interface.
The built-in Tcl interpretor has support for SNMP, Telnet and Serial I/O to allow users to define their own scripts that test other aspects of the device including its Command Line Interface (CLI).
The SimpleTester includes a MIB Browser that graphically displays the object registration tree and allows the retrieval and setting of manageable objects.
In addition to the user interface, the SimpleTester can also be run in an unattended mode by specifying the tests to be conducted in a command file.
SimpleTester also includes support for Diffie-Hellman Key Change and Key Ignition. Ability to create random numbers and their corresponding keys is also available. This functionality is particularly useful within the Cable Modem industry implementing the DOCSIS 1.1 specifications.
A few simple steps are required to start an Agent. They are:
- Use the built-in MIB compiler to load the MIBs supported by the Agent.
- Use the built-in MIB walker to specify the variables to be tested.
- Run any or all of the predefined tests to check for conformance with the MIB definitions and SNMP specifications. The detailed reports pinpoint problem areas.
- Use the built-in Script Generator and RowStatus Tester to automatically create test scripts and the built-in Script Runner to run these scripts for load and regression testing.
- Optionally use the built-in Semantics checker to check the implementation of popular MIBs.
- Supports IPv4 and IPv6.
- Checks MIBs (v1 and v2 SMI) for Syntax Errors.
- Checks agent responses (and traps) for conformance with the associated MIBs.
- Checks agent for compliance with the SNMP protocol specification (SNMPv1, v2C and v3)
- Automatically tests each MIB variable for get, getnext, getbulk and set operations.
- Supports the Posix test results as defined in IEEE std 2003-1997.
- Includes over 1100 semantic tests for popular MIBs like MIB-II, RMON and SNMPv3 with source code.
- Creates script files to be used for regression, load and "RowStatus" related testing.
- Provides detailed reports that pinpoint problems.
- Includes Tcl interpreter and SNMP, Telnet and Serial I/O Tcl commands for custom script development.
- Contains a simple MIB Browser that graphically displays the MIB structure.
- Supports MD5, SHA, DES, for standard SNMPv3 authentication and privacy.
- Support for 3DES, as well as AES with 128, 192, and 256 key lengths, also available in US.
- Includes support for Diffie-Hellman Key Change and Key Ignition.
- Supports functionality to include user defined test suites.
- Includes a test suite builder to ease the burden of creating and organizing user defined test suites.(Windows version)
- Supports both hardware andsoftware based licensing schemes.
- Simple, intuitive, easy to use interface that runs on a PC.
Test Suites Included
- Complete Syntax Test Suites for Any MIB:
- Standard IETF MIBs, Experimental MIBs, or Proprietary MIBs.
- MIB-II Semantic Test Suite
- RMON Semantic Test Suite
- SNMPv3 Semantic Test Suite
- Diffie-Hellman Semantic Test Suite
- IPv6 Semantic Test Suite
- Performance Test Suite
Additional Test Suites Available:
- SAN Test Suite
- DOCSIS 1.1 Test Suites for CM and CMTS
- DOCSIS 2.0 Test Suites for CM and CMTS
Supported IETF RFC's
- RFC 1157 - Simple Network Management Protocol
- RFC 1155 - Structure of Management Information
- RFC 1212 - Concise MIB Definitions
SNMPv2 Data Definition
- RFC 3411 - Architecture for SNMP Frameworks
- RFC 3412 - Message Processing and Dispatching
- RFC 3413 - SNMPv3 Applications
- RFC 3414 - User-based Security Model
- RFC 3415 - View-based Access Control Model
- RFC 1321 - MD5 Message-Digest Algorithm
- RFC 2104 - HMAC: Keyed-Hashing for Message Authentication
- RFC 2786 - Diffie-Helman USM Key
Hardware and Software Requirements
The SimpleTester is supported on the following:
- Microsoft Windows 95/98/NT/2000/XP/7/8
- RedHat Linux 9.0 or higher
SimpleSoft provides a whole family of SNMP Agent testers to ensure that as your agent complexity and testing requirements grow, SimpleTester solutions grow with it. The smooth upgrade path also minimizes the need for retraining and learning a new and different test tools. As your test environment grows, individual testers familiar with SimpleTester will find it straight-forward to migrate to the SimpleTesterPro and carry out additional vulnerability testing. Test departments with many test engineers can migrate to using the floating license to carry out SNMP testing, by using a license server-based solution.
SimpleTester Family Feature Comparisons provides a tabulated description of the features available in SimpleTester, SimpleTesterLite and SimpleTester for Workgroups.
Current Users Include
More than 250 networking companies including CableLabs, Cisco, Nortel, Lucent, 3Com, Alcatel, Nokia, HP, TI, Fujitsu, Ericsson, and Deutsche Telekom.
Back in 1994, some of the openly available ISODE 8.0/SNMPv2 software distributions included a number of Tcl based test scripts to check for SNMP MIB and protocol compliance. But the process of getting the dependent software packages (BLT,ISODE, Tcl/Tk) and compiling them was fairly long and cumbersome and required gigabytes of space as well as a good understanding of the UNIX operating system. The test suite was also only available on UNIX.
Realizing the ubiquity of PCs, SimpleSoft created the first commercially available Microsoft Windows 3.1 based automated SNMP agent tester (SimpleTester). It was written in C, easy to use, and included some of the tests in the openly available package augmented with script generation and trap checking capabilities. The shrink-wrap product required only a few megabytes of space and could be used out-of-the-box. This made the test engineers productive very quickly without requiring them to be UNIX gurus.
SimpleTester's ease of use soon made it a popular SNMP tester on hundreds of PCs in testing labs all around the world and its popularity continues to grow with every passing day.