Table of Contents
Notes on Revelation's Network Products Benchmark Tests[#NPB1]
Standard Test Bank[#Fig1]
NT 4.0[#NPB4]
Windows 2000[#NPB5]
[<a name="NPB1">]Notes on Revelation's Network Products Benchmark Tests[</a>]
Revelation is pleased to publish the results of its internal network testing procedures. The purpose of these test is to:
ascertain the quality of the Revelation Network Products by performing tests that simulate extreme processing conditions.
determine the relative performance of any network operating system environment and the improvement in performance that results with the implementation of a service.
Methodology
Revelation has developed a standard test bank[#Fig1]. Under each individual network heading, there is a table that summarizes the elements of the testing environment, including network, PC types, OpenInsight version used, services, and number of loops performed. Following is the results in raw data.
Conclusions
Novell 4.11 vs. 5.0 – The performance of the Novell 5.0 environment is equal to or better than that of 4.11 in most tests performed.
Novell vs. NT – the Novell environment generally outperforms the NT environment with our products.
No service vs. Service – The introduction of the Revelation NLM to a 4.11 or 5.0 Novell Network increases performance in a range of 2 to 15 times. The introduction of the Windows 2000 Service (formerly call NT Service) to an NT 4.0 network generally increases performance in a range of 2 to 8 times.
Windows 2000 – Based on testing results, the recommended configuration is P 200 with 128 MB RAM on the server, and P 200 with 64 MB of RAM on the client.
We encourage you to use these tests in your environments and compare results to those that we obtained. Please note that performance is only one of the benefits offered by the NLM and Windows 2000 Service. Most users have experienced an incredible increase in network stability through the elimination of network errors (GFEs). Please refer to the Product Info section of our web site for complete information on the value of Revelation s Network Product portfolio.
[<a name="Fig1"]Standard Test Bank[</a>]
| Test | Test Code | Description |
| Lock/Write/Delete/Unlock | LWDU | 1. Open LH table. Each iteration of the loop corresponds to a record key. 2. Lock record at record key iteration. If lock fails, wait 1 second, then retry lock. 3. Write record at record key iteration. 4. Delete record at record key iteration. 5. Unlock record at record key iteration. |
| Lock/Write/Read/Unlock | LWRU | 1. Open LH table. Each iteration of the loop corresponds to a record key. 2. Lock record at record key iteration. If lock fails, wait 1 second, then retry lock. 3. Write record at record key iteration. 4. Read record at record key iteration. 5. Unlock record at record key iteration. |
| Lock/Write/Unlock | LWU | 1. Open LH table. Each iteration of the loop corresponds to a record key. 2. Lock record at record key iteration. If lock fails, wait 1 second, then retry lock. 3. Write record at record key iteration. 4. Unlock record at record key iteration. |
| Read | R | 1. Open LH table. Each iteration of the loop corresponds to a record key. 2. Read record from table iteration. |
| Select/ReadNext | SRN | 1. Open and select LH table. Each iteration of the loop corresponds to a record key. 2. ReadNext key. |
| Select/ReadNext/Read | SRNR | 1. Open and select LH table. Each iteration of the loop corresponds to a record key. 2. ReadNext key. 3. Read record from table at key. |
[<a name="NPB4">] NT 4.0 [</a>]
Testing Environment
| Network | Server Type | PC Types | OpenInsightVersion | Services | Loops |
| NT 4.0 | P2 300, 128MB | P133, 16MB, Windows 95 (5 machines) P166, 48 MB, Windows 98 P60, 48 MB, Windows 95 (2 machines) | 3.61 | No Service with All Networks Driver Windows 2000 Service 1.5 with All Networks Driver Windows 2000 Service 2.0 with Beta TCP/IP Driver (internal beta version) | 5,000 10,000 20,000 |
Benchmark Data
| Test Code | Loops | PC Type | Windows 2000 Service 2.0 (internal beta version) | Windows 2000 Service 1.5 | No Service |
| LWDU | 5,000 | P133,16mb (1) | 0:03:04 | 0:03:07 | 0:21:04 |
| P133,16mb (2) | 0:03:34 | 0:03:20 | 0:21:04 | ||
| P133,16mb (3) | 0:02:56 | 0:02:58 | 0:12:38 | ||
| P133,16mb (4) | 0:03:37 | 0:03:22 | 0:13:29 | ||
| P133,16mb (5) | 0:03:36 | 0:03:10 | 0:06:10 | ||
| P166,48mb | 0:03:11 | 0:03:02 | 0:05:34 | ||
| P60,48mb (1) | 0:03:13 | 0:02:55 | 0:10:44 | ||
| P60,48mb (2) | 0:03:17 | 0:02:52 | 0:12:01 | ||
| 10,000 | P133,16mb (1) | 0:05:52 | 0:05:41 | 0:31:07 | |
| P133,16mb (2) | 0:06:23 | 0:06:04 | 0:31:11 | ||
| P133,16mb (3) | 0:05:44 | 0:05:32 | 0:23:59 | ||
| P133,16mb (4) | 0:06:38 | 0:06:09 | 0:24:35 | ||
| P133,16mb (5) | 0:06:27 | 0:06:00 | 0:11:53 | ||
| P166,48mb | 0:05:53 | 0:05:52 | 0:11:14 | ||
| P60,48mb (1) | 0:06:53 | 0:06:48 | 0:21:49 | ||
| P60,48mb (2) | 0:06:30 | 0:06:26 | 0:23:07 | ||
| 20,000 | P133,16mb (1) | 0:11:05 | 0:11:00 | 0:45:12 | |
| P133,16mb (2) | 0:12:06 | 0:11:39 | 0:45:22 | ||
| P133,16mb (3) | 0:10:49 | 0:10:48 | 1:00:16 | ||
| P133,16mb (4) | 0:12:12 | 0:11:58 | 0:49:23 | ||
| P133,16mb (5) | 0:11:55 | 0:11:39 | 0:22:42 | ||
| P166,48mb | 0:11:15 | 0:11:30 | 0:21:02 | ||
| P60,48mb (1) | 0:13:56 | 0:13:00 | 0:50:04 | ||
| P60,48mb (2) | 0:13:22 | 0:12:35 | 0:51:36 | ||
| LWRU | 5,000 | P133,16mb (1) | 0:03:10 | 0:02:41 | 0:16:04 |
| P133,16mb (2) | 0:03:12 | 0:02:45 | 0:04:41 | ||
| P133,16mb (3) | 0:03:00 | 0:02:43 | 0:05:52 | ||
| P133,16mb (4) | 0:02:55 | 0:02:26 | 0:04:45 | ||
| P133,16mb (5) | 0:03:04 | 0:02:47 | 0:08:22 | ||
| P166,48mb | 0:02:38 | 0:02:37 | 0:02:54 | ||
| P60,48mb (1) | 0:04:39 | 0:04:24 | 0:06:00 | ||
| P60,48mb (2) | 0:04:29 | 0:04:10 | 0:05:38 | ||
| 10,000 | P133,16mb (1) | 0:06:18 | 0:05:15 | 0:23:11 | |
| P133,16mb (2) | 0:05:40 | 0:05:15 | 0:10:08 | ||
| P133,16mb (3) | 0:06:17 | 0:05:17 | 0:12:51 | ||
| P133,16mb (4) | 0:05:45 | 0:04:51 | 0:10:53 | ||
| P133,16mb (5) | 0:05:52 | 0:05:20 | 0:13:48 | ||
| P166,48mb | 0:05:33 | 0:05:06 | 0:06:19 | ||
| P60,48mb (1) | 0:09:32 | 0:08:54 | 0:12:11 | ||
| P60,48mb (2) | 0:09:09 | 0:08:26 | 0:11:45 | ||
| 20,000 | P133,16mb (1) | 0:13:38 | 0:11:59 | 0:48:54 | |
| P133,16mb (2) | 0:11:36 | 0:10:46 | 0:35:50 | ||
| P133,16mb (3) | 0:13:37 | 0:12:09 | 0:24:22 | ||
| P133,16mb (4) | 0:11:44 | 0:10:05 | 0:21:00 | ||
| P133,16mb (5) | 0:12:14 | 0:11:15 | 0:39:31 | ||
| P166,48mb | 0:12:02 | 0:11:05 | 0:13:34 | ||
| P60,48mb (1) | 0:17:36 | 0:16:40 | 0:23:51 | ||
| P60,48mb (2) | 0:16:47 | 0:15:39 | 0:23:21 | ||
| LWU | 5,000 | P133,16mb (1) | 0:01:57 | 0:01:59 | 0:04:28 |
| P133,16mb (2) | 0:01:53 | 0:01:56 | 0:04:24 | ||
| P133,16mb (3) | 0:02:01 | 0:02:06 | 0:04:48 | ||
| P133,16mb (4) | 0:01:59 | 0:02:03 | 0:04:18 | ||
| P133,16mb (5) | 0:02:00 | 0:02:10 | 0:04:42 | ||
| P166,48mb | 0:02:13 | 0:01:33 | 0:02:19 | ||
| P60,48mb (1) | 0:03:30 | 0:03:06 | 0:04:21 | ||
| P60,48mb (2) | 0:03:16 | 0:02:57 | 0:04:10 | ||
| 10,000 | P133,16mb (1) | 0:04:29 | 0:03:58 | 0:17:09 | |
| P133,16mb (2) | 0:03:59 | 0:03:53 | 0:08:36 | ||
| P133,16mb (3) | 0:04:33 | 0:04:03 | 0:09:50 | ||
| P133,16mb (4) | 0:04:12 | 0:04:01 | 0:08:30 | ||
| P133,16mb (5) | 0:04:15 | 0:04:07 | 0:08:39 | ||
| P166,48mb | 0:04:23 | 0:03:20 | 0:05:46 | ||
| P60,48mb (1) | 0:06:37 | 0:06:16 | 0:09:04 | ||
| P60,48mb (2) | 0:06:11 | 0:05:59 | 0:08:44 | ||
| 20,000 | P133,16mb (1) | 0:08:42 | 0:08:18 | 0:54:48 | |
| P133,16mb (2) | 0:07:55 | 0:07:51 | 1:07:48 | ||
| P133,16mb (3) | 0:09:06 | 0:08:26 | 0:18:52 | ||
| P133,16mb (4) | 0:08:26 | 0:08:22 | 0:18:19 | ||
| P133,16mb (5) | 0:08:39 | 0:08:24 | 1:03:52 | ||
| P166,48mb | 0:08:45 | 0:07:10 | 0:15:03 | ||
| P60,48mb (1) | 0:13:53 | 0:12:33 | 0:18:48 | ||
| P60,48mb (2) | 0:13:01 | 0:11:57 | 0:18:04 | ||
| R | 5,000 | P133,16mb (1) | 0:01:05 | 0:01:02 | 0:01:09 |
| P133,16mb (2) | 0:01:04 | 0:01:01 | 0:01:09 | ||
| P133,16mb (3) | 0:01:02 | 0:01:03 | 0:02:06 | ||
| P133,16mb (4) | 0:01:04 | 0:01:02 | 0:01:34 | ||
| P133,16mb (5) | 0:01:05 | 0:01:02 | 0:01:15 | ||
| P166,48mb | 0:01:00 | 0:00:57 | 0:00:54 | ||
| P60,48mb (1) | 0:01:40 | 0:01:42 | 0:02:51 | ||
| P60,48mb (2) | 0:01:31 | 0:01:30 | 0:02:32 | ||
| 10,000 | P133,16mb (1) | 0:02:07 | 0:02:04 | 0:02:23 | |
| P133,16mb (2) | 0:02:09 | 0:02:02 | 0:02:23 | ||
| P133,16mb (3) | 0:02:08 | 0:02:05 | 0:04:04 | ||
| P133,16mb (4) | 0:02:08 | 0:02:05 | 0:03:15 | ||
| P133,16mb (5) | 0:02:07 | 0:02:05 | 0:02:34 | ||
| P166,48mb | 0:01:59 | 0:01:54 | 0:01:51 | ||
| P60,48mb (1) | 0:03:19 | 0:03:23 | 0:05:51 | ||
| P60,48mb (2) | 0:03:02 | 0:03:01 | 0:05:18 | ||
| 20,000 | P133,16mb (1) | 0:04:26 | 0:04:03 | 0:05:07 | |
| P133,16mb (2) | 0:04:14 | 0:04:02 | 0:05:08 | ||
| P133,16mb (3) | 0:04:25 | 0:04:04 | 0:07:27 | ||
| P133,16mb (4) | 0:04:21 | 0:04:07 | 0:07:20 | ||
| P133,16mb (5) | 0:04:22 | 0:04:09 | 0:05:26 | ||
| P166,48mb | 0:04:03 | 0:03:47 | 0:03:53 | ||
| P60,48mb (1) | 0:06:37 | 0:06:46 | 0:12:01 | ||
| P60,48mb (2) | 0:06:02 | 0:06:03 | 0:11:16 | ||
| SRN | 5,000 | P133,16mb (1) | 0:00:34 | 0:00:34 | 0:00:50 |
| P133,16mb (2) | 0:00:34 | 0:01:26 | 0:00:49 | ||
| P133,16mb (3) | 0:00:34 | 0:00:35 | 0:01:18 | ||
| P133,16mb (4) | 0:00:37 | 0:01:24 | 0:01:03 | ||
| P133,16mb (5) | 0:00:38 | 0:00:38 | 0:00:59 | ||
| P166,48mb | 0:00:30 | 0:00:39 | 0:01:17 | ||
| P60,48mb (1) | 0:01:19 | 0:01:19 | 0:01:51 | ||
| P60,48mb (2) | 0:01:10 | 0:01:08 | 0:01:39 | ||
| 10,000 | P133,16mb (1) | 0:01:08 | 0:01:15 | 0:01:38 | |
| P133,16mb (2) | 0:01:09 | 0:02:13 | 0:01:39 | ||
| P133,16mb (3) | 0:01:09 | 0:01:14 | 0:02:40 | ||
| P133,16mb (4) | 0:01:14 | 0:02:11 | 0:02:04 | ||
| P133,16mb (5) | 0:01:15 | 0:01:25 | 0:01:56 | ||
| P166,48mb | 0:00:58 | 0:01:25 | 0:02:20 | ||
| P60,48mb (1) | 0:02:37 | 0:02:37 | 0:03:41 | ||
| P60,48mb (2) | 0:02:19 | 0:02:15 | 0:03:15 | ||
| 20,000 | P133,16mb (1) | 0:02:17 | 0:02:24 | 0:03:15 | |
| P133,16mb (2) | 0:02:18 | 0:03:22 | 0:03:15 | ||
| P133,16mb (3) | 0:02:17 | 0:02:23 | 0:05:20 | ||
| P133,16mb (4) | 0:02:28 | 0:03:28 | 0:04:06 | ||
| P133,16mb (5) | 0:02:31 | 0:02:40 | 0:03:44 | ||
| P166,48mb | 0:01:57 | 0:02:30 | 0:03:57 | ||
| P60,48mb (1) | 0:05:15 | 0:05:15 | 0:07:25 | ||
| P60,48mb (2) | 0:04:37 | 0:04:31 | 0:06:30 | ||
| SRNR | 5,000 | P133,16mb (1) | 0:01:06 | 0:01:02 | 0:01:38 |
| P133,16mb (2) | 0:00:57 | 0:01:02 | 0:01:39 | ||
| P133,16mb (3) | 0:01:05 | 0:01:02 | 0:02:41 | ||
| P133,16mb (4) | 0:01:04 | 0:01:05 | 0:02:00 | ||
| P133,16mb (5) | 0:01:05 | 0:01:05 | 0:01:37 | ||
| P166,48mb | 0:00:56 | 0:00:57 | 0:01:10 | ||
| P60,48mb (1) | 0:01:40 | 0:01:43 | 0:03:36 | ||
| P60,48mb (2) | 0:01:30 | 0:01:31 | 0:03:25 | ||
| 10,000 | P133,16mb (1) | 0:02:10 | 0:02:21 | 0:03:17 | |
| P133,16mb (2) | 0:02:00 | 0:02:13 | 0:03:18 | ||
| P133,16mb (3) | 0:02:10 | 0:02:17 | 0:05:17 | ||
| P133,16mb (4) | 0:02:10 | 0:02:17 | 0:04:02 | ||
| P133,16mb (5) | 0:02:10 | 0:02:16 | 0:03:16 | ||
| P166,48mb | 0:01:56 | 0:02:00 | 0:02:15 | ||
| P60,48mb (1) | 0:03:20 | 0:03:28 | 0:06:57 | ||
| P60,48mb (2) | 0:03:00 | 0:03:02 | 0:06:34 | ||
| 20,000 | P133,16mb (1) | 0:04:20 | 0:04:37 | 0:06:36 | |
| P133,16mb (2) | 0:04:08 | 0:04:25 | 0:06:37 | ||
| P133,16mb (3) | 0:04:22 | 0:04:34 | 0:11:09 | ||
| P133,16mb (4) | 0:04:21 | 0:04:30 | 0:08:11 | ||
| P133,16mb (5) | 0:04:22 | 0:04:28 | 0:06:49 | ||
| P166,48mb | 0:03:55 | 0:04:04 | 0:04:16 | ||
| P60,48mb (1) | 0:06:43 | 0:06:54 | 0:13:38 | ||
| P60,48mb (2) | 0:06:01 | 0:06:07 | 0:12:48 |
[<a name="NPB5">] Windows 2000 [</a>]
Testing Environment
| Network | Server Type | PC Types | OpenInsightVersion | Services | Loops |
| Windows 2000 | P3 450, 256MB | P133, 64MB, Windows NT 4.0 SP4 P200, 64MB, Windows 95 P166, 48MB, Windows 98 P133, 64MB, Windows 2000Wkst | 3.7 | No Service with All Networks Driver Windows 2000 Service 1.5 with All Networks Driver | 5,000 10,000 20,000 |
Benchmark Data
| Test Code | Loops | PC Type/OS | Windows 2000 Service 1.5 | No Service |
| LWDU | 5,000 | P133, 64mb Win 95 | 0:02:17 | 0:05:27 |
| P166, 48mb Win 98 | 0:02:40 | 0:05:26 | ||
| P200, 64mb NT 4.0 SP 5 | 0:02:59 | 0:05:25 | ||
| P133, 64mb Win 2000 Pro | 0:04:39 | 0:08:42 | ||
| 10,000 | P133, 64mb Win 95 | 0:04:06 | 0:11:29 | |
| P166, 48mb Win 98 | 0:05:33 | 0:13:38 | ||
| P200, 64mb NT 4.0 SP 5 | 0:08:48 | 0:11:33 | ||
| P133, 64mb Win 2000 Pro | 0:05:59 | 0:16:37 | ||
| 20,000 | P133, 64mb Win 95 | 0:07:14 | 0:26:17 | |
| P166, 48mb Win 98 | 0:16:43 | 0:28:24 | ||
| P200, 64mb NT 4.0 SP 5 | 0:13:56 | 0:26:20 | ||
| P133, 64mb Win 2000 Pro | 0:15:49 | 0:31:33 | ||
| LWRU | 5,000 | P133, 64mb Win 95 | 0:01:49 | 0:02:54 |
| P166, 48mb Win 98 | 0:01:59 | 0:02:33 | ||
| P200, 64mb NT 4.0 SP 5 | 0:03:36 | 0:02:55 | ||
| P133, 64mb Win 2000 Pro | 0:05:51 | 0:05:25 | ||
| 10,000 | P133, 64mb Win 95 | 0:03:31 | 0:05:58 | |
| P166, 48mb Win 98 | 0:04:07 | 0:05:17 | ||
| P200, 64mb NT 4.0 SP 5 | 0:08:24 | 0:06:00 | ||
| P133, 64mb Win 2000 Pro | 0:11:03 | 0:11:34 | ||
| 20,000 | P133, 64mb Win 95 | 0:07:16 | 0:13:12 | |
| P166, 48mb Win 98 | 0:08:12 | 0:11:05 | ||
| P200, 64mb NT 4.0 SP 5 | 0:16:03 | 0:13:09 | ||
| P133, 64mb Win 2000 Pro | 0:19:36 | 0:23:38 | ||
| LWU | 5,000 | P133, 64mb Win 95 | 0:01:28 | 0:04:15 |
| P166, 48mb Win 98 | 0:01:14 | 0:04:17 | ||
| P200, 64mb NT 4.0 SP 5 | 0:02:35 | 0:04:11 | ||
| P133, 64mb Win 2000 Pro | 0:03:09 | 0:04:11 | ||
| 10,000 | P133, 64mb Win 95 | 0:02:57 | 0:08:28 | |
| P166, 48mb Win 98 | 0:02:36 | 0:08:30 | ||
| P200, 64mb NT 4.0 SP 5 | 0:05:12 | 0:08:24 | ||
| P133, 64mb Win 2000 Pro | 0:06:31 | 0:08:24 | ||
| 20,000 | P133, 64mb Win 95 | 0:05:52 | 0:17:01 | |
| P166, 48mb Win 98 | 0:05:34 | 0:17:01 | ||
| P200, 64mb NT 4.0 SP 5 | 0:10:33 | 0:16:55 | ||
| P133, 64mb Win 2000 Pro | 0:13:17 | 0:16:55 | ||
| R | 5,000 | P133, 64mb Win 95 | 0:00:50 | 0:00:45 |
| P166, 48mb Win 98 | 0:00:45 | 0:00:46 | ||
| P200, 64mb NT 4.0 SP 5 | 0:01:43 | 0:01:37 | ||
| P133, 64mb Win 2000 Pro | 0:02:01 | 0:02:03 | ||
| 10,000 | P133, 64mb Win 95 | 0:01:46 | 0:01:31 | |
| P166, 48mb Win 98 | 0:01:29 | 0:01:33 | ||
| P200, 64mb NT 4.0 SP 5 | 0:03:26 | 0:03:17 | ||
| P133, 64mb Win 2000 Pro | 0:04:01 | 0:04:09 | ||
| 20,000 | P133, 64mb Win 95 | 0:03:56 | 0:03:04 | |
| P166, 48mb Win 98 | 0:03:05 | 0:03:07 | ||
| P200, 64mb NT 4.0 SP 5 | 0:06:52 | 0:23:11 | ||
| P133, 64mb Win 2000 Pro | 0:08:05 | 0:08:20 | ||
| SRN | 5,000 | P133, 64mb Win 95 | 0:02:17 | 0:05:27 |
| P166, 48mb Win 98 | 0:00:24 | 0:05:26 | ||
| P200, 64mb NT 4.0 SP 5 | 0:01:16 | 0:05:25 | ||
| P133, 64mb Win 2000 Pro | 0:01:31 | 0:05:25 | ||
| 10,000 | P133, 64mb Win 95 | 0:04:06 | 0:11:29 | |
| P166, 48mb Win 98 | 0:00:50 | 0:13:38 | ||
| P200, 64mb NT 4.0 SP 5 | 0:02:34 | 0:11:33 | ||
| P133, 64mb Win 2000 Pro | 0:03:03 | 0:11:33 | ||
| 20,000 | P133, 64mb Win 95 | 0:02:24 | 0:23:16 | |
| P166, 48mb Win 98 | 0:01:42 | 0:27:20 | ||
| P200, 64mb NT 4.0 SP 5 | 0:05:07 | 0:23:11 | ||
| P133, 64mb Win 2000 Pro | 0:06:10 | 0:23:11 | ||
| SRNR | 5,000 | P133, 64mb Win 95 | 0:01:02 | 0:05:27 |
| P166, 48mb Win 98 | 0:00:49 | 0:05:26 | ||
| P200, 64mb NT 4.0 SP 5 | 0:01:40 | 0:05:25 | ||
| P133, 64mb Win 2000 Pro | 0:02:10 | 0:05:25 | ||
| 10,000 | P133, 64mb Win 95 | 0:02:21 | 0:11:29 | |
| P166, 48mb Win 98 | 0:01:38 | 0:13:38 | ||
| P200, 64mb NT 4.0 SP 5 | 0:03:22 | 0:11:33 | ||
| P133, 64mb Win 2000 Pro | 0:04:37 | 0:11:33 | ||
| 20,000 | P133, 64mb Win 95 | 0:03:11 | 0:23:16 | |
| P166, 48mb Win 98 | 0:06:44 | 0:27:20 | ||
| P200, 64mb NT 4.0 SP 5 | 0:08:43 | 0:23:11 | ||
| P133, 64mb Win 2000 Pro | 0:08:43 | 0:23:11 |