Mainpine, Inc. Certification Lab Report Results for Microsoft Fax by udr50599

VIEWS: 8 PAGES: 13

									        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007


                                                                                        Contents
                                                             Certification Overview............................................1
                                                             Testing Methodology .............................................2
                                                             Product Profile........................................................2
                                                             Broadcast Completion Percentage .......................4
                                                             Broadcast Connection Speeds..............................5
                                                             Broadcast Average Duration .................................5
                                                             Fax Machine Completion Percentage ...................6
                                                             Fax Machine Connection Speeds..........................7
                                                             Fax Machine Transmission Times ........................10
                                                             Conclusion ..............................................................12
Certification Overview                                       Summary of the Test Results ................................13
Interoperability, Performance and Reliability


Fax hardware plays a crucial role in the sending and receiving of business documents. The IQ Express™
intelligent fax board series enables fax servers like Microsoft’s built-in fax server – Microsoft Fax
Services to electronically send and receive via facsimile corporate documents while reducing workflow
costs and improving productivity and efficiency processes.

A perception exists that most fax boards and fax modems are similar. The reality is
that vast disparities exist in terms of performance and reliability.

Mainpine demands its line of fax boards perform exceptionally well with fax software
applications which is why the company has built a state-of-the-art lab facility to
provide expert performance and interoperability testing. The testing facility simulates
nearly any ‘real world’ messaging environment in which a server equipped with IQ
Express™ hardware and Microsoft Fax Services may be utilized.

This repeatable testing procedure provides fax server manufacturers with a way to
gain an in-depth understanding of how their fax applications perform with IQ
Express™ intelligent fax boards in a variety of controlled yet diverse working
conditions. Load and stress testing allow the discovery of maximum performance as
well as uncover any anomalies or instabilities that may only become apparent over an extended period
of time or under high usage. The results of the Mainpine / Microsoft Fax performance tests can be used
to extrapolate real-world performance figures.

This document reports the results of various load and stress testing performed with Mainpine’s IQ Express
fax boards and a Microsoft Fax server.




                                                                                                                            1
        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007

Methodology

The Mainpine hardware library consists of dozens of test platforms, monitors, fax
machines, multi-function devices, NICs, LAN/WAN equipment, printers and other
peripherals.

Microsoft Fax Services was tested for interoperability with IQ Express intelligent
fax boards with nearly 100 fax machine and multi-function devices and with a
dozen networked desktop computers to give the widest variety of compatibility
configurations possible.

The IQ Express / Microsoft Fax combination went through high-volume stress
testing which included broadcasts using single and multi-page industry standard fax images.

The Microsoft Fax software application was tested with IQ Express intelligent fax board line to measure
reliability, speed and performance on the send and receive side from various V.29 (9600 Kbps), V.17
(14.4 Kbps) and V.34 (33.6 Kbps) fax devices.

Hands-on testing was performed by a Mainpine field technician and engineer and took approximately two
weeks. At the conclusion of the testing, log files were analyzed. These are available upon request. This
report provides a comprehensive and accurate assessment of the Microsoft Fax / IQ Express results.


Product Profile

Product: Microsoft Fax Services included with Windows Operating Systems

Software Version: 5.2

Supported Operating Systems: Windows XP, Windows 2003
Server, Windows Vista, Windows 2008 Server. Supports Small
Business and Enterprise Versions. 32 and 64 bit versions are
also supported.

Licensing: By number of ports. Windows XP and Vista
only support 1 port. Windows 2003 and 2008 Standard
Editions support 4 ports, and 2003 / 2008 Enterprise Editions
support unlimited ports.

Dates Tested: 8/29/2007 to 9/12/2007

General Features Supported:

Network Fax Server or Stand-alone: Both
Server Clustering: Yes
Least Cost Routing: Yes – but not automatic. Manual process required.
Fax Broadcasting: Yes
Caller ID Support: No
Email Integration: Yes – for inbound and outbound faxing.
Inbound File Formats: TIF
DID/DTMF Support: No




                                                                                                     2
         Mainpine, Inc.                   Certification Lab Report
         Results for Microsoft Fax Service         October 2007


Fax Features Supported:

Fax Protocols Supported: V.17, V.29, V.27ter
Image Compressions Supported: 1D-MH
Image Resolutions Supported: Fine or Standard
Error Correction Mode: No
Fax Service Classes: 1, 2, or 2.0
Activity Logging Options: Date/Time, Elapsed Time, Image Location, Errors
Low Level Debug Trace Logging: Yes – enabled by default.
Multiple Simultaneous Line Support: Yes


Test Machine Environment:

Motherboard: Gigabyte GA-965G-DS3 with Intel Core 2 Duo Processor
Processor: Intel Pentium 4 – 3.22 GHZ
Memory: 1 GB RAM
Operating System: Windows 2003 Server Standard Edition – 32 Bit
Service Packs: Service Pack 2
Fax Board Tested: Mainpine IQ Express 4 port Intelligent Fax Board
Fax Board Firmware Version Tested: 7.0.0.4



Fax Configuration Tested:

Fax Service Class: Class 2.0
Flow Control: Hardware Flow Control
Port Speed: 57600

(Note: All the low level logs, fax images used, and report logs that were used to compile this lab report are available by request
from Mainpine Inc. Email your request to support@mainpine.com)




                                                                                                                   3
           Mainpine, Inc.                   Certification Lab Report
           Results for Microsoft Fax Service         October 2007



   Phase One: Microsoft Fax / IQ Express Broadcast Testing
   The first portion of the Microsoft Fax / IQ Express testing included the sending of 2,000 individual fax pages
   from 2 ports on a 4-port IQ Express card to 2 other ports on the same IQ Express board that received the
   faxes. This test gauged how well the Microsoft Fax application was able to handle a high volume of sending
   and receiving faxes simultaneously. It also provided a fax completion percentage on the first attempt, and an
   average transmission time under the cleanest line conditions. Single page fax images as well as a 13 page fax
   images were tested.

   This test measured the following information regarding Microsoft Fax with an IQ Express fax board:

       1. The number of calls that succeeded or failed on the first attempt.

       2. The number of calls that succeeded or failed eventually.

       3. The lowest and highest connection speeds during the fax broadcast.

       4. The shortest and longest transmission times of the faxes during the fax broadcast.


   Test Result 1: Microsoft Fax Completion Percentage on the First Attempt

   Obviously it is desirable for a fax to connect and transmit successfully on the first attempt. When multiple
   attempts are necessary this delays the message, ties up server ports and phone lines and results in
   increased charges. Microsoft Fax completed 1999 out of 2000 faxes for both the single page and 13-page
   fax broadcast jobs.

   Below are the results for this broadcast test.                              Microsoft Fax experienced a
                                                                               99.95% success rate on the first
                                                                               attempt for the 1 page broadcast
                                                                               and 99.95% for the 13-page
                                                                               broadcast. (2,000 faxes in each test
                                                                               group)




Single Page




  13 Pages


              0         20           40             60       80          100

                              Completion Percentage (%)




                                                                                                                 4
        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007


Test Result 2: Microsoft Fax Lowest and Highest Connection Speeds

 Microsoft Fax connected at a consistent 14400 bps on every fax attempt during the fax broadcast.




          Single
          Page


                                                                 Lowest Speed
                                                                 Highest Speed
       13 Pages



                   0           14400             28800
                       Connection Speed (BPS)




Test Result 3: Average Fax Duration during the Fax Broadcast

Microsoft Fax averaged 40 seconds for the single page broadcast. The average for the 13 page broadcast
was 7 minutes and 14 seconds.
                                                                      Single page faxes with Microsoft
                                                                      Fax averaged 40 seconds/per
                                                                      page. The average transmission
                                                                      time for the 13-page broadcast
                                                                      was 7 minutes and 14 seconds.




Single Page




  13 Pages


              0    1       2       3         4           5   6       7         8

                                       Time in Minutes




                                                                                                         5
               Mainpine, Inc.                   Certification Lab Report
               Results for Microsoft Fax Service         October 2007


    Phase Two: Microsoft Fax / IQ Express Fax Machine Testing
    Using Microsoft Fax, single page faxes and 13 page faxes were sent to dozens of different fax machines.
    Fax machines were from a variety of vendors including Brother, Canon, Ricoh, Samsung and Xerox. The
    testing took place in the Mainpine Lab using an IQ Express fax board. Also, single page faxes and 13 page
    faxes were sent from the same fax machines back to the IQ express board. The testing recorded the
    following results:

           1. The number of calls that succeeded or failed.
           2. The lowest and highest connection speeds when sent to and received from each fax machine.
           3. The shortest and longest transmission times when sent to and received from each fax machine.


    Test Result 1: Fax Completion Percentage When Sending to Fax Machines

    For distribution purposes across a range of fax machines and multi-function devices, five of the 1 page faxes
    and two of the 13 page faxes were sent to each device. Then five of the single page faxes and two of the
    13 page faxes were sent to the IQ Express board from the same fax machines.

    Microsoft Fax sent 100% of the faxes successfully to the 10 fax machines that were selected for the testing.




  Ricoh
  2210L                                             Samsung
                                                     5312F


 Brother
  8750P                                             Canon L-
                                                      600

  Canon
  FAX L-                                            Brother
   220                                Single Page   MFC-890
                                                                                          Single Page
                                      13 Pages
  Canon                                                                                   13 Pages
  FAX L-                                             Brother
   350                                              Fax-1030


Samsung                                              Brother
 SF-430                                             Intellifax
                                                      775

           0   25   50    75    100                              0   25   50   75   100
                Completion                                       Completion Percentage
               Percentage (%)                                             (%)




                                                                                                          6
        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007


Test Result 2: Fax Completion Percentage When Receiving to Fax Machines


Mainpine technicians also tested Microsoft Fax’s ability to receive from various fax machines with an IQ
Express 4-port board installed in the server. Microsoft Fax received 100% of the faxes successfully from
all 10 fax machines.




          Ricoh 2210L


         Brother 8750P


         Canon FAX L-
             220

         Canon FAX L-
             350

         Samsung SF-
            430

              Samsung                                                Single Page
               5312F
                                                                     13 Pages

          Canon L-600


         Brother MFC-
              890

          Brother Fax-
             1030

             Brother
          Intellifax 775


                           0    25        50       75      100
                               Completion Percentage (%)




                                                                                                     7
          Mainpine, Inc.                   Certification Lab Report
          Results for Microsoft Fax Service         October 2007

  Test Result 3: Connection Speed When Sending to Each Fax Machine

Tests were also performed with sending and receiving documents from fax machines. Whether on the send
or receive side, Microsoft Fax was able to send and receive faxes efficiently and the recorded transmission
times in the tests demonstrated that fact. Microsoft Fax connected consistently at 14400 bps to each fax
machine, except for the Brother Intellifax 775 – which only supports a maximum speed of 9600 bps.




                Ricoh 2210L


              Brother 8750P


               Canon FAX L-
                   220

               Canon FAX L-
                   350


            Samsung SF-430


             Samsung 5312F                                                   Single Page
                                                                             13 Pages

                Canon L-600


            Brother MFC-890


                Brother Fax-
                   1030

            Brother Intellifax
                  775


                                 0        14400           28800
                                     Connection Speed (BPS)




                                                                                                       8
        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007


Test Result 4: Connection Speed When Receiving from Each Fax Machine

Microsoft Fax connected at 14400 bps when receiving from each fax machine, except for the Brother I
Intellifax 775 – which only supports a maximum 9600 bps connection.




    Ricoh 2210L


  Brother 8750P


   Canon FAX L-
       220

   Canon FAX L-
       350


Samsung SF-430


 Samsung 5312F                                                 Single Page
                                                               13 Pages

    Canon L-600


Brother MFC-890


    Brother Fax-
       1030

Brother Intellifax
      775


                     0        14400          28800
                         Connection Speed (BPS)




                                                                                                  9
        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007

Test Result 5: Average Single Page Fax Duration When Sending to and Receiving
From each Fax Machine

Each singe page fax sent from Microsoft Fax averaged around a minute, while the received faxes averaged
around 40 seconds. The duration was measured by the start and stop times listed in the fax activity report
that were generated by the software. The reported sending times are longer than the true accurate fax
duration.




       Ricoh 2210L


     Brother 8750P


  Canon FAX L-220


  Canon FAX L-350


   Samsung SF-430


    Samsung 5312F                                                   Sending
                                                                    Receiving

       Canon L-600


   Brother MFC-890


   Brother Fax-1030


   Brother Intellifax
         775


                        0       20     40        60         80
                            Average Duration (seconds)




                                                                                                  10
          Mainpine, Inc.                   Certification Lab Report
          Results for Microsoft Fax Service         October 2007


Test Result 6: Average 13 Page Fax Duration When Sending to and Receiving
From each Fax Machine

Each singe 13-page fax sent from Microsoft Fax averaged around 10 minutes, while the received faxes averaged
around 7 to 8 minutes. The duration was measured by the start and stop times listed in the fax activity report that
were generated by the software. The reported sending times are longer than the true accurate fax duration.




         Ricoh 2210L


       Brother 8750P


     Canon FAX L-220


     Canon FAX L-350


     Samsung SF-430


      Samsung 5312F                                                     Sending
                                                                        Receiving

         Canon L-600


     Brother MFC-890


     Brother Fax-1030


     Brother Intellifax
           775


                          0    2   4    6    8     10    12    14
                              Average Duration (minutes)




                                                                                                       11
        Mainpine, Inc.                   Certification Lab Report
        Results for Microsoft Fax Service         October 2007


Conclusion
This report provides a comprehensive and accurate assessment of the Microsoft Fax / IQ Express results.
The log files from the testing were analyzed by a Mainpine lab technician and are available upon
request.

The Microsoft Fax software passed all the tests in the Mainpine lab. The fax completion percentages were
perfect with regards to the fax machines, and the fax broadcast results were nearly perfect. Mainpine approves
Microsoft Fax for use with the Mainpine IQ Express Intelligent fax boards. Because the software is able to
provide low level trace logs, Mainpine is also able to provide technical support for any transmission issues.

If you have any questions, please contact Mainpine Technical Support at support@mainpine.com




                                                                                                   12
                         Mainpine, Inc.                   Certification Lab Report
                         Results for Microsoft Fax Service         October 2007

                                                                         Summary of the Test Results:
                                                                                                                                                                   Call
                                                                                                 Fax                      Total
                             Test                                      Fax Machine                         Speed                       Results      Errors       Duration
                                                                                                Class                   Attempts
                                                                                                                                                                 Average *
Send 5 single pages to the fax machine                          Ricoh FAX 2210L                    2.0       14400                 5         5/5   None             0:01:03
Receive 5 single pages from the fax machine                     Ricoh FAX 2210L                    2.0       14400                 5         5/5   None             0:00:42
Send 2 x 13 page documents to the fax machine                   Ricoh FAX 2210L                    2.0       14400                 2         2/2   None             0:10:11
Receive 2 x 13 page documents from the fax machine              Ricoh FAX 2210L                    2.0       14400                 2         2/2   None             0:06:24


Send 5 single pages to the fax machine                          Brother FAX 8750P                  2.0       14400                 5         5/5   None             0:01:05
Receive 5 single pages from the fax machine                     Brother FAX 8750P                  2.0       14400                 5         5/5   None             0:00:40
Send 2 x 13 page documents to the fax machine                   Brother FAX 8750P                  2.0       14400                 2         2/2   None             0:10:06
Receive 2 x 13 page documents from the fax machine              Brother FAX 8750P                  2.0       14400                 2         2/2   None             0:07:13


Send 5 single pages to the fax machine                          Canon FAX L-220                    2.0       14400                 5         5/5   None             0:01:08
Receive 5 single pages from the fax machine                     Canon FAX L-220                    2.0       14400                 5         5/5   None             0:00:46
Send 2 x 13 page documents to the fax machine                   Canon FAX L-220                    2.0       14400                 2         2/2   None             0:10:13
Receive 2 x 13 page documents from the fax machine              Canon FAX L-220                    2.0       14400                 2         2/2   None             0:08:22


Send 5 single pages to the fax machine                          Canon FAX L-350                    2.0       14400                 5         5/5   None             0:01:09
Receive 5 single pages from the fax machine                     Canon FAX L-350                    2.0       14400                 5         5/5   None             0:00:47
Send 2 x 13 page documents to the fax machine                   Canon FAX L-350                    2.0       14400                 2         2/2   None             0:10:14
Receive 2 x 13 page documents from the fax machine              Canon FAX L-350                    2.0       14400                 2         2/2   None             0:08:21


Send 5 single pages to the fax machine                          Samsung SF-430                     2.0       14400                 5         5/5   None             0:00:54
Receive 5 single pages from the fax machine                     Samsung SF-430                     2.0       14400                 5         5/5   None             0:00:44
Send 2 x 13 page documents to the fax machine                   Samsung SF-430                     2.0       14400                 2         2/2   None             0:08:52
Receive 2 x 13 page documents from the fax machine              Samsung SF-430                     2.0       14400                 2         2/2   None             0:07:38


Send 5 single pages to the fax machine                          Samsung SCX 5312F                  2.0       14400                 5         5/5   None             0:01:09
Receive 5 single pages from the fax machine                     Samsung SCX 5312F                  2.0       14400                 5         5/5   None             0:00:39
Send 2 x 13 page documents to the fax machine                   Samsung SCX 5312F                  2.0       14400                 2         2/2   None             0:10:17
Receive 2 x 13 page documents from the fax machine              Samsung SCX 5312F                  2.0       14400                 2         2/2   None             0:07:23


Send 5 single pages to the fax machine                          Canon FAX L-600                    2.0       14400                 5         5/5   None             0:01:08
Receive 5 single pages from the fax machine                     Canon FAX L-600                    2.0       14400                 5         5/5   None             0:00:50
Send 2 x 13 page documents to the fax machine                   Canon FAX L-600                    2.0       14400                 2         2/2   None             0:10:17
Receive 2 x 13 page documents from the fax machine              Canon FAX L-600                    2.0       14400                 2         2/2   None             0:07:58


Send 5 single pages to the fax machine                          Brother MFC-890                    2.0       14400                 5         5/5   None             0:01:05
Receive 5 single pages from the fax machine                     Brother MFC-890                    2.0       14400                 5         5/5   None             0:00:40
Send 2 x 13 page documents to the fax machine                   Brother MFC-890                    2.0       14400                 2         2/2   None             0:10:10
Receive 2 x 13 page documents from the fax machine              Brother MFC-890                    2.0       14400                 2         2/2   None             0:06:53


Send 5 single pages to the fax machine                          Brother FAX-1030                   2.0       14400                 5         5/5   None             0:01:08
Receive 5 single pages from the fax machine                     Brother FAX-1030                   2.0       14400                 5         5/5   None             0:00:50
Send 2 x 13 page documents to the fax machine                   Brother FAX-1030                   2.0       14400                 2         2/2   None             0:10:30
Receive 2 x 13 page documents from the fax machine              Brother FAX-1030                   2.0       14400                 2         2/2   None             0:08:21


Send 5 single pages to the fax machine                          Brother Intellifax-775             2.0        9600                 5         5/5   None             0:01:12
Receive 5 single pages from the fax machine                     Brother Intellifax-775             2.0        9600                 5         5/5   None             0:00:56
Send 2 x 13 page documents to the fax machine                   Brother Intellifax-775             2.0        9600                 2         2/2   None             0:13:04
Receive 2 x 13 page documents from the fax machine              Brother Intellifax-775             2.0        9600                 2         2/2   None             0:10:40
Fax Broadcast Tests
2000 single pages, Ports 1 & 2 sending to Ports 3 & 4           2 x 2 ports back to back           2.0       14400             2000    1999/2000          1 **      0:00:40
2000 13 page documents, Ports 1 & 2 sending to Ports 3 & 4     2 x 2 ports back to back             2.0       14400             2000   1999/2000          1 **      0:07:14
             * Call Duration computed using Start Times and End Times in the Activity Reports    ** The single error was “busy”




                                                                                                                                                   13

								
To top