BAPCo Knowledgebase

All other products continue to receive limited support through BAPCo website and email support for incidences which have a known solution.

For all publication, evaluation, testing and tendering purposes BAPCo strongly recommends using the results from the latest version of all its products. Users wishing to continue to use older products (with limited support) should be aware that it may not be possible to obtain results from all systems and that BAPCo’s solutions to incident reports may require users to upgrade. BAPCo strongly recommends customers to consider SYSmark 2014 for all Windows 8+ based system requirements. BAPCo stopped support on SYSmark 2007 as of October 13th, 2014. Customers who would like to continue using SYSmark 2007 may wish to consider both SYSmark 2007 and SYSmark 2014 scores for a better representation of system performance. OEMs stopped providing Windows 7 driver support on all latest systems and that may affect the overall SYSmark 2007 scores.

Product patches downloaded or revisions integrated into updated DVD media are not expected to materially change the performance of a platform compared to that of any previous patch or version number; as such results generated with the newest patch or version are currently considered by BAPCo to be comparable with results generated with any previous patches for the given product series.

Search BAPCo Support

SYSmark 2018

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2018 are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

After the hotfix is applied, launch SYSmark 2018. The new version should be reported as 1.0.0.39.

SYSmark 2018 may hang when testing on configurations with disabled network adapters

SYSmark 2018 may hang when testing on configurations with disabled network adapters. To avoid this issue, BAPCo recommends that customers be sure that all network adapters on the system under test are enabled.

BAPCo will release a fix for this issue in an upcoming version of SYSmark 2018.

APPmark 2018

APPmark 2018 battery run fails on Snapdragon-based Windows devices

Users may experience test failures when running an APPmark 2018 battery life test on some Snapdragon-based devices running Windows 10 April 2018 update (also known as Version 1803 or Redstone 4) or newer. The failure typically occurs after several hours of testing when the benchmark attempts to allocate memory for a workload operation and the operating system denies the request. In such cases, it should still be possible to obtain performance scores by running a 3 iteration test without the battery run checkbox selected, and it may be possible to obtain battery life results by repeatedly attempting the battery life test or reverting to an earlier version of Windows (e.g., RS3). It is possible a future update to Windows or the supporting platform software will resolve this issue, but no other workaround is currently available.

Mobilemark 2018

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Note, there may be other applications, ie, Adobe Creative Suite that will need to be removed as well. This FAQ item covers MS Office only.

Why did my MobileMark 2018 installation expire

Some of the applications in MobileMark 2018 have licensing restrictions which cause them to expire after 7 days. MobileMark 2018 will warn the user prior to this expiration. Once the installation has expired, the system under test must be wiped completely, and a new instance of MobileMark 2018 must be installed.

SYSmark 2018 or MobileMark 2018 may fail if Windows taskbar is set to autohide

SYSmark 2018 or MobileMark 2018 may fail if the Windows taskbar is configured to autohide. Leave the taskbar default setting of always visible to avoid this problem.

TabletMark

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer. Using incorrect drivers could result in significantly reduced performance.

How do I submit TabletMark results to BAPCo.com?

At the completion of a successful run of TabletMark, results can be submitted to BAPCo.com from the results browser. Select the result to be submitted, then press the ‘submit’ icon. Note that the test system must be connected to the Internet for BAPCo.com to import the submission.

Where can I get TabletMark v3 for sideloading on my device?

TabletMark v3 packages are made available for sideloading on the TabletMark v3 product page. Sideloadable packages for Andriod, Windows, and iOS are available at the bottom of the page. Click the green ‘Download’ button next to the package you wish to download.

SYSmark 2014 SE

SYSmark 2014 SE patch 1 hotfix 4 v2.0.1.91

The following hotfix corrects an issue in SYSmark 2014 SE OP and/or RE scenarios where some systems would fail to switch between applications correctly. Hotfix 4 to resolves this issue, which should improve benchmark stability on current and future CPU architectures.

Hotfix 4 is a cumulative update and includes fixes released in Hotfixes 1-3.

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE are closed before attempting to apply the hotfix
4) Right click the extracted .exe and run as administrator. Note, failing to run the installer as administrator may result in the hotfix failing to install correctly.

SYSmark 2014 SE patch 1 or higher must be installed to apply Hotfix 4. The update will not apply versions of SYSmark 2014 SE prior to patch 1.

After the hotfix is applied, launch SYSmark 2014 SE. The new version should be reported as 2.0.1.91.

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

1) Copy hotfix package to the to target system
2) Unzip the archive to extract the hotfix installer
3) Be sure that any instances of SYSmark 2014 SE patch 1 (or SYSmark 2014 SE patch 1 hotfix 1 or hotfix 2) are closed before attempting to apply the hotfix package
4) Right click the extracted .exe and run as administrator

SYSmark 2014

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

Systems with Intel Dynamic Power and Thermal Framework (DPTF) driver version (8.4.11000.6436) may fail to execute and display Error 1: Errorstate::Enter: unknown error code (1) in the results browser.

You may encounter this issue when testing with older versions of SYSmark 2014 SE or MobileMark v1.5. If so, please visit either the SYSmark 2014 SE product page or the MobileMark 2014 v1.5 product page to download the latest patch and hotfix for your product. Update your benchmark according the patch or hotfix instructions and reboot the system under test. You should now be able to run SYSmark 2014 SE or MobileMark 2014 v1.5 successfully.

If you are testing SYSmark 2014 v1.5, please follow these steps to work around the issue:

SYSmark 2014 v1.5 patch 1 must be installed to apply hotfix 1. The update will not apply to older versions of SYSmark 2014 v1.5. After the hotfix is applied, launch SM14 v1.5. The new version should be reported as 1.5.1.85.

MobileMark 2014

How do I remove Microsoft Office from OEM images prior to installing BAPCo benchmarks?

As BAPCo benchmarks such as SYSmark and MobileMark include all the applications required to run the benchmark(s) users must be certain that any previous installation of those same applications are completely removed from the OEM preload prior to attempting to install a BAPCo product.

On some systems, MobileMark 2014 installation hangs when attempting to enable the direct play service and becomes unresponsive, even though the benchmark installation has completed. User experiencing this issue may work around the problem by rebooting the system to clear the installation hang. When the desktop appears, launch MobileMark 2014 and start a test.

Systems with Intel Dynamic Power and Thermal Framework (DPTF) driver version (8.4.11000.6436) may fail to execute and display Error 1: Errorstate::Enter: unknown error code (1) in the results browser.

You may encounter this issue when testing with older versions of SYSmark 2014 SE or MobileMark v1.5. If so, please visit either the SYSmark 2014 SE product page or the MobileMark 2014 v1.5 product page to download the latest patch and hotfix for your product. Update your benchmark according the patch or hotfix instructions and reboot the system under test. You should now be able to run SYSmark 2014 SE or MobileMark 2014 v1.5 successfully.

If you are testing SYSmark 2014 v1.5, please follow these steps to work around the issue:

MobileMark 2012

Which device drivers should I use when testing with BAPCo benchmarks?

When using BAPCo benchmarks to evaluate performance or battery life, one should install the latest production drivers from the hardware manufacturer. Drivers included with the operating system may not be device specific or newer drivers may be available from the device manufacturer. Using incorrect drivers could result in significantly reduced performance.

How do I configure a non-English OS installation for use with BAPCo SYSMark or MobileMark?

For testing on Non-Engish OS, SYSmark 2018 and MobileMark 2018 installers will configure the system correctly for the supported languages, provided the operating system is installed in a supported language, i.e., German.

SYSmark and MobileMark support seven Non-English languages. Download the .pdf for the target language and follow the instructions to configure the operating system.

MobileMark 2012 should be run with DPI scaling set to 100%. Setting the DPI scaling value to something other than 100% may cause the test to fail. The Configuration tool now includes an option to automate setting the DPI scaling value to 100%.

EEcoMark v2

A given Controller system may be used with several UUT systems. However, the Controller can only be connected to and interact with one UUT at a time.

Is a meter required to run the benchmark?

No. EEcoMark v2 can be run without a power meter by selecting the ‘null meter’ option when setting up the test parameters in the Controller GUI. However, when selecting the ‘null meter’ option, power data readings are simulated and will not reflect the actual energy consumption of the system.

Which compiler does BAPCo use to compile benchmarks?

Applications within BAPCo benchmarks are not compiled by BAPCo, but by the original application vendors. All other components within BAPCo benchmarks are compiled using Microsoft Visual Studio 2008 or Microsoft Visual Studio 2010, or Microsoft Visual Studio 2012 (with default options).