Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
documentation/2.6
PTSuite 2.6.odt 1
documentation/2.6 10/12/10
Table of Contents
documentation/2.6..................................................................................................................1
I - Phoronix Test Suite Installation..........................................................................................4
A - Dependencies...............................................................................................................4
B - File Structure................................................................................................................5
C - Running Locally...........................................................................................................5
D - Generic Installation......................................................................................................5
E - Debian/Ubuntu Installation...........................................................................................5
F - Download Cache For Tests..........................................................................................6
II - Default Files & Folders.....................................................................................................7
III - Phoronix Test Suite Options............................................................................................9
A - Test Installation Options...............................................................................................9
install <To Install>......................................................................................................................9
batch-install <To Install>............................................................................................................9
B - Run Options.................................................................................................................9
benchmark <To Run>..................................................................................................................9
default-benchmark <To Run>.....................................................................................................9
run <To Run>............................................................................................................................10
default-run <To Run>................................................................................................................10
run-tests-in-suite <To Run>......................................................................................................10
estimate-run-time <To Run>.....................................................................................................10
C - Recovery Run Options...............................................................................................10
finish-run <Saved Results File>................................................................................................10
recover-run <Saved Results File>.............................................................................................10
D - Batch Run Options.....................................................................................................11
batch-setup................................................................................................................................11
batch-run <To Run>..................................................................................................................11
batch-benchmark <To Run>......................................................................................................11
E - Test Dependency Options..........................................................................................11
install-dependencies <To Install>..............................................................................................11
list-possible-dependencies.........................................................................................................11
list-installed-dependencies........................................................................................................11
list-missing-dependencies.........................................................................................................11
F - Test Options................................................................................................................12
list-tests.....................................................................................................................................12
list-all-tests................................................................................................................................12
list-suites...................................................................................................................................12
list-installed-tests......................................................................................................................12
list-installed-suites....................................................................................................................12
list-test-usage............................................................................................................................12
info <To Show>........................................................................................................................12
G - Result Viewing Options..............................................................................................13
list-results..................................................................................................................................13
show-result <To Show>............................................................................................................13
remove-result <To Remove>....................................................................................................13
remove-all-results......................................................................................................................13
remove-installed-test <To Remove>.........................................................................................13
PTSuite 2.6.odt 2
documentation/2.6 10/12/10
PTSuite 2.6.odt 3
I - Phoronix Test Suite Installation 10/12/10
The Phoronix Test Suite can run on almost any Linux distribution along with Apple Mac OS
X, FreeBSD, OpenBSD, NetBSD, OpenSolaris, webOS / Optware, and other operating
systems. The only Linux distribution-specific bits deal with the external dependencies
support feature that are set by individual test profiles. If you are not running one of the
supported Linux distributions (Ubuntu, Fedora, Mandriva, Gentoo, PCLinuxOS, Arch Linux,
Pardus, OpenSuSE, Zenwalk, and CentOS), OpenSolaris, FreeBSD, NetBSD, or Mac OS
X, you may need to install a package manually (as instructed by the Phoronix Test Suite)
in order for a test to run. An example of an external dependency would be GCC and the
OpenGL Utility Toolkit being needed for test profiles that build an OpenGL benchmark from
source-code.
A - Dependencies
The only required dependencies for the Phoronix Test Suite on Linux systems is PHP 5.x
CLI (packages for it are commonly called php5-cli or php-cli or just php). It's important to
note that only PHP 5 is needed and not a web server (Apache) or other packages
commonly associated with PHP. Additionally, the PHP GD module (commonly called php-
gd or php5-gd) is recommended to render graphs to PNG image files, but other renderers
are available. Likewise, if you wish to use the Adobe SWF renderer, the PHP Ming module
(commonly called php-ming or php5-ming) is required. If you wish to use the result-file-to-
pdf option, the PHP FPDF (commonly called php-fpdf or php5-fpdf) module is needed.
Note #1: Depending upon your distribution's package configuration, you may also need
php-posix package for providing the POSIX functions.
While PHP is the only required dependency, many of the test profiles do require the
standard Linux development tools/libraries (GCC, etc). On a clean Ubuntu installation, it's
as easy as first running sudo apt-get install php5-cli and then running the Phoronix Test
Suite as it will take care of installing additional dependencies. Most Phoronix Test Suite
development is done on Ubuntu and Fedora systems, but the Phoronix Test Suite is
routinely tested against a variety of Linux distributions and other supported operating
systems.
The Phoronix Test Suite has a feature known as "External Dependencies" where the
Phoronix Test Suite can attempt to automatically install some of the test-specific
dependencies on supported distributions. If running on a distribution where there is
currently no External Dependencies profile, the needed package name(s) are listed. To
see all possible External Dependencies, run phoronix-test-suite list-possible-
dependencies. Running phoronix-test-suite list-missing-dependencies will attempt to report
the external dependencies that are not installed on the given system.
PTSuite 2.6.odt 4
I - Phoronix Test Suite Installation 10/12/10
B - File Structure
The pts folder houses the XML test profiles, XML test suites, test resource files, and
other important information. The pts-core directory contains the "engine" of the Phoronix
Test Suite.
C - Running Locally
The Phoronix Test Suite can be simply extracted from the downloaded .tar.gz file or it can
also be installed system-wide. If you just wish to run the Phoronix Test Suite without
installing it, open a terminal and run ./phoronixtestsuite <options> from the
same directory.
D - Generic Installation
Running installsh from the root directory of the Phoronix Test Suite will install the
software for system-wide access.
Root access is required. The default installation prefix is /usr/ but can be adjusted as
the first argument (example: installsh /home/user/ to install the Phoronix Test
Suite in your home directory).
E - Debian/Ubuntu Installation
Debian/Ubuntu users are able to follow the Generic Installation instructions or optionally
can generate their own Debian package.
This package contains the phoronix-test-suite executable in /usr/bin/, the Phoronix Test
Suite files in /usr/share/phoronix-test-suite/, and the documentation in
/usr/share/doc/phoronix-test-suite/.
PTSuite 2.6.odt 5
I - Phoronix Test Suite Installation 10/12/10
Phoronix Media maintains a Debian package repository for the Phoronix Test Suite of
all the latest releases.
deb http://www.phoronixtestsuite.com/releases/repo pts.debian/
If you are a company or simply own multiple computers, the download caching support of
the Phoronix Test Suite can work quite well. This feature allows you to very simply
setup a local (or network-wide) repository for the Phoronix Test Suite of all the files
the different tests use. After you have installed the tests on one system that you normally
use (or have ran phoronix-test-suite install all) running phoronix-test-suite make-download-
cache will cache all of the files that each test downloaded. The location of this cache
is ~/.phoronix-test-suite/download-cache/.
Once the cache has been created, you can copy this folder to other systems and place the
files in the same location. Then when the Phoronix Test Suite needs to download a file for
a test, before downloading it from the Internet it will first check this cache for the file(s). If
the files are there and the MD5 check-sums have been verified, it will simply copy the file
-- thereby saving bandwidth and time. The download cache location can be downloaded
in ~/.phoronixtestsuite/userconfig.xml. By adjusting the download cache,
you could setup the cache folder to be on an FTP or NFS share (as an example) on a
server that's accessible via your LAN. Configure your test systems to use this local
repository and you will be saving time and bandwidth.
PTSuite 2.6.odt 6
II - Default Files & Folders 10/12/10
~/.phoronixtestsuite/userconfig.xml
This is a per-user configuration file. Among the information stored here is the Phoronix
Global account information, test options, locations for storing files, and batch mode
options. This file is formatted in XML.
~/.phoronixtestsuite/graphconfig.xml
This is a per-user configuration file for storing graph attributes. The adjustable options
include HTML hex color codes for different areas of the graph, dimensions of the graph,
and font sizes. This file is formatted in XML.
~/.phoronixtestsuite/downloadcache/
This directory contains test packages that have been generated when running phoronix-
test-suite make-download-cache. For more information on the download cache, view the
included HTML documentation.
~/.phoronixtestsuite/installedtests/
This directory is where tests are installed by default. Each test has its own directory
within installed-tests/. In the test's folder is a pts-install.xml file used for managing the
installation.
~/.phoronixtestsuite/testresults/
This directory is where tests results are saved by default. Each saved file has its own
directory. In the saved directory is then a composite.xml file containing the useful results
while in the test-X.xml files are back-ups of the results. In the result-graphs sub-directory
are the rendered graph image files.
~/.phoronixtestsuite/modulesdata/
This is the directory where any Phoronix Test Suite modules should save any files to,
within a sub-directory of the module's name. The module configuration settings are also
stored within this directory.
~/.phoronixtestsuite/testprofiles/
PTSuite 2.6.odt 7
II - Default Files & Folders 10/12/10
This is the directory where locally installed test profiles can be stored. This is similar to
the pts/test-profiles/directory within the Phoronix Test Suite package.
~/.phoronixtestsuite/testresources/
This is the directory where locally installed test profile resources can be stored. This is
similar to the pts/test-resources/ directory within the Phoronix Test Suite package.
~/.phoronixtestsuite/testsuites/
This is the directory where locally installed test suite profiles can be stored. This is similar
to the pts/test-suites/directory within the Phoronix Test Suite package.
PTSuite 2.6.odt 8
III - Phoronix Test Suite Options 10/12/10
This option will install the selected test(s) inside the testing environment directory (defaults
to ~/.phoronix-test-suite/installed-tests). The install process from downloading of the test
files to the installation is fully automated. The install option needs to be supplied with the
test name or suite as an argument. Optionally, a Phoronix Global ID or the name of a
saved results file can be supplied as well and the test(s) to install will automatically be
extracted from that information. If the test is already installed and was run by the latest
version of the installation process, no action will be taken. Multiple arguments can be
supplied to install additional tests at the same time.
If you wish to run the install process in the Phoronix Test Suite batch mode but do not wish
to run any tests at this time. Running the install process in the batch mode will use the
default values and not prompt the user of any possible options, to ensure the process
is fully automated.
B - Run Options
PTSuite 2.6.odt 9
III - Phoronix Test Suite Options 10/12/10
PTSuite 2.6.odt 10
III - Phoronix Test Suite Options 10/12/10
batch-setup
This option is used to configure the batch mode options for the Phoronix Test Suite, which
is subsequently written to the user configuration file. Among the options are whether to
automatically upload the test results to Phoronix Global and prompting for the saved file
name.
list-possible-dependencies
This option will list all possible external dependencies used by tests within the Phoronix
Test Suite.
list-installed-dependencies
This option will list all external dependencies used by tests within the Phoronix Test Suite
that are installed on the system.
list-missing-dependencies
This option will list all external dependencies used by tests within the Phoronix Test Suite
that are not installed or missing from the system.
PTSuite 2.6.odt 11
III - Phoronix Test Suite Options 10/12/10
F - Test Options
list-tests
This option will list all available tests. The name, title, status, and license are displayed for
each test. Tests that aren't supported on the system due to architecture or platform
limitations aren't listed.
list-all-tests
This option is like list-tests but will also lists tests that are marked of an EXPERIMENTAL,
PRIVATE, BROKEN, or UNVERIFIED state. The name, title, status, and license are
displayed for each test.
list-suites
This option will list all available test suites. The name, title, and type are displayed for each
suite.
list-installed-tests
This option will list all tests that have been installed by the Phoronix Test Suite.
list-installed-suites
This option will list all suites where all of the contained tests have been installed by the
Phoronix Test Suite.
list-test-usage
This option is similar to list-installed-tests with showing the tests that are installed, but it
will also show the date/time a test was installed, when the test was last run, and the
number of times the test was run by the Phoronix Test Suite.
PTSuite 2.6.odt 12
III - Phoronix Test Suite Options 10/12/10
list-results
This option will list all saved results. The file name, title, test(s) performed, and result
identifiers are displayed.
remove-all-results
This option will permanently remove all saved results.
PTSuite 2.6.odt 13
III - Phoronix Test Suite Options 10/12/10
PTSuite 2.6.odt 14
III - Phoronix Test Suite Options 10/12/10
J - Analytical Options
K - Module Options
list-modules
This option will list all modules that are installed / present in the pts-
core/modules/ directory. Modules are used for extending the functionality of the Phoronix
Test Suite without over-inflating the pts-core.
PTSuite 2.6.odt 15
III - Phoronix Test Suite Options 10/12/10
L - Test/Suite Creation
build-suite
This option will guide the user through the process of generating their own test suite, which
they can then run. Optionally, passed as arguments can be the test(s) or suite(s) to add to
the suite to be created, instead of being prompted through the process.
validate-test-profile <Test>
This option will run automated checks on a Phoronix Test Suite test profile in an effort to
catch common errors or warnings with the test profile, such as missing XML tags or other
issues.
validate-test-suite <Suite>
This option will run automated checks on a Phoronix Test Suite test suite in an effort to
catch common errors or warnings with the test suite, such as missing XML tags or other
issues.
PTSuite 2.6.odt 16
III - Phoronix Test Suite Options 10/12/10
M - Miscellaneous Options
make-download-cache
This option will backup all files that were automatically downloaded by the Phoronix Test
Suite during the installation of tests. These files are automatically backed up by default
to ~/.phoronix-test-suite/download-cache/. By backing up these files, one can easily
transfer these files to another system running the Phoronix Test Suite thereby conserving
bandwidth and reducing time. Through modifying the user configuration file (at ~/.phoronix-
test-suite/user-config.xml), the download cache location can be adjusted. The Phoronix
Test Suite supports reading from download caches over the network and on remote file-
systems.
system-info
This option will show installed system hardware and software that has been detected by
the Phoronix Test Suite.
diagnostics
This option will print information that is useful to developers when debugging problems
with the Phoronix Test Suite.
version
This option will print the Phoronix Test Suite version.
network-setup
This option allows the user to configure how the Phoronix Test Suite connects to Phoronix
Global and other web-services. Connecting through an HTTP proxy can be configured
through this option.
user-config-reset
This option will generate a new user configuration (user-config.xml) file.
user-config-set
This command will set new option value(s) for user configuration options stored
in ~/.phoronix-test-suite/user-config.xml. The tag name must be specified followed by an
PTSuite 2.6.odt 17
III - Phoronix Test Suite Options 10/12/10
user-config-get
This command will read option value(s) from the user configuration file stored
in ~/.phoronix-test-suite/user-config.xml. The tag name must be specified or all can be
supplied to read all values. Example: phoronix-test-suite user-config-get CacheDirectory to
read the current cache directory location.
PTSuite 2.6.odt 18
IV - Tips & Tricks 10/12/10
A - Running
- If while running multiple tests you want to quit the testing prematurely,
In a new terminal window type touch ~/.phoronixtestsuite/halttesting.
- If you wish to stop the current test run prematurely but continue the testing process,
In a new terminal window type touch ~/.phoronixtestsuite/skiptest.
All results for tests that had already run will be saved (permitting you opted to save the
results), except for the test currently being run.
Boucles d'execution
- If you want the specified test(s) to run in a loop for a set period of time, use
the TOTAL_LOOP_TIMEenvironmental variable. For instance, running
TOTAL_LOOP_TIME=120 phoronixtestsuite benchmark ffmpegwould
- If you want the specified test(s) to run in a loop for a set number of times, use
the TOTAL_LOOP_COUNTenvironmental variable. For instance, running
TOTAL_LOOP_COUNT=3 phoronixtestsuite benchmark ffmpeg
Test d'execution
- When any tests are being installed and when tests are being run, a lock is created in the
system's temporary directory with the name phoronix-test-
suite.active (i.e. /tmp/phoronixtestsuite.active) and is removed upon
completion.
Thus if you have any system scripts that you wish to run when tests are not running or
being installed as to not impact the results, one simple way to handle this is by having the
script check for the existence of this lock.
PTSuite 2.6.odt 19