FreeBSD OpenOffice.org porting status page : Quality Assurance
$Id: QA.html,v 1.21 2005/12/01 07:19:41 maho Exp $by OpenOffice.org porting team and NAKATA, Maho
Quality AssuranceOnce porting has been done, it means that the OOo source is buildable. The next step should be to perform Quality Assurance of the FreeBSD ported OpenOffice.org. This consists of several parts. Automated QA testing is also available. Other testcases are always needed.
Automated QABasic functionality of OpenOffice.org can be tested via automated GUI tools. The testtool connects OOo via TCP/IP, and does partial testing. Before proceeding, you should read Automated GUI Testing, Introduction to Automated GUI Testing, and OpenOffice.org TestTool CookBook.
Testing OpenOffice.org 2.0
- Install OpenOffice.org 2.0 via port:
# cd /usr/ports/editors/openoffice.org-2.0 # make install
- Prepare some directory (this affects .testtoolrc)
% mkdir /work/ooo/2.0
- Checkout QA test scripts
% cd /work/ooo/2.0 % cvs -d:pserver:firstname.lastname@example.org:/cvs co qa/qatesttoolCAUTION: you must checkout appropreate qa/qatesttool otherwise meaningless. Please refer qa/qatesttool cvs tags and branches. If you want to test OOo 2.0.0, check out by:
% cd /work/ooo/2.0 % cvs -d:pserver:email@example.com:/cvs co -r OOO200final qa/qatesttool2.0.1 (currently in the works until it will out)
% cd /work/ooo/2.0 % cvs -d:pserver:firstname.lastname@example.org:/cvs co -r OOO201 qa/qatesttool
- Write .testtoolrc
Just copying and pasting this section into ~/.testtollrc is enough. You can change some directories/profile/hardcoded names, etc., if you'd like.
The following part is the most important:
[OooProgramDir] Current=/usr/local/openoffice.org2.0/ All=/usr/local/openoffice.org2.0/You must change to another directory if you installed the newer port (RC2 or 2.0 or 2.0.1 or developer version). you can check by typing:
%cd /usr/ports/editors/openoffice.org-2.0-devel % make -V INSTALLATION_BASEDIR openoffice.org2.0m140for example and you can download from here testtoolrc2. please rename to .testtoolrc and change appropreately before using it.
- Install bash via ports
% su Password: # cd /usr/ports/shells/bash # make install clean
- Apply following patch to qa/qatesttool/script/unix/OOoTestRun_unix.sh
(just setting sLocation, LD_LIBRARY_PATH and sTestTool appropriately)
--- qa/qatesttool/script/unix/OOoTestRun_unix.sh Thu Sep 8 17:51:36 2005 +++ qa/qatesttool/script/unix/OOoTestRun_unix.sh Thu Oct 13 11:30:26 2005 @@ -43,11 +43,12 @@ # set location of testscripts # (the directory, where directory 'qatesttool' exists) -sLocation=/testtool +sLocation=/work/ooo/2.0/qa/ # set location of TestTool # (full path including executable 'testtool') -sTestTool=/testtool/linux/testtool +sTestTool=/usr/local/openoffice.org2.0.RC1/program/testtool.bin +LD_LIBRARY_PATH=/usr/local/openoffice.org2.0.RC1/program; export LD_LIBRARY_PATH # set location of close-office file # (see cvs)
- Run OOoTestRun_unix.sh
% cd /work/ooo/2.0/ % bash qa/qatesttool/script/unix/OOoTestRun_unix.sh
- running VCL testtool in background
if you are running testtool, you cannot do anything other than QA. you cannot run OOo, you need X terminal dedicated to QA, etc. to QA in background, I wrote a shell script. this does clean test, removing user settings and logs everytime. oooqa20.sh. You should create a new user like oooqa20, then
login: oooqa20 ... % bash oooqa20.shOf course, I assume you are QA expert :)
- Diagnostics: Logs are accumulated in qa/qatesttool/errorlog/maho/*res
Testing OpenOffice.org 1.1.5You need the GNU/Linux version of qatesttool to run. Currently, my FreeBSD build of the testtool are broken and I don't know how to fix it...
- Activate linux ABI via ports
# cd /usr/ports/emulators/linux_base-rh-9/ # make install
- Install OpenOffice.org 1.1.5 via port: (do not delete the work directory!!)
and copy the necessary library named libsts645fi.so to /usr/local/OpenOffice.org1.1.5/program/.
# cd /usr/ports/editors/openoffice.org-1.1 # make install # cp /usr/ports/editors/openoffice.org-1.1/work/OOo_1.1.5/solver/645/unxfbsd.pro/lib/libsts645fi.so /usr/local/OpenOffice.org1.1.5/program/
- Make sure OpenOffice.org 1.1.5 user installation has been completed
% openoffice.org-1.1.5 ...Do you have ~/.sversionrc and ~/OpenOffice.org1.1.5?
% ls ~/.sversionrc /home/maho/.sversionrc % ls ~/OpenOffice.org1.1.5/ LICENSE setup@ LICENSE.html setup.log README share/ README.html soffice@ THIRDPARTYLICENSEREADME.html spadmin@ instdb.ins user/ program/If so, then you're okay.
- Prepare the qa directory
% mkdir /work/ooo/1.1.5
- Download the testtool (linux version)
% cd /work/ooo/ % fetch http://www.openoffice.org/qa/qatesttool/11beta/tt_645m5_linux.tar.gz % tar xvfz tt_645m5_linux.tar.gz
- Checkout QA test scripts for 1.1.5 (tag is ooo115)
% cd /work/ooo/1.1.5 % cvs -d:pserver:email@example.com:/cvs co -r ooo115 qa/qatesttoolfor 1.1.4 and 1.1.3 please use branch (tag) ooo114, ooo113, respectively.
- Write ~/.testtoolrc (do not mix with 2.0s one)
you can also download from here testtoolrc1.
please rename to .testtoolrc and change appropreately before using it.
- Apply qa_ooo115_fbsd.diff this patch to qa/qatesttool
- Run OOoTestRun_unix.sh
% cd /work/ooo/1.1.5 % bash qa/qatesttool/script/unix/OOoTestRun_unix.sh
- running VCL testtool in background
if you are running testtool, you cannot do anything other than QA. you cannot run OOo, you need X terminal dedicated to QA, etc. to QA in background, I wrote a shell script. this does clean test, removing user settings and logs everytime. oooqa11.sh. You should create a new user like oooqa11, then
login: oooqa11 ... % bash oooqa11.shOf course, I assume you are QA expert :)
- Diagnostics: Logs are accumulated at qa/qatesttool/errorlog/maho/*res
If you install different version of OOo, you must change this.
if you want to run QA 1.1.5 and 2.0 at the same time, you must change the port number, and port numbers are arbitrary, but never be the same.
- Quality assurance project
- QA for localized builds
- OpenOffice.org 1.1.4 Localization Status
- qa/qatesttool cvs tags and branches