Choipd's Software Testing

GUI testing automation

2009-02-18T14:18:50+09:00

I got a gold idea on gui tesing taught by Uncle Bob, who is the author of Fitnesse in the mailing list. I am trying to implement "GUI testing on Fitnesse". You can get check my recent article, GUI testing automation.

Here is his wisdom;

Just make sure that you don't test any business rules that way.

Testing business rules through the GUI is a *terrible* form of

coupling. If you write thousands of tests through the GUI, and then

change your GUI, thousands of tests break.

Rather, test only GUI things through the GUI, and couple the GUI to a

dummy system instead of the real system, when you run those tests.

Test business rules through an API that doesn't involve the GUI.

It is very interesting the sentence, "test only GUI things through the GUI"

GUI testing and fitnesse

2008-11-25T16:02:20+09:00

I like the definition of fitnesse as the respect of test case management tool. It is quite diverse from the official definition is the acceptance automation tool. Fitnesse is know as unfit for testing GUI. I had agreed this idea before I met the pyWinAuto which is a python module supporting simulation of user input, like mouse click and key in.

Convergence of pyfit and pyWinAuto makes it possible to integrate fitnesse and GUI testing. The process is like this;

1. Installing Fitnesse
- download from here the lastest version.
- if you don't have jre 1.5 or later, you can download it from Java web site.
- unzip the fitnesse(fitnesse20081115.zip ) to a specific folder, i.e. c:\fitnesse

2. Installing Python
- download from here the lastest version for Windows installer.
- run the installer. default installation folder can be c:\python26
- you should append the environment variable PATH the path of python, i.e. c:\python26.

3. Installing pyfit
- pyfit is the fit server and libraries of the porting to python language, By this we can use python on the Fitnesse.
- download from here. PyFIT-0.8a2.zip
- unzip it into specific folder.
- type python setup.py install in dos window
- PyFit-0.8a2 version setup.py need to edit for avoiding some errors, by comment out the lines on 'filter'

4. Installing pyWinAuto
- download from here.
- unzip it into specific folder.
- type python setup.py install in dos window

5. Start up Fitnesse
- cd c:\fitnesse
- run.bat
when the port 80 is using by other process, you can set your port to use by fitnesse like this;
run.bat -p 8080

6. Make a pyfit testing page
a. Edit wiki page

!define COMMAND_PATTERN {python "%m" %p}
!define TEST_RUNNER {C:\Python26\Lib\site-packages\fit\FitServer.py}
|eg.Division|
|numerator|denominator|quotient?|
|10|5|2|
|10|2|5.001|

b. select 'Properties', check the test checkbox and save the properties, then the test button is shown.
c. click the test button after then if you find like this result you are right.

eg.Division
numerator	denominator	quotient?
10	5	2
10	2	5.001 expected 5.0 actual

7. Write a python fixture code

from fit.ColumnFixture import ColumnFixture
from pywinauto import application

class Notepad(ColumnFixture):
_typeDict={
"openReplace": "String"
}
def openReplace(self):
app = application.Application.start("notepad")
app.notepad.MenuSelect("Edit->Replace")
return "success"

This code runs the notepad and select the replace menu.
Save this code at the python fit folder i.e. C:\Python26\Lib\site-packages\fit\eg\Notepad.py

8. Write a wiki page for run GUI testing

|eg.Notepad|
|openReplace?|
|success|

change the properties to test menu enable.

9. run the test, you can see the Notepad has run and the replace menu has selected.

Any question? Leave your comment below.

Is that so exciting?

Steve Freeman's "Agile software people and team".

2008-11-24T17:42:10+09:00

Steve Freeman is famus on agile movement. Today I met him in Xper group off meeting. He gave us his presentation about the Agile software, people, and team. It is quite new to me but very interesting topic.

James Bach is comming to Seoul

2008-09-12T09:33:48+09:00

James Bach is known for the father of exploratory testing. It seems his schedule is always filled with education and consulting company. During Oct. 19 to 22, he is going to have the lecture about the Rapid Software Testing(RST) in Seoul, Korea. It could be a good chance to Korean quality engineers, having not much knowledge on exploratory testing.

Unfortunately, I can't join this time, but one of my collegues is going to attend this education. So I can hear something from my collegue indirectly.

I f you have any interesting on this, here is a link for application;
http://www.sten.or.kr/exam/requestform.php?ex_id=219
Warning! the tuition is quite expensive, but it is worthy.

--choipd

The first day at NHN Service

2008-09-23T19:52:49+09:00

Wow, this company is the biggest I have ever been in before. More than 2000 employs are working spread over the Seoul, Bun-dang, Chun-chen and Cheong-ju. I am working here in Seoul. At Seoul office all the testing group is working together. The number of people in testing group are about 160 persons. These peoples are taking their role as TM(test manager), TL(test lead), and TE(test enginner).

I took a review on the testing wares they produced, for example, testing plan, testing schedule, test case, testing methods, and so on. But it is not very satisfied with me. I thought I do have enough things to change and to improve. That is not bad!

I hope to improve our testing process based on the TMMi model. First of all we do need to do self-test to check where we are right now.

Sunday Lunch with Rex Black

2008-09-07T23:35:13+09:00

Today It was a special meeting called Sunday Lunch with Rex Black. For me this is the first time to meet Mr. Rex Black. He is the president of ISTQB, international software testing qualification board and the author wrote several books on software testing. As always meeting a famous person is interesting experience. He presented a introduction to ISTQB Advanced Level(AL). There are only 33 person certifed AL in Korea. It is challenge for me. I am going to take a exam on AL next year.

ISTQB Foundation course

2008-09-06T11:11:01+09:00

It was fantastic experience! Before one month ago, I was totally new to s/w testing. Now I have read a introductory book, Software Testing 2nd edition by Ron Patton. This book brings me a solid foundation on this field. After reading this book, I took a interview at NHN Serivce. At that time my knowledge had enhanced enough to pass that exam and the interviews. During this period, I met a good community for software testing, STEN. STEN stands for Software Testing Enignneer Network. This community let me know how to improve my knowledge on s/w testing. I heard from this community about a education based on the ISTQB foundation level. ISTQB is the International Software Testing Qualification Board, it is an aka standard for s/w testing qualification and education in over the 60 countries. ISTQB builds and develops the body of knowledge on s/w testing. I think it is quite acceptable for whole industry.

For last five days, 40 hours, I took the ISTQB Foundation course by STA consulting. KIPA, Korea SW Industry Promotion Agency gave me a spoonsership, 90% of education fee, so I just paid only 10%. How nice! The lecture is fantasitic for me. First of all, the structure of the lecture is very well organized. Here is the outline of this course;

1st day - Introduction to s/w testing, the definition of s/w testing and necessity, V-model, testing organization.
2nd day - Specification based testing design methods - equivalence partitioning, boundary value analysis, decision table testing, pairwise testing, state-transition testing, use-case testing.
3rd day - Structure based testing design methods - coverage, basis path testing, control-flow testing, elementary comparison testing,
4th day - Experience based testing method - classification tree method (CTE tool), Exploratory Testing, Case Maker
5th day - Risk based tesitng method - Risk analysis, review and testing automation

I am appriciate to the lecturer, Lee, Hyun-joo. She gave me a good foundation for this career. And I thank STA, KIPA, and STEN.

Cause and Effect table

Event flow and testing scenario in Use-case testing

Risk analysis using Erik van Veneendaal model

Graduation! Congratulation!

PythonMagick 0.7 build error

2008-07-17T15:32:37+09:00

I encountered an error when i build the PythonMagick 0.7 in OpenSUSE 10.3.
The error message is like this;

/usr/include/boost/python/converter/registered.hpp:88: error: no matching function for call to 'registry_lookup(const volatile void (*)())

it seems registered.hpp has problem. I update the boost to new. Then the error has disappeared.

Here is the diff;

admin@linux-t5mw:/usr/include/boost/python/converter> diff registered.hpp registered.hpp.bak
12d11
< # include <boost/type_traits/is_void.hpp>
14,15d12
< # include <boost/python/type_id.hpp>
< # include <boost/type.hpp>
83,84c80,81
< inline registration const&
< registry_lookup2(T&(*)())
---
> registration const&
> registry_lookup(T&(*)())
91,106c88
< inline registration const&
< registry_lookup1(type<T>)
< {
< return registry_lookup2((T(*)())0);
< }
<
< inline registration const&
< registry_lookup1(type<const volatile void>)
< {
< detail::register_shared_ptr1((void*)0);
< return registry::lookup(type_id<void>());
< }
<
< template <class T>
< registration const& registered_base<T>::converters = detail::registry_lookup1(type<T>());
<
---
> registration const& registered_base<T>::converters = detail::registry_lookup((T(*)())0);

It is too hard to understand this code, isn't it?

Python and Ruby

2008-07-01T00:32:05+09:00

I have a chance to study popular script languages, python and ruby. I always want to study these since i had heard them before. Fortunately, my one client want to make a image management web service. So i choose python as backend and flash(actionscript) as a client. Now i am enjoying hacking python. It is really exciting experience.

And ThoughtWorks gave me a test as a procedure of interview. They gave me to choose a language to implement the test of Java, Ruby, and C#. I had a little experience on Java and C#, but i choose Ruby because i want to learn it and use it. So in three days, i learned by online documents and solved the problem. That is also great experience. How could programming is so fun? I am so proud of these two programming languages. I'll polish it in a short period. It is a good challenge for me.

Agile China 2008

2008-06-22T03:10:51+09:00

it was the Agile China 2008 conference in Beijing. Thoughtworks, CSDN , InfoQ China organized this conference. Almost speakers is consist of Thoughtworks' inner peoples. There was two tracks, one for English and another for Chinese.

The first speaker, Martin Fowler, presented about Domain Specific Language with Xuwu. DSL's concept is familiar to me though it was my first time i heard about DSL, because I tried at the serveral projects to give a scripting language to my colleagues. Using these scripting languages, the programmer could forget the game design issues at the moment. It means we could focus on the more valuable objects.

Richard Durnall presented 'Lean Thinking Techniques for IT Professionals.' It is quite general introduction for me. Howerver at the end of presentation, there were several practices. I hope he should spend more time to the practices.

Paulo Caroli presented 'Agile Evolutionary Design: from simple to well-structured design.' He talked about the TDD, refactoring, and continuous integration.

It was nice to meet ThoughWorks people. Mr. Tao is a recuiter. Miss Choi is a business analyst, she is from Korea like me. Mr. Wang who presented about 'Goal Oriented Team.' Every ThoughWorks peoples were kind and smart. it seems they are really enjoying thier job.

The Agile China 2008, it was full of ThoughWorks. Everywhere i could find the logo from the bag to T-shirts. I am sure their advertise was successful! The contents of conference was not bad inspite of it was free of charge. So it was a win-win event. Cool!

Rise up chinese developers!