5th International Workshop Automating Test Case Design, Selection and Evaluation (ATSE'14)

Warsaw, Poland, 7 - 10 September, 2014


Trends such as globalisation, standardisation and shorter lifecycles place great demands on the flexibility of the software industry. In order to compete and cooperate on an international scale, a constantly decreasing time to market and an increasing level of quality are essential. Software and systems testing is at the moment the most important and mostly used quality assurance technique applied in industry. However, the complexity of software systems and hence of their development is increasing. Systems get bigger, connect large amounts of components that interact in many different ways on the Future Internet, and have constantly changing and different types of requirements (functionality, dependability, real-time, etc.). Consequently, the development of cost-effective and high-quality systems opens new challenges that cannot be faced only with traditional testing approaches. New techniques for systematization and automation of testing are required.

Even though many test automation tools are currently available to aid test planning and control as well as test case execution and monitoring, all these tools share a similar passive philosophy towards test case design, selection of test data and test evaluation. They leave these crucial, time-consuming and demanding activities to the human tester. This is not without reason; test case design and test evaluation are difficult to automate with the techniques available in current industrial practice. The domain of possible inputs (potential test cases), even for a trivial program, is typically too large to be exhaustively explored. Consequently, one of the major challenges associated with test case design is the selection of test cases that are effective at finding flaws without requiring an excessive number of tests to be carried out. This is the problem which this workshop wants to attack.

This workshop will provide researchers and practitioners a forum for exchanging ideas, experiences, understanding of the problems, visions for the future, and promising solutions to the problems in automated test case generation, selection and evaluation. The workshop will also provide a platform for researchers and developers of testing tools to work together to identify the problems in the theory and practice of software test automation and to set an agenda and lay the foundation for future development.


Topics include (but are not limited to):

  • techniques and tools for automating test case design:
    • model-based,
    • combinatorial.based,
    • optimization-based,
    • etc.
  • Evaluation of testing techniques and tools on real systems, not only toy problems.
  • Benchmarks for evaluating software testing techniques

Type of submissions

We expect the following types of submissions:

  • Research in progress, including research results at a premature stage.
  • Experience reports with the usage of testing technique and tools.
    • Positive experiences should present techniques and tools that work and the situations in which they work.
    • Negative experiences should be used to highlight new research challenges.
  • Surveys, case studies and comparative studies that investigate pros, cons and complementarities of existing tools.
  • Vision papers stating where the research in the field should be heading towards.
  • Tool and technique demonstrations.

Paper submission

  • Authors should submit draft papers (as Postscript, PDF of MSWord file).
  • The total length of a paper should not exceed 10 pages IEEE style (including tables, figures and references). IEEE style templates are available here.
  • Papers will be refereed and accepted on the basis of their scientific merit and relevance to the workshop.
  • Preprints containing accepted papers will be published on a USB memory stick provided to the FedCSIS participants.
  • Only papers presented at the conference will be submitted for inclusion in the IEEE Xplore® database.
  • Conference proceedings will be published in a volume with ISBN and ISSN numbers and posted at the conference WWW site.
  • Conference proceedings will be indexed in BazEkon and submitted for indexation in: Thomson Reuters - Conference Proceedings Citation Index, SciVerse Scopus, InspecIndex CopernicusDBLP Computer Science Bibliography and Google Scholar
  • Extended versions of selected papers presented during the conference will be published as Special Issue(s).
  • Organizers reserve right to move accepted papers between FedCSIS events.


Session program

Important Dates

  • Call for event proposals: October 18, 2013
  • Paper submission (strict deadline): Wednesday Apr 23 2014 11:59:59 pm HST
  • Position paper submission: May 23, 2014
  • Acceptance decision: June 02, 2014
  • Final version of paper submission: June 24, 2014
  • Final deadline for discounted fee: July 30, 2014
  • Conference dates: September 7-10, 2014

FedCSIS is organized by :

Under auspices of

Prof. Lena Kolarska-Bobińska

Minister of Science
and Higher Education

Dr Rafał Trzaskowski

Minister of Administration
and Digitization

Prof. Michał Kleiber

President of the Polish Academy of Sciences

Major General Wiesław Leśniakiewicz

Chief Commandant of
the State Fire Service

Prof. Hanna Gronkiewicz-Waltz

Mayor of the Capital City of Warsaw

Prof. Jan Szmidt

Rector of Warsaw University of Technology

Gen. Prof. Zygmunt Mierczyk

Rector of Military Technical Academy

Prof. Andrzej Gospodarowicz

Rector of Wroclaw University of Economics