Important dates
- Submission of extended abstracts: April 30, 2010
- Submission of full papers: May 13, 2010 (extended)
- Notification of paper acceptance: May 31, 2010
- Camera ready copy submission: July 31, 2010
- Early Registration Deadline: July 31, 2010
- The Workshop: September 13, 2010
Objectives
Evaluation, Verification, Validation and Refinement of Intelligent systems, have been an important issue from the very beginning of their applications. These issues were an important research area and engineering aspect in the 80's and 90's. A number of conceptual approaches as well as practical tools were developed then. With time the focus of research in the design of intelligent systems moved away from these topics, towards knowledge representation, discovery and processing, the Semantic Web technologies, and a number of other AI-inspired areas. However, recently a number of researchers have realized that the lack of systematic methods and formal techniques for the design, evaluation and refinement is often an important reasons for limited applications of even mature intelligent systems. Therefore, there is a growing need to reconsider some of the basic issues in this field.
Today, in fact, the classic approaches to the Desing, Evaluation, Verification, Validation and Refinement have to be assessed from the new perspectives in order to transfer their principles to new approaches and application fields. The practical design issues are of prime importance. The integration of Intelligent Systems with mainstream technologies and design approaches from other areas, e.g., from Software Engineering, from Machine Learning, or from the Social Sciences, is especially important. The quality issues need to be considered as early as possible during the Design phase of the system.
The goal of the workshop is to promote community-wide discussion of ideas that will influence and foster continued research concerning the topics of Design, Evaluation, and Refinement, as well as attract new researchers to the field.
The objective is to focus on the contributions in the above fields and to provide an environment for communicating different paradigms and approaches, thus hopefully stimulating future cooperation and synergistic activities.
Topics of Interest
Topics of interest include but are not limited to:
- Principles in knowledge systems and ontology design
- Detecting and handling inconsistencies and other anomalies within knowledge bases
- Fundamentals and formal methods for verification of AI systems
- Fundamentals and formal methods and techniques of validity assessment of AI systems, AI principles, and intelligent behavior in general
- Special approaches to verify and/or validate certain kinds of AI systems: rule-based, case-based,
- Special approaches or tools to evaluate systems of a particular application field
- Knowledge base refinement by using the results of evaluation
- Development and evaluation of ontologies
- Maintenance and evolution of knowledge systems and ontologies
- Explanation in the context of evaluation and assessment
- Problems in system certification
- Ontology and knowledge capture
- Design and evaluation issues in automatic knowledge capture and knowledge discovery
- Design and evaluation of semantic web applications and systems
- Formal methods in verification and evaluation of intelligent systems
- Case studies in design and evaluation and the lessons learned
We also encourage submissions which relate research results from other areas to the workshop topics.
We expect researchers and practitioners working on design, evaluation, and refinement issues in knowledge systems, e.g., from knowledge engineering, knowledge discovery, semantic web, social web, and web science. No limitation on the number of participants is planned.
The workshop will be held with presentations of accepted papers. A comfortable time slot for discussion of all papers will be given.
The abstracts of the papers will be published in an Abstract-Booklet of the IWK conference, and the full papers will be included in the printed IWK proceedings. Additionally, the full papers will be published as online proceedings after the event, edited by the workshop chairs. A Journal Special Issue of selected and revised papers of two subsequent DERIS workshops is planned in 2010.
Workshop Organizers
- Martin Atzmueller, Knowledge and Data Engineering Group, University of Kassel, Germany
( ) - Rainer Knauf, Artificial Intelligence Group, TU Ilmenau, Germany
( )
Program Committee
- M. Atzmueller, University of Kassel, Germany
- J. Baumeister, University Würzburg, Germany
- S. Gaudl, Fraunhofer IDMT, Germany
- A. Gonzalez, University of Central Florida, Florida, USA
- K. P. Jantke, Fraunhofer IDMT, Germany
- R. Knauf, TU Ilmenau, Germany
- A. Ligêza, AGH UST Krakow, Poland
- G. J. Nalepa, AGH UST, Krakow, Poland
- Th. Roth-Berghofer, DFKI GmbH, Germany
- D. H. Sleeman, University of Aberdeen, United Kingdom
Accepted papers
- Avelino Gonzalez, Rainer Knauf and Klaus Jantke. Composing Tactical Agents through Contextual Storyboards.
- Benedikt Kaempgen, Florian Lemmerich and Martin Atzmueller. Decision-Maker-Aware Design of Descriptive Data Mining.
- Feras Batarseh, Avelino Gonzalez and Rainer Knauf. Validation of Knowledge-based Systems through CommonKADS.
- Krzysztof Kaczor, Szymon Bobek and Grzegorz J. Nalepa. Rule Modularization and Inference Solutions – a Synthetic Overview.
- Martin Atzmueller and Stephanie Beer. Validation of Mixed-Structured Data using Pattern Mining and Information Extraction.
- Petia Kademova-Katzarova, Rumen Andreev, and Valentina Terzieva. An Adaptable E-Learning System for Pupils with Specific Learning Difficulties.
- Rainer Knauf, Yoshitaka Sakurai, Kouhei Takada and Setsuo Tsuruta. Validation of a Data Mining Method for Optimal University Curricula.
Submission and Proceedings
Authors are requested to initially submit complete manuscripts. However, draft versions of papers (work in progress, etc.) are also acceptable. The submitted works will be reviewed by at least two members of the program committee.
Papers should be formatted according to the IWK guidelines. The length of each paper should not exceed 6 pages for regular papers and 4 pages for short, or work in progress papers (including figures and references), see: http://www.tu-ilmenau.de/uni/fileadmin/Startseite/iwk10/submission/latex_templates_55iwk.zip. All papers must be written in English and submitted in PDF format.
Paper submission is a two-step process: