LANGETI 2020
November, 2020 @ Sacramento, California, United States.
In conjuction with ESEC/FSE 2020
Table of contents
Languages and Tools for Next Generation Testing Workshop - LANGETI 2020
Every year, new ideas arise in programming and software development that facilitate new capabilities for software systems. However, aspects of software systems development (testing) are overlooked. The LANGETI workshop intends to serve as an open discussion platform for practitioners and researchers to share their ideas and the results of their work around the topic of automated testing for next generation applications.
LANGETI aims to disrupt the current state of workshops through the introduction of more dynamic and involved working sessions. We will divide the workshop sessions into three main components. First, we will provide a space to share high quality research ideas focused on the subject of testing languages and tools for next generation platforms and systems. Second, we will have hands-on sessions to offer a practical overview of tools. Finally, we will have an open panel for early career researchers and nascent projects in a “pechakucha” style of presentation. These presentations will specifically aim to spark conversation about researchers’ ideas, to be further discussed in small panels at the end of each day.
Program
| Time Slot (UTC+1) | Session Name |
|---|---|
| 8:00 - 8:10 | Welcome, opening speech (A-Test) |
| 8:10 - 8:20 | Welcome, opening speech (LANGETI) |
| 8:20 - 8:45 | [A-TEST/Short paper] Fuzz4B: A Front-End to AFL Not Only for Fuzzing Experts |
| 8:45 - 9:45 | [Keynote] Aldeida Aleti - The effectiveness of automated software testing techniques |
| 9:45 - 9:55 | Short Break, 10 min |
| 9:55 - 10:25 | [LANGETI] Testing Practices for Infrastructure as Code |
| 10:25 - 10:55 | [A-TEST] Navigation and Exploration in 3D-Game Automated Play Testing |
| 10:55 - 11:00 | Announcements |
| 11:00 - 12:00 | Longer Break, 1h, leave the room open for discussions |
| 12:00 - 13:00 | [Tutorial] Peter Schrammel: Diffblue Cover |
| 13:00 - 13:10 | Short Break, 15 min |
| 13:15 - 14:15 | [Tutorial] Michel Nass, Emil Alegroth: Scout |
| 14:15 - 14:30 | Short Break, 15 min |
| 14:30 - 14:55 | [A-TEST/Short paper] Towards Automated Testing of RPA Implementations |
| 14:55 - 15:00 | Announcements |
| 15:00 - 18:00 | Longer Break, 3h, leave the room open for discussions |
| 18:00 - 18:30 | [LANGETI] Testing multi-tenant applications using fuzzing and reinforcement learning |
| 18:30 - 19:00 | [LANGETI] RIVER 2.0: An open-source testing framework using AI techniques |
| 19:00 - 19:30 | [A-TEST] Comparing Transition Trees Test Suites Effectiveness for Different Mutation Operators |
| 19:40 - 19:50 | Short Break, 10 min |
| 19:50 - 20:50 | [Keynote] Corina Pasareanu - SafeDNN: Understanding and Verifying Neural Networks |
| 20:40 - 20:45 | Final Remarks by Organizers |
| 20:45 - 21:00 | Time for open discussion, leave the room open for discussion |
Intended Audience
The workshop looks to bring together practitioners and researchers at different stages of their career. The workshop contents should be of interest for people working on software testing in general. Moreover, with the hands-on format planned for the workshop we expect to capture the interest of both newcomers to the field and industrial practitioners alike.
Format
The workshop will take place over 2 days. The first day will commence with an initial theory-oriented keynote, followed by regular paper presentations. Each of these presentations will undergo the normal peer review process expected of research papers at academic SE venues. The second day will open with a keynote-style tutorial, followed by practical sessions showcasing a wide variety of software testing tools ranging from prototypes to mature systems. These sessions will be structured as short tutorials, where attendants will have the opportunity to download, and use the tool in their own machines, following a guided example. Across both days of the workshop time will be dedicated for the “pecha kucha” spotlights, wherein the presentations on the first day will be more theoretical in nature, and those on the second day will be more tool oriented.
Submission
An explicit goal of the workshop is to open a platform for new or visionary testing techniques. We are also interested in tool-oriented submissions, where participants would present and demo their testing solutions. Therefore, contributions to the workshop should ideally include, in addition to a detailed discussion of the proposed approach (for example by defining the models, mechanisms, or testing strategies underlying that approach), a discussion of how the proposed approach on software testing could influence or be influenced by other approaches and perspectives. Although it is not mandatory, we encourage the authors to include preliminary results of using the proposed approaches/tools. We encourage submissions that make contributions related to the topics of testing-oriented programming languages and tools tailored for new technologies, or new application domains.
We will accept contributions in the following forms:
-
Technical Workshop Papers (up to 6 pages including references): Technical workshop papers should explicitly discuss new testing techniques as relevant to the workshop topics listed below. Submissions of work in early stages is encouraged, although we also suggest authors include a preliminary evaluation of their proposed techniques or discussions of the implications of findings from empirical studies.
-
Research Abstracts (up to 2 pages including references): We encourage both academic researchers and industrial practitioners to submit extended abstracts that describe early or existing ideas about testing approaches to be discussed during the workshop. Abstracts should clearly state the purpose of the approach, research/implementation challenges, and research agenda.
-
Testing Tool Extended Abstracts (up to 2 pages including references): We encourage both academic researchers and industrial practitioners to submit extended abstracts that describe new or existing testing tools to be showcased during the workshop. Abstracts should clearly state the purpose of the tool, and provide an overview of its functionality.
The topics of interest of the workshop include, but are not limited to:
- Domain specific automated testing: mobile, web, micro-services, IoT, context-driven, autonomous systems, etc.
- Chaos engineering
- Metamorphic testing
- Automated testing of quality attributes (performance, security, usability, etc.)
- Game/Play testing
- Mutation testing
- Model-based testing
- Artificial Intelligence for Software Testing
- Testing of artificial intelligence-based systems
- Empirical studies
- Experience/Industry reports
Papers must be written in English, provided as PDF documents, and follow the ESEC/FSE 2020 Format and Submission Guidelines, i.e., ACM Conference Format (10 point font, Times New Roman font family, numeric citation style). Submission will be managed through the LANGETI 2020 EasyChair conference management system.
Accepted papers will be published as part of ACM’s Digital Library. Submissions will undergo standard peer reviewing by at least three members of the program committee. Shepherding will be a possibility after notification. All accepted papers will be allocated a presentation slot. All paper submissions are expected to present their topic together with a hands-on mini tutorial about the use/implementation of the tool/algorithm presented in their paper.
Important Dates
| Paper submission: | August 17, 2020 |
| Paper notification: | September 13, 2020 |
| Camera-ready submission: | September 18, 2020 |
| Workshop date: | November 9, 2020 |
Follow-up Plans
This will be the first edition of the LANGETI workshop, which we aim to evolve into a self-sustaining workshop and a mainstay of the ESEC/FSE conference. With LANGETI we will build a community for software testing researchers and practitioners to come together. We will create an online software testing portal associated with LANGETI. The idea of the portal is to use it as a hub gathering information about authors and tools that participate in the workshop. Overtime, profiles for other researchers, and other testing tools can be added to the webpage.
In addition to this testing portal, we will record the “pecha kucha” talks, which will be added to the permanent workshop webpage. These talks will serve as a roadmap and archive of emerging ideas in software testing. We will add an editorial note of the workshop summarizing the main discussions (together with a detailed discussions memoir) of the workshop.
Organizers Bio
Mario Linares-Vásquez - Universidad de los Andes, Colombia - m.linaresv@uniandes.edu.co
Mario has been an Assistant Professor at Universidad de los Andes since 2016. Mario’s research has focused on automated testing techniques for mobile platforms, specifically targeting the android environment. Mario has served in different program committees for conferences and workshops in the software engineering community such as ASE, ICSME, SANER, ICPC, MobileSoft, and GREENS. Mario is a member of the editorial board of the Information and Software Technology Journal and has served as reviewer for TSE, TOSEM, EMSE, JSS, JSEP, IEEE Software. He has been the co-chair of the tool demo track at the SANER’17, CIBSE’18, and ICSME’20 conferences; he also served as Student Volunteers chair at ICSME’18 and Co-chair of the REproducibility Studies and NEgative Results (RENE) Track at SANER’19.
Nicolás Cardozo - Universidad de los Andes, Colombia – n.cardozo@uniandes.edu.co
Nicolás has been an Assistant Professor at Universidad de los Andes since 2016; he has worked in the programming language and adaptive systems community since 2009 participating in the program committees for different conferences and workshops. Nicolás has been the organizer of the LASSY workshop, co-located with the <Programming> conference 2014-2017. In 2018 Nicolás was also part of the organization of the Iberoamerican conference on Software Engineering, and the Workshop on Logic, Languages, Information and Computation, both held at Universidad de los Andes.
Ivana Dusparic - Trinity College Dublin, Ireland - ivana.dusparic@scss.tcd.ie
Ivana has been an Ussher Assistant Professor at Trinity College Dublin since 2016. Her research focuses on development and use of Artificial Intelligence (AI) techniques to achieve autonomous optimization of large-scale heterogeneous infrastructures, with particular focus on smart cities applications, sustainable urban mobility, and communication networks. One of her particular interests is testing of AI-based systems. She has been part of the organizing committee of the Symposium on Software Engineering for Adaptive and Self-Managing Systems collocated with ICSE’19, and a co-organizer of ATT’18 and ATT’20, Workshop on Agents in Traffic and Transportation, collocated with AAMAS’18 and ECAI’20.
Kevin Moran, George Mason University, United States - kpmoran01@email.wm.edu
Kevin Moran is a Research Assistant Professor in the Computer Science Department at William & Mary. He will be joining George Mason University as an Assistant Professor in Fall 2020. He graduated with a B.A. in Physics from the College of the Holy Cross in 2013 and an M.S. degree from William & Mary in August of 2015. He received his Ph.D. degree from William & Mary in August 2018. His main research interests involve facilitating the processes of software engineering, maintenance, and evolution with a focus on mobile platforms. He has published in several top peer-reviewed venues including: ICSE, ESEC/FSE, TSE, USENIX Security, ICST, ICSME, and MSR. He was the second-overall graduate winner in the ACM Student Research competition at ESEC/FSE 2015, received the best paper award at CODASPY 2019, and an ACM SIGSOFT distinguished paper award at ESEC/FSE’19. Moran has served on the organizing committees of MobileSOFT’19 and ICSME’19. More information is available at http://www.kpmoran.com.
Camilo Escobar-Velásquez - Universidad de los Andes, Colombia - ca.escobar2434@uniandes.edu.co
Camilo is a Ph.D. student at Universidad de los Andes in Colombia. He received his M.S. in Software Engineering from Universidad de los Andes in 2019. He received his B.S. in Systems and Computing Engineering - Minor: Mathematics from Universidad de los Andes in 2017. He is part of The Software Design Lab, where he has been part of research projects on evolution, maintenance and analysis of closed-source android apps, automation of software engineering tasks and software testing. He received a Google Latin American Research Award in 2018-2020. He served as a student volunteer for ICSME’2018, ICSE’2019 and ASE’2019.More information is available at https://caev03.github.io
Program Committee
| Saba Alimadadi | Simon Fraser University |
| Nuno Antunes | University of Coimbra |
| Alexandre Bergel | Universidad de Chile |
| Gabriele Bavota | Università della Svizzera italiana |
| Carlos Bernal-Cárdenas | William and Mary |
| Massimiliano Di Penta | University of Sannio |
| Julian Dolby | IBM |
| Mattia Fazzini | University of Minnesota |
| Carlos Gavidia | Uiversity College London |
| Owolabi Legunsen | Cornell University |
| Sam Malek | University of California at Irvine |
| Corina Pasareanu | NASA Ames |
| Fabio Palomba | University of Salerno |
| Gordana Rakic | University Novi Sad |
| August Shi | UT Austin |
| Gerson Sunyé | University of Nantes |
| Michele Tufano | Microsoft |
| Tanja Vos | Technical University of Valencia |