Systematic data generation and test design for solution algorithms on the example of SALBPGen for assembly line balancing

• Published in: European journal of operational research Vol. 228; no. 1; pp. 33 - 45
• Main Authors: Otto, Alena, Otto, Christian, Scholl, Armin
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01-07-2013; Elsevier Sequoia S.A
• Subjects: Algorithms; Assembly line balancing; Assembly lines; Benchmark data set; Complexity measures; Datasets; Experiments; Generators; Graph theory; Heuristic; Manufacturing; Precedence graph; Scheduling; Structure analysis; Studies; Benchmark data set; Precedence graph; Scheduling; Assembly line balancing; Structure analysis; Complexity measures
• DOI: 10.1016/j.ejor.2012.12.029
• EISSN: 1872-6860
• ISSN: 0377-2217

► Guidelines for systematic testing of algorithm’s performance. ► New generator for realistic and diversified line balancing instances. ► Analysis and new measure of hardness of problem instances. ► Statistical analysis of heuristics’ performance based on new data sets.
Recently, the importance of correctly designed computational experiments for testing algorithms has been a subject of extended discussions. Whenever real-world data is lacking, generated data sets provide a substantive methodological tool for experiments. Focused research questions need to base on specialized, randomized and sufficiently large data sets, which are sampled from the population of interest. We integrate the generation of data sets into the process of scientific testing.
Until now, no appropriate generators or systematic data sets have been available for the assembly line balancing problem (ALBP). Computational experiments were mostly based on very limited data sets unsystematically collected from the literature and from some real-world cases. As a consequence, former performance analyses often come to contradictory conclusions and lack on statistical evidence.
We introduce SALBPGen, a new instance generator for the simple ALBP which can be applied and extended to any generalized ALBP, too. Unlike most generators, SALBPGen takes into account usual properties of precedence graphs in manufacturing. It is very flexible and able to create instances with very diverse structures under full control of the experiment’s designer. We also propose new challenging data sets, as shown with the new direct measure of instance’s hardness called trickiness. By two exemplary computational experiments, we illustrate how important insights can be gained with the help of the systematically generated data sets.