As explained in the previous post, Agent-Based Modelling and Simulation (ABMS) has a great potential in solving challenging problems in aviation. Unfortunately, this powerful approach is not yet well exploited by the aviation community. So we thought it would be nice to provide an overview of past agent-based applications in order to give an idea about the kind of problems that can be addressed with this novel approach. This post summarizes previous work conducted by various aviation research groups using the agent-based paradigm.
After having performed a literature scan, we have noticed that there are two main approaches namely: Multi-Agent Systems (MAS) and ABMS of socio-technical systems. Although there is significant knowledge and background overlap between the two approaches (e.g. both use distributed autonomous agents) the two are used in complementary ways. The primary goal in ABMS of socio-technical systems is to search for explanatory insight into the collective behaviour of agents obeying simple rules, rather than solving specific practical or engineering problems as in MAS (Wikipedia 2017). Researchers in ABMS of socio-technical systems develop simulations that can reveal system behaviour emerging from the agent’s collective actions and interactions. In these simulations, the agent entities are used to represent actors in the real world (E.g. individuals or teams) and need not be intelligent technical system agents only. They are programmed to react to the computational environment in which they are located, where this environment is a model of the real environment in which the actors operate (Gilbert 2008). So with this comes the need for instance to represent human behaviour and social interactions. On the other hand, a technical MAS is a computerized system composed of multiple interacting intelligent agents. Here intelligence can include some methodical, procedural or algorithmic search. When running simulations of a technical MAS then this also is referred to as ABMS. In Nikolic & Kasmire (2013), a distinction was made between ABMS and MAS, however the explicit mentioning of technical MAS and ABMS of socio-technical systems was not done. According to their distinction, the main difference between ABMS and MAS is that ABMS sets up agents believed to have crucial characteristics of real world analogs to see what happens when they do whatever they do; while in a MAS agents are set up with exactly the characteristics, connections and choices that they need to achieve certain desired emergent states.
In air transportation, agent-based models of socio-technical systems and of technical MAS have been developed and used by the aviation community. These models have been applied to fulfil several purposes, e.g. to evaluate current and future operational concepts, to assess safety risk, or optimize ATC, airline, or airports operations. Table 1 gives an overview of these models and classifies them in the two distinct categories of technical MAS and ABMS of a socio-technical system. This overview has revealed interesting findings: 1) Technical MAS have been used before ABMS of socio-technical systems; 2) ATM systems apparently are among the oldest application areas of technical MAS and have been a standard application of research in the field since the work of Cammarata et al. (1983). It is also relevant to recognize that ABMS is known by many names, e.g. ABM (agent-based modelling), IBM (individual-based modelling), ABS (agent-based systems or simulation) are all widely-used acronyms.
Table 1: models in air transportation using the agent-based paradigm
|Publications (in chronological order)||Institute||Model purpose|
|Cammarata et al. 1983||Rand||Conflict resolution|
|Ljungberg & Lucas 1992||Australian Artificial Intelligence Institute||Assisting flow managers to arrange sequence of incoming aircraft|
|Langerman & Ehlers 1997||Rand Afrikaans University||Airline schedule development|
|Tomlin et al. 1998||University of California||Conflict resolution|
|Wangermann & Stengel 1998||Princeton University||Optimization of airline operations through negotiation|
|Nguyen-Duc et al. 2003||University of Paris 6, EUROCONTROL||Real time traffic synchronization|
|Wollkind et al 2004||Texas A&M University||Conflict resolution using cooperative and negotiation techniques|
|Hwang et al 2007||Purdue University||Verification of collision avoidance algorithms|
|Sislak et al. 2007||Czech Technical University, US Air Force Research Laboratory||Conflict resolution|
|Tumer & Agogino 2007||Oregon State University, NASA Ames Research Centre||Traffic flow management|
|Gorodetsky et al. 2008||St. Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences||Conflict resolution|
|Mao 2011||Universiteit van Tilburg||Scheduling aircraft ground handling operations|
|Castro et al. 2014||University of Porto, MASDIMA||Airline disruption management|
|Udluft et al 2016||Delft University of Technology||Agent-based simulation of decentralized control for taxiing aircraft|
|ABMS of a Socio-Technical System|
|Blom et al. 2001||National Aerospace Laboratory NLR||Accident risk assessment of advanced ATM concepts|
|Corker 1999||San Jose State University||Evaluation of advanced ATC operational concepts|
|Campbell et al. 2000||The MITRE Corporation||Policy analysis of collaborative traffic flow management|
|Callantine 2001||San Jose State University, NASA Ames Research Centre||Evaluation of advanced ATC operational concepts|
|Blom et al 2003a||National Aerospace Laboratory NLR||Accident risk assessment of opposite en-route traffic lanes|
|Blom et al 2003b||National Aerospace Laboratory NLR||Accident risk assessment of simultaneous converging instrument approaches|
|Niedringhaus 2004||The MITRE Corporation||Assessing the impact of stakeholder decisions on the NAS|
|Lee et al. 2005||NASA Ames Research Centre||Evaluation of advanced ATC operational concepts|
|Mehta et al. 2006||Purdue University, Lockheed Martin and Simulex||Evaluation of advanced ATC operational concepts|
|Blom et al 2009a||National Aerospace Laboratory NLR||Free flight equipped aircraft|
|DeLaurentis & Ayyalasomayajula 2009||Purdue University||Assessing the impact of stakeholder actions on the air transport network|
|Stroeve et al 2009||National Aerospace Laboratory NLR||Accident risk assessment of active runway crossings|
|Wolfe et al. 2009||NASA Ames Research Centre||Evaluation of air traffic flow management concepts|
|DeOliveira et al 2010||Atech Tecnologias Críticas , University of São Paulo, National Aerospace Laboratory||Safety risk assessment of an advanced ASAS interval management concept|
|Kuhn et al. 2010||University of Louisville, Louisiana Tech University, West Virginia University, Argonne National Laboratory||Airline market share prediction|
|George et al. 2011||Intelligent Automation, University of California Santa Cruz, Raytheon Company, Sensis Corporation, Mosaic-ATM, Aerospace Computing, NASA (Ames, Glenn, and Langley)||Evaluation of current and future operational concepts|
|Sharpanskykh & Stroeve 2011||Vrije Universiteit Amsterdam, National Aerospace Laboratory NLR||Assessment of safety culture|
|Bouarfa et al. 2013||Delft University of Technology||Safety assessment of an advanced airport ConOps|
|Darabi et al. 2014||Stevens Institute of Technology||Studying competition and collaboration between airlines|
|Gurtner et al. 2014||Scuola Normale Superiore di Pisa, Deep Blue, Universita degli Studi di Siena, Santa Fe Institute||Studying airspace allocation in various conditions|
|Molina et al. 2014||Technical University of Madrid||Evaluating the impact of new concepts and regulations on the ATM network|
|Blom & Bakker 2015||National Aerospace Laboratory NLR||Safety assessment of an advanced pure airborne TBO concept under very high traffic demand|
|Blom & Bakker 2016||National Aerospace Laboratory NLR||Safety assessment of an advanced ground-based TBO concept under very high traffic demand|
|Sharpanskykh and Haest 2016||Delft University of Technology||Agent-based sociotechnical modelling of aircraft turnaround processes|
|Bouarfa et al. 2016||Delft University of Technology||Agent-based modelling of coordination by Airline Operations Control|
|Blom & Bouarfa 2016||Delft University of Technology||Agent-based modelling of resilience|
|Sharpanskykh, A. (2016b)||Delft University of Technology||Agent-based modelling framework for adaptive resilience in air transport|
|Sharpanskykh, A. (2016a); Janssen and Sharpanskykh 2017||Delft University of Technology||Agent-based modelling of security of airports|
If you are aware of an agent-based application that was not shown in this overview, we would very much appreciate it if you email it to firstname.lastname@example.org or leave the reference details in the comments box below.
- Bouarfa, S, Blom, H.A.P., Curran, R., Everdij, M.H.C. Agent-Based Modeling and Simulation of Emergent Behavior in Air Transportation. Journal of Complex Adaptive Systems Modeling, 1:15, 2013. DOI 10.1186/2194-3206-1-15.
- Bouarfa, S., Blom, H.A.P., Curran, R., 2016. Agent-Based Modelling and Simulation of Coordination by Airline Operations Control. IEEE Transactions on Emerging Topics in Computing, Volume:PP, Issue:99, February.DOI 10.1109/TETC.2015.2439633.
- Blom, H.A.P., Bakker, G.J., Blanker, P.J.G., Daams, J., Everdij, M.H.C., Klompstra, M.B., 2001. Accident Risk Assessment for Advanced ATM. In: Donohue, G.L., Zelweger, A.G. eds. Air Transport Systems Engineering: AIAA, p 463-80.
- Blom, H.A.P., Stroeve, S.H., Everdij, M.H.C., van der Park, M.N.J, 2003a. Human cognition performance model to evaluate safe spacing in air traffic, Human Factors and Aerospace Safety, Vol. 3, pp. 59-82.
- Blom, H.A.P., Klompstra, M.B., Bakker, G.J., 2003b. “Accident risk assessment of simultaneous converging instrument approaches,” Air Traffic Control Quarterly, Vol. 11, pp. 123-155.
- Blom, H.A.P., Obbink, B.K., Bakker, G.J., 2009a. Simulated Safety Risk of an Uncoordinated Airborne Self Separation Concept of Operation. ATC-Quarterly, 17, 63-93.
- Blom, H.A.P., Bakker, G. J., 2015. “Safety Evaluation of Advanced Self-Separation Under Very High En Route Traffic Demand”, Journal of Aerospace Information Systems, Vol. 12, No. 6, pp. 413-427. doi: 10.2514/1.I010243
- Blom, H.A.P., Bakker, G.J., 2016. “Agent-Based Modelling and Simulation of Trajectory Based Operations under Very High Traffic Demand”, Proc. of 6th SESAR Innovation Days, Delft, 8-10 November 2016, Ed: D. Schaefer, Eurocontrol, Brussels, ISSN 0770-1268, pp. 1-9.
- Blom, H.A.P., Bouarfa, S., 2016. Resilience. In Complexity Science in Air Traffic Management, eds. Cook, A., & Rivas, D., Ashgate publishing, Chapter 5, ISBN 978-1-4724-6037-0.
- Callantine, T.J., 2001. Agents for Analysis and Design of Complex Systems. in Systems, Man, and Cybernetics, 2001 IEEE International Conference, vol. 1, 567-573.
- Cammarata, S., McArthur, D., Steeb, R., 1983. Strategies of Cooperation in Distributed Problem Solving. N-2031-ARPA, the defense advanced research projects agency.
- Campbell, K.C., Cooper, W.W.jr., Greenbaum, D.P., Wojcik, L.A., 2000. Modeling Distributed Human Decision-Making in Traffic Flow Management Operations. 3rd USA/Europe Air Traffic Management R&D Seminar, Napoli, 13-16 June.
- Castro, A.J.M., Rocha, A.P., Oliveira, E., 2014. “A new approach for disruption management in airline operations control,” Studies in Computational Intelligence, vol. 562, Springer, Berlin.
- Corker, K.M., 1999. Human Performance Simulation in the Analysis of Advanced Air Traffic Management. Proc. of the 1999 Winter Simulation Conference.
- Darabi, H.R., Mostashari, A., Mansouri, M., 2014. Modelling Competition and Collaboration in the Airline Industry using Agent-Based Simulation. Int. J. Industrial and Systems Engineering, Vol. 16, No. 1.
- DeLaurentis, D.A., Ayyalasomayajula, S. 2009. Exploring the Synergy between Industrial Ecology and System of Systems to understand Complexity’, Journal of Industrial Ecology, Vol. 13, No. 2, pp.247–263.
- DeOliveira, I.R., L.F. Vismari, P.S. Cugnasca, J.B. Camargo Jr, G.J. Bakker, H.A.P. Blom, 2010. “A case study of advanced airborne technology impacting air traffic management”. Eds. Weigang, L., et al., Computational models, software engineering and advanced technologies in air transportation, Engineering Science Reference, Hershey, pp. 177-214.
- George, S.E., Satapathy, G., Manikonda, V., Wieland, F., Refai, M.S., Dupeee, R., 2011. Build 8 of the Airspace Concept Evaluation system. AIAA 2011-6373, AIAA Modeling and Simulation Technologies Conference, 08-11 August, Portland, Oregon.
- Gilbert, N., 2008. Agent-Based Models. Sage Publications Ltd, UK.
- Gorodetsky, V., Karsaev, O., Samoylov, V., Skormin, V., 2008. Multi-Agent Technology for Air Traffic Control and Incident Management in Airport Airspace. In proceedings of the International Workshop Agents in Traffic and Transportation; Portugal, 119-125.
- Gurtner, G., Valori, L., Lillo, F., 2014. Competitive Allocation of Resources on a Network: an Agent-Based Model of Air Companies Competing for the Best Routes. arXiv:1411.5504v1 [physics.soc-ph], 20 Nov.
- Hwang, I., Kim, J., Tomlin, C. 2007. Protocol-based conflict resolution for air traffic control. Air Traffic Control Quarterly 15(1), 1–34.
- Janssen, S., Sharpanskykh, A., 2017. Agent-based Modelling for Security Risk Assessment (forthcoming)
- Kuhn, J.R. Jr., Courtney, J.F., Morris, B., Tatara, E.R., 2010. Agent-Based Analysis and Simulation of the Consumer Airline Market Share for Frontier Airlines, Knowledge-Based Systems (23), 875–882.
- Langerman, J., Ehlers, E.M., 1997. Agent-Based Airline Scheduling. Computers ind. Engng, Vol. 33, Nos 3-4, 849-852.
- Lee, S.M., Ravinder, U., Johnston, J.C., 2005. Developing an Agent Model of Human Performance in Air Traffic Control Operations Using APEX Cognitive Architecture. Proc. of the 2005 Winter Simulation Conference.
- Ljungberg, M., Lucas, A., 1992. The OASIS Air Traffic Management System. Technical Note 28, August.
- Mao, X., 2011. Airport under Control: Multi-agent Scheduling for Airport Ground Handling. PhD thesis, May, Tilburg University.
- Mehta, S., Nedelescu, L., Nolan, M., Krull, K., Whitford, J., Pfleiderer, M., Cheemun, F. 2006. Using Agent-based Simulation to Evaluate Technology and Concepts for the National Airspace System, IEEEAC paper #1227, Version 2.
- Molina, M., Carrasco, S., Martin, J., 2014. Agent-Based Modeling and Simulation for the Design of the Future European Air Traffic Management System: The Experience of CASSIOPEIA. In Corchado, J.M. et al. (Eds.): PAAMS 2014 Workshops, CCIS 430, pp. 22-33.
- Nguyen-Duc, M., Briot, JP, Drogoul, A., Duong, V., 2003. An Application of Multi-Agent Coordination Techniques in Air Traffic Management. Proc. Of the IEEE/WIC International Conference on Intelligent Agent Technology (IAT’03).
- Niedringhaus, W.P., 2004. The Jet:Wise Model of National Air Space System Evolution. Simulation 80:45.
- Nikolic, I., Kasmire, J., 2013. Theory. Van Dam, K.H., Nikolic, I., Lukszo, Z., eds. Agent-Based Modelling of Socio-Technical Systems, Chapter 2, Agent-Based Social Systems 9.
- Sharpanskykh, A., Stroeve S.H., 2011. An Agent-Based Approach for Structured Modeling Analysis and Improvement of Safety Culture. Comput Math Organ Theory 17:77–117, Springer.
- Sharpanskykh, A., 2016a. A Complex Systems Approach to Modeling and Analysis of Security and Resilience in Air Transport, Conference on Complex Systems, Amsterdam, the Netherlands.
- Sharpanskykh, A., 2016b. Unravelling and Improving Adaptive Resilience of Complex Air Transport Systems, Conference on Complex Systems, Amsterdam, the Netherlands.
- Sharpanskykh, A., Haest, R., 2016. An Agent-based Model to Study Compliance with Safety Regulations at an Airline Ground Service Organization. Applied Intelligence, Volume 45, Issue 3, pp. 881–903.
- Sislak, D., Pechoucek, M., Volf, P., Pavlicek, D., Samek, J., Marik, V., Losiewicz, P., 2007. AGENTFLY: Towards Multi-Agent Technology in Free Frlight Air Traffic Control. Whitestein Series in Software Agent Technologies, 73-96, Birkhauser Verlag Baser/Switzerland.
- Stroeve, S.H., Blom, H.A.P., Bakker, G.J., 2009. Systemic accident risk assessment in air traffic by Monte Carlo simulation. Safety Science 47(2), 238-249.
- Tomlin, C., Pappas, G.J., Sastry, S., 1998. Conflict Resolution for Air Traffic Management: A Study in Multiagent Hybrid Systems. IEEE Transactions on Automatic Control, Vol. 43, No. 4, April.
- Tumer, K., Agogino, A., 2007. Distributed Agent-Based Air Traffic Flow Management. AAMAS’07, May 14-18, Honolulu, Hawaii, USA.
- Udluft, H., Sharpanskykh, A., Curran, R., Clarke, JP., 2016. Agent-Based Simulation of Decentralized Control for Taxiing Aircraft. The Sixth SESAR Innovation Days.
- Wangermann, J.P., Stengel, R.F., 1998. Principled Negotiation between Intelligent Agents: A Model for Air Traffic Management. Artificial Intelligence in Engineering 12, 177-187.
- Wikipedia, 2017. Agent-Based Model. https://en.wikipedia.org/wiki/Agent-based_model
- Wolfe, S.R., Jarvis, P.A., Enomoto, F.Y., Sierhuis, M., van Putten, B.J., Sheth, K.S., 2009. A Multi-Agent Simulation of Collaborative Air Traffic Flow Management. In: Bazzan, A.L.C, Klugl, F. (Eds.), Multi-Agent Systems for Traffic and Transportation Engineering, Chapter 18, IGI Global Publishing, 357–381.
- Wollkind, S., Valasek, J., Ioerger, T.R., 2004. Automated Conflict Resolution for Air Traffic Management Using Cooperative Multiagent Negotiation. In proc. AIAA Guidance, Navigation, Control Conference. 1078-1088.