An architecture for identifying emergent behavior in multi-agent systems

In this paper, we propose a formal approach to study the emergent behaviors in multiagent systems with limited communications and environmental constraints. Temporal logic and formal grammars are employed to specify the formal model of multiagents, and based on that an automated approach can be used to identify the emergent behaviors due to interactions among agents. Instead of exploring all possible system state spaces, which may grow exponentially, the proposed approach computes the local group polarization and the local group momentum for generating the emergent behavior set, and accordingly from which the emergent behaviors can be detected. To facilitate simulation and analysis, a MATLAB GUI is further designed to enable us to flexibly select control parameters in formal models of multiagent systems. Simulation results are provided to verify the proposed approach.

Optimization of performance in collective systems often requires altruism. Emergence and stabilization of altruistic behaviors are difficult because the agents incur a cost when behaving altruistically. In this paper we propose a biologically inspired strategy to learn stable altruistic behaviors in artificial multi-agent systems, namely reciprocal altruism. Our multi-agent system is made up of autonomous agents with a behavior-based architecture. Agents learn the most suitable cooperative strategy for different environments by means of a reinforcement learning algorithm. Each agent receives a reinforcement signal that only measures its individual performance. Simulation results show how the multi-agent system learns stable altruistic behaviors, so reaching optimal (or near-to-optimal) performances in unknown and changing environments.

Implementing collective behaviour in cooperative multi-agent systems requires several practical constraints to be addressed. In some environments, communication bandwidth is a critical constraint which may compromise the intended cooperative behaviour. This paper introduces a bio-inspired model which invokes collective behaviour in a multi-agent system using passive sensing without any explicit inter-agent communication. An agent looks for the majority of its neighbours either in its left or its right half space using two sensors. For a source localization problem, we compare performance of the proposed model using passive sensing against the well known school-of-fish collective behaviour models using ideal explicit inter-agent communication. For different cue strengths and neighbourhood radii, our results show that the proposed strategy boosts higher levels of group cohesion to make up for the information loss and in certain conditions performs better than the other collective behaviour models.

Multi agent systems (MAS) play an important role in many of industrial software systems today. MAS are distributed systems and there is no central control for the agents in most of the systems. The lack of central control and the local view of each agent from the whole system may cause some unexpected behaviors which is called emergent behavior. Detecting and fixing these unexpected behaviors is more valuable and cost effective in the requirement and design phases rather than the implementation. In this paper, a method for the detection of emergent behaviors in MAS focusing on analysis phase of MaSE methodology and fixing them in the design phase is presented. The contributions of this work are investigating a specific type of emergent behaviors, the detection of them in MaSE methodology, and proposing solutions for the detected emergent behaviors. The details and the architecture of the system are presented. The method and how to apply this on MaSE is shown along with a case study followed by the discussion part.

Multiagent systems in which independent software agents interact with each other to achieve common goals, complete distributed tasks concurrently under autonomous control. Agent communication has been shown to be an important factor in coordinating efficient group behavior in agents. Most research on training or evolving group behavior in multiagent systems used predefined agent communication protocols. Designing agent communication becomes a complex problem in dynamic and large-scale systems. In order to solve this problem, in our previous research we proposed a method applying genetic programming techniques, in particular Automatically Defined Function Genetic Programming (ADF-GP) (K. Mackin and E. Tazaki, 1999), to allow agents to autonomously learn effective agent communication messaging. For this research we take this approach further and combine training of the agent behavior as well as the communication protocol. By training both behavior and communication we expect to further optimize the system performance. A software simulation of a multiagent transaction system is used to observe the effectiveness of the proposed method.

Multiagent systems, in which independent software agents interact with each other to achieve common goals, complete concurrent distributed tasks under autonomous control. Agent Communication has been shown to be an important factor in coordinating efficient group behavior in agents. Most researches on training or evolving group behavior in multiagent systems used predefined agent communication protocols. Designing agent communication becomes a complex problem in dynamic and large‐scale systems. In order to solve this problem, in this paper we propose a new application of existing training methods. By applying Genetic Programming techniques, namely Automatically Defined Function Genetic Programming (ADF‐GP), in combination with pheromone communication features, we allowed the agent system to autonomously learn effective agent communication messaging for coordinated group behavior. A software simulation of a multiagent transaction system aiming at e‐commerce usage will be used to observe the effectiveness of the proposed method in the targeted environment. Using the proposed method, automatic training of a compact and efficient agent communication protocol for the multiagent system was observed.

Metric-based Evaluation of Implemented Software Architectures

Multi-Agent Systems (MAS) are extensively studied and defined differently in literature. A MAS can be described as an environment with multiple agents that interact with each other or the environment, following predetermined rules to achieve individual or shared goals. This work represents a survey focused on collaborative and non-collaborative behaviors within MAS. The survey presents the key characteristics, benefits and drawbacks of each behavior type and provides a structured review of the literature, emphasizing on the applications of these behaviors in different domains. Understanding these behaviors in MAS can have benefits in both academic research and day-to-day life. This understanding may help researchers and practitioners to design and implement MAS and to provide guidance for different behaviors that may be suitable based on specific scenarios.

This paper discusses a mechanism to ensure safe behaviors of HMSs (Holonic Manufacturing Systems). The change from low-variety high-volume to high-variety low-volume production requires highly flexible and adaptive manufacturing systems. Multi agent systems, in which decisions are made through cooperation among autonomous and cooperative elements, fulfill these requirements by exploiting full abilities of individual elements while eliminating various bottlenecks that exist in conventional systems. However, highly adaptive features induce non-deterministic behaviors of systems, and make it difficult to adopt multi agent systems as primary bases of manufacturing systems. In order to apply these systems to large and complicated applications, mechanisms that make their behaviors more predictable are essential. HMSs are a kind of multi agent systems, and an HMS safety ensuring mechanism proposed here is one of the attempts to make behaviors of multi agent systems more predictable.

As utility calculus cannot account for an important part of agents’ behaviour in Multi-Agent Systems, researchers have progressively adopted a more normative approach. Unfortunately, social laws have turned out to be too restrictive in real-life domains where autonomous agents’ activity cannot be completely specified in advance and the complexity of the system is ever changing. The idea of Rights is a halfway concept between anarchic and off-line constrained interaction. Rights improve coordination and facilitate social action in Multi-Agent domains through adjusting the coordination mechanisms to the complexity of the system. So far rights have not been tested or proven experimentally. We are comparing experimentally the three mentioned interaction architectures in the domain of agent-based traffic simulation.

In the multi-agent system (MAS) context, the theories and practices of evolutionary computation (EC) have new implications, particularly with regard to engineering and shaping system behaviors. Thus, it is important that we consider the embodiment of EC in “real” agents, that is, agents that involve the real restrictions of time and space within MASs. In this chapter, we address these issues in three ways. First, we relate the foundations of EC theory to MAS and consider how general interactions among agents fit within this theory. Second, we introduce a platform independent agent system to assure that our EC methods work within the generic, but realistic, constraints of agents. Finally, we introduce an agent-based system of EC objects. Concluding sections discuss implications and future directions.

Multiagent systems, in which independent software agents interact with each other to achieve common goals, complete concurrent distributed tasks under autonomous control. We propose a method applying genetic programming (GP) to allow agents to autonomously learn effective agent communication messaging in order to achieve group behavior. A software simulation of a multiagent system will be used to observe the effectiveness of the proposed method. Using the proposed method, emergence of a compact and efficient agent communication protocol for the multiagent system was observed.

Analysis of motor control and behavior in multi agent systems by means of artificial neural networks

The Petri nets (PN)-based analytical approach to describing the agent behaviour in MAS (multi agent systems) is presented. PN yield the possibility to express the MAS behaviour by means of the vector state equation in the form of linear discrete system. Thus, the modular approach to the creation of the MAS model can be successfully used too. Three different interconnections of modules (agents, interfaces, environment) expressed by PN subnets are introduced. Special attention is paid to conflict resolution and machine learning methods based on modelling tools, detection and resolution of conflicts. The approach makes possible to use methods of linear algebra. In addition, it can be successfully used at the system analysis (e.g. the reachability of states), at testing the system properties, and even at the system control synthesis.KeywordsAgentPetri NetNegotiationConflict ResolutionMachine Learning

Chapter 17 - Strategies and Prediction in Multi-Agent Systems