Learning and stabilization of altruistic behaviors in multi-agent systems

Multi-agent systems exhibit unexpected, emergent behavior as a result of the complexity of agent behaviors and their interactions. Despite significant research interest in the past decades, computational methods to identify and analyze emergence as it happens are still needed. This paper proposes a software architecture for identifying emergent behavior in a multi-agent system as it happens, using interval-based snapshots and emergent behavior metrics. We propose various distance functions to compare between the multi-agent system under analysis and systems that have been previously shown to exhibit emergent behavior.

Implementing collective behaviour in cooperative multi-agent systems requires several practical constraints to be addressed. In some environments, communication bandwidth is a critical constraint which may compromise the intended cooperative behaviour. This paper introduces a bio-inspired model which invokes collective behaviour in a multi-agent system using passive sensing without any explicit inter-agent communication. An agent looks for the majority of its neighbours either in its left or its right half space using two sensors. For a source localization problem, we compare performance of the proposed model using passive sensing against the well known school-of-fish collective behaviour models using ideal explicit inter-agent communication. For different cue strengths and neighbourhood radii, our results show that the proposed strategy boosts higher levels of group cohesion to make up for the information loss and in certain conditions performs better than the other collective behaviour models.

In this paper, we propose a formal approach to study the emergent behaviors in multiagent systems with limited communications and environmental constraints. Temporal logic and formal grammars are employed to specify the formal model of multiagents, and based on that an automated approach can be used to identify the emergent behaviors due to interactions among agents. Instead of exploring all possible system state spaces, which may grow exponentially, the proposed approach computes the local group polarization and the local group momentum for generating the emergent behavior set, and accordingly from which the emergent behaviors can be detected. To facilitate simulation and analysis, a MATLAB GUI is further designed to enable us to flexibly select control parameters in formal models of multiagent systems. Simulation results are provided to verify the proposed approach.

Multiagent systems in which independent software agents interact with each other to achieve common goals, complete distributed tasks concurrently under autonomous control. Agent communication has been shown to be an important factor in coordinating efficient group behavior in agents. Most research on training or evolving group behavior in multiagent systems used predefined agent communication protocols. Designing agent communication becomes a complex problem in dynamic and large-scale systems. In order to solve this problem, in our previous research we proposed a method applying genetic programming techniques, in particular Automatically Defined Function Genetic Programming (ADF-GP) (K. Mackin and E. Tazaki, 1999), to allow agents to autonomously learn effective agent communication messaging. For this research we take this approach further and combine training of the agent behavior as well as the communication protocol. By training both behavior and communication we expect to further optimize the system performance. A software simulation of a multiagent transaction system is used to observe the effectiveness of the proposed method.

Multiagent systems, in which independent software agents interact with each other to achieve common goals, complete concurrent distributed tasks under autonomous control. Agent Communication has been shown to be an important factor in coordinating efficient group behavior in agents. Most researches on training or evolving group behavior in multiagent systems used predefined agent communication protocols. Designing agent communication becomes a complex problem in dynamic and large‐scale systems. In order to solve this problem, in this paper we propose a new application of existing training methods. By applying Genetic Programming techniques, namely Automatically Defined Function Genetic Programming (ADF‐GP), in combination with pheromone communication features, we allowed the agent system to autonomously learn effective agent communication messaging for coordinated group behavior. A software simulation of a multiagent transaction system aiming at e‐commerce usage will be used to observe the effectiveness of the proposed method in the targeted environment. Using the proposed method, automatic training of a compact and efficient agent communication protocol for the multiagent system was observed.

This paper discusses a mechanism to ensure safe behaviors of HMSs (Holonic Manufacturing Systems). The change from low-variety high-volume to high-variety low-volume production requires highly flexible and adaptive manufacturing systems. Multi agent systems, in which decisions are made through cooperation among autonomous and cooperative elements, fulfill these requirements by exploiting full abilities of individual elements while eliminating various bottlenecks that exist in conventional systems. However, highly adaptive features induce non-deterministic behaviors of systems, and make it difficult to adopt multi agent systems as primary bases of manufacturing systems. In order to apply these systems to large and complicated applications, mechanisms that make their behaviors more predictable are essential. HMSs are a kind of multi agent systems, and an HMS safety ensuring mechanism proposed here is one of the attempts to make behaviors of multi agent systems more predictable.

As utility calculus cannot account for an important part of agents’ behaviour in Multi-Agent Systems, researchers have progressively adopted a more normative approach. Unfortunately, social laws have turned out to be too restrictive in real-life domains where autonomous agents’ activity cannot be completely specified in advance and the complexity of the system is ever changing. The idea of Rights is a halfway concept between anarchic and off-line constrained interaction. Rights improve coordination and facilitate social action in Multi-Agent domains through adjusting the coordination mechanisms to the complexity of the system. So far rights have not been tested or proven experimentally. We are comparing experimentally the three mentioned interaction architectures in the domain of agent-based traffic simulation.

Multi agent systems (MAS) play an important role in many of industrial software systems today. MAS are distributed systems and there is no central control for the agents in most of the systems. The lack of central control and the local view of each agent from the whole system may cause some unexpected behaviors which is called emergent behavior. Detecting and fixing these unexpected behaviors is more valuable and cost effective in the requirement and design phases rather than the implementation. In this paper, a method for the detection of emergent behaviors in MAS focusing on analysis phase of MaSE methodology and fixing them in the design phase is presented. The contributions of this work are investigating a specific type of emergent behaviors, the detection of them in MaSE methodology, and proposing solutions for the detected emergent behaviors. The details and the architecture of the system are presented. The method and how to apply this on MaSE is shown along with a case study followed by the discussion part.

Multi-Agent Systems (MAS) are extensively studied and defined differently in literature. A MAS can be described as an environment with multiple agents that interact with each other or the environment, following predetermined rules to achieve individual or shared goals. This work represents a survey focused on collaborative and non-collaborative behaviors within MAS. The survey presents the key characteristics, benefits and drawbacks of each behavior type and provides a structured review of the literature, emphasizing on the applications of these behaviors in different domains. Understanding these behaviors in MAS can have benefits in both academic research and day-to-day life. This understanding may help researchers and practitioners to design and implement MAS and to provide guidance for different behaviors that may be suitable based on specific scenarios.

A formalization of multi-agent systems (MAS) as hidden Markov models (HMM) is proposed and investigated from a view point of interaction among agents and environments. Conventional formalizations of agents as HMM do not take changes of environments in account, so that it is hard to analyze behaviors of agents that act in dynamic environments. The proposed formalization enables HMM to handles changes of environment and interaction among agents via environment directly inside of state-transitions. I first investigate HMM that represents changes of the environment in the same state-transitions of agent itself. Then I derive a structured model in which environment, agent, and another agent are treated as separated state-transitions and coupled with each other. For this model, in order to reduce the number of parameters, I introduce “symmetricity” among agents. Moreover, I discuss relation between reducing dependency in transitions and assumption of cooperative behaviors in MAS.

Multiagent systems, in which independent software agents interact with each other to achieve common goals, complete concurrent distributed tasks under autonomous control. We propose a method applying genetic programming (GP) to allow agents to autonomously learn effective agent communication messaging in order to achieve group behavior. A software simulation of a multiagent system will be used to observe the effectiveness of the proposed method. Using the proposed method, emergence of a compact and efficient agent communication protocol for the multiagent system was observed.

Analysis of motor control and behavior in multi agent systems by means of artificial neural networks

In the multi-agent system (MAS) context, the theories and practices of evolutionary computation (EC) have new implications, particularly with regard to engineering and shaping system behaviors. Thus, it is important that we consider the embodiment of EC in “real” agents, that is, agents that involve the real restrictions of time and space within MASs. In this chapter, we address these issues in three ways. First, we relate the foundations of EC theory to MAS and consider how general interactions among agents fit within this theory. Second, we introduce a platform independent agent system to assure that our EC methods work within the generic, but realistic, constraints of agents. Finally, we introduce an agent-based system of EC objects. Concluding sections discuss implications and future directions.

The Petri nets (PN)-based analytical approach to describing the agent behaviour in MAS (multi agent systems) is presented. PN yield the possibility to express the MAS behaviour by means of the vector state equation in the form of linear discrete system. Thus, the modular approach to the creation of the MAS model can be successfully used too. Three different interconnections of modules (agents, interfaces, environment) expressed by PN subnets are introduced. Special attention is paid to conflict resolution and machine learning methods based on modelling tools, detection and resolution of conflicts. The approach makes possible to use methods of linear algebra. In addition, it can be successfully used at the system analysis (e.g. the reachability of states), at testing the system properties, and even at the system control synthesis.KeywordsAgentPetri NetNegotiationConflict ResolutionMachine Learning

Coalition formation provides a versatile framework for analyzing cooperative behavior in multi-agent systems. In particular, hedonic coalition formation has gained considerable attention in the literature. An interesting class of hedonic games recently introduced by Aziz et al. [3] are fractional hedonic games. In these games, the utility an agent assigns to a coalition is his average valuation for the members of his coalition. Three common notions of stability in hedonic games are core stability, Nash stability, and individual stability. For each of these notions we show that stable partitions may fail to exist in fractional hedonic games. For core stable partitions this holds even when all players only have symmetric zero/one valuations ("mutual friendship"). We then leverage these counter-examples to show that deciding the existence of stable partitions (and therefore also computing stable partitions) is NP-hard for all considered stability notions. Moreover, we show that checking whether the valuation functions of a fractional hedonic game induce strict preferences over coalitions is coNP-complete.