arxiv: v2 [nlin.ao] 24 May 2012

Transcription

1 arxiv: v2 [nlin.ao] 24 May 202 Synchronization an quorum sensing in a swarm of humanoi robots Patrick Bechon, Jean-Jacques Slotine Abstract With the avent of inexpensive simple humanoi robots, new classes of robotic questions can be consiere experimentally. One of these is collective behavior of groups of humanoi robots, an in particular robot synchronization an swarming. The goal of this work is to robustly synchronize a group of humanoi robots, an to emonstrate the approach experimentally on a choreography of 8 robots. We aim to be robust to network latencies, an to allow robots to join or leave the group at any time (for example a fallen robot shoul be able to stan up to rejoin the choreography). Contraction theory is use to allow each robot in the group to synchronize to a common virtual oscillator, an quorum sensing strategies are exploite to fit within the available banwith. The humanois use are ao s, evelope by Alebaran Robotics. Inex Terms ao, synchronization, contraction, quorum sensing. I. ITRODUCTIO With the avent of inexpensive simple humanoi robots, new classes of robotic questions can be consiere experimentally. One of these is collective behavior of groups of humanoi robots, an in particular robot synchronization an swarming. Among the great number of humanoi robot projects, one can think of the first robot to walk Asimo by Hona [], of the Humanoi Robotics Projet supporte by AIST [2] or Darwin create at Virginia Tech [3]. Toyota has also been working on his partner robots [4]. The Robocup (a competition of robot soccer) has also create a league for humanoi robots, an has aopte ao, a french humanoi robot by Alebaran Robotics [5], as it stanar platform for the Stanar Platform League. This work is the result of a collaboration between MIT s onlinear System Laboratory an Alebaran Robotics, the French company who esigne ao. ao is use worlwie in universities or in schools, mostly for research or eucation purposes. The aim of this work is to evelop a program to synchronize the movements of a large group of robots, for example to realize a synchronize choreography. This project is ifferent from most of the existing work on robot groups because it eals with strong synchronization rather than cooperation, like in Robocup. This kin of experiment has alreay been conucte by Alebaran for the Universal Exposition in Shanghai in 200 with 20 robots. Their approach was to synchronize every robot s clock by using the TP protocol [6], which is currently use by every computer to synchronize its clock on Internet. Then all robots start the choreography at the same time, assuming every that every robot will have the same loaing time. The rawback of this system is that it is not possible to compensate for an small error on one robot (if it starts with a elay for example), or to a a new robot uring the choreography. So we trie to evelop a more robust way to synchronize this behavior. Since our goal is really to ensure that every robot is acting precisely with the others (to o synchronization rather than collaboration), the issues that have to be solve are almost entirely network-relate. If the robots ha access to a perfect network (with immeiate transmission of ata between all the robots), a master-robot woul have been able to sent immeiate commans for every other robot, an they woul have been synchronize. But with real networks, information takes time to propagate an this time can be highly variable. It can be as small as several millisecons, but it can also take several secons Patrick Bechon is a stuent from Ecole Polyetchnique, France. He is currently stuying at MIT in the onlinear Systems Laboratory. Jean-Jacques Slotine heas the onlinear Systems Laboratory at MIT, USA in worst case, if the network has too much loa for instance, an especially if using Wi-Fi. To synchronize clocks betweens two robots, we also use the TP protocol. It allows every robot to share the same time, with an offset of a few millisecons in worst case. But the robot will constantly ajust his spee to catch up with every other robot. To achieve this goal our work is base on two theoretical ieas : contraction theory (alreay use in another case of synchronization between humanoi robots [7]) an quorum sensing [8]. A vieo illustrating the result of this work is available on the Web, on the Alebaran Robotics Youtube Channel. II. COTRACTIO Contraction theory provies a framework to guarantee convergence of complex nonlinear systems, without using information concerning the limit trajectory [9]. A. Contraction efinition Let consier a system of the form : ẋ = f(x, t) where x is a size n vector. Let call δx the virtual isplacement. This virtual isplacement is an infinitesimal isplacement at fixe time. Its norm is then a measure of the ifference between two trajectories. So the evolution of δx(x 0, t) is the evolution of the ifference between the two trajectories with initial conitions at t = 0, x = x 0 an x = x 0 + δx(x 0, t = 0). The evolution of δx is given by : δẋ = f (x, t)δx x It is then possible to calculate the evolution of the ifference between two trajectories initially close : t (δxt δx) = 2δx T δẋ = 2δx T f (x, t)δx x Let λ max be the higher eigenvalue of the hermitian part of f x. t (δxt δx) 2λ maxδx T δx By integration, we can upper boun δx T δx as δx δx 0 e t 0 λmax(x,t)t If λ max is negative on the whole trajectory, δx will ten towar 0, an this for every initial conition. If λ max is negative in a stable region, every system starting in this region will ten towar a limit trajectory, inepenently of its initial conition. In this case we say that the system is contracting in this region. It will forget its initial conition exponentially fast. B. Generalization It s possible to generalize the previous proof by noticing that it oes not epen on the efinition of length. So we can use a more general efinition of the length to prove the contraction efinition, the exponential convergence will remain true in any other metric. The etails of this generalization can be foun in [9]. We can efine this metric change by a matrix Θ, such as new coorinates are of the form δz = Θδx. Since this equation is not integrable in general, it s not always possible to efine explicitly z irect link :

2 2 in term of x. In the new coorinate system, the system is contracting if the largest eigenvalue of the symmetric part of ( ) f F = Θ + Θ x (x, t) Θ is negative Distance exp ^ 2t C. Anronov-Hopf oscillator Consier the classical Anronov-Hopf oscillator, [0]. ẋ + (x 2 + y 2 )x + y = 0 ẏ + (x 2 + y 2 )y x = 0 Its trajectories converge to the limit cycle x(t) = sin(t+θ), y(t) = cos(t + θ), as can be shown applying the invariant set theorem to the Lyapunov-LaSalle function E = x 2 + y 2 []. This is an oscillator so obviously it is not contracting. The goal is to fin a coupling between each oscillator to have all of them converge towar the same trajectory. Let consier a coupling between every oscillator, proportional to the ifference of position in x an y. () Fig. 2. rate. Evolution of exp ^ 3t (x x 3 ) 2 + (y y 3 ) 2 an of the contraction Phi ifference ẋi + (x 2 i + yi 2 )x i + y i = κ (xj xi) j=0 ẏ i + (x 2 i + yi 2 )y i x i = κ (yj yi) j=0 The contraction of this system is shown in [0]. By aing κx i in the first equation an κy i in the secon, we can have the same right han sie term for every oscillator : ẋ + (x 2 + y 2 + β)x + y = u(t) ẏ + (x 2 + y 2 + β)y x = u(t) where β = κ an u(t) = κ xj. j=0 [ ] f 3x 2 x (x, t) = + y 2 + β 2yx + 2xy x 2 + 3y 2 + β The eigenvalues of the symmetric part of this matrix are β+x 2 +y 2 an β + 3x 2 + 3y 2. So if β > 0 the system is contracting, an the contraction rate is at least β. So the istance between two trajectories will ecrease at least like e βt [2], [0]. So it is at least β = κ, an close to the limit cycle (where x 2 + y 2 = ), it s at least β = κ. Here is a simulation of three oscillators, with κ = an initial conitions x i(0) = + i 0 an y i(0) = 2 + i. So the three oscillators starts in neighboring 0 trajectories. An we have plotte on each of the following figure the evolution of a istance between oscillator an 3, an the curves e (κ )t an e (κ)t. Fig. shows the ifference in x, Fig. 2 shows the istance on the phase iagram, an Fig. 3 shows the ifference in φ. Fig.. Evolution of x x 3 an of the contraction rate X ifference exp ^ 2t exp ^ 3t exp 2 exp 3 Fig. 3. Evolution of φ φ 3 an of the contraction rate. The brown curve is overlaying the blue one. So every oscillator, inepenently of its initial conitions, will rejoin the other oscillators an oscillate with them. The ifference between two oscillators will ecrease with a exponentially spee proportional to β. The limit cycle of the oscillators will be of the form x(t) = sin(t + θ), y(t) = cos(t + θ). III. QUORUM SESIG To have the best synchronization possible, it is necessary to have a fully-connecte network - that is to say, every robot must have access to every other robot position, because if the istance between two robots increases, the time taken to etect an correct this ifference will also increase. But on the other han, the more links we have in the same network the more stress the network will have. So aing links will ecrease the overall quality of every link an will also ecrease the number of robots that will be able to synchronize in the same time on a given network. To simulate a fully-connecte network while limiting the number of links, we can fin inspiration in natural mechanisms, such as quorum sensing. The iea is to communicate through a global variable that everyone can access an moify, rather than with every other robot [8] [3]. This strategy also reuces consierably the number of necessary connections. In biology [4], agents (bacteria) can emit a fixe quantity of chemical (so-calle auto-inucer), an also measure the concentration of the chemical in its environment so as to have an estimate of the number of agents present locally. As the bacteria multiply, an infection is launche only once the concentration reaches a certain threshol, i.e., once there are enough other agents present an thus a quorum is reache. This phenomenon is reprouce here to calculate the mean of every oscillator position. It is then possible to couple oscillators irectly with the mean, an the result will be the same in theory.

3 3 ẋ i + (x 2 i + yi 2 )x i + y i = κ (xj xi) = j=0 [ κ ẏ i + (x 2 i + yi 2 )y i x i = κ (yj yi) = j=0 [ κ j=0 xj) xi ] j=0 yj) yi ] To implement this system, it is compulsory to a at least one new noe in the network to collect information of position for every noe an to sen back the mean. So in this case, we will have a star-shape network (with a number of link proportional to ) to have the same synchronization spee of a fully-connecte network (with a number of link proportional to 2 ). See Fig 4 we have to link irectly the position of the oscillator to a robot position. We also want the movements to be close enough to nominal movement : the robots can go faster or slower to rejoin the others, but the movement has to be only slightly moifie. Once synchronize, the robot has to move accoring to the nominal movement. To escribe the movement of a robot insie a preefine choreography, one nees only to know its time position insie that choreography. So we only nee to convert the position of our oscillator into a parameter going from 0 to uniformly an continuously to cover precisely the initial movement Fig. 4. Comparaison of the network topology without (left) or with (right) quorum sensing 0.5 Even if in this simple case there is only one central server to which every robot is connecte, this is not a master/slave system. If the server (or the network) has trouble, the only thing the robots will miss will be their synchronization information. The oscillations will continue at the nominal spee, an the synchronization will not occur until the issue is solve. But if they are alreay synchronize, they will stay synchronize. It is also possible to easily istribute this system, so as to reuce the loa of the server. If several servers are running in the same time, it is only neee that one robot sens its ata to several servers to have all the robots on those servers synchronize. In this way, it is possible to have a istribute system if the workloa is too large for a single server. To go further, it is also possible to put this server on every robot, an to use only the first one who join the choreography. If the first robot leaves, the robots have to elect one of their own to run the new server [5]. If the first robot etects a workloa too high, it can ask another robot to start its server, which will hanle any incoming robot. evertheless, this system has a rawback : it takes two messages sent on the network to transmit an upate from one robot to another. So the effect of any elay on the network will be amplifie. To compensate for this, every ata sent is sent with its time of emission an its erivative, to be able to preict its new value when neee. This is also use to rop a ata that is too ol. Alternatively, the same information may be conveye by a single composite variable combining each ata an its erivative []. IV. IMPLEMETATIO In this paper we will focus on moving accoring to a preefine trajectory, like a choreography. A. Trajectory escription We have seen in the two previous sections how to synchronize efficiently oscillators over a network, but we want to synchronize more complex trajectories. Since it is not possible to escribe a complex trajectory as the limit cycle of a ifferential equation,.0 Fig. 5. Phase iagram of an Anronov-Hopf oscillator () with initial conition x(0) = y(0) =. By looking at the phase iagram (Fig. 5) for an Anronov-Hopf oscillator, we can see that the limit cycle is a perfect circle (an we have prove in section II-C). By phase iagram we mean here a plot of x in respect of y. Inee when E goes to zero, we have ẋ + y = 0 ẏ x = 0 that is equivalent to ÿ + y = 0. The phase iagram in this case woul have been ẏ in respect of y. We just replace ẏ by x even if E is not null for the analogy. So by consiering the angle in this phase portrait, we have a parameter that evolve between 0 an 2π perioically, an a small variation in the phase iagram (so in the oscillator state) will moify only slightly this angle. The evolution of this angle (calle φ) is plotte Fig 6. B. Oscillator spee ajustment To correctly reprouce a trajectory, it is necessary to aapt to its length, so to aapt the spee of the oscillator. Let x(t), y(t)} be a solution of (), an then we will look for a ifferential equation satisfie by x(ωt), y(ωt)}. We have (x(ωt)) = ωẋ(ωt). t t (y(ωt)) = ωẏ(ωt) an ωẋ(ωt) + (x(ωt) 2 + y(ωt) 2 )x(ωt) + y(ωt) = 0 ωẏ(ωt) + (x(ωt) 2 + y(ωt) 2 )y(ωt) x(ωt) = 0 So x(ωt), y(ωt)} satisfy the ifferential equation : ẋ + ω[(x 2 + y 2 )x + y] = 0 ẏ + ω[(x 2 + y 2 )y x] = 0

4 Fig. 6. raians φ evolution of the Anronov-Hopf oscillator shown in Fig 5, in By moifying ω in this equation, we will moify the spee of the oscillator without moifying the trajectory. The phase iagram will stay the same, it will just be covere in a ifferent time. To be precise, the limit cycle will be covere with a perio of 2π ω. To keep the same influence of synchronization, it is also compulsory to replace κ by ωκ in previous equation. So the final equation for the oscillator number i is : [ ẋ i + ω[(x 2 i + yi 2 )x i + y i] = ωκ [ ẏ i + ω[(x 2 i + yi 2 )y i x i] = ωκ j=0 xj) xi ] j=0 yj) yi ] Ẋ leaer = f(x leaer ) Ẋ i = f(x i) + κ( + )X i κ X j κx leaer, for i =... }} j= =g(x i ),contractant }} =u(t) Here we can recognize in g(x i) the same system than before : the system which we have alreay prove the contraction. An u(t) is the same for any robot, so will not have any effects on the synchronization. Thus we have prove the partial contraction of the new system with the leaer. We have then prove that with one robot who share its position without taking into account others position, the synchronization remains. So this robot can be the musician, an if he start the music with its oscillator, the two will not change their respective spee so they will stay synchronize. This iea can also be use if we want to preict with a goo accuracy the time when every robot will finish : they will all finish with the leaer, which has a fixe spee. D. Robot implementation To achieve our initial goal, our implementation has to separate the calculation of the oscillator an the network communication because we on t want any perturbation from the network (latencies, lost message, etc...) causing a shacking movement on the robot. So we separate the implementation in two ifferent threas : one for the oscillator simulation an joint comman an the other one for network communication. A schematic view is shown Fig. 7. C. Music Another issue that has to be consiere is the music. We aim at having something to o choreographies, so we nee to be able to play music uring the performance, an to synchronize the robots with the music. But it is not a goo iea to change the spee of the music in real time : in human shows, the music stays at the same pace an only the ancers have to change their pace to synchronize. So we want the music to act as a leaer : to share its oscillator position to allow the others to synchronize to itself but not to take into account the other robot positions. To prove that this behavior will act as we want, we have to use partial contraction [6]. The iea is to buil a virtual system from the real system, an to prove the contraction of this virtual system to get information on the real system. By proving the contraction of the whole system, we prove that every trajectory will converge to the other. Since the leaer trajectory is a particular solution, every trajectory will ten towar this trajectory. Formally, if ẋ = g(x, x, t) is a system, one can buil the virtual system ẏ = g(y, x, t) an proving the contraction of this new system will emonstrate that every solution will ten towar x (because x is a particular solution). This theory is evelope more in epth in [6]. Let X be [x, y] T. The system with a leaer is : umerical ata upate : To keep the oscillator calculation realtime, we use a calculation step (use in the numerical resolution Ẋleaer = f(x leaer ( ) Ẋ i = f(x i) + κ X i ) j= Xj + κ(x i X leaer ), i =... of the oscillator ifferential equation) variable, an equal to Fig. 7. Schematic robot implementation of this behavior To escribe more in etail each task : Oscillator initialization : For this initialization the robot has to etermine its initial conition. For this he retrieve ata from the server concerning the mean position of the group an estimate the position of group in secon. He then has secon to join this position, so when he will start to synchronize he will be close enough to the others. At the en of this step, the network threa can start since there is a virtual oscillator position to be share with the others.

5 5 the time ifference between the beginning of the last loop an the beginning of the current loop. During this tack, the robot calculate this step an use the current time to estimate the current mean of every other robot position (or to iscar this information if it s too ol, see next section for more information). ew state calculation : Here the robot can use a Euler metho with the current state an the synchronization information estimate on the previous task to calculate the next state of its virtual oscillator. These ata are store in a global variable to be accesse by the network threa. Commans sening : With the new state available, a new φ can be compute an a new robot position too. This new comman is then sent to the robot to be reache in 50 ms (in aition to every remaining comman). The movement will then be smooth (without interruption) if the calculation step remains uner 50ms. etwork threa initialization : The robot connects itself to the server an request an upate of the synchronization information. Data sent to server : Sening syntonization ata to the server, accoring to the new section Data receive from server : Receiving syntonization ata to the server, accoring to the new section E. Server implementation The precise goal of this program is to receive the virtual oscillator position from every robot, an to sen back to each of them the mean. The server can also receive configuration messages (like changing the coupling strength that is sen back to every robot, stopping the server,...). Synchronization ata are transmitte with the form : Message for the server time : x : ẋ : y : ẏ; Answer from the serveur time 2 : m x : ṁ x : m y : ṁ y : : κ; where time is not the sening time, but the time of the calculation that leas to x an y. The values of ẋ an ẏ are sen only to o preiction on x an y an are not irectly use in the synchronization process. Every value is separate by a :, an every message finishes with a ;. This way, it is easy to parse the incoming messages an separate them. Every robot expects a message of the form presente above, where m x is the mean of x an m y is the mean of y. Their erivatives are there for preiction, is the total number of robot an κ is the coupling strength. The server will sen a copy of this message to every robot that are connecte. Here again, time 2 is the time use to evaluate the mean, not the time of the sening. To be more precise m x is the mean of x i +(time 2 time (i)) ẋ i an ṁ x is the mean of ẋ i (i is there the robot inex). The fact that the server sens κ allows the user to change the coupling in real time, so as to activate, increase or ecrease its strength. V. PERSPECTIVE OF IMPROVEMETS In this implementation, the movements of the robots are not really relate to the virtual oscillator movements. But for movement like walking, it is possible to o a stronger link an to eal for example with every initial conition [7]. To go further, it coul be useful to use the same quorum server to synchronize ifferent types of oscillators. For example if several robots are running ifferent choreography (with ifferent length) or are walking with ifferent pace (because of size ifferences between robots for example), each robot will have to ecompose the quorum signal to fin the part of the mean concerning the robot ientical to itself. For example if 3 robots walking with step/secon an 3 robots with 0.5 step/secon, each robot can filter the quorum signal for its corresponing frequency. With a fixe calculation step, it is possible to esign filter with an arbitrary precision [7]. With a non-constant step, one has to incorporate the step into the filter coefficients. But without knowing the total number of robots (but with the knowlege of the number of similar robot), a robot can synchronize with all the robots sharing the same spee. Another improvement coul be to track the tempo of the music [8], an see it as an oscillator. At the beginning the robot has to etermine the frequency to configure its own oscillator, but will then be able to use the music instea of the quorum signal to synchronize. So every robot will synchronize its virtual oscillator to the music, so the movements performe will be synchronize with the music. It can also be a goo way for the robot to improvise a ance on a music. ACKOWLEDGMET The authors woul like to thank Alebaran Robotics, an in particular Roolphe Gelin, for their help in using ao an their lening of robots for the final vieo. REFERECES [] Y. Sakagami, R. Watanabe, C. Aoyama, S. Matsunaga,. Higaki, an K. Fujimura, The intelligent asimo: System overview an integration, in Intelligent Robots an Systems, IEEE/RSJ International Conference on, vol. 3. Ieee, 2002, pp [2] K. Akachi, K. Kaneko,. Kanehira, S. Ota, G. Miyamori, M. Hirata, S. Kajita, an F. Kanehiro, Development of humanoi robot hrp-3p, in Humanoi Robots, th IEEE-RAS International Conference on. IEEE, 2005, pp [3] K. Muecke an D. Hong, Darwin s evolution: evelopment of a humanoi robot, in Intelligent Robots an Systems, IROS IEEE/RSJ International Conference on. IEEE, 2007, pp [4] Y. Ota, Partner robots from evelopment to implementation, in Human System Interactions (HSI), 200 3r Conference on. IEEE, 200, pp [5] D. Gouaillier, V. Hugel, P. Blazevic, C. Kilner, J. Monceaux, P. Lafourcae, B. Marnier, J. Serre, an B. Maisonnier, The nao humanoi: a combination of performance an afforability, CoRR, vol. abs/ , [6] D. Mills, Internet time synchronization: The network time protocol, Communications, IEEE Transactions on, vol. 39, no. 0, pp , 99. [7] A. Mukovskiy, J. Slotine, an M. Giese, Design of the ynamic stability properties of the collective behavior of articulate bipes, IEEE-RAS International Conference on Humanoi Robots, 200. [8] G. Russo an J. Slotine, Global convergence of quorum-sensing networks, Physical Review E, vol. 82, no. 4, p. 0499, 200. [9] W. Lohmiller an J. Slotine, On contraction analysis for non-linear systems, Automatica, vol. 34, no. 6, pp , 998. [0] Q. Pham an J. Slotine, Stable concurrent synchronization in ynamic system networks, eural etworks, vol. 20, no., pp , [] J. Slotine an W. Li, Applie onlinear Control. Prentice-Hall, 99. [2] M. Belabbas an J. Slotine, Factorizations an partial contraction of nonlinear systems, in American Control Conference (ACC), 200. IEEE, 200, pp [3]. Tabareau, J. Slotine, an Q. Pham, How synchronization protects from noise, PLoS Computational Biology, vol. 6, no., 200. [4] W. g an B. Bassler, Bacterial quorum-sensing network architectures, Annual review of genetics, vol. 43, pp , [5] H. Garcia-Molina, Elections in a istribute computing system, Computers, IEEE Transactions on, vol. 00, no., pp , 982. [6] W. Wang an J. Slotine, On partial contraction analysis for couple nonlinear oscillators, Biological Cybernetics, vol. 92, no., pp , [7] A. v. Oppenheim, R. Schafer, an J. Buck, Discrete-time signal processing. Prentice Hall, 989. [8] M. Goto an Y. Muraoka, A real-time beat tracking system for auio signals, in Proceeings of the International Computer Music Conference. San Francisco: International Computer Music Association, 995, pp