arxiv: v2 [physics.soc-ph] 14 Sep 2015

Transcription

1 Measurng and modelng correlatons n multplex networks Vncenzo Ncosa 1, and Vto Latora 1 1 School of Mathematcal Scences, Queen Mary Unversty of London, London E1 4NS, Unted Kngdom arxv: v2 [physcs.soc-ph] 14 Sep 2015 The nteractons among the elementary components of many complex systems can be qualtatvely dfferent. Such systems are therefore naturally descrbed n terms of multplex or mult-layer networks,.e. networks where each layer stands for a dfferent type of nteracton between the same set of nodes. There s today a growng nterest n understandng when and why a descrpton n terms of a multplex network s necessary and more nformatve than a sngle-layer projecton. Here, we contrbute to ths debate by presentng a comprehensve study of correlatons n multplex networks. Correlatons n node propertes, especally degree-degree correlatons, have been thoroughly studed n sngle-layer networks. Here we extend ths dea to nvestgate and characterze correlatons between the dfferent layers of a multplex network. Such correlatons are ntrnscally multplex, and we frst study them emprcally by constructng and analyzng several multplex networks from the real-world. In partcular, we ntroduce varous measures to characterze correlatons n the actvty of the nodes and n ther degree at the dfferent layers, and between actvtes and degrees. We show that real-world networks exhbt ndeed non-trval multplex correlatons. For nstance, we fnd cases where two layers of the same multplex network are postvely correlated n terms of node degrees, whle other two layers are negatvely correlated. We then focus on constructng synthetc multplex networks, proposng a seres of models to reproduce the correlatons observed emprcally and/or to assess ther relevance. PACS numbers: Fb, Hc and 89.75,-k I. INTRODUCTION Snce ts orgns, the new scence of complex networks has been prmarly drven by the need to characterze the propertes of real-world systems [1, 2]. The ntroducton of new deas and concepts n the feld has been very often assocated to the avalablty of new, more accurate, or larger data sets, and to the dscovery of new structural propertes of complex systems from the real world [3 12]. Ths s the reason why a lot of nterest has been recently devoted to the study of multplex networks,.e. networks n whch the same set of nodes can be connected by means of lnks of qualtatvely dfferent type or nature. Several data sets of real-world systems that can be represented and studed as multplex networks have appeared n the recent lterature [13 16], and we expect that many more wll arrve n the next few years. The frst papers on the subject have focused on the characterzaton of the structure of multplex networks [16 28], and on modelng the basc mechansms of ther growth [29 33]. In parallel to ths, some effort has been also devoted on nvestgatng varous knds of dynamcal processes on multplex topologes, ncludng dffuson [34 38], epdemc spreadng [39 44], cooperaton [45 48], opnon formaton [49 52], and percolaton [46, 53 56]. There s today a general agreement on the fact that multplex networks represent the deal framework to study a large varety of complex systems of dfferent nature. And there are already some numercal and analytcal results showng that the dynamcs of processes on Electronc address: v.ncosa@qmul.ac.uk multplex networks s far rcher than n networks wth a sngle layer. A comprehensve revew of the man advances n ths new vbrant feld of research can be found n a few recent survey papers [57 59]. In ths Artcle we focus on an ssue that has revealed of great mportance n sngle-layer networks, but has not yet been nvestgated thoroughly n multplex networks,.e. that of correlatons [31, 46, 60, 61]. In networks wth a sngle layer t has been found that there are correlatons n the propertes of connected nodes. Namely, the degree of a node can be ether postvely or negatvely correlated wth the degree of ts frst neghbors. In the frst case, the hubs of the networks are preferentally lnked to each others, whle n the second case they are preferentally connected to low-degree nodes [6, 11]. In multplex networks the very same concept of correlatons s far rcher than n a network wth a sngle layer. In fact, on one hand t s stll possble to explore the standard degree-degree correlatons at the level of each layer of the network, but on the other hand t s more nterestng to ntroduce a truly multplex defnton of correlatons, for nstance by lookng at how a certan property of a node at a gven layer s correlated to the same or other propertes of the same node at another layer. We present here a complete and self-consstent study of correlatons of node propertes n multplex networks. In dong ths, we follow the usual steps of the typcal approach to complex networks: ) we frst explore emprcally correlatons n real multplex networks, ) we ntroduce varous measures to characterze and quantfy correlatons n multplex networks, ) we propose a seres of models to reproduce the correlatons found n real multplex systems, or to assess ther relevance. We fnd that multplexty ntroduces novel levels of

2 2 complexty. In partcular, n real-world multplex networks the patterns of presence and nvolvement of the nodes at the dfferent layers are characterzed by strong correlatons. And ths has to be taken nto account when t comes to model such systems. The Artcle s organzed as follows. In Sect. II we focus on two small real-world networks and we use them as examples to explan why a descrpton n terms of multplex networks captures more nformaton on a system than a sngle-layer projecton. In the remanng sectons we study the structure of fve real-world multplex networks (addtonal nformaton about the networks are provded n Appendx), wth the man attenton to the concept of correlatons. In partcular, n Sect. III we focus on the patterns of node actvty and nvolvement at the varous layers. We say that a node s actve at a gven layer f t has at least one lnk at that layer, and we ntroduce varous quanttes to characterze the dstrbuton and the correlatons of node actvtes. We also nvestgate the actvty correlatons between pars of layers. We fnd that real-world multplex networks are qute sparse, wth only a few nodes actve n many layers, and are characterzed by strong correlatons: nterestngly, the actvty of a node n a partcular layer s very often correlated wth ts actvty n some other layer. In Sect. IV we ntroduce the frst null-models to assess the sgnfcance of the observed patterns of node actvty. In Sect. V we nvestgate correlatons between the actvty and the degree of the nodes of a multplex network, whle n Sect. VI we show how to quantfy nter-layer degree correlatons (degree correlatons between layers). In partcular, we focus our attenton on measurng correlaton n the node degrees of a par of layers, ether by usng the Spearman s rank correlaton coeffcent of the two degree sequences, or by plottng, as a functon of k, the average degree q(k) at one layer of nodes havng degree k at the other layer. We fnd that there exst sgnfcant correlatons among the degree of the same node at dfferent layers, and such correlatons can be ether postve, meanng that nodes tend to have smlar roles across layers, or negatve, meanng that nodes wth a large degree n one layer tend to have small degrees n another layer. Fnally, n Sect.VII, we propose two algorthms based on smulated annealng whch allow to construct multplex networks wth tunable nter-layer degree-degree correlatons, and n Sect. VIII we report our conclusons. The detals on the fve multplex networks constructed from data sets of bologcal, technologcal and socal complex systems, and analyzed n the paper, are descrbe n the Appendx. The networks and the software mplementatons of the algorthms descrbed n ths paper are avalable at [62]. Network N M N [α] C.elegans BIOGRID Arlnes - Afrca Arlnes - Asa Arlnes - Europe Arlnes - North Amerca Arlnes - Oceana Arlnes - South Amerca APS IMDb TABLE I: Number of nodes N, number of layers M and average number of actve nodes N [α] of the multplex networks analyzed n ths study. II. WHY A DESCRIPTION IN TERMS OF A MULTIPLEX NETWORK? The am of ths work s to dentfy, measure and model the dfferent knds of correlatons among node propertes whch can be found n a multplex network. For such a reason we constructed several multplex networks from fve data sets of real-world systems. The systems we consder are: the nervous system of a roundworm at the cellular level (C.elegans), a systems of nteractons between protens (BIOGRID), the routes of contnental arlnes (OpenFlght), the papers publshed n the journals of the Amercan Physcal Socety (APS), and the moves n the Internet Move Database (IMDb). These data sets are representatve of the major classes of complex systems, namely socal, technologcal and bologcal, and ther szes range from hundreds of nodes and just two knds of nteractons n the case of C.elegans up to mllons of nodes and dozens of layers n IMDb. We provde n ths way the reader wth some novel multplex data sets, n addton to those already appeared n the recent lterature [14 16, 28], also showng that some well-known networks, such as the neural system of the C.elegans, and the collaboraton network of move actors, can ndeed be better represented as multplex networks. Basc characterstcs of the networks we have constructed, such as number of nodes N, number of layers M and average number of actve nodes per layer N [α] are shown n Table I. Addtonal detals about the orgnal data sets and the procedure used to construct the networks can be found n Appendx. All the data sets are avalable for download at [62]. Before movng to the man topc of our work and to the varous ways of formalzng and measurng correlatons n a multplex network, we focus n ths secton on what we gan by studyng a system as a multplex network, nstead of aggregatng together ts dfferent layers. We wll do ths by consderng two of the real-world multplex networks we have ntroduced, namely the two two-layer bologcal systems reported n Table. II: the C.elegans neural system and the BIOGRID proten-gene

3 3 FIG. 1: (Color onlne) In a multplex representaton dfferent types of relatonshps correspond to the dstnct layers of a mult-layer network. For nstance, n the case of the neural system of the C.elegans two neurons can communcate ether by means of electrcal sgnals, whch are propagated through synapses and neuronal dendrtes, or by means of the dffuson of ons and small molecules, whch travel through nter-cellular channels called gap junctons. The two types of communcaton are encoded n the two layers of a multplex network. Layer N [α] K [α] k [α] N [α] C S [α] 1, S[α] 2, S[α] 3 C.elegans Synapses ,2, Gap junctons ,3,2 Aggregated ,2, BIOGRID Genetc , 1110, 979 Physcal , 20, 20 Aggregated , 304, 20 TABLE II: The number of actve nodes N [α], the number of edges K [α], the average degree k [α], the number of components N [α] C and the sze of the three largest components at the two layers of the C.elegans neural network, and at the two layers of the BIOGRID proten nteracton network. We report for reference also the values correspondng to the networks obtaned by aggregatng the two layers together. nteracton network. The frst thng we notce from a component analyss of such systems at the two layers s that not all the nodes are connected n both layers. For nstance, the synaptc layer (Syn) of the C.elegans neural network conssts of two connected components of 279 and 2 nodes, whle n the gap-juncton layer (Gap) we observe a large connected component contanng 248 nodes, two small components respectvely wth three and two nodes, and 28 solated nodes. Secondly, the two layers of the C.elegans have largely dfferent denstes. The synaptc layer has an average degree equal to k [Syn] = 13.9, whle the gap-juncton layer has k [Gap] = 3.7 only. Addtonally, each node can play a very dfferent role n the two layers. As an example, we report n Table III the lst of the top ten nodes ranked by degree centralty n each of the two layers. Despte some nodes have smlar postons n the two rankngs (e.g., AVAL, AVAR, AVBR), n general a node wth a hgh degree n the synaptc layer mght have just a few lnks n the other layer, as n the case of node AVDR, whch s ranked fourth n the synaptc layer, wth 53 edges, but has only 4 edges n the gap-juncton layer. For reference, we also report n the same table the rankng nduced by the degree on the aggregated graph, whch s n turn dfferent from the rankngs correspondng to the two sngle layers, especally from that at the gap-junctons level. Also the two layers of the BIOGRID network, respectvely representng physcal (Phys) and genetc (Gen) nteractons among protens, have radcally dfferent structures. Frst of all, the two layers have a dfferent number of non-solated nodes and a dfferent dstrbuton of the szes of connected components, wth Phys havng N = non-solated nodes, whle Gen only N = Of these nodes, only 9738 are non-solated on both layers, meanng that more than 80% of the nodes are actve n just one of the two layers, and not n the other. Despte havng a smaller number of non-solated nodes, the Gen layer s much denser than Phys, wth an average degree k [Gen] 32 compared to k [P hys] 11. Also n ths case there s no correspondence between the hubs at the two layers, as shown by the plot n Fg. 2

4 4 rank Syn k [Syn] Gap k [Gap] Syn+Gap k 1 AVAR 85 AVAL 40 AVAL AVAL 83 AVAR 34 AVAR AVBL 56 AVBR 29 AVBR 80 4 AVDR 53 AVBL 24 AVBL 80 5 PVCL 52 RIBR 17 PVCR 60 6 AVBR 51 RIBL 17 PVCL 60 7 AVER 50 AVKL 14 AVDR 57 8 AVEL 50 RIGL 14 AVER 56 9 PVCR 49 VA08 11 AVEL DVA 48 RIGR 11 DVA 53 TABLE III: The nodes ranked n the frst ten postons accordng to ther degree at the synapse layer, at the gap-juncton layer and at the sngle-layer network obtaned by aggregatng the two layers. Notce that some neurons are present n one of the two layer-based rankng and not n the other, e.g. PVCL and RIBR, ndcatng node can play dfferent roles at the two layers. Moreover, also the rankng based on the degree of the aggregated network s dfferent from the rankngs at the two layers. whch reports the fracton N L of those nodes whch are found n the top-l rankng of both layers accordng to the degree. Notce that N L s much smaller than 10% for a wde range of values of L (.e., up to L 600), meanng that f a node s a hub on one layer there s a qute small probablty that t wll also be a hub on the other layer. Ths result s due to the fundamental dfference between physcal nteractons, whch produce new proten compounds, wth respect to genetc nteractons, whch trgger the producton of other protens. Summng up, f we take nto account the mult-layered nature of the C.elegans neuronal network and of the BIOGRID proten nteracton network we dscover new structural patterns, and n partcular a poor correspondence of the roles of a node across layers, wth a large fracton of the nodes beng solated at least n one of the two layers. These results suggest that representng a system as a multplex network allows to retan mportant nformaton, snce mult-layer real-world systems are often characterzed by non-trval patterns of node nvolvement across layers. In the rest of the paper we propose some metrcs to quantfy these patterns, and we ntroduce a few models to reproduce and to assess ther sgnfcance. III. CORRELATIONS OF NODE ACTIVITY Let us consder a multplex network wth N nodes and M layers. Such a network can be naturally descrbed by gvng a set of M adjacency matrces, one for each layer, {A [1], A [2],..., A [M] } R N N M, so that the element a [α] j a [α] = 1 f node and j are connected at layer α, whle j = 0 otherwse. Notce that n ths partcular knd of multplex networks, a node effectvely conssts of M replcas, one for each layer, and nter-layer connectons among these replcas have no explct cost assocated [16]. FIG. 2: (Color onlne) The fracton N L of nodes whch appear n the top L postons accordng to degree n both layers (Phys and Gen) of the BIOGRID network (squares) scales approxmately as a power law N L L 0.56 (sold lne, r 2 = 0.96). In partcular, less than 20 nodes appear n both rankngs up to L 300, meanng that there s almost no correlaton between the degrees of the a node at the two layers, and that t s very unlkely that a node s a hub on both Gen and Phys. These multplexes are sometmes referred n the lterature as colored-edge networks [57]. In ths framework, the propertes of the nodes are represented by vectoral varables. For nstance, we can assocate to each node of the multplex a mult-degree,.e. a M-dmensonal vector { } k = k [1], k [2],..., k [M] (1) such that k [α] denotes the degree of at layer α. A node can n fact partcpate wth a dfferent number of edges to each layer, and can also be solated n some of the layers. Intutvely, the presence and number of edges ncdent n a node s a frst ndcaton of the actvty or mportance of that node at that layer. But there s another level of complexty, typcal of multplex structures, whch s related to the mportance or role of one layer wth respect to another n terms of the fracton of connected nodes and of the relatve number of edges of a certan knd. For example, n the APS multplex the number of actve nodes n the two Condensed Matter layers (layer 6 and layer 7) account for more than one thrd of the total number of actve nodes at all layers, whle the number of edges connectng authors workng n General Physcs, Partcle Physcs, Nuclear Physcs and Astronomy account for more than 99% of all the edges n the multplex (see Table A-V for detals). The addtonal complexty added by the presence of multple layers allows for the exploraton of several knds of structural propertes. In partcular, we are nterested here n detectng, quantfyng and modelng the exstence of correlatons of node actvty across layers (vertcal analyss) and of correlatons among layer structures (horzontal analyss). To ths am, we defne n the followng some basc quanttes whch characterze,

5 5 FIG. 3: (color onlne) Dstrbutons of node-actvty for (a) the sx multplex networks of contnental arlnes and for (b) APS and IMDb. In all arlne networks P (B ) can be ftted by power-laws wth exponents rangng from 1.8 to 2.3 (the exponents, together wth the correspondng p-values n parenthess, are reported n the legend). Ths means that the typcal number of layers n whch a node s actve s subject to unbounded fluctuatons. The plots n panel (a) have been vertcally dsplaced to enhance readablty. respectvely, the actvty of nodes and layers. A. Node actvty We say that node, wth = 1, 2,..., N, s actve at layer α f k [α] > 0. We can then assocate to each node a node-actvty vector { } b = b [1], b [2],..., b [M] (2) where b [α] = 1 δ 0,k [α].e., b [α] = 1 f node has at least one edge at layer α, and s 0 otherwse. We call node-actvty B of node the number of layers on whch node s actve: B = α b [α] (3) By defnton we have 0 B M. Notce that the node-actvty vector b provdes a compact, yet ncomplete (because t does not take nto account the number of lnks) representaton of the nvolvement of node at the dfferent layers of the multplex. However, we wll show that t contans useful nformaton. Dstrbuton of node-actvty. In Fg. 3 we report the dstrbutons of node-actvty obtaned for the multplex networks constructed from OpenFlght, APS and IMDb. Interestngly, n the arport networks the dstrbutons are well ftted by a power-law functon P (B ) B δ, wth exponents δ n the range [1.8, 2.4]. The values of the exponents were obtaned through the maxmum-lkelhood estmator [63]. The most heterogenous dstrbuton s that of the Afrcan arplane multplex network (δ 1.86), reported as black crcles n Fg. 3(a), whle the two most homogeneous dstrbutons are those of the arlne networks of South Amerca and Oceana (both charactersed by δ 2.3). The powerlaw behavour of node-actvty ndcates that there s no meanngful typcal number of layers on whch a node s actve, snce for δ < 3.0 the fluctuatons on ths number are unbound as M grows. A scale-free dstrbuton of node-actvty n the arport multplex networks ndcates that the majorty of arports usually tend to be connected only by a relatvely small number of arlnes (between 68% and 89% of all the arports n each multplex are actve n less than 5 layers), but some outlers exst whch are connected by a relatvely large number of dfferent arlnes (at least one arport n each multplex s actve n 10% to 30% of the layers). Smlar consderatons can be made for APS and IMDb, where the vast majorty of authors and actors are actve n just one or a few layers, whle a few outlers are found actve n almost all layers. In the same sprt of what s done n sngle-layer networks, where nodes havng a relatvely hgh number of connectons n a network are called hubs, we call multactve hubs those outler nodes of a multplex whch are actve n a large fracton of layers. However, as we wll better see n Secton V, n real-world systems nodeactvty s not strctly correlated to the total number of edges ncdent n a node, so that a node mght be a multactve hub wthout beng a hub n the classcal sense (of havng many lnks) n any of the layers. In partcular, there exst nodes havng, at the same tme, a large number of ncdent edges and a small node-actvty (e.g., they mght be actve n just a few layers, or even n one layer only), and also nodes havng a relatvely small number of edges whch are nstead actve on almost all layers. Dstrbuton of node-actvty vectors. The nodeactvty B accounts only for the number of layers at whch node s actve, dscardng any nformaton about

6 6 whch are these layers. As a matter of fact, two nodes and j mght have the same value of node-actvty but they can be nvolved n dfferent layers. So t s nterestng to look also at how the node-actvty vectors b, = 1, 2,..., N, are dstrbuted, to see the relevant frequency of dfferent node-actvty patterns. Frst of all t s mportant to notce that the actual number of dstnct node-actvty vectors observed n a multplex can n general be much smaller than the total possble number of such vectors, whch s equal to 2 M 1 (f we take nto account only nodes that are actve on at least one layer). For nstance, whle n the APS multplex we observe 981 out of the 1023 possble node-actvty vectors (wth an average of nodes havng the same vector), n IMDb we observe only around out of more than possble vectors (wth an average of around 17.4 nodes havng the same vector). In Fg. 4(a) we show the Zpf s plot of the node-actvty vectors for the APS and IMDb multplex networks. In both cases the dstrbuton of b s a power-law (wth a clear exponental cut-off n the case of APS), wth an exponent respectvely equal to 1.53 and 1.2. Ths means that the majorty of the nodes have smlar actvty patterns, wth the hghest values of P (b ) always correspondng to nodes actve on just one or two layers, whle some other node-actvty vectors are more rare. Ths result s also confrmed by Fg. 4(b) and 4(c) where we report, respectvely for APS and IMDb, the rank dstrbutons,.e., the Zpf s plots of the probablty P (b B ) of node-actvty vectors b restrcted to nodes actve on exactly B layers, as a functon of the rank R(b B ). The varous curves correspond to dfferent values of B. Notce that n general P (b B ) s heterogeneous and s a power-law for the large majorty of values of B. Ths means that a large fracton of the nodes havng the same value of node-actvty share also the same actvty pattern across layers, whle some outler nodes have qute pecular actvty patterns. In the case of IMDb, for nstance, of all the actors who have worked on exactly two genres, around 20% are specalsed n Short and Drama (layers 23 and 9) or Short and Comedy (layer 23 and 6), whle only one actor has acted both on Fantasy and War moves (respectvely layer 11 and 27) and only two have acted both n an Adult move and n a Famly move. B. Layer actvty The actvty of a gven layer α, wth α = 1, 2,..., M, depends on the patterns of node actvtes at that layer, and can be represented by the layer-actvty vector: d [α] = { } b [α] 1, b[α] 2,..., b[α] N. (4) We defne the layer-actvty of layer α as the number N [α] of actve nodes n α, whch s equal to the number FIG. 4: (color onlne) (a) The Zpf s plot of the node-actvty vectors s a power-law, both for APS and for IMDb. Also the rank dstrbuton P (b B ) restrcted to nodes havng a gven value of node-actvty B, for (b) APS and (c) IMDb, are power-laws wth exponental cut-off. The esponents of the power-laws range between 0.5 (dot-dashed blue lne) and 1.0 (dashed black lne). of non-zero elements of d [α] : N [α] = By defnton we have 0 N [α] N. Dstrbuton of layer-actvty. b [α] (5) In Fg. 5 we show

7 7 FIG. 5: (color onlne) Dstrbuton of layer-actvty for the contnental arlne networks, APS and IMDb. In the sx multplex of contnental arlnes, whch consst of O(10 2 ) layers, P (N α ) has a clear power-law shape. A somehow heterogeneous behavour s also observed for IMDb, although the number of layers s not large enough to allow a meanngful ft. The plots were vertcally dsplaced to enhance readablty. the dstrbutons of N [α] for all the multplex networks wth more than two layers. Interestngly, as found for B, also the dstrbuton of N [α] s heterogeneous, and has a marked power-law behavor for the contnental arlnes networks, whch have a larger number of layers. Ths confrms that, not only the actvty of nodes across layers s heterogeneous, but also that not all layers have the same mportance n the overall organsaton of the system. For nstance, a large fracton of all the layers of the contnental arlnes multplexes have no more than N [α] = 10 actve nodes. However, some layers contan up to a few hundred actve nodes (whch account for 10% up to 30% of all the nodes). Ths means that, on average, the removal of one layer at random from the system,.e., the removal of all the routes operated by one arlne company, wll cause only mnor dsruptons, but n some specfc cases such a removal mght break the system apart. Correlatons of layer-actvty. We defne here some smple measures to detect and characterze the correlatons among layer actvtes. The frst measure we propose s the parwse multplexty Q α,β of two layers α and β defned as: Q α,β = 1 N b [α] b [β] (6) Notce that ths quantty s equal to the fracton of nodes of the multplex whch are actve on both layers α and β, and therefore takes values n the range [0, 1]. The more smlar the actvty pattern of the nodes at two layers, the hgher the multplexty of two layers s. The dstrbuton of the values of the parwse multplexty P (Q α,β ) among all the possble pars of layers α and β s reported n Fg. 6(a)-(b), respectvely for the contnental arports networks and for APS and IMDb. We frst notce that n all the multplex networks consdered only a relatvely small fracton of nodes are actve at the same tme on at least two layers. In partcular, n the case of contnental arlnes the multplexty has a broad dstrbuton, so that the majorty of couples of layers have less than 1% of the nodes n common, whle n a few cases the multplexty can be as hgh as 20%. Also n APS and IMDb the values of parwse multplexty are usually below 20%, but n ths case the dstrbutons exhbt an exponental decay, ndcatng that there exsts a typcal scale of parwse layer multplexty. The dfferent behavour of P (Q α,β ) n the arport networks, wth respect to the collaboraton networks s probably due to the dfferent meanng of actvty at each layer, and also to the dfferent dynamcs of node actvaton n the two cases. In partcular, for the arport network, we expect that the competton between arlnes operatng n the same area produces a small overlap n the actvty pattern of the correspondng layers. Ths s clear shown n Fg. 6(c), where we report the graph representng relatonshps among the frst 20 arlnes n Europe operatng n the largest number of arports. In ths graph each node represents a layer of the orgnal multplex network, ts sze s proportonal to the correspondng value N [α], the wdth of an edge s proportonal to the parwse multplexty of the correspondng layers,.e. the fracton of nodes actve on both layers, and the color of nodes ndcates the total multplexty,.e. the sum of the values of parwse multplexty ncdent on a node (red s maxmum, yellow s mnmum). Notce that natonal companes, lke Lufthansa, Altala and Ar France, tend to have a large overlap wth other arlnes,.e. to serve smlar sets of arports, whle low-cost arlnes, lke easy- Jet, Ryanar, Wzz Ar and Flybee, systematcally tend to avod overlaps wth other companes. The relatvely small values of parwse multplexty found n these realworld multplex networks may have an mpact on the dynamcs of processes occurrng over them, such as opnon formaton, epdemc spreadng, percolaton or mmunzaton [52, 56]. Indeed, snce only a relatvely small fracton of nodes are actve on two layers at the same tme then the removal of just a few of these nodes mght result n a massve dsrupton of the multplex network, and can thus slow down dramatcally ether the spreadng of an epdemc or the dffuson of nformaton. Ths aspect has to be properly taken nto account when consderng dynamcal processes on multplex networks. Another measure to quantfy the relatve overlap between two layers at the level of node actvty s the normalsed Hammng dstance between the two correspondng layer-actvty vectors: H α,β = b[α] (1 b [β] ) + (1 b [α] mn(n [α] + N [β], N) )b [β] (7) H α,β s equal to the number of dfferences n the actvtes of the two layers dvded by the maxmum possble number of such dfferences, and takes values n [0, 1]. In partcular, H α,β = 0 f d [α] = d [β], whle H α,β = 1

8 8 FIG. 6: (color onlne) The parwse multplexty has a power-law behavor n (a) arlne networks, whle t s exponental n (b) APS and IMDb. In panel (c) we report a graph of the frst 20 arlnes n Europe by number of covered arports. Each node of ths graph represents a layer of the orgnal multplex network, whle the weght of the edge connectng two nodes s proportonal to the fracton of nodes present n both layers. The sze of a node s proportonal to the number of arports n whch the correspondng company operates, whle the color (from yellow to red) corresponds to the node strength, whch n ths case s proportonal to the total node overlap wth other arlnes. when all the actve nodes at layer α are not actve at layer β. In Fg. 7 we report the dstrbutons of H α,β for the contnental arlnes, for APS and for IMDb. In all the networks consdered the measured values of H α,β are dstrbuted throughout the whole [0, 1] range. However, n the contnental networks the dstrbutons have an ncreasng exponental behavour, meanng that the normalsed Hammng dstance s qute large for the vast majorty of layer pars, n accordance wth the observaton that arports generally have small node-actvty (Fg. 5(a)). Conversely, for APS and IMDb the dstrbutons are more homogeneous. It s nterestng to notce that n all the systems around 1% of the layer pars have a normalsed dstance smaller than 0.05, correspondng to large overlaps of node actvty. IV. MODELS OF NODE AND LAYER ACTIVITY FIG. 7: (color onlne) The dstrbuton of the normalsed Hammng dstance H α,β between all the possble pars of layers on varous multplex networks. Notce that P (H) ncreases exponentally for the contnental arlnes networks. The emprcal results of Secton III suggest that the patterns of node and layer actvty n real-world multplex networks can be qute heterogeneous. In general, real-world multplex systems tend to be qute sparse, meanng that the majorty of nodes partcpate to only a small subset of all the layers, and gven two layers only a small fracton of ther nodes are actve on both. It s therefore natural to ask whether smlar patterns mght naturallly arse from a random dstrbuton of node actvty across layers or not. Or, n other words, f there s anythng specal at all n the power-law dstrbutons of node-actvty, node-actvty vectors, and layer actvty, and f the observed behavour of multplexty and normalsed Hammng dstance among layers can be just the result of the juxtaposton of ndependent layers. We propose here four dfferent multplex network models and we compare the correlatons n node and layer actvty observed n real-world multplexes wth those produced by those models. The frst three models are null-models to assess the sgnfcance of the heterogenety of the dstrbutons P (N [α] ), P (B ) and P (b ). The fourth model s nstead a generatve model whch proposes a possble explanaton for the observed dstrbutons of parwse

9 9 FIG. 8: (color onlne) Dstrbuton of parwse multplexty (a) and Zpf s plot of node-actvty (b) for the European arlnes multplex network (sold black lne) and the correspondng synthetc networks obtaned by four dfferent models, namely: HM (red crcles), MDM (orange squares), MSM (green damonds) and LGM (blue trangles). Notce that LGM fts well the dstrbuton of parwse multplexty, and performs better than HM n reproducng the rank dstrbuton of node-actvty. The shape of P (B ) n MDM and MSM s dentcal to that of the orgnal multplex by constructon. multplexty and normalsed Hammng dstance among layers. A software mplementaton of the four models s avalable for download at [62]. Hypergeometrc model (HM). In ths model we fx the numbers N [α] of actve nodes at each layer α to be equal to those observed n the orgnal multplex network. The N [α] nodes to be actved at each layer α are then randomly sampled wth a unform probablty from the N nodes of the graph. In ths way, the actvty of a node at a gven layer s uncorrelated from ts actvty at another layer and, gven two layers α and β, wth N [α] actve at the frst layer and N [β] actve at the second layer, the probablty p(m; N, N [α], N [β] ) that exactly m nodes, wth m = 0,..., mn(n [α], N [β] ), are actve at both layers follows a hypergeometrc dstrbuton: ( )( ) N [α] N N [α] ( p m; N, N [α], N [β]) = m N [β] m ( ) N. (8) N [β] Consequently, the average number of nodes actve at both layers s equal to N [α] N [β] /N, and the expected parwse multplexty of the two layers s: Q α,β = N [α] N [β] N 2 (9) Smlarly, the expected value of the normalsed Hammng dstance between two layers α and β s equal to: H α,β = N [β] m=0 ( ) N [α] + N [β] 2m p (m; N, N [α], N [β]) mn(n, N [α] + N [β] ) (10) FIG. 9: (color onlne) The rank dstrbuton of node-actvty vectors n APS (a) and IMDb (b), compared wth those of synthetc multplex networks genrated usng MDM and MSM. Mult-actvty Determnstc Model (MDM). In ths model we costruct networks wth the same number of layers M and the same number of actve nodes N as n a gven real-world multplex network. We consder a node actve f t s actve at at least one of the M layers of the orgnal network. Then, we assocate to each actve node a node-actvty vector sampled at random among the ( ) M B M-dmensonal bnary vectors havng exactly B non-zero entres, where B s the number of layers n whch node s actve n the orgnal network. We name the model Mult-actvty Determnstc Model, snce the dstrbuton of B of the orgnal multplex s preserved, although the correlatons n layer actvty and the dstrbuton of node-actvty vectors are destroyed. The unform assgnment of node-actvty vectors also mples that

10 10 all the layers wll have, on average, the same number of actve nodes, snce the probablty that a gven node s actve on a gven layer α s equal to B /M and does not depend on α. In partcular, the expected number of actve nodes at layer α s: Ñ [α] = 1 B, α. (11) M Mult-actvty Stochastc Model (MSM). In ths model, we actvate node at layer α wth probablty B = B /M, where B s the node-actvty of n the orgnal network. Also n ths case the expected actvty of each layer s equal to M 1 B, but the node-actvty of each node s a bnomally dstrbuted random varable centered around B, so that, dfferently from MDM, the node-actvty dstrbuton s not preserved. Layer Growth wth Preferental Actvaton Model (LGM). Ths model takes nto account the fact that real-world multplex networks exhbt fat-taled dstrbutons of layer actvty, and ams at explanng the powerlaw dstrbuton of node-actvty reported n Fg. 3. The man assumpton of the model whch s certanly vald for some networks such as the contnental arlnes, s that a multplex network grows through the addton of entre layers, each arrvng wth a certan number of nodes to be actvated. Then, each node of a newly arrved layer s actvated (at that layer) wth a probablty that ncreases lnearly wth the number of other layers n whch s already actve. From an operatonal pont of vew, we start from a multplex consstng of N nodes (ether actve or nactve) and M 0 layers, and we add a layer at each tme step. Therefore, at tme t the multplex has M 0 + t layers. We assume that n the newly arrved layer α there are N [α] nodes to be actvated, where N [α] s set equal to the number of actve nodes at layer α observed n the orgnal multplex. Then, we consder all the nodes and actvate each node wth probablty: P (t) A + B (t) (12) where A > 0 s a tunable real-valued parameter and B (t) s the number of layers (among the M 0 + t exstng ones) n whch node s already actve. The parameter A s an ntrnsc attractveness whch guarantees that also nodes not yet actve n the exstng layers have a non-zero probablty of beng actvated at a new layer. In Fgures 8 and 9 we compare the results of the models wth some measured quanttes n real-world multplex networks. In partcular n Fg. 8(a) we show the dstrbuton of parwse multplexty for the European contnental arlnes and those obtaned wth the four synthetc models. Remarkably, the dstrbuton of multplexty of the real system s pretty dfferent from those obtaned through HM, MDM and MSM. In partcular, both MDM and MSM produce multplex networks wth an exponental-lke dstrbuton of multplexty, whle n the orgnal system Q α,β s a power-law. HM can somehow reproduce the heterogenety of P (Q α,β ), even f the typcal values of Q α,β are much smaller than those observed n the European arlne network. The best approxmaton s obtaned through the LGM, whch reproduces qute accurately both the shape and the slope of P (Q α,β ). Smlarly, n Fg. 8(b) we show the dstrbuton P (B ) of node-actvty for the orgnal European arlnes multplex and the correspondng synthetc networks. Takng asde MDM and MSM, for whch the dstrbuton of node-actvty s equal to that of the orgnal network by constructon, also n ths case LGM s the model whch better approxmates P (B ). Fnally, n Fg. 9 we compare the rank dstrbuton of node-actvty vectors n APS and IMDb wth those obtaned through MDM and MSM (we dd not consder LGM snce these multplex have a relatvely small number of layers). We notce that the Zpf s plots of the dstrbutons produced by both MDM and MSM are stepwse constant functons, n whch each step corresponds to node-actvty vectors havng the same value of nonnull entres (.e., of node-actvty B ). Ths s due to the fact that n MDM and MSM the probablty for a certan node-actvty vector to be produced depends only on the correspondng node-actvty value B. The results shown n Fg. 9 suggest that the pattern of node actvty across layers n real-world multplex networks can be qute heterogeneous, and that ndeed the actvty of a node at a certan layer s often hghly correlated wth ts actvty (and nactvty) at other layers. Ths means that by studyng the propertes of each layer separately, or, even worse, by aggregatng all layers n a sngle graph, one obtans only a partal pcture of the system, whle a comprehensve understandng of a multlayer system requres to take nto account the dfferent layers altogether. V. CORRELATION BETWEEN ACTIVITY AND DEGREE In ths secton we nvestgate the exstence of correlatons between the actvty of a node and ts multdegree,.e. the number of edges ncdent n the node at each layer. To a frst approxmaton, the nformaton contaned n the multdegree of a node s well descrbed by only two quanttes, the overlappng degree and the partecpaton coeffcent of a node [16]. Followng the defnton gven n [16], we denote the overlappng degree of node as: o = α k [α] (13) that s the total number of edges ncdent on. Notce that o s sometmes called the total degree of node. As the degree s a proxy for the mportance of a node n a sngle-layer network, the overlappng degree of s a

11 11 FIG. 10: (color onlne) Densty plots of overlappng degree, partcpaton coeffcent and node-actvty, for APS (top panels) and IMDb (bottom panels). On average, node-actvty s postvely correlated wth both overlappng degree and partcpaton coeffcent (the sold lne shows the average B computed over all the nodes havng a certan value of o ). However, the fluctuatons n the values of B are qute large n all the cases. proxy for the overall nvolvement of node n the multplex network. However, the overlappng degree measures only an aspect of the role played by a node n a multplex system. In fact, f we consder two nodes and j, so that s actve n all the M layers and has m lnks on each of them, whle j s actve only on one layer wth m M lnks, then we wll have o = o j = m M. Nevertheless, and j have qute dfferent roles n the multplex, snce the removal of node j from the system wll drectly affect the structure of just one layer (namely, the only layer n whch j s actve), whle the removal of wll potentally cause dsruptons at all layers. In order to quantfy the heterogenety of the dstrbuton of the lnks of a node across the layers, one can make use of the multplex partcpaton coeffcent [16] : P = M M 1 [ 1 M ( [α] ) ] 2 k. (14) α=1 whch takes values n [0, 1], s equal to 0 f node s actve n exactly one layer, and tends to 1 only f the edges of are equally dstrbuted across all the layers. It has been shown n Refs. [16, 31] that mportant nformaton on the node propertes of a multplex can be obtaned by a scatter plot or a densty plot of the partcpaton coeffcent as a functon of overlappng degree. Such dagram have been called multplex cartography dagrams. In Fg. 10 panels (a) and (d) we plot the multplex cartography dagrams for APS and IMDb. Accordng to the o values of the partcpaton coeffcent, nodes can be dvded nto focused (P < 1/3), mxed (1/3 < P < 2/3) and truly multplex (2/3 < P 1). It s worth notcng that ths classfcaton of nodes accordng to the value of ther partcpaton coeffcent s n lne wth the defnton of network cartography orgnally proposed n Ref. [64] to characterse the role played by sngle nodes n the organsaton n communtes, and was adapted to multplex networks n Ref. [16]. More prncpled ways to defne the boundares of the three regons mght be based, for nstance, on the selecton of percentles of the dstrbuton of partcpaton coeffcents, e.g., by settng the boundary between focused and mxed at the 50-th percentle and the boundary between mxed and multplex at the 95-th or 99-th percentle. However, such a choce would make dffcult the comparson of multplex cartography dagrams assocated to dstnct multplex networks. Nodes wth relatvely hgh values of o are consdered hubs. By constructon, we do not expect a correlaton between o and P, snce the two quanttes dentfy two dfferent aspects of node connectvty. And n fact, the dagrams shown n Fg. 10 exhbt a large varety of patterns. For nstance, APS s charactersed by a relatvely large fracton of mxed hubs (nodes wth hgh o and ntermedate values of P ), whle almost all the hubs n the IMDb data set are truly multplex (hgh values of P ). In a smlar way, we can quantfy the exstence of correlatons between the node-actvty B of a node and the

12 12 correspondng values of overlappng degree o and partcpaton coeffcent P. In Fg. 10 panel (b) and (e) we report the densty plots of node-actvty and overlappng degree, respectvely for APS and IMDb. As expected, we observe postve correlatons between the two quanttes B and o, so that nodes wth many lnks tend to be actve on more layers. Ths s reasonable because a node wth a small number of edges cannot be actve on a large number of layers. However, the fluctuatons around the average value of node-actvty for a certan value of overlappng degree (marked by the black sold lne n the plots) are qute large. Smlar relatonshps exst between node-actvty and partcpaton coeffcent as shown n Fg. 10(c) and Fg. 10(f), despte the exstence of large fluctuatons. Namely, nodes havng a hgher value of partcpaton coeffcent usually are actve on more layers than nodes havng small values of P. Ths s ndeed not surprsng, sncethe edges of a node wth a hgher value of partcpaton coeffcent are more unformly dstrbuted across layers, hence the node wll be actve on more layers. VI. INTER-LAYER DEGREE CORRELATIONS It has been extensvely shown n the lterature that sngle-layer networks are charactersed by the presence of degree-degree correlatons, meanng that nodes havng a certan degree are preferentally connected to other nodes havng smlar (assortatve correlatons) or dssmlar degree (dsassortatve correlatons). Socal and communcaton networks are the most remarkable examples of assortatve networks, whle the vast majorty of technologcal and bologcal networks exhbt dsassortatve degree correlatons. In addton to the classcal ntra-layer degree-degree correlatons, n a multplex network we can also defne the concept of nter-layer degree-degree correlatons. A. Inter-layer correlaton coeffcents A compact way to quantfy the presence of nter-layer degree correlatons s to make use of one of the standard correlaton coeffcents to measure how the degree sequences of two layers are correlated. One possblty s the Pearson s lnear correlaton coeffcent [31, 46, 60, 61]. If we denote as k [α] and k [β] the degrees of node respectvely at layer α and layer β, the Pearson s correlaton coeffcent of the two degree sequences s defned as: r α,β = k[α] k [β] k [α] σ k [α]σ k [β] k [β] (15) To avod the bas due to the relatvely small multplexty of real-world systems, the averages are taken over all the nodes whch are actve on both layers. Another possblty s to use the Spearman s rank correlaton coeffcent ρ [31]: ρ α,β = ( R [α] R [β] ) ( R [α] ( ) 2 R [α] R [α] j ) R [β] ( ) (16) 2 R [β] j R [β] where R [α] s the rank of node due to ts degree on layer α, and R [α] and R [β] are the average ranks of nodes respectvely at layer α and layer β. Also n ths case, only nodes actve on both layers are consdered n the computaton of ρ α,β. A thrd opton s to use the Kendall s τ rank correlaton coeffcent [31]: n α,β c n α,β d τ α,β = (n0 n α )(n 0 n β ). (17) where n 0 = 1/2 NQ α,β (NQ α,β 1), and n α,β c and n α,β d are, respectvely, the number of concordant pars and the number of dscordant pars n the two rankngs. We say that the two nodes and j are a concordant par f the ranks of the two nodes at the two layers agree,.e. f both R [α] > R [α] j and R [β] > R [β] j, or both R [α] < R [α] j and R [β] < R [β]. If a par of nodes s not concordant, j then t s sad dscordant. Fnally, n α and n β account for the number of rank tes n the two layers. We have computed the three above parwse correlaton coeffcents for the APS and for the IMDb multplex networks. The results are shown n Fg. 11. We notce that each of the three coeffcents show a slghtly dfferent behavour. Nevertheless, t s clear from the Fgure that nter-layer correlatons n APS are exclusvely assortatve, whle n IMDb we can observe both postve and negatve correlatons. In partcular, the degree of nodes at layer 2 (Adult moves) and at layer 25 (Talk- Shows) are negatvely correlated wth the degree on all the other layers, whlst beng postvely correlated to each other. These results ndcate that t s pretty uncommon even f not mpossble for an actor of Adult moves, to take part n a Famly move or n a Thrller. In addton to ths, the large majorty of actors usually prefer to avod talk-shows, the man excepton beng porn stars. The presence of negatve nter-layer degree correlatons n the IMDb multplex network s hghlghted n the dstrbutons of the three correlaton coeffcents reported n panel (h). It s nterestng that, n most of the cases, also the nter-layer degree correlatons n multplex socal networks are assortatve. Ths s n agreement wth the common belef that ntra-layer degree-degree correlatons n sngle-layer socal systems are always of the assortatve type. However, cases such as the IMDb are an example that dsassortatvty s possble n socal networks when they are not aggregated, and treated as multplex networks. It s mportant to stress that, although the Spearman s and Kendall s rank correlaton coeffcents are able to capture, at least to some extent, the presence of nonlnear correlatons n the rankngs nduced by two degree dstrbutons, the choce of whch coeffcent s more

13 13 FIG. 11: (color onlne) Dfferent degree correlaton coeffcents, namely (a) Pearson s r, (b) Spearman s ρ and (c) Kendall s τ for dfferent couples of layers, and the correspondng dstrbutons (d) are reported for the APS, and show that nter-layer correlatons n ths system tend to be assortatve. A smlar pattern s observed n IMDb (panels (e)-(h)). However, some move genres, lke Adult and Talk-Show (respectvely correspondng to layer number 2 and number 25 n the dagram) have marked negatve nter-layer correlatons wth almost all the other layers. approprate to quantfy nter-layer correlatons mght n general depend on the actual system under study. As we wll see n the followng, a more accurate way of measurng such correlatons s by means of nter-layer degree correlaton functons. B. Inter-layer correlaton functons The complete nformaton on degree correlatons n sngle-layer networks s contaned n the jont degree dstrbuton functon P (k, k ) or, equvalently, n the condtonal degree dstrbuton P (k k), whch respectvely denote the probablty that a randomly chosen lnk connects a node of degree k to a node of degree k, and the probablty that a lnk from a node of degree k connects a node of degree k. A convenent quantty that s commonly used to detect degree correlatons s the degree correlaton functon, defned as the average degree of the frst neghbours of a node havng a certan degree k: k nn (k) = k (k) = k k P (k k) In fact, n sngle-layer networks wth assortatve degree correlatons k nn (k) wll be an ncreasng functon of k, whle n dsassortatve networks k nn (k) wll decrease wth k. An nterestng result s that n many cases of realworld complex networks we have k nn (k) k ν, so that FIG. 12: (color onlne) The Zpf s plot of the dstrbuton of mult-degree n (a) APS and (b) IMDb have a power-law tal wth exponent close to 1.0. However, the mult-degree dstrbuton mght be affected by large fluctuatons. In fact, n both cases around 90% of the mult-degree vectors are present only once, and more than 95% are observed less than four tmes. the correlaton exponent ν can be used to quantfy the sgn and ntensty of degree-degree correlatons [6, 7]. In a multplex network the complete nformaton about nter-layer correlatons s contaned n the jont probablty P (k [1],..., k [M] ), whch represents the probablty that a randomly chosen node has degree k [1] at layer 1,

14 14 FIG. 13: (color onlne) The nter-layer parwse degree correlaton functon k [β] (k [α] ) s shown for (a) C.elegans and BIOGRID and for varous couples of layers α and β, respectvely, n (b) APS and (c) IMDb. The lnes reported are ft obtaned by a power law of the form k [β] (k [α] ) (k [α] ) µ. The plots are vertcally dsplaced to enhance readablty. degree k [2] at layer 2, and so on, and s nothng else than the mult-degree dstrbuton of the system P (k). As an example, we report n Fg.12 the Zpf s plot of the dstrbuton of mult-degree for APS and IMDb. Interestngly, both dstrbutons exhbt a power-law behavor wth a negatve exponent around 1.0. The nter-layer correlatons between layers α and β can be studed by constructng the parwse jont and condtonal probablty dstrbutons P (k [α], k [β] ) and P (k [β] k [α] ) The frst quantty denotes the probablty that a randomly chosen node has degree k [α] at layer α and degree k [β] at layer β, whle the latter denotes the probablty that a node havng a gven degree k [α] at layer α has degree k [β] at layer β. In the same sprt of the degree correlaton functon defned for sngle-layer networks, gven two layers α and β we can defne the two nter-layer degree correlaton functons: and k [β] (k [α] ) = k [β] k [β] P (k [β] k [α] ) (18) multplex network of move actor collaboratons we fnd nstead pars of layers wth assortatve or dsassortatve nter-layer degree correlatons, and also pars of uncorrelated layers. As an example of postvely correlated genres n the IMDb we report the couple Drama-Western. The couple Adult-Western s nstead negatvely correlated, whle Drama Moves are not correlated wth Game Show, as wtnessed by the fact that k [β] (k [α] ) shows no dependence on k [α]. It s worth notcng that also nterlayer correlaton functons can be well ftted, n most of the cases, by power-laws n the form k [β] (k [α] ) (k [α] ) µ, so that for each network, and for each ordered par of layers (α, β), t s possble to extract the nter-layer correlaton exponent µ. We can therefore say that we observe assortatve, neutral or dsassortatve correlatons, dependng on the fact that the sgn of µ s respectvely postve, null or negatve. The absolute value of µ then gve nformaton on the ntensty of the correlatons. Notce that n general, accordng to the defnton of k [α] (k [β] ), the exponent of k [β] (k [α] ) mght be dffrent from the esponent of k [α] (k [β] ), as happens for nstance n Fg. 13(a) for the layers of C.elegans and BIOGRID. k [α] (k [β] ) = k [α] k [α] P (k [α] k [β] ). (19) These two quanttes quantfy the average degree at layer β (resp. α) of a node havng a degree equal to k [α] (resp. k [β] ) at layer α (resp. β). Beng average quanttes, we expect smaller fluctuatons than f we drectly plotted the two-dmensonal functons P (k [α], k [β] ) and P (k [β] k [α] ). Agan, the dea s that an ncrease (decrease) of k [β] (k [α] ) as a functon of k [α] s a sgn of the presence of assortatve (dsassortatve) nter-layer degree correlatons between α and β. In Fg. 13 we show some typcal examples of parwse nter-layer degree correlaton functons n C.elegans, BI- OGRID, APS and IMDb. Both n the two bologcal networks and n APS we observe an ncreasng behavor of k [β] (k [α] ) as a functon of k [α], denotng the presence of assortatve nter-layer degree correlatons. For the In Fg. 14 we report a graphcal representaton of the nter-layer degree correlaton patterns n APS and n IMDB and we also show the correspondng dstrbuton of nter-layer correlaton exponents observed n the two systems. Each node of the graphs shown n Fg. 14(a)- (b) corresponds to a layer of the multplex, and the color of a lnk represents the sgn and magntude of the exponent of the nter-layer correlaton functon between two layers (red for negatve exponents and blue for postve ones). It s evdent that whle n APS nter-layer degree correlatons are always postve, n IMDb they mght be ether postve or negatve. Notce also that the only layers n IMDB havng negatve degree correlatons wth the others are those correspondng to Adult moves and Talk-Shows.

15 15 FIG. 14: (color onlne) The nter-layer correlaton pattern of (a) APS and (b) IMDB s evdent by consderng a graph whose nodes correspond to layers and the weght of the edges s the value of the nter-layer correlaton exponent µ. In the fgure blu weghts correspond to postve correlatons whle red weghts to negatve ones. Panel (c): the dstrbuton of the values of the nter-layer correlaton exponent µ n APS (sold black lne) and n IMBd (dashed red lne). Notce that whle nter-layer degree correlatons are always postve n APS, the layers of IMDb mght be ether postvely or negatvely correlated. VII. MODELS OF INTER-LAYER DEGREE CORRELATIONS We propose here two dfferent models to reproduce the observed patterns of parwse nter-layer degree correlatons. The frst model s based on the tunng of the Spearman rank correlaton coeffcent ρα,β, whle the second one allows to obtan an nter-layer correlaton functon k [β] (k [α] ) (k [α] )µ. wth a prescrbed value of the correlaton exponent µ. Both models are based on smulated annealng. correspondng to the assgnment S can be wrtten as P,j sj (x x )(yj y ) ρ = qp (20) P 2 2 (x x ) (y y ) j j Ths equaton can be also expressed n the form P j sj x yj + C D where C = N x y y A. (21) X x x Model for ρ X y (22) and Let us consder two graphs wth the same number of nodes N. If we want to construct a two-layer multplex network usng the two graphs respectvely as layer α and layer β of the multplex, we need to couple the nodes of the two graphs n such a way that each node of layer α s connected wth exactly one node on the other layer β. Such a couplng can be realzed n many dfferent ways, and n partcular t can be chosen n order to obtan a gven level of nter-layer degree correlaton, for nstance a gven value of the Spearman rank correlaton coeffcent ρα,β. The couplng/correspondence between the nodes of the two graphs can be descrbed by a N N matrx S = {sj } that we call assgnment. Entry sj = 1 f node n layer α corresponds to node j n layer β. Snce we have a one-to-one correspondence P between the nodes of the two graphs we have to mpose j sj = 1,. For smplcty n the notaton, let us denote by x the rank of node [α] n layer α, as nduced by the degree sequence {k }, and [β] by y the rank of node n layer β, as nduced by {k }. In ths case the Spearman s rank correlaton coeffcent D= sx X (x x )2 (yj y )2 (23) j are two constants whch depends only on the two rankngs {x } and {y }, and not on the actual assgnment S. Therefore, the Spearman s correlaton coeffcent s P unquely determned by the term s x j yj,.e. by,j the adjacency matrx S. Consequently, one should n prncple be able to obtan any prescrbed value ρ of the Spearman rank correlaton coeffcent by approprately changng the assgnment,.e. by fndng a matrx S = {s j } so that P,j s j x yj + C = ρ (24) D For a generc assgnment S we have: P,j sj x yj + C = ρs 6= ρ D

16 16 Algorthm 1 Smulated annealng for ρ Requre: {k }, S = {s j}, ρ, ε Ensure: S = {s j} so that ρ = ρ 1: compute ρ S 2: F (S) ρ S ρ 3: whle F (S) > ε do 4: select two nter-layer edges, (, j) and (k, l), at random 5: replace (, j) wth (, l) and (k, l) wth (k, j) 6: compute ρ S 7: F (S ) ρ S ρ 8: f F (S ) < F (S) then 9: S S 10: else 11: swap F (S) and F (S ) wth probablty p = e (F (S ) F (S))/γ 12: end f 13: F (S) ρ S ρ 14: end whle 15: return S whch s assocated to the cost functon F (S) = ρ S ρ. The basc dea s then to subsequently modfy the structure of the assgnment n order to mnmze F (S). We wll make use of a smulated annealng algorthm whch works as follows. We start from an ntal random assgnment S, and we compute ts assocated cost functon F (S). Then, we select two edges e 1 = (, j) and e 2 = (k, l) of S, unformly at random so that e 1 e 2, and we consder the adjacency matrx assocated to the assgnment S obtaned from S by replacng e 1 and e 2 wth e 1 = (, l) and e 2 = (k, j). We compute F (S ), and we accept the new assgnment S wth a probablty p = { 1 f F (S ) < F (S) e F (S ) F (S) γ otherwse (25) where γ s a parameter. Ths scheme, whose pseudo-code s reported n Algorthm 1, wll favour changes to the adjancency matrx whch contrbute to mnmze the functon F, but t also allows to explore ergodcally all the possble confguratons of S, by acceptng unfavourable changes wth a fnte probablty. Notce that, due to the dscrete nature of the assgnment problem and dependng on the characterstcs of the two rankngs under consderaton, t mght happen that there exsts no assgnment whch produces exactly the desred value ρ. Consequently, the algorthm wll stop when F (S) < ε, where ε s a threshold set by the user. Moreover, n order to avod any bas due to the relatvely small multplexty of real-world systems (.e., to the relatvely small fracton of nodes whch are actve on both α and β, for any choce of α and β), t s usually better to run the algorthm only on the nodes whch are actve on both the layers consdered. In the generc case of M-layer multplex networks one can terate ths algorthm n order to set the values of ρ α,β for up to M 1 pars of layers. As an example, we report n Fg. 15 the values of ρ α,β measured for the APS and for the IMDb, together wth those obtaned n the synthetc multplex networks constructed by usng the proposed algorthm. Each synthetc network was constructued by keepng the dstrbuton of node-actvty vectors of the orgnal multplex, and by reassgnng at random the degrees of the actve nodes at each layer, samplng them from the same dstrbuton observed n the real multplex. We consdered the M 1 pars of layers havng consecutve IDs (e.g., couples of layers (α, β) such that β = α + 1, for nstance (0, 1), (1, 2) and so on), and we measured the observed nterlayer rank correlaton coeffcents ρ α,β. Then, we terated Algorthm 1, startng from the frst two layers, settng ρ = ρ α,β and obtanng an optmal assgnment of the nodes n α and β. Keepng fxed ths assgnment, we run agan Algorthm 1 on the second and the thrd layer of the multplex, and we obtaned the optmal assgnment between ther nodes, and so forth. By lookng at Fg. 15 t s evdent that there s a qualtatve correspondence between the dstrbutons of ρ n real and synthetc networks, mostly due to the fact that partal orderng s a transtve relaton, but n general the dfference between the two mght be relatvely hgh (up to 0.4 n APS and up to 0.5 n IMDb). It s mportant to stress here that Algorthm 1 can be straghtforwardly generalzed to work wth any other node property. In fact the algorthm s based on the comparson of rankngs nduced by node propertes, ndependently from the fact that these rankngs are nduced by degree sequences or by any other node attrbute. Consequently, the same procedure can be employed to set the magntude and sgn of nter-layer correlatons wth respect to any real-valued pars of node propertes, such as the clusterng coeffcent, the betweenness, or the sze of the communty to whch a node belongs. Notce that t would also be possble to consder mult-objectve functons whch allow to set the correlatons for all the M(M 1)/2 pars of layers at the same tme. Such varants of Algorthm 1 wll be the subject of another work currently n preparaton. A software mplementaton of Algorthm 1 s avalable for download at [62]. B. Model for k [β] (k [α] ) Analogously to what done n the prevous subsecton, here we propose an algorthm to tune the assgnment of the nodes of two layers α and β n order to set a prescrbed nter-layer degree correlaton functon. In partcular, we wll assume that the desred correlaton functon s a power-law,.e. k [β] (k [α] ) = a(k [α] ) µ, as those observed n real-world multplex networks. To smplfy the notaton here we wll ndcate as q the degree of the node at layer β and as k the degree of the node at layer α. Then the desred correlaton functon has the form q(k) = ak µ where the value of µ s that obtaned emprcally for a gven real network, whle a s a constant to be determned. The algorthm s smlar to that proposed for the adjustment of the Spearman s ρ coeffcent. We

17 17 FIG. 15: (color onlne) The values of the Spearman correlaton coeffcent n the orgnal multplex (left panels) and n that obtaned through Algorthm 1 (mddle panels) respectvely for APS (top) and IMDb (bottom). In the rghtmost panel we show the dfference between the orgnal dstrbuton of ρ and that obtaned n the synthetc network. In both cases, the overall shape of the dstrbuton of nter-layer correlatons n the synthetc multplex looks very smlar to the orgnal one. However, the dfferences n the obtaned value of ρ mght be qute hgh. Ths s due to the fact that Algorthm 1 allows to set only M 1 pars or correlatons, over the total M(M 1)/2. Algorthm 2 Smulated annealng for q = ak µ Requre: {k }, {q }, {s j}, µ, ε Ensure: {s j} so that q ak µ < ε 1: contnue True 2: whle contnue s True do 3: select two nodes, and j, at random 4: old 1 log(q ) log(a) µ log(k ) 5: old 2 log(q j) log(a) µ log(k j) 6: new 1 log(q j) log(a) µ log(k ) 7: new 2 log(q ) log(a) µ log(k j) 8: F old old 1 + old 2 9: F new = new 1 + new 2 10: f F new < F old then 11: swap and j n the second layer and obtan {s j} 12: else 13: swap and j wth probablty p = e (Fnew F old)/γ 14: end f 15: compute the best power-law ft a k µ of q 16: f µ µ < ε then 17: contnue False 18: end f 19: end whle 20: return {s j} start from a random assgnment of nodes S, we select two edges of S unformly at random and we try to swap ther endponts n order to locally mnmze the dfference between the actual functon q(k) and the desred one k µ. Favorable swaps,.e. those whch produce smaller values of, are always accepted, whle unfavorable ones,.e. those whch produce a local ncrease n, are accepted wth a probablty whch decays exponentally wth the dfference n. The man steps of the procedure are summarzed n Algorthm 2. There are some techncal subtletes to take nto account for the mplementaton of Algorthm 2. Frst of all, the fact that the coeffcent a whch multples k µ s n general unknown. Consequently, a s ntally set to an arbtrary postve value and then t s adaptvely changed as the algorthm proceeds, by settng t equal to the coeffcent obtaned through the best power-law ft of q(k). Updates of a are performed once every t a steps of the algorthm, where t a s a parameter set by the user. A software mplementaton of Algorthm 2 s avalable at [62]. In Fg. 16 we compare the values of the nter-layer degree correlaton exponent µ observed n the APS multplex and n the synthetc network obtaned through Algorthm 2. Despte the dstrbuton of µ n the synthetc

18 18 FIG. 16: (color onlne) The values of the nter-layer degree correlaton exponent µ n the APS multplex (left) and n a synthetc multplex network generated through Algorthm 2 (mddle). The rghtmost panel shows the dfference between the exponents observed n the orgnal system and those measured n the synthetc network. Although the left and the mddle panel look qualtatvely smlar, the rght panel reveals that the dfference n the actual nter-layer degree correlaton exponent µ of the synthetc network mght be as hgh as 0.7. multplex looks qualtatvely smlar to that of the orgnal system, the dfference n the actual value of µ can be qute large. Remember that by usng Algorthm 2 one can set the value of µ only for M 1 pars of layers, so the poor agreement of the pattern of correlaton observed n the model wth that of the orgnal system suggests that nter-layer degree correlatons of the APS multplex network are not just due to the superposton of parwse nter-layer correlatons. VIII. CONCLUSIONS In the last ffteen years complex networks theory has shed new lghts on the structure, organzaton, dynamcs and evoluton of complex systems, provdng a unfyng framework to characterze and model dverse natural and man-made systems. However, a complex network s rarely an solated object, snce ts consttuent nodes can belong to dfferent systems at the same tme and can be connected through a varety of dfferent relatonshps. Despte beng stll n ts nfancy, the multplex network approach, whch conssts n representng the dfferent knds of relatonshps among nodes as separate layers of a mult-layer graph, provdes a promsng framework to understand and model the structure of mult-layer nterconnected systems. In ths work we have analyzed multplex networks obtaned from real-world bologcal, technologcal and socal systems, and spannng a wde range of szes. We showed that real-world multplex networks tend to be qute sparse, meanng that only a few nodes are actve on more than one layer, and that the patterns of presence and nvolvement of nodes through the layers are characterzed by nter-layer correlatons, as clearly shown by the heterogeneous dstrbutons of node-actvty and by the non-trval nter-layer degree correlaton functons. The observaton of such non-trval patterns ndcates that a multplex s more than the sum of ts layers and cannot be descrbed by a sngle-layer network obtaned by aggregatng the layers. Recent results n the feld actually confrm that such multplex patterns play a fundamental role n many dynamcal processes takng place on multplex networks, and can ndeed be responsble of completely new physcal phenomena, unobservable n sngle-layer projectons [52, 56]. Fnally, t s nterestng to notce that the large majorty of models for multplex networks proposed so far are based on the assumpton that each node of a multplex s actve at all layers, and that all layers have the same number of nodes. In the lght of the results of ths paper, these assumptons result too smplstc for the modelng of real-world multplex systems. Despte some recent attempts to take nto account heterogenetes of node and layer actvtes [66], we beleve that further research s needed n ths drecton to better understandng the elementary processes whch mght be responsble for the formaton of such nterestng structural patterns. Acknowledgments The authors acknowledge the support of the EU Commsson through the project LASAGNE (FP7-ICT ). Ths research utlzed Queen Mary s MdPlus computatonal facltes, supported by QMUL Research- IT and funded by EPSRC Grant No.EP/K000128/1.