arxiv: v1 [cs.ni] 14 Oct 2015

Transcription

1 arxv: v1 [cs.ni] 14 Oct 2015 PRIMAL: PROFIT MAXIMIZATION AVATAR PLACEMENT FOR MOBILE EDGE COMPUTING XIANG SUN NIRWAN ANSARI TR-ANL OCT 14, 2015 ADVANCED NETWORKING LABORATORY DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING NEW JERSY INSTITUTE OF TECHNOLOGY

2 PRIMAL: PRofIt Maxmzaton Avatar placement for Moble Edge Computng 1 Xang Sun, Student Member, IEEE, and Nrwan Ansar, Fellow, IEEE Abstract We propose a cloudlet network archtecture to brng the computng resources from the centralzed cloud to the edge. Thus, each User Equpment (UE) can communcate wth ts Avatar, a software clone located n a cloudlet, wth lower end-to-end (E2E) delay. However, UEs are movng over tme, and so the low E2E delay may not be mantaned f UEs Avatars stay n ther orgnal cloudlets. Thus, lve Avatar mgraton (.e., mgratng a UE s Avatar to a sutable cloudlet based on the UE s locaton) s enabled to mantan low E2E delay between each UE and ts Avatar. On the other hand, the mgraton tself ncurs extra overheads n terms of resources of the Avatar, whch compromse the performance of applcatons runnng n the Avatar. By consderng the gan (.e., the E2E delay reducton) and the cost (.e., the mgraton overheads) of the lve Avatar mgraton, we propose a PRofIt Maxmzaton Avatar placement (PRIMAL) strategy for the cloudlet network n order to optmze the tradeoff between the mgraton gan and the mgraton cost by selectvely mgratng the Avatars to ther optmal locatons. Smulaton results demonstrate that as compared to the other two strateges (.e., Follow Me Avatar and Statc), PRIMAL maxmzes the proft n terms of mantanng the low average E2E delay between UEs and ther Avatars and mnmzng the mgraton cost smultaneously. I. INTRODUCTION Recent moble applcatons, such as augmented realty, mage processng and speech recognton, become resource ntensve and dran User Equpments (UEs ) batteres very quckly. Moble Cloud Computng (MCC) [1], [2] has been proposed to offload applcatons workloads from UEs to the cloud n order to not only reduce energy consumpton of UEs but also accelerate the executon tme of the applcatons. MCC reduces the UE s computatonal cost at the expense communcatons cost,.e., the UE frequently nteracts wth the cloud by offloadng ts applcaton workloads. Thus, t s not effcent to do the applcaton offloadng f the End-to-End (E2E) delay between a UE and the cloud s unbearable. The cloudlet archtecture s ntroduced to reduce the

3 2 E2E delay,.e., the computng resources are moved from the remote cloud to the local cloudlet, whch s a tny verson of a data center resdng close to UEs, so that UEs can access the computng resources va the Local Area Networks (LANs) wth lower E2E delay [2]. Fg. 1. The cloudlet network archtecture. To reap benefts of the cloudlet, we propose the cloudlet network archtecture, as shown n Fg. 1, n order to provde ubqutous computng resources to UEs and at the same tme mantan low E2E delay. Snce the exstng LTE network nfrastructure can provde seamless connecton between a UE and a base staton (BS), each BS s connected to a cloudlet va hgh speed fbers so that UEs can utlze computng resources n the cloudlets wth one wreless hop delay. Moreover, each UE subscrbes one Avatar, a hgh performance Vrtual Machne (VM) n the cloudlet, whch provdes extra computng resources and storage space. Avatars are software clones of ther UEs and always avalable to UEs when UEs are movng from one coverage area to another [3]. Assgnng a specfc Avatar to each UE n the cloudlet provdes hardware solaton by securely runnng each UE s applcaton workloads on a shared physcal hardware. On the top of the cloudlets, Software Defned Network (SDN) based cellular core network has been

4 3 proposed n the cloudlet network archtecture to provde effcent and flexble communcatons paths between Avatars n dfferent cloudlets as well as between UEs n dfferent BSs [4], [5]. Moreover, every UE and ts Avatar n the cloudlet can communcate wth publc data centers (e.g., Amazon EC2) and Storage Area Networks (SANs) va the Internet n order to provson scalablty,.e., f cloudlets are not avalable for UEs because of the capacty lmtaton, UEs Avatars can be mgrated to the remote data centers to contnue servng ther UEs. The locatons of cloudlets depend on the UE densty,.e., the BS n the hotspot area can own a specfc cloudlet (e.g., BS1 connects to a specfc cloudlet, say, Cloudlet A n Fg. 1), or the BSs n the rural or suburban area can share the same cloudlet. Thus, the cloudlet can be placed among the BSs (e.g., cloudlet B s deployed between BS2 and BS3 n Fg. 1) or the cloudlet s drectly connected to the swtch at the edge of the SDN based cellular core (e.g., cloudlet C connects to the edge swtch so that BS4 and BS5 can share the computng and storage resources of cloudlet C). The cloudlet network archtecture not only helps UEs offload ther applcaton workloads to ther Avatars wth lower latency but also facltates real tme bg moble data analyss. Smart UEs, embedded wth a rch set of sensors, become a data stream generator producng ther users nformaton (e.g., users locatons, actvtes, mood and ther health nformaton) over tme. Analyzng these massve amount of moble data s not only extremely valuable for market applcatons, but also potentally benefts the socety as a whole [6]. Tradtonally, these bg moble data are analyzed wthn a data center [7] by utlzng the dstrbuted computng framework, such as MapReduce [8], Dryad [9] and Storm [10]. However, transmttng the bg moble data from UEs to the data center through the Internet suffers from the long latency and ncreases the traffc load of the network. Meanwhle, most of the moble data are tmesenstve,.e., the potental value of the moble data s decreasng as tme passes by. Thus, rather than brngng the moble data to the computng resources, the cloudlet network archtecture s proposed to brng the computng resources to the moble data. In other words, each Avatar locally collects, flters, classfes or even analyzes the raw data stream of ts user so that the volume of the moble data, whch need to be transmtted to the remote data center for further analyss, can be reduced substantally or elmnated and the communcatons latency can be reduced as well. A typcal example by utlzng the cloudlet network archtecture to analyze the bg moble data s the terrorst localzaton applcaton,.e., each Avatar receves the terrorsts photos and

5 4 runs the face matchng algorthm locally to compare the recent photos and vdeos captured by ts user. If matched, the nformaton of the photos/vdeos,.e., the locatons and tmestamps of the photos/vdeos, would be uploaded to the central server for further processng. The rest of the paper s organzed as follows. In Secton II, we propose the lve Avatar mgraton among cloudlets to mantan the low E2E delay between UEs and ther Avatars when UEs are movng over tme. We desgn the lve Avatar mgraton gan and cost models to calculate the gan and cost of each Avatar mgraton, respectvely. In Secton III, we formulate the novel Avatar placement strategy, referred to as PRofIt Maxmzaton Avatar placement (PRIMAL), to maxmze the mgraton proft n terms of optmzng the tradeoff between the mgraton gan and the mgraton cost. In Secton IV, we demonstrate the performance of the proposed strategy. The concluson s presented n Secton V. II. LIVE AVATAR MIGRATION UEs frequently communcate wth ther Avatars by transmttng ther moble data (.e., the applcaton workloads and users data streams) over tme. Thus, deployng the Avatar close to ts UE wll essentally reduce the E2E delay between the UE and ts Avatar, and helps meet the QoS of MCC applcatons and facltates bg moble data analyss. However, UEs are movng over tme, and so UEs may be far away from ther Avatars f the locatons of the Avatars are statc,.e., the E2E delay between a UE and ts Avatar n the cloudlet mght be worse than the E2E delay between a UE and a VM n a remote data center. Therefore, t s necessary to optmze each Avatar s placement based on ts UE s locaton. By takng advantages of the lve VM mgraton n a data center, Avatars can also be mgrated among cloudlets over the SDN based celluar core network to alter ther locatons, and thus the E2E delay between a UE and ts Avatar can be reduced by optmzng the Avatars locatons. Nevertheless, Avatar mgratons are expensve operatons because they ncur addtonal overheads [11] [13],.e., Avatar mgratons consume extra resources (e.g., CPU, memory, network, dsk I/O resources), whch affect the performance of applcatons runnng n the Avatars. Whle mgratng the Avatar close to ts UE potentally mproves the E2E delay, t may ntroduce humongous mgraton overheads. In order to measure the proft of the mgraton, t s mportant to consder the gan and the cost of the Avatar mgraton smultaneously.

6 5 A. Lve Avatar Mgraton Gan Model Dfferent from the tradtonal lve VM mgraton n a data center (that tres to maxmze the resource utlzaton and reduce the energy consumpton of the data center), the beneft of the lve Avatar mgraton s to reduce the E2E delay between a UE and ts Avatar, whch comprses three parts: frst, T access,.e., the E2E delay between a UE and ts BS (to whch the UE s assocated wth); second, T core,.e., the E2E delay between the UE s BS and the UE s cloudlet (n whch the UE s Avatar s located); thrd, T cloudlet,.e., the E2E delay wthn the cloudlet. Snce changng the placement of UEs Avatars does not sgnfcantly affect the values of T access and T cloudlet, we consder the gan of lve Avatar mgraton as the reducton of T core, whch s the most mportant parameter affectng the E2E delay between a UE and ts Avatar. In other words, f a UE s Avatar s mgrated to the cloudlet whch has lower E2E delay to the UE s BS, then the gan of the lve Avatar mgraton s defned as the reducton of T core. Denote I as the set of UEs/Avatars (note that one UE s assocated wth one specfc Avatar, and thus we equate the set of UEs to the set of Avatars), and s used to ndex the UEs and ther correspondng Avatars. Denote J and K as the set of cloudlets and BSs n the network, respectvely, and j and k are used to ndex the cloudlets and BSs, respectvely. Denote x,j as the bnary varable to ndcate whether Avatar s located n cloudlet j (.e., x,j = 1) or not. Meanwhle, y,k s used to ndcate whether UE s assocated wth BS k (.e., y,k = 1) or not. By takng the advantage of the SDN network, the E2E between the jth (j J ) cloudlet and the kth (k K) BS n the cloudlet network, denoted as d j,k, can be measured by the SDN controller n each tme slot [14], [15]. Thus, the E2E delay between UE s BS and UE s cloudlet can be derved as follows: K J T core = x,j y,k d j,k. (1) j=1 k=1 Assumng that reducng one unt of the E2E delay ncreases one unt of the gan for a UE, then gven UE s locaton (denoted as y t+1,k ) n the next tme slot, the mgraton gan model s defned as the amount of E2E delay reducton acheved by the case that UE s Avatar mgrates to the locaton of x t+1,j n the next tme slot as compared to the case that UE s Avatar stays n the current locaton (.e., x t,j) n the next tme slot,.e., J K r = j=1 k=1 ( x t,j x t+1 ),j y t+1,k d j,k. (2)

7 6 B. Lve Avatar Mgraton Cost Model As mentoned prevously, Avatar mgraton may lead to performance degradaton of applcatons runnng n the Avatar,.e., although the mgraton can facltate the communcatons between a UE and ts Avatar, the avalable resources for runnng the Avatar s applcatons become less, thus compromsng the QoS for usng the Avatar. Suppose the mgraton overheads are fxed durng the mgraton process (.e., the mgraton consumes the same amount of extra resources n each tme slot durng the process); f the mgraton consumes less tme, t generates fewer overheads to affect the applcatons runnng n the Avatar,.e., the mgraton cost s proportonal to the total mgraton tme. We set up the lve Avatar mgraton cost model as follows: c = κ T mg J j=1 1( x t 2,j x t+1 ) 2,,j (3) where c s the mgraton cost of Avatar, T mg s the total mgraton tme of Avatar, κ s J ( ) the cost coeffcent that maps the mgraton tme to the cost, and x t,j x t+1 2,j ndcates whether Avatar s mgrated to another cloudlet (.e., the summaton equals to 1) or not (.e., the summaton equals to 0). j=1 1 2 Fg. 2. The pre-copy lve mgraton procedure. 1) Total Mgraton Tme: The total mgraton tme s dfferent by applyng dfferent mgraton technques. As an example, we apply the pre-copy lve mgraton technque [16], [17] for mgratng Avatars among cloudlets. As shown n Fg. 2., there are two phases durng pre-copy lve mgraton,.e., the pre-copy phase and stop&copy phase [17], [18]. In the pre-copy phase, the whole memory of the source Avatar s transmtted to the destnaton Avatar n the ntal round. For the rest of each round, source Avatar sends the drty pages, whch are generated from

8 7 the prevous round to the destnaton. Untl the number of generated drty pages s no larger than a predefned threshold, the mgraton proceeds to the stop-and-copy phase,.e., the source Avatar stops servng ts UE, transmts the rest of the drty memory pages and nforms the destnaton Avatar to resume servces to ts UE [13]. Lemma 1. If the bandwdth provsonng for dong mgraton s constant, gven the amount of Avatar s memory (denoted as M ) and Avatar s average memory page drtyng rate (.e., the average number of drty memory pages generated n each tme slot, denoted as D ) durng the mgraton, the tme requred for executng Avatar s mgraton s: T mg = M R D 1 ( D R ) log D /R ( M th M )+1 +1 (4) where R s the bandwdth provsonng n terms of the data rate for dong mgraton (R > D ) and M th s the threshold of drty pages generated. Proof: Suppose there are N number of rounds durng the mgraton process and the SDN network provder can guarantee a constant bandwdth n terms of a fxed bt rate for dong mgraton, the amount of tme consumed n the current round n depends on the amount of drty memory generated n the prevous round n 1. Thus, we have [19]: T mg,n = D ( ) n R Tmg,n 1 = D T mg,0 R, 1 n N, (5) where T mg,n s the tme consumpton of round n durng Avatar s mgraton, and T mg,0 s the tme consumpton of the ntal round (.e., round 0) durng whch the whole memory of the source Avatar s transmtted to the destnaton,.e., T mg round n s:,0 = M R. Thus, the tme consumpton of ( ) n T mg,n = D M R R, 0 n N. (6) The total tme consumpton of the mgraton s the sum of the tme consumpton n each round,.e., T mg = N n=0 = M R D N T mg,n = [ 1 n=0 {( D R ( D R ) n } M R ) N+1 ]. As mentoned before, once the number of the generated drty pages are no larger than a predefned threshold (.e., M th ) n the prevous round, then the source Avatar would stop servng (7)

9 8 ts UE and transmt the rest of the drty pages to the destnaton Avatar n the last round,.e., T mg,n 1 R Mth. Based on Eq. 6, we have T mg,n 1 = ( ) D N 1 M, and so we can derve that f R R R > D, N log D /R ( M th M )+1 (note that f R D, then N + ). Snce the number of the mgraton rounds should be an nteger value, we have: ( ) M th N = log D/R +1, R > D. (8) By substtutng Eq. 8 nto Eq. 7, we have Eq. 4 and thus prove Lemma 1. M 2) Cost Coeffcent κ : The cost coeffcent κ n Eq. 4 may also vary among Avatars because even f dfferent Avatars generate the same mgraton overheads n terms of the same mgraton tme, the performance degradaton of applcatons runnng n dfferent Avatars are also dfferent. The reason s that the lve Avatar mgraton tself can be consdered as an I/O ntensve applcaton, and so the Avatar mgraton would have more negatve effect on the performance of applcatons whch have hgher I/O footprnts as compared to the pure CPU ntensve applcatons [12],.e., the Avatars runnng hgher I/O applcatons have hgher cost coeffcent than the Avatars runnng lower I/O applcatons. Based on the above observaton, we model the value of κ to be proportonal to the weghted sum of utlzaton of dfferent resources [12]: where u net, u men, u dsk κ =α ( w net u net +w dsk u dsk and u cpu +w mem u men +w cpu u cpu ), (9) denote the bandwdth, memory, dsk I/O and CPU resource utlzaton of Avatar, respectvely; w net, w men, w dsk and w cpu are the mgraton mpact factor of the bandwdth, memory, dsk I/O and CPU resource utlzaton, respectvely, ndcatng the degree of mpact of dfferent resources (note that the values of w net, w men, w dsk and w cpu can be derved through experments [12]); α s the penalty coeffcent that maps the weghted sum of utlzaton of resources to the cost coeffcent. α s an mportant parameter n the system. Increasng the value of α would ncrease the rato of the mgraton cost to mgraton gan, and dscourage Avatars from dong lve mgratons. Consequently, the E2E delay would ncrease f Avatars are not ncentvzed to do lve mgraton. Thus, α s a parameter to adjust the tradeoff between the E2E delay and the cost for dong lve Avatar mgraton, and can be chosen va experments by testng users QoE for utlzng ther Avatars. Also, alterng the value of α can adjust the traffc n the SDN cellular core,.e., ncreasng the value of α would reduce the traffc generated by the mgratons and mtgate the traffc load n the SDN cellular core consequently.

10 9 III. PROFIT MAXIMIZATION AVATAR PLACEMENT (PRIMAL) In order to ncrease the gan by facltatng the communcatons between a UE and ts Avatar, the UE s Avatar can be placed n the cloudlet whch has lower E2E delay to the UE s BS. However, changng the placement of the UE s Avatar nvolves lve Avatar mgraton whch would degrade the performance of applcatons runnng n the Avatar. Thus, we need to desgn an optmal Avatar placement strategy to optmze the tradeoff between the mgraton gan and the mgraton cost by estmatng whether t s worth to do the lve Avatar mgraton or not. Denote f as the proft of mgratng Avatar,.e., mgraton gan mnus mgraton cost (Eq. 2 - Eq. 3): f = r c J = j=1 J + 0.5κ T mg K xt,j j=1 k=1 ( ) x t+1 2+,j κ T mg y t+1,k d j,k 0.5κ T mg K x t,j y t+1,k d j,k x t+1,j k=1 (10) ( ) x t 2,j. We assume that each UE s Avatar s homogeneous,.e., the hardware confguraton of each Avatar s the same, and the capacty of each cloudlet s lmted,.e., each cloudlet can only host a fxed number of Avatars, denoted as s j (j J ). Then, we formulate PRIMAL as follows: arg max x t+1,j s.t. I, j J, I =1 J j=1 I =1 f (11) x t+1,j = 1, (12) x t+1,j s j, (13) I, j J, x t+1,j {0,1}, (14) where the objectve s to maxmze the total proft of Avatar lve mgratons. The frst constrant mposes that every UE s Avatar should be allocated n only one cloudlet. The second constrant means that the total number of Avatars assgned to the cloudlet cannot exceed the cloudlet s capacty. Theorem 1. The PRIMAL problem s NP-hard.

11 10 g = Proof: The objectve functon of the problem can be transformed nto argmax J j=1 { 0.5κ T mg ( x t+1,j ) 2+ (κ T mg x t K,j ε k=1 y t+1,k d j,k ) x t+1,j } x t+1,j I =1 g, where. Suppose the capacty of each cloudlet s one (.e., j J, s j = 1) and the number of the Avatars s equal to the number of the cloudlets n the network (.e., I = J ), the orgnal problem can be reformulated as follows: R1 : argmax x t+1,j s.t. I, j J, I =1 J j=1 I =1 g (15) x t+1,j = 1, (16) x t+1,j = 1, (17) I, j J, x t+1,j {0,1}. (18) The problem of R1 s a quadratc assgnment problem whch s proven to be NP-hard [20]. Thus, the quadratc assgnment problem s reducble to the PRIMAL problem,.e., the PRIMAL problem s NP-hard. Lemma 2. The PRIMAL problem s a concave quadratc optmzaton problem wth bnary constrants when κ T mg > 0. Proof: The lemma can be proved by showng the Hessan matrx of the objectve functon of PRIMAL (.e., Eq. 11) s negatve defnte. Based on Lemma 2, we use the Mxed-Integer Quadratc Programmng (MIQP) tool n the CPLEX solver to fnd the heurstc soluton of PRIMAL. IV. SIMULATION RESULTS We smulate the proposed PRIMAL strategy n the cloudlet network. For comparsons, we select other two lve Avatar mgraton decson strateges,.e., the Follow me AvataR (FAR) strategy and the Statc strategy. The dea of the FAR strategy s to mnmze the E2E delay between an Avatar and ts UE by assgnng the Avatar to the avalable cloudlet (.e., the cloudlet has enough space to hold the Avatar), whch has the lowest E2E delay to ts UE s BS [5]. The

12 11 Proft 9x10 4 8x10 4 7x10 4 6x10 4 5x10 4 4x10 4 3x10 4 2x10 4 PRIMAL FAR 1x10 4 Statc Smulaton Tme RTT (ms) PRIMAL FAR Statc Smulaton Tme Fg. 3. Proft generated by dfferent strateges. Fg. 4. the smulaton. The average RTT between UEs and ther Avatars durng Mgraton Cost 1.2x x x x x x10 4 PRIMAL FAR Statc Smulaton Tme The dfference of the average proft durng the smulaton 2.5x x x x x10 4 PRIMAL-FAR PRIMAL-Statc Fg. 5. Mgraton cost ncurred by dfferent strateges. Fg. 6. The average proft dfferences among dfferent strateges by choosng dfferent values of α. Statc strategy s to avod the mgraton cost,.e., the locatons of Avatars do not change over tme after they are ntally deployed. We set up a network wth the topology that ncludes 25 cloudlet-enb combnatons (5 5) n a square area of 100 km 2. Each cloudlet connects one enb and the coverage area of each enb s a square area of 4 km 2. There are 1000 UEs, each assocated wth one Avatar, n the

13 12 Average RRT of PARA (ms) Average number of mgratons Average number of mgratons Average mgraton tme Average mgraton tme (s) Fg. 7. values of α. The average RTT ncurred by PRIMAL over dfferent Fg. 8. The average number of mgratons and the average mgraton tme ncurred by PRIMAL over dfferent values of α. network. The UE s moblty model follows the random way pont model,.e., each UE randomly selects a destnaton wthn the network and moves toward the destnaton wth the speed, whch s randomly chosen between 0 and 10 m/s. Each cloudlet has the same capacty of 50 Avatars. Meanwhle, the E2E delay between a cloudlet and a BS s estmated to be proportonal to the dstance between them,.e., d j,k = ε j,k (j J, k K), where j,k s the dstance between cloudlet j and BS k, and ε s the coeffcent that maps the dstance to the E2E delay. The resource capacty of each Avatar s homogeneous; each Avatar s confgured wth 2-core CPU, 4GB memory, and 500 Mbps bandwdth. The Google cluster data trace [21] s appled to emulate the CPU, memory and dsk I/O utlzaton of each Avatar (we select the machnes wth CPU and memory capacty of 0.5 (normalzed) n the Google cluster data trace, and calculate ther CPU, memory and dsk I/O utlzaton n each tme slot. Then, the resources of Avatars (CPU, memory and dsk I/O utlzaton tme seres) are emulated to be the same as those of the machnes). Snce the Google cluster data trace does not publsh the bandwdth resource utlzaton and memory page drtyng rate traces of the machnes, we emulate the bandwdth demand of each Avatar as a stochastc process whch follows a normal dstrbuton N(µ,σ 2) [22], [23], where µ and σ are the expectaton and the standard devaton of the bandwdth demand for Avatar. Note that the value of µ and σ 2 are dfferent among dfferent Avatars, and thus we randomly select µ [0,350Mbps] and σ 2 [0,100Mbps] for each Avatar. Furthermore,

14 13 each Avatar s memory page drtyng rate depends on dfferent types of applcatons runnng n the Avatar,.e., some memory-ntensve applcatons (e.g., n-memory data analytcs) may generate more drty memory pages as compared to the CPU-ntensve and network I/O-ntensve applcatons. In the smulaton, the memory page drtyng rate s randomly chosen between 0 and 10K pages (each memory page conssts of 32K bts) per tme slot for each Avatar. The rest of the smulaton parameters are shown n Table I. TABLE I SIMULATION PARAMETERS Parameters Value The length of each tme slot 5 mns The amount of bandwdth for dong mgraton, R 200 Mbps The mgraton mpact factor, w net 0.8 [12] The mgraton mpact factor, w men 0.6 [12] The mgraton mpact factor, w dsk 0.4 [12] The mgraton mpact factor, w cpu 0.1 [12] Intally, each Avatar s deployed n the avalable cloudlet, whch s the closest to ts UE. Frst, we set up the penalty coeffcent α = 5 and run the smulaton. Fg. 3 shows the proft trace by applyng three dfferent Avatar placement strateges. PRIMAL acheves the hghest proft as compared to the other two strateges ndcatng that PRIMAL can choose the valuable mgratons (.e., f > 0) to maxmze the proft. In order to demonstrate the beneft for maxmzng the proft, we further test the average Round Trp Tme (RTT) n terms of the E2E delay between UEs and ther Avatars, as shown n Fg. 4, PRIMAL and FAR yeld the smlar average RTT, whch s much lower than that of Statc because Statc does not dynamcally adjust Avatars placement even f the E2E delays between UEs and ther Avatars are unbearable. On the other hand, as shown n Fg. 5, the mgraton cost of PRIMAL s much less than that of FAR, and thus PRIMAL acheves hgher proft than FAR. We further test the average number of mgratons and the average mgraton tme as shown n Table II. Obvously, PRIMAL reduces the average number of the mgratons as well as the average mgraton tme, ndcatng that PRIMAL avods some

15 14 mgratons wth long mgraton tme. In other words, PRIMAL selectvely mgrates Avatars that mprove ther RTT tme (n terms of the mgraton gan) sgnfcantly but consume less mgraton tme (n terms of the mgraton cost). TABLE II SIMULATION RESULTS Strateges Average number of mgratons Average mgraton tme PRIMAL mgratons/slot 59.7 seconds FAR mgratons/slot 67.4 seconds Second, we try to analyze the performance of PRIMAL by choosng dfferent values of α. Fg. 6 shows the dfferences of the average profts between PRIMAL and FAR as well as between PRIMAL and Statc durng the smulaton by choosng dfferent vaules of α. When α = 0 (.e., there s no cost for dong lve Avatar mgraton), PRIMAL performs exactly the same as FAR (.e., the average proft dfference s zero) as both try to mnmze the RTT only. However, as the value of α ncreases, the mgraton cost ncreases and PRIMAL enables less mgratons to maxmze the proft, thus ncreasng the average proft gap between PRIMAL and FAR. On the other hand, as the value of α ncreases, the average proft gap between PRIMAL and Statc s decreasng snce more Avatars reman statc to avod the mgraton cost. We beleve the performance of PRIMAL and Statc s the same as α +. We further test the trend of the average RTT, the average number of mgratons and the average mgraton tme for runnng PRIMAL as the value of α vares. As shown n Fg. 7 and Fg. 8, when the value of α s small, PRIMAL trggers more mgratons to mprove the RTT even f the mgratons consume more tme. However, as α ncreases, the cost for dong mgraton ncreases and PRIMAL avods more worthless mgratons (those that mprove the RTT a lttle bt at the expense of longer mgraton tme). Therefore, there are tradeoffs between the average RTT and the average number of mgratons, and between the average RTT and the average mgraton tme,.e., n order to reduce the average RTT, more mgratons are trggered and more mgraton tme s consumed. Changng the value of α can adjust these tradeoffs.

16 15 V. RELATED WORK Varous VM placement strateges have been proposed for the resource management n data centers. Wood et al. [24] proposed Sandpper to detect hotspots and mtgate them by mgratng the VMs to lghtly loaded servers. In addton to elmnate the hotspots by VM mgratons, Zhen et al. [25] tred to detect overprovsoned servers (.e., the servers resource utlzaton s lower than a predefned threshold) and mgrate the VMs n the overprovsoned servers to sutable servers as much as possble so that the overprovsoned servers can be shut down to save the energy. Pao and Yan [26] consdered that VMs and ther data may be located at dfferent physcal servers n the cloud, and thus proposed a vrtual machne placement strategy to mnmze the data access tme,.e., placng VMs close to ther data so that the access tme s mnmzed. Shrvastava et al. [27] proposed the VM placement strategy to place the dependent VMs (.e., the VMs wth heavy nteracton among them) close to each other so that the network traffc can be reduced. Rather than only consderng the gan of VM placement by mgratng VMs to sutable servers, many studes argued that the cost of VM mgraton nvolved n the VM placement cannot be neglected when the resource management s appled. Verma et al. [28] proposed the VM placement strategy to mnmze the total power whle takng the mgraton cost nto account. The mgraton cost s depcted as the throughput of the mgraton. Hossan et al. [29] also tred to mnmze the total energy consumpton by utlzng the VM placement, but they modeled the mgraton cost as the mgraton energy consumpton at the destnaton and source servers. Our prevous work [5] tred to maxmze the green energy utlzaton of the cloudlets (each cloudlet s powered by both on-grd and green energy) n the network by utlzng the Avatar mgratons to adjust the energy demands among cloudlets. In ths paper, we try to optmze the Avatars placement by maxmzng the proft of Avatar mgratons n terms of optmzng the tradeoff between the mgraton gan and the mgraton cost. To best of our knowledge, none of the prevous work consdered reducng the E2E delay between a user and ts VM as the gan of VM mgratons, and reducng the E2E s very mportant n the proposed cloudlet network (the emergng network archtecture) snce t can substantally facltate communcatons between a UE and ts Avatar n meetng the QoS of MCC applcatons and provsonng bg moble data analyss.

17 16 VI. CONCLUSION In ths paper, we have proposed the cloudlet network archtecture to reduce the E2E delay between a UE and ts Avatar so as to meet the QoS of MCC applcatons and to provson bg moble data analyss. However, UEs are movng n the network, and so the E2E may become worse f the UE s far away from ts Avatar. In order to mantan the low E2E delay, the lve Avatar mgraton s trggered to adjust the locaton of the UE s Avatar. However, the mgraton process consumes extra resources of the Avatar that may degrade the performance of applcatons runnng n the Avatar. Therefore, we have proposed PRIMAL to maxmze the proft of the Avatar mgraton n terms of optmzng the tradeoff between the gan and the cost of the Avatar mgraton. We have also demonstrated that PRIMAL acheves hghest proft as compared to the other two Avatar placement strateges,.e., FAR (whch tres to mnmze the E2E delay by neglectng the mgraton cost) and Statc (whch tres to mnmze the mgraton cost wthout consderng the E2E delay). REFERENCES [1] X. Sun and N. Ansar, Energy-optmzed bandwdth allocaton strategy for moble cloud computng n LTE networks, n IEEE Wreless Communcatons and Networkng Conference (WCNC), New Orleans, LA, Mar. 9-12, 2015, pp [2] S. Mahadev, P. Bahl, R. Caceres, and N. Daves, The Case for VM-Based Cloudlets n Moble Computng, IEEE Pervasve Computng, vol. 8, no. 4, pp , Oct. Dec [3] C. Borcea, et al., Avatar: Moble Dstrbuted Computng n the Cloud, n 3rd IEEE Internatonal Conference on Moble Cloud Computng, Servces, and Engneerng (MobleCloud 15), San Francsco, CA, Mar. 30-Apr. 3, 2015, pp [4] A. Basta, et al., A Vrtual SDN-Enabled LTE EPC Archtecture: A Case Study for S-/P-Gateways Functons, n 2013 IEEE SDN for Future Networks and Servces (SDN4FNS), Trento, Italy, Nov , 2013, pp [5] X. Sun, N. Ansar, and Q. Fan, Green Energy Aware Avatar Mgraton Strategy n Green Cloudlet Networks, n 7th IEEE Internatonal Conference on Cloud Computng Technology and Scence (Cloudcom)), Vancouver, Canada, Nov. 30 Dec. 3, 2015, accepted. [6] M. Musoles, Bg Moble Data Mnng: Good or Evl?, IEEE Internet Computng, vol. 18, no. 1, pp , Jan. Feb [7] Y. Zhang and N. Ansar, On Archtecture Desgn, Congeston Notfcaton, TCP Incast and Power Consumpton n Data Centers, IEEE Communcatons Surveys and Tutorals, vol. 15, no. 1, pp , Frst Quarter, [8] J. Dean and S. Ghemawat, MapReduce: smplfed data processng on large clusters, Communcatons of the ACM, vol. 51, no. 1, pp , [9] M. Isard, et al., Dryad: dstrbuted data-parallel programs from sequental buldng blocks, ACM SIGOPS Operatng Systems Revew, vol. 41, no. 3, pp , [10] Apache storm. [Onlne]. Avalable:

18 17 [11] V. Mann, A. Vshno, A. Iyer, and P. Bhattacharya, Vmpatrol: Dynamc and automated qos for vrtual machne mgratons, n Proceedngs of the 8th Internatonal Conference on Network and Servce Management, Las Vegas, NV, Oct , 2012, pp [12] A. Anand, J.Lakshm, and S.K. Nandy, Vrtual Machne Placement Optmzaton Supportng Performance SLAs, n 2013 IEEE 5th Internatonal Conference on Cloud Computng Technology and Scence (CloudCom), Brstol, UK, Dec. 2 5, 2013, vol. 1, pp [13] L. Hakun, H. Jn, C.Z. Xu, and X. Lao, Performance and energy modelng for lve mgraton of vrtual machnes, Cluster computng, vol. 16, no. 2 pp , [14] N.L.M. Adrchem, C. Doerr, and F. Kupers, Opennetmon: Network montorng n openflow software-defned networks, n 2014 IEEE Network Operatons and Management Symposum (NOMS), Krakow, Poland, May , pp [15] C. Yu, et al., Software-Defned Latency Montorng n Data Center Networks, n Passve and Actve Measurement, vol.8995, pp , Mar., [16] VMware vmoton: Lve mgraton of vrtual machnes. [Onlne]. Avalable: [17] C. Clark, et al., Lve mgraton of vrtual machnes, n Proceedngs of the 2nd conference on Symposum on Networked Systems Desgn & Implementaton, Boston, MA, May. 2 4, 2005, vol. 2, pp [18] A. Strunk, A lghtweght model for estmatng energy cost of lve mgraton of vrtual machnes, n 2013 IEEE Sxth Internatonal Conference on Cloud Computng (CLOUD), Santa Clara Marrott, CA, Jun. 27 Jul. 2, 2013, pp [19] V. Mann, et al., Remedy: Network-aware steady state VM management for data centers, n NETWORKING, Prague, Czech Republc, May , 2012, pp [20] E.M. Loola, et al., A survey for the quadratc assgnment problem, European Journal of Operatonal Research, vol. 176, no. 2, pp , [21] Google Cluster Data. [Onlne]. Avalable: 2.md. [22] H. Jn, D. Pan, J. Xu, and N. Pssnou, Effcent VM placement wth multple determnstc and stochastc resources n data centers, n 2012 IEEE Global Communcatons Conference (GLOBECOM), Anahem, CA, Dec. 3 7, 2012, pp [23] M. Wang, X. Meng, and L. Zhang, Consoldatng vrtual machnes wth dynamc bandwdth demand n data centers, n 2011 Proceedngs IEEE INFOCOM, ShangHa, Chna, Apr , pp [24] T. Wood, P. Shenoy, A. Venkataraman, and M. Yousf, Sandpper: Black-box and gray-box resource management for vrtual machnes, Computer Networks, vol. 53, no. 17, pp , [25] X. Zhen, W. Song, and Q Chen, Dynamc resource allocaton usng vrtual machnes for cloud computng envronment, IEEE Transactons on Parallel and Dstrbuted Systems, vol. 24, no. 6, pp , [26] J.T. Pao and J. Yan, A network-aware vrtual machne placement and mgraton approach n cloud computng, n IEEE 9th Internatonal Conference on Grd and Cooperatve Computng (GCC), Nanjng, Chna, Nov. 1 5, 2010, pp [27] V. Shrvastava, et al., Applcaton-aware vrtual machne mgraton n data centers, n 2011 Proceedngs IEEE INFOCOM, Shangha, Chna, Apr , 2011, pp [28] A. Verma, P. Ahuja, and A. Neog, Mapper: power and mgraton cost aware applcaton placement n vrtualzed systems, Mddleware, vol. 5346, pp , [29] M.M. Hossan, J.C. Huang, and H.H.S. Lee, Mgraton energy-aware workload consoldaton n enterprse clouds, n 2012 IEEE 4th Internatonal Conference on Cloud Computng Technology and Scence (CloudCom), Tape, Tawan, Dec. 3 6, 2012, pp