Research on Human Sensory Architecture for Cyber Physical Systems

Transcription

1 2692 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER 2013 Research on Human Sensory Architecture for Cyber Physical Systems Zhejun Kuang, *Liang Hu, and Chen Zhang Department of Computer Science and Technology, Jilin University, Changchun , P. R. China *Corresponding author Abstract CPS is complex distributed systems, which contain computing, communications, and control. CPS is a product of the combination of physical world and the cyber world. The cyber world needs a lot of physical equipment to deal with perception and communication, then collect and transfer the information in the real environment, and by computation to forecast what might happen in future real environment, at last through the control strategy to achieve the optimal solution. In short, cyber physical system is the complex systems combination with computation system, sensory system and control system. Cyber physical system through more extensive connection, the physical world more thorough cognition, more effectively control the physical world, make the information world and the physical world closer integration, realize coordination awareness and control of the physical world. The paper through the analysis of the human perception system, build a cyberphysical fusion system based on human perception architecture. Index Terms Cyber Physical Systems; Human Sensory; Architecture; Artificial Intelligence I. INTRODUCTION The CPS requires a large number of dispersed sensors to collect information and high-performance computing to control the physical unit to execute tasks. CPS in a network environment, there are a lot of potential uncertainties in the decision-making process. However, task should be finished in limited time, otherwise will lead to a very serious problem. Therefore, it is necessary to predict the influence of the result of the decision within the time and the physical environment according to the uncertainty factors. CPS creates plasticity dependent structures and distributed cyber physical control on the basis of the time limit. The CPS is a cyclical process of the world to interact with the physical world. Being in the physical world, people work through mechanical operations, automation to complete tasks and to expand the capacity of people. CPS is able to combine the characteristics of information world and the physical world to build a stable coalition system, and predict the cyber physical system overhead and performance at the same time. CPS is diversified and complex distributed systems composed of man, machine and material. Systems usually perceive the environment by the physical unit, and then the human rise demands in this environment. The computation unit according to the needs of the person changes the corresponding environment by computation processing. In this process, the person is wanted initiator. The physical unit is an interactive bridge of the digital world and the real environment. What CPS system emphasizes is control, the effectiveness of control decision-making is done by people. With the improvement of the intelligent on CPS system, the decision-making suppliers gradually shifted from the people to the computing unit. Moreover, the physical unit is not only the purely sensing the environment, but also sensing the information of people at the same time. Through a series of information by sensing the people, take the initiative to understand the requirements and then process the formulation and implementation of strategy, rather than passively accept the people's needs and then make control decisions. Under different environments, people have different demands, environment; however, also affect the decisionmaking. CPS system needs to perceive the people and environment from the perspective of the people, which make a reasonable decision. In this paper, through the analysis of human perception, according to characteristics of CPS, we build a people-centered CPS architecture. Figure 1. A cyber-physical system prototype architecture [7] doi: /jnw

2 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER Figure 2. A control network system architecture of CPS [6] The rest of the paper is organized as follows: In Section 2, recent CPS research, prototype and architecture are reviewed. The relationship between human sensory and CPS are described in Section 3. In Section 4, we propose a human sensory architecture for CPS. We conclude the paper and point out future work in Section 5. II. RELATION WORK Cyber physical system (CPS) is a popular field of cutting-edge research. In 2007, in the U.S. Presidential Science and Technology Advisory Committee report, CPS was listed as the highest priority funded status of the federal research funds, attracting wide attention. In addition, CPS attached great importance to the U.S. government, academia and industry, so has put a lot of manpower and material resources, engaging in the CPS fields of basic theory and applied research. The concept of CPS is not unified as a clear definition. There are several theories, which are more recognized: (1) Edward Lee thinks that CPS is an integrated system of computing power and physical processes [8]. This system utilizes embedded computer and network to monitor the physical process, set up a feedback loop; computation affects physical process and physical process impact's computation through the feedback loop; (2) CPS is an integrated system of computing, communication, storage capacity, monitoring, controlling capability of the physical and engineering system [2], which can be manipulated by safety, reliable, effective, and Real-time method; (3) Insup Lee believes that CPS is a system which integrated by computing, communications, and physical processes, embedded computer real-time monitors and controls the physical process [9]. There are three common points of these theories: 1) interconnection by network between the computation system and the physical system; 2) monitoring capabilities; 3) real-time performance. Ying Tan, Steve Goddard and Lance C. Perez proposed a CPS prototype architecture [7], viewed from the embedded systems point. This architecture prototype CPS feature: timeliness, reliability, fault tolerance, security, scalability and autonomy. Reference [6] proposed a CPS architecture which is similar to computer bus structure, very simple and not described the various functional modules. Albert Benveniste proposed a layered architecture based on postoperative rehabilitation in the medical fields [4]. Reference [1] proposed architecture with easing time arrival based on the realtime characteristics. Computer science references human perception isn't a new thing, such as video surveillance, draw lessons from eyes of the human, which makes the computer can "see" the world. Nowadays, the newest video monitoring system not only can see the world, but also be able to analysis the objects moving, action or behavior. Reference [5] proposed a real-time human tracker that detects human location and motion using cameras. Reference [3] proposed a hierarchical approach that recognizes activities, in which different image features and learning methods are used for different activities based on their characteristics. Draw lessons from ear of the human, in which makes the computer can hear the world. At the same time, people build the language voice library that computer could understand what the meaning of people speaks. Through using human neural network as an example constructs the computer neural network. Therefore, man - machine - objects in the real surroundings are inseparable. CPS is a complicated distributed control system interaction between cyber world and physical world by computation, communication and control. In the modeling, [16] proposed a Concept Lattice-based Event Model for Cyber-Physical Systems. Under this model, a CPS event is uniformly represented by three components: event type, its internal attributes, and its external attributes. The internal and external attributes together characterize the type, superotemporally properties of the event as well as the components that observe it. A set of event composition rules are defined where the CPS event composition is based on a CPS concept lattice. A real-life smart home example is used to illustrate the proposed event model. [17] present a novel context-sensitive resource explicit service model and develop the corresponding composition formalisms to help automate the composition process under real-time constraints as well as under various physical resource constraints. The approach is illustrated using an emergency response system. [18] proposed and discusses a modeling framework for embodied anticipatory behavior systems. In the real-time system, [19] developed a framework for Fault Observant and Correcting Real-Time Embedded design (Forte) that utilizes massive multi-core NoC designs to reduce overhead by up to an order of magnitude and to lower jitter in systems via utilizing message passing instead of shared memory as the means for intra-processor communication. [20] proposed a control-theoretic design methodology which permits a system designer to specify a set of hard-real-time performance modes under which the system may operate. [21] described the first implementation of a mixedcriticality scheduling framework of a multicore system which experimentally evaluate design tradeoffs that arise when seeking to isolate tasks of different criticalities and to maintain overheads commensurate with a standard RTOS. In the Application field, [22] presented a system implementing a clinical scenario where closed-loop control may reduce the possibility of human error and improve safety of the patient. [23] proposed using formal methods, self-stabilization, and (m,k)-firm scheduling to

3 2694 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER 2013 allow the safe cyber-physical operation of a medical ventilator, a life-critical reactive device to move breathable air into and out of the lungs of a patient with respiratory difficulties, with the ultimate goal of speeding-up the recovery of the patient. To sum up, the various fields of scholar research in different level of CPS. However, people have different understanding of the CPS. CPS is not a new product; it is an integration by the original traditional technology. That provides the theoretical foundation research of CPS. Nevertheless, the information inconsistency exists in different research fields. In the future, information sharing between the various fields has brought the difficulty. III. GENERAL CPS ARCHITECTURE CPS system is a complex distributed system which contains three parts such as computing, communication and control. There exist unique aspects in the CPS system and also get a common side. On the one hand, their uniqueness is reflected in different environments in the field and at the mean time environmental factors involved in the different field is not the same. However, according to the properties of the CPS such as huge amounts of data and real-time requirements, the people who design a CPS system must consider on its unique characteristics for different areas in the aspects of performance and power consumption. They have to gather diverse kinds of features information, as well as specific operation of the field behavior. On the other hand, CPS also exists the essence of commonalities, just like mass data processing, hard and soft real-time strategy and so on. Therefore, you need to understand the relationship between the Humanmachine-object, and then you can give a reasonable solution wish the combination of the environments. Figure 3. Relationship between each basic element in CPS. Looking at the CPS system in different areas of environments, it is easy to find that the CPS system consists of four basic elements, including people, computation cells, the physical unit and the environment. Human: the initiator of the needs and the advisor that feedback the views, also the service object throughout the whole systems. Environment: refers to the area of the environment. Under different circumstances, the amount of information, attributes, meaning and so on are quite different. Computation cells: all devices with computing power unit. Physical unit: the physical terminal can receive and send information, such as sensors, actuators and so on. A series of activities among the Human-machineobject is conducted in real-world environments. Due to the aspect, application environment is quite disparate in different areas. IV. HUMAN SENSE PERCEPTION In CPS system, human always plays an important role. The man is the object of the system services, demand providers, decision makers. However, the uncertainty of demand, the misuse of the system also brings a lot of challenges. System needs to collect environmental information, and human behavior information, personalized information, transform the information into useful knowledge for understanding environmental and people. The system through understanding of the requirements of people to make automation efficiently completes the task. CPS is the product of the combination of the physical world and the digital world, the communication bridge of the physical world and the digital world People play a leading role in the physical world; therefore, the systems not only need to perceive the environment, but also perceive the people. We can through the human perception system to understand how human perceive the world, so that the system in the form of people to perceive the world, closer to the people's decision-making to enhance the intelligent effect. A popular definition of artificial intelligence, is also earlier definitions of the field is by John McCarthy (John McCarthy) in 1956, Dartmouth spear meeting where the Conference) is proposed in: Artificial intelligence is to make the behavior of the machine looks like the behavior of an intelligent man [13-15]. The CPS could borrow the idea, let the system more humanity that makes the system easier to communication with human, and easier to understand people behavior. Human perception system mainly consists of the eyes, ears, nose, tongue, touch and other sensory organs and nervous system. The human perception system is usually divided into sensation and perception these two types. The sensation is that the reflection of individual properties that directly the effect on the individual sensory stimulation, include external and internal feeling. External feeling to accept an external stimulus, reflecting the sense of the characteristics of external things, such as vision, hearing, smell, taste and feel of the skin. Its receptors located on the surface. Skin sensory receptors and taste receptors known as contact receptors. External things are only direct contact with both receptors, in order to cause the feeling; visual, auditory and olfactory receptors, known as long-distance receptors, external

4 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER Figure 4. Process procedure for CPS things at a distance, through the role of the media, causing the feeling. Internal feelings, also known as the body's sleep, relative to reflect the feeling of the external environment such as vision, hearing, feeling reflects the internal state of the body and internal changes, including the use of feeling, sense of balance and visceral sensation. The perception is the procedures of that organize individual sensory information into meaningful perception, object to perception and social perception. Among the CPS system, more concerned about is physical perception, object perception is the perception of material things and external relations. Any matter or thing has spatial characteristics, time features and movement change. Therefore, the perception of the object includes the perception of space, time perception and motion perception. The spatial perception reflects the perception of the spatial characteristics of the object's shape, size, depth, orientation, etc. The Time Perception is the perception reflects continuity and sequence of the objective phenomenon. Motion perception is the perception reflects objects spatial displacement and displacement speed. Whether the space perception, time perception or motion perception are gradually formed and developed in people s life practice. All external stimulation perceived by human must first be received, stored and analyzed by the human perception system, and produce feelings and perception, and then effect on people. Sensory react to appropriate stimulation, through the perception analyzer feel and process the information, and thus form a meaningful sense of perception, then to filter, according to the subjective demand, intentionally or unintentionally, to feel those things with useful information, while ignoring other things. At this point, we can consider that the human sensory system can complete the data collection in the physical layer of the CPS system, and the formation of perception system knowledge base and the CPS system knowledge base are very similar, both of them process, analysis the collected data, and ultimately get meaningful data. V. HSP ARCHITECTURE In the early CPS system, people or physical unit (sensor) perceived the environment, gathered information, analyzed the data collected, made decision, and finally complete the execution of tasks by sending control commands to the remote execution unit. However, with the advance of the intelligence in the CPS system, information analysis and decision-makers gradually shifted from people to computing unit. People only need to perceive the environment and make the demand, and then the computing unit and physical unit deal with all the subsequent work. In order to allow the computation unit to take decisions that meet people s need, we need to understand and perceive the environment from people s perspective. Based on the CPS architecture of human perception it is divided into three levels, the computation layer, network layer and physical layer. The computation layer is the core of the CPS system, where data storage, decision-making and the formation of a knowledge base are. In other words, knowledgebase is the brain of CPS. The purpose of the knowledge base is to make the machine by the data to understand better the thinking of the people, and its role is similar to the perception, ultimately in order to assist decision making. The

5 2696 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER 2013 formation of the knowledge base, not only allows the data to fit into the system, but also improves the efficiency of decision-making. The network layer is a communication layer in the CPS system, primarily as a channel of communication exchanges, in which routing, data transmission; data forwarding, etc. are completed. The physical layer the interactive terminal between the CPS system and the physical world, the CPS system used the sensor to collect the data of the physical world, and the actuator to change the physical world environment. In the CPS, people have ultimate control over the whole system. Thus, at the same time of the perception of the physical world, CPS system also needs to perceive people by perceiving what people perceive. The physical layer of the CPS architecture based on the human perception includes interactive communication function. The communication interaction according to people s exchanges was divided into reading, listening, speaking, writing and observing; the traditional humancomputer interaction command was initiated by the way of writing, commands input through the keyboard and other external devices. The system by reading input command start to execute. However, with speaking and listening added to this behavior, it improved system more complex, but to simplify the operation of human behavior, so that the human-computer interaction is more convenient. Observation is a deeper interaction, people s behavior aimed at completing the demand, if the system can observe the behavior of the person and analyzes it to identify the needs of people, and it can play a very good supporting role on this decision classifying and prediction. And observe the system self-learning to improve a process, human language not established, mostly by observing to learn. The system can observe the timely receipt of feedback after the task is completed. For example, People will be pleased, or appear to praise it, when the task is completed better. If the task is compared unreasonably, maybe there will be an angry look. In general, interactive communication, on the one hand, for the type of information can be processed optimization, on the other hand, to improve the convenience of the humancomputer interaction, a variety of means of communication makes it easier to convey the demands to the system, capable of making the formulation of a strategy closer to the people's need. General CPS architecture basically centers on machines, through the collection of environmental information; the execution of tasks depends on the specific rules. The information needs of the machine is basically collected in accordance with established rules, and in accordance with the rules established complete the execution of tasks, by which industrial automatic control is realized. Machine-oriented strategy in industrial control can avoid misuse of the people during the task, well constrained task execution time, namely enhancing the real-time control. However, machine-oriented strategy only applies to the specific environment and specific needs, and does not apply to mutable environment. However, the CPS architecture based on human perception will understand multi-faceted information by its own knowledge base on the environment, status, tasks, and make dynamically adjustable rules. Then it will be applied to a variety of real-world environment better. Figure 5. A Human sensory architecture for CPS The CPS data may be divided into environmental, human, time, positional and historical information. The system unifies the existing rule to formulate the decisionmaking according to these five types of information. The information or the event that at the same time and place has are by the inner link, thus time and location information is the key relationship between human and environment. Historical information is in order to find the context of data information and rules that can discover a way to deal with the similar issue. Therefore, it is the simplified step to enhance the function of efficiency. Show on the Figure 4. Through the collection of data, the angle of processing and execution analyzes human sensory architecture for CPS. Data collection is basically complete by sensor. There are many types of sensor, and the information gathered is also extraordinary complexity. Due to the system architecture, the information usually separate into two types of categories which is human data and environment data. Information between human and environment has inner link and certain significance that under same time and space. Hence, make the time and space as a condition for fusion the human and environment data. After fusion information, system could make a reasonable decision by using knowledgebase, and send the command to actuators. If the result is not ideal, can be sent back to the knowledge base, adjust decisions and in the execution, until satisfied. The CPS decision-making procedure: 1. Gain the human and environment information 2. filters the imperfect information 3. Stored data to database 4. fusion the human and environment data, which base on time and space 5. make the decision by using fusion data and knowledgebase

6 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER send the command and execute by actuators 7. if the result unsatisfied, return to step 5 8. end Overall, at first CPS architecture based on human perception in the computation layer construct a knowledge base, which will analyze and understand the discrete data, enabling the machine to build its own knowledge system. The construction of the knowledge base of laid the foundation of the machine in terms of self-learning and the semantic understanding. Secondly, based on human perception, the CPS increased communication interaction, communication interaction, the communication channels between man and machine. Based on the knowledge base interactive communications in a convenient interactive way learn people s behavior to understand the needs of the people semantically. The CPS architecture based on human perception highlights an important role in the CPS system and CPS system needs to perceive, understand and serve the people. VI. CONCLUSION CPS system is a complex distributed system, which is not the neonatal product, but an integrated one from the conventional technique. This paper by human perception, propose a general CPS architecture, which is constructed relying on the human perception system, so that the CPS system is capable of perceive what people perceive, affording a good source of information for the decision making of the CPS system. CPS is a complex distributed system; semantic synthesis is essential in order to enhance performance and efficiency. The semantics synthesis of CPS needs to across heterogeneous cyber and physical levels. In different areas, the CPS system has different meaning of the data. Separation of concerns through the supporting reshaped flexible custom interface, to guide the selfadaptive components as much as possible to resolve the remaining issues. Through basic research reduce the system integration difficulties, including the integration between systems and subsystems. In applied research, under the open environment, based on protecting independent intellectual property rights, provide flexible component interconnection support for the current and future suppliers, to achieve information seamless integration of physical components. In the future, a unified language library can be constructed, which will make it more convenient for the information exchange and the sharing of resources among various areas. ACKNOWLEDGMENT This work was supported in part by the National High Technology Research and Development Program of China under Grant No. 2011AA010101, the National Natural Science Foundation of China under Grant No and , the Science and Technology Key Project of Jilin Province under Grangt No. 2011ZDGG007, the Youth Foundation of Jilin Province of China under Grant No , and the Fundamental Research Funds for the Central Universities of China under Grant NO REFERENCES [1] X. Ma, X. Tu, J. Huang, and J. He, "A cyber-physical system based framework for motor rehabilitation after stroke, presented at the Proceedings of the 1st International Conference on Wireless Technologies for Humanitarian Relief, Amritapuri, Kollam, Kerala, India, [2] J. Li, X. Jin, J. Tang, and Y. Zhang, "Target localization method based on wireless multimedia sensor network, Journal of Multimedia, Vol. 45, 2011, pp [3] C. Wu, A. H. Khalili, and H. Aghajan, "Multiview activity recognition in smart homes with spatio-temporal features, presented at the Proceedings of the Fourth ACM/IEEE International Conference on Distributed Smart Cameras, Atlanta, Georgia, [4] A. Benveniste, "Loosely time-triggered architectures for cyber-physical systems, presented at the Proceedings of the Conference on Design, Automation and Test in Europe, Dresden, Germany, [5] N. Quoc Cuong, S. Dongil, S. Dongkyoo, and K. Juhan, "Real-Time Human Tracker Based on Location and Motion Recognition of User for Smart Home, in Multimedia and Ubiquitous Engineering, MUE '09. Third International Conference on, 2009, pp [6] Y. Wang, M. C. Vuran, and S. Goddard, "Cyber-physical systems in industrial process control, SIGBED Rev., vol. 5, 2008, pp [7] Y. Tan, S. Goddard, and L. C. Pérez, "A prototype architecture for cyber-physical systems, SIGBED Rev., vol. 5, 2008, pp [8] E. A. Lee, "Cyber physical systems: Design challenges, in 11th IEEE Symposium on Object/Component/Service- Oriented Real-Time Distributed Computing, ISORC 2008, May 5, May 7, 2008, Orlando, FL, United states, 2008, pp [9] L. Insup, S. Oleg, "Medical cyber physical systems, Proceedings of the 47th Design Automation Conference, DAC '10, 2010, pp [10] W. Zhong, C. Ming-Rui, F. Yi-Fu, and F. Xing, "Lighten 3D data and its application in manufacturing industry, Journal of Theoretical and Applied Information Technology, vol. 43, 2012, pp [11] X. Xu, J. Zhao, and Y. Deng, "Integrated optimization and deployment mechanism of information resources in complex manufacturing collaborative logistics network, Journal of Theoretical and Applied Information Technology, vol. 44, 2012, pp [12] V. Violet Juli and J. Raja, "A comparative study on algorithms for mobility in wireless sensor network, Journal of Theoretical and Applied Information Technology, vol. 41, 2012, pp [13] C. Krishnaswamy, W. Erika, Gilbert, et al. Neural Network Applications in Finance: A Practical Introduction. Financial Practice and Education, 2000, (05). [14] Y. Jiang. Uncertainty in the output of artificial neural networks, IEEE International Conference on Neural Networks. New York, 2007 [15] J. A. Pecas. Integration of dispersed generation distribution networks-impact studies. IEEE Power Engineering Society Winter Meeting, New York, [16] Y. Tan, M. C. Vuran, and S. Goddard. A Concept Latticebased Event Model for Cyber-Physical Systems, Proceeding ICCPS '10 Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems, Pages 50-60, 2010 [17] J. Huang, F. Bastani, I. L. Yen, Toward a Smart Cyber- Physical Space: A Context-Sensitive Resource-Explicit

7 2698 JOURNAL OF NETWORKS, VOL. 8, NO. 11, NOVEMBER 2013 Service Model, Computer Software and Applications Conference, COMPSAC '09. 33rd Annual IEEE International, Volume: 2, pp , 2009 [18] F. P. Bonsignorio, Steps to a Cyber-Physical Model of Networked Embodied Anticipatory Behavior, Anticipatory Behavior in Adaptive Learning Systems, From Psychological Theories to Artificial Cognitive Systems, pp , 2009 [19] C. Zimmer, M. Frank, Fault Resilient Real-Time Design for NoC Architectures, Cyber-Physical Systems (ICCPS), 2012 IEEE/ACM Third International Conference on, pp75-84, 2012 [20] P. M. Hettiarachchi, N. Fisher, M. Ahmed, L. Y. Wang, S. Wang, and W. Shi, The Design and Analysis of Thermal- Resilient Hard-Real-Time Systems, Real-Time and Embedded Technology and Applications Symposium (RTAS), 2012 IEEE 18th, pp , 2012 [21] J. L. Herman, C. J. Kenna, M. S. Mollison, J. H. Anderson, and D. M. Johnson, RTOS Support for Multicore Mixed- Criticality Systems, Real-Time and Embedded Technology and Applications Symposium (RTAS), 2012 IEEE 18th, pp , 2012 [22] D. Arney, M. Pajic, J. M. Goldman, I. Lee, R. Mangharam, and O. Sokolsky Toward Patient Safety in Closed-Loop Medical Device Systems, Proceeding ICCPS '10 Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems, Pages , 2010 [23] A. M. K. Cheng, Dept. of Comput. Sci., Houston Univ., Houston, Cyber-Physical Medical and Medication Systems, Distributed Computing Systems Workshops, ICDCS '08. 28th International Conference on, pp , 2008 Zhejun Kuang received the degree in computer science and information system from Massy university of New Zealand in He is a research student of Jilin University of China. Currently, he is studying for Ph. D. in computer architecture at Jilin University of China. His interests are in cyber physical system and internet of things. Liang Hu was born in Changchun, China, on Feb He received his Ph.D. degree in computer software and theory from Jilin University of China in He is currently a professor in the Department of Computer Science and Technology, Jilin University, China. As an author or co-author, he has published more than 180 research papers, including 80 journal papers, 8 books, and has 1 National invention patent of China as well as 18 computer software copyright registration certificates of China. His research interest covers network security and distributed computing, including related theories, models, and algorithms of PKI/IBE, IDS/IPS, and grid computing. Zhang Chen, was born in 1988, master degree, focus on wireless sensor network(wsn),cyber and information security, taking part in national 863 engineering project which named system platform based on the Cyber Physical integration system