FMW Automatic install using cloning

Transcription

1 FMW Automatic install using cloning

2 About me Pascal Brand Consultant Middleware Technology Leader FMW Automatic Install using cloning Page 2

3 Who we are Experts At Your Service Over 50 specialists in IT infrastructure Certified, experienced, passionate Based In Switzerland 100% self-financed Swiss company Over CHF8 mio. Turnover Leading In Infrastructure Services More than 150 customers in CH, D & F Over 50 SLAs dbi FlexService contracted FMW Automatic Install using cloning Page 3

4 Agenda Demonstration (start) 1.Introduction 2.Use Cases 3.Study case 4.Demonstration 5.Conclusion dbi services Page 4

5 Demonstration Fusion Middleware ADF Cloning Architecture Fusion Middleware WebLogic Domain with one cluster running an ADF application Fronted HTTP Server Oracle Database with Metadata repository Ansible project playbooks Run against the source > Create the archives for the Middleware Software and the WebLogic Domain Run against the target > Create the user and user profile > Install the JDK > Install the DMK WebLogic > Paste the Middleware Software > Create the Cloned WebLogic Domain > Starts the domain Start it now because it takes about 30 minutes Page 5

6 Demonstration 1 Demonstration FMW Automatic Install using cloning Page 6

7 Introduction Challenge and solutions General concepts Cloning tools Cloning steps Ansible introduction FMW Automatic Install using cloning Page 7

8 Introduction Challenge and solutions The Challenge We have to setup and configure a huge number of environments Several customers > Case 1: Documentum Middleware > WebLogic Server with client applications deployed (D2, D2Config, DA ) > Case 2: Fusion middleware ADF application > Case 3: Fusion Middleware Reports & Forms Installation & Configuration for Fusion Middleware ~2 days per system The Ansible Solutions Automatic installation, patching and configuration scripts Automatic Cloning Page 8

9 Introduction General Concepts The Cloning procedure Moving Oracle Fusion Middleware components to minimizes the amount of work that would otherwise be required to reapply all >Patches >Configuration changes >Customizations Some examples of where Cloning can provide key benefits To copy a freshly installed system to create a test or development environments To diagnose production issues without impacting production To preserve a copy of a system and refresh periodically from it after some development or QA use To distribute one copy to multiple users so all can have the same setup Page 9

10 Introduction Cloning Tools Copy the binaries Copy the Configuration > WebLogic Domain > For Fusion Middleware > WebLogic Domain + system components Page 10

11 Introduction Cloning tools Tool copybinary pastebinary copyconfig pasteconfig extractmoveplan Usage Script to copy the software (binaries) of the source Middleware home. Script to paste the software (binaries) on the target Middleware home. Creates a configuration archive file that contains a snapshot of the configuration of an Oracle WebLogic Server domain (Java Component) or Instance (System Component) in source Fusion Middleware. Extracts the files from the archive (jar) file and uses the information in the move plan to modify the configuration on the target. Extracts configuration information from the archive into a move plan. Page 11

12 Introduction Cloning Steps Steps run on the source copybinary copyconfig extractmoveplan Page 12

13 Introduction Cloning Steps Steps run on the target Install JDK pastbinary Create repository and import custom schemas pastconfig Page 13

14 Introduction Cloning Steps Clone the Middleware configuration Use copyconfig.sh to get a image jar file of the WebLogic domains > Uses the cloningclient.jar provided in $MV_HOME/oracle_common/jlib Use extractmoveplan.sh to get the XML move plan file and > Adapt Data Sources, Machines and ports > Adapt passwords: administrator, repository schemas (password files) Copy the domain jar and the plan to your target Use pasteconfig.sh & moveplan.xml to create your domain configuration on the target > The pasteconfig script is performed only on the Administration Server domain directory. Use pack and unpack if > The managed servers are not in the same directory structure > The domain includes WebLogic Cluster deployed several machines Page 14

15 Introduction Ansible What is Ansible? Ansible is a radically simple IT automation engine Designed for multi-tier deployments since day one uses SSH, with no agents or software installed on target systems. Further Reading > Ansible: Up and Running, Lorin Hochstein > Print ISBN: > Ebook ISBN: Find Ansible code > on Ansible Galaxy > and GitHub > Main repo, Core modules, Extra modules Page 15

16 Introduction Cloning Steps Ansible Orchestration Ansible: Up and Running, Lorin Hochstein Page 16

17 Use cases Documentum Middleware Fusion Middleware ADF Application Fusion Middleware Reports & Forms FMW Automatic Install using cloning Page 17

18 Use Cases Documentum Middleware Clone the Middleware software > WebLogic software Clone the WebLogic domain configuration > 2 domains with 4 managed servers > No metadata repository > Application configuration done through the application war file deployment Page 18

19 Use Cases Fusion Middleware ADF Application Clone the Middleware software > Fusion Middleware Infrastructure software > Web Tier HTTP server Clone the WebLogic domain configuration > Simple domain with 1 managed servers > HTTP Server System Component > Metadata repository (JDBC data sources) > Application schemas Page 19

20 Use Cases Fusion Middleware Reports & Forms Clone the Middleware software > Fusion Middleware Infrastructure software > Reports & Forms Software > Web Tier HTTP server Clone the WebLogic domain configuration > Simple domain with 2 managed servers > Reports server, Forms server and HTTP Server system components > DB Metadata repository (JDBC Data Sources) Page 20

21 Study case Fusion Middleware ADF Domain Cloning Ansible playbooks FMW Automatic Install using cloning Page 21

22 Study case Fusion Middleware ADF Domain Cloning Architecture Fusion Middleware WebLogic Domain with one cluster configured to host ADF application Fronted HTTP Server with mod_wl_ohs plugin Oracle Database with Metadata repository Ansible project playbook fusion-infra-clone-source > Create the archive for the Middleware Software, the WebLogic Domain and the move plan fusion-infra-clone-target > Check Unix packages installed and install missing ones > Create the user and user profile > Install the JDK > Install the DMK WebLogic (dbi management kit) > Paste the Middleware Software > Create the Cloned WebLogic Domain > Starts the domain Page 22

23 Study case Ansible playbooks fusion-infra-clone-source - name: Ansible Playbook for Fusion Middleware 12C cloning - source hosts: weblogic-servers-source sudo: True vars_files: # Encrypted file for server access - servergroups.yml # User defined variables for infrastructure - infra-vars.yml # Encrypted file for server access - secrets.yml roles: - role: fmw-domain-clone-source become: yes become_user: '{{ oracle_user }} become_method: su Page 23

24 Study case Ansible playbooks fusion-infra-clone-source Software # ==> Copy create cloned source Middleware script - name: copy create cloned source Middleware script template: src=copymiddleware.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 when: create_middleware_source_clone tags: - create-middleware_clone-archive # ==> Execute create clone source Middleware script - name: Execute create clone source Middleware script shell: "{{ installation_folder }}/copymiddleware.sh" when: create_middleware_source_clone tags: - create-middleware_clone-archive # ==> fetch middleware clone binary image from target - name: fetch middleware clone binary image from target fetch: src={{ installation_folder }}/{{ wls_infra_archive }} dest={{ role_path }}/../shared_files/{{ wls_infra_archive }} flat=yes Page 24

25 Study case Ansible playbooks fusion-infra-clone-source Cloning scripts > Copy Binaries (copymiddleware.sh template) {{ oracle_home }}/oracle_common/bin/copybinary.sh -javahome {{ java_home }} \ -archivelocation {{ installation_folder }}/{{ wls_infra_archive }} \ -sourcemwhomeloc {{ oracle_home }} \ -logdirloc {{ installation_folder }}/logs \ -invptrloc {{ oracle_home }}/orainst.loc Page 25

26 Study case Ansible playbooks fusion-infra-clone-source Config: Password file creation # ==> Copy java classes - name: Copy MyObfuscatepassword java class copy: src=myobfuscatepassword.class dest={{ installation_folder }} # ==> Copy obfuscatepassowrd script - name: Copy obfuscatepassowrd script template: src=obfuscatepassword.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 # ==> Execute obfuscatepassword.sh to create the password file - name: Execute obfuscatepassword.sh Server script shell: "{{ installation_folder }}/obfuscatepassword.sh" Page 26

27 Study case Ansible playbooks fusion-infra-clone-source Cloning scripts > Create Password file (obfuscatepassword.sh template) {{ java_home }}/bin/java -cp {{ installation_folder }}:/app/weblogic/product/middleware/oracle_common/jlib/obfuscatepassword.jar:. MyObfuscatepassword {{ weblogic_admin_pass }} {{ installation_folder }}/source_cloning.pwd Page 27

28 Study case Ansible playbooks fusion-infra-clone-source Config: Domain jar file # ==> Copy create cloned source Domain script - name: copy create cloned source Domain script template: src=copydomain.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 when: create_domain_source_clone tags: - create-weblogic-domain-clone-archive # ==> Execute create clone domain script - name: Execute create clone domain script shell: "{{ installation_folder }}/copydomain.sh" when: create_domain_source_clone tags: - create-weblogic-domain-clone-archive # ==> fetch clone domain image from target - name: fetch clone domain image from target fetch: src={{ installation_folder }}/{{ wls_domain_archive }} dest={{ role_path }}/../shared_files/{{ wls_domain_archive}} flat=yes Page 28

29 Study case Ansible playbooks fusion-infra-clone-source Cloning scripts > Copy configuration (copydomain.sh template) {{ oracle_home }}/oracle_common/bin/copyconfig.sh -javahome {{ java_home }} \ -archiveloc {{ installation_folder }}//{{ wls_domain_archive }} \ -logdirloc {{ installation_folder }}//logs \ -sourcedomainloc {{domain_loc }} \ -sourcemwhomeloc {{ oracle_home }} -domainhostname {{wls_host_source_ipaddr }} \ -domainportnum {{ admin_listen_port}} \ -domainadminusername {{ weblogic_admin }} \ -domainadminpasswordfile {{ installation_folder }}/source_cloning.pwd FMW Automatic Install using cloning Page 29

30 Study case Ansible playbooks fusion-infra-clone-source Config: extract move plan # ==> Copy create cloned domain move plan - name: copy create cloned domain move plan template: src=createmoveplan.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 when: create_domain_source_clone tags: - create-weblogic-domain-move-plan # ==> Execute create cloned domain move plan - name: Execute create cloned domain move plan shell: "{{ installation_folder }}/createmoveplan.sh" when: create_domain_source_clone tags: - create-weblogic-domain-move-plan # ==> fetch clone domain move plan from target - name: fetch clone domain move plan from target fetch: src={{ installation_folder }}/plan/moveplan.xml dest={{ role_path }}/../shared_files/moveplan.xml flat=yes Page 30

31 Study case Ansible playbooks fusion-infra-clone-source Cloning scripts > Create move plan (createmoveplan.sh template) {{ oracle_home }}/oracle_common/bin/extractmoveplan.sh -javahome {{ java_home }} \ -archiveloc {{ installation_folder }}/{{ wls_infra_domain_clone }} \ -logdirloc {{ installation_folder }}/logs \ -plandirloc {{ installation_folder }}/plan Page 31

32 Study case Ansible playbooks fusion-infra-clone-target (1) - name: Ansible Playbook for Fusion Middleware 12C cloning Target hosts: weblogic-servers sudo: True vars_files: # Encrypted file for server access - servergroups.yml # User defined variables for infrastructure - infra-vars.yml # Encrypted file for server access - secrets.yml roles: - role: wls-linux - role: jdk-install become: yes become_user: '{{ oracle_user }}' become_method: su Page 32

33 Study case Ansible playbooks fusion-infra-clone-target (2) - role: dmk-install become: yes become_user: '{{ oracle_user }}' become_method: su - role: fmw-infra-clone become: yes become_user: '{{ oracle_user }}' become_method: su - role: fmw-domain-clone become: yes become_user: '{{ oracle_user }}' become_method: su - role: fmw-domain-startup become: yes become_user: '{{ oracle_user }}' become_method: su Page 33

34 Study case Ansible playbooks fmw-infra-clone Copy the cloningclient.jar and generated WLS.jar # ==> Copy Fusion Middleware client cloning software (cloningclient.jar) - name: Copy Fusion Middleware client cloning software copy: src={{ wls_infra_domain_cloning_software }} dest={{ installation_folder }} when: create_middleware_home # ==> Copy Fusion Middleware Infrastructure cloning software - name: Copy Fusion Middleware Infrastructure Installer copy: src={{ role_path }}/../shared_files/{{ wls_infra_archive }} dest={{ installation_folder }} when: create_middleware_home Page 34

35 Study case Ansible playbooks fmw-infra-clone Copy the pastebinary.sh and execute it # ==> copy create middleware clone binary script on target - name: copy create middleware clone binary script copy: src=pastebinary.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 # ==> copy create middleware clone wrapper script on target - name: copy create middleware clone wrapper script template: src=createclonemiddleware.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 when: create_middleware_home tags: - middleware # ==> execute create clone Middleware script - name: execute create clone Middleware script - shell: "{{ installation_folder }}/createclonemiddleware.sh" when: create_middleware_home tags: - middleware args: creates: "{{ mw_home }}/Middleware/oraInst.loc" Page 35

36 Study case Ansible playbooks fmw-infra-clone Cloning scripts > Create Middleware (createclonemiddleware.sh template) set LANG=en_US.UTF8 {{ installation_folder }}/pastebinary.sh -javahome {{ java_home }} \ -archiveloc {{ local_installation_folder }}/{{ wls_infra_archive }} \ -targetmwhomeloc {{ oracle_home }} \ -invptrloc {{ installation_folder }}/orainst.loc Page 36

37 Study case Ansible playbooks fmw-domain-clone Create repository # ==> Create Repository in Database - name: password response file for repository creation template: src=passwords.txt dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} when: create_repo_schemas tags: - repo # ==> copy create repository script - name: copy create repository script template: src=create_repo.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 when: create_repo_schemas tags: - repo # ==> execute create repository script - name: execute create repository scrip shell: "{{ installation_folder }}/createrepo.sh" when: create_repo_schemas tags: - repo Page 37

38 Study case Ansible playbooks fmw-domain-clone Cloning scripts > Create Repository (createrepo.sh template) {{ mw_home }}/oracle_common/bin/rcu \ -silent \ -createrepository \ -databasetype ORACLE \ -connectstring {{ dbserver_name }}:{{ dbserver_port }}:{{ dbserver_service }} \ -dbuser sys \ -dbrole SYSDBA \ -schemaprefix {{ repository_prefix }} \ -usesamepasswordforallschemausers true \ -component IAU \ -component IAU_APPEND \ -component IAU_VIEWER \ -component OPSS \ -component STB \ -component MDS \ -f < {{ config_base }}/{{ domain_name }}/passwords.txt Page 38

39 Study case Ansible playbooks fmw-domain-clone Adapt move plan # ==> copy create middleware clone domain moveplan on target - name: copy create middleware domain domain moveplan copy: src={{ role_path }}/../shared_files/moveplan.xml dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} # ==> replace keywords in Domain move plan - name: replace keywords in Domain move plan replace: dest={{ installation_folder }}/plan//moveplan.xml regexp={{ wls_host_source }} replace={{ wls_host }} backup=no # ==> replace password file keywords in Domain move plan - name: replace password file keywords in Domain move plan replace: dest={{ installation_folder }}/plan/moveplan.xml regexp={{ wl_password_file_regex }} replace={{ wl_password_file_value }} backup=no Page 39

40 Study case Ansible playbooks fmw-domain-clone Adapt move plan: JDBC example <configproperty id="datasource1"> <configproperty> <name>url</name> <itemmetadata> <datatype>string</datatype> <scope>read_write</scope> </itemmetadata> </configproperty> <configproperty> <name>password File</name> <value>/app/weblogic/install/cloning.pwd</value> <itemmetadata> <datatype>string</datatype> <password>true</password> <scope>read_write</scope> </itemmetadata> </configproperty> </configproperty> Page 40

41 Study case Ansible playbooks fmw-domain-clone Create WebLogic domain # ==> copy create middleware clone domain archive on target - name: copy create middleware domain domain archive copy: src={{ role_path }}/../shared_files/{{ wls_domain_archive }} dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} # ==> Copy the Create domain script - name: copy create cloned domain script template: src=pastedomain.sh dest={{ installation_folder }} owner={{ oracle_user }} group={{ oracle_group }} mode=0755 tags: - create-config # ==> Execute create clone domain script - name: Execute create clone domain script shell: "{{ installation_folder }}/pastedomain.sh" tags: - create-config Page 41

42 Study case Ansible playbooks fmw-domain-clone Cloning scripts > Run pasteconfig (pastedomain.sh template) export LANG=en_US.UTF8 {{ oracle_home }}/oracle_common/bin/pasteconfig.sh -javahome {{ java_home }} \ -archiveloc {{ installation_folder }}/{{ wls_domain_archive }} \ -moveplanloc {{ installation_folder }}/moveplan.xml \ -tdl {{ domains_base }}/adf_domain -tmw {{ oracle_home }} \ -logdirloc {{ installation_folder }}/logs \ -domainadminpasswordfile {{ installation_folder }}/cloning.pwd Page 42

43 Study case Ansible playbooks Archives creation > In one run we create the Binaries and domain archives ansible-playbook -i inventories/test fusion-infra-clone-source.yml Clone environment creation > In one run we create the Middleware home and the WebLogic Domain ansible-playbook -i inventories/test fusion-infra-clone-target.yml Page 43

44 Demonstration 1 Demonstration FMW Automatic Install using cloning Page 44

45 Demonstration Dive into Demo Check what we have got Ansible tasks execution traces Navigate in the cloned WebLogic Domain > Administration Console Show the ADF Application up and running Page 45

46 Conclusion Advantages vs Drawbacks Ansible FMW Cloning vs Ansible FMW New Install FMW Automatic Install using cloning Page 46

47 Conclusion Advantages vs Drawbacks Executed on running source environment: No downtime Patches are included Full configuration cloned Customization included Existing configuration files or libraries outside Middleware Home are not copied Difficulties to recover from falling situations Can corrupt the Oracle inventory Depreciated in FMW Oracle Note & Page 47

48 Conclusion Ansible FMW Cloning vs Ansible FMW New Install Ansible FMW Cloning For each use case a new master is needed Middleware archive can be huge > Ansible bug on copying or fetching huge file Recover from Domain cloning failure > Drop the domain directory > Restart Domain creation script Middleware cloning crash might corrupt the inventory Applications deployments included > Metadata too Ansible FMW New Install Domain creation based on builder template Easier to manage new versions or new patch sets More development Recover from failure > Drop the domain directory > Ansible reruns the failed steps Needs manual Applications Deployments Page 48

49 Conclusion Fusion Middleware WebLogic Domain Cloning Today Cloning procedure used for FMW and FMW Installation Time win Less Installation Errors Less configuration scripts development Future: FMW and upper Cloning procedure changed The MovePlan doesn t exist anymore Needs a lot of configuration scripts development Starting from FMW , we decided to not use Cloning anymore Use of Ansible full installation project Page 49

50 Basel Delémont Zürich Nyon Any questions? Please do ask! We would love to boost your IT-Infrastructure How about you? FMW Automatic Install using cloning Page 50

51 Let s meet at booth 242 And use CLONING