First iBook on Oracle ASM 12c Pocket Reference Guide

ASM iBook

Our very first iBook will be available in the iTunes Apps Store soon. This is our first iBook on the Apps Store. Look for more books to come in the near future.

Authored by Charles Kim and Nitin Vengurlekar

DBaaS Without Virtualization

From Oracle OpenWorld 2013 conference, numerous Oracle experts expound on how DBaaS can be achieved without virtualization options:
1. Database consolidation in RAC for those who do not want to pay for the CDB/PDB license
2. Schema consolidation without CDB/PDB for those who do not want to pay for the CDB/PDB license
3. Database consolidation with RAC with PDB
4. Consolidation (Database/Schema/PDB) without RAC (Single Instance) and Active Data Guard (Redo Replication)
5. Consolidation (Database/Schema/PDB) without RAC (Single Instance) and GoldenGate (SQL Replication)

All the Oracle experts in the private database cloud claim that the above five options will satisfy NIST definition of Cloud Computing especially with ExaData and ExaLogic.

Successfully Virtualize Business Critical Oracle Databases

Book Title:
Successfully Virtualize Business Critical Oracle Databases

VMware iBook Cover

Here’s the book Description:
Written by VMware vExperts (Charles Kim (VCP), Viscosity North America, and George Trujillo (VCI), HortonWorks) and leading experts within VMware VCI and Learning Specialist (Steve Jones) and Chief Database Architect in EMC’s Global IT organization (Darryl Smith), this book will provide critical instructions for deploying Oracle Standalone and Real Application Cluster (RAC) on VMware enterprise virtualized platforms. You will learn how to setup an Oracle ecosystem within a virtualized infrastructure for enterprise deployments. We will share industry best practices to install and configure Linux, and to deploy Oracle Grid Infrastructure and Databases in a matter of hours. Whether you are deploying a 4 node RAC cluster or deploying a single standalone database, we will lead you to the foundation which will allow you to rapidly provision database-as-a-service. We will disseminate key details on creating golden image templates from the virtual machine to the Oracle binaries and databases. You will learn from industry experts how to troubleshoot production Oracle database servers running in VMware virtual infrastructures.

Audience:
Database Admins/Architects, VMware Admins, System Admins/Architects, Project Architects
This book designed for Oracle DBAs and VMware administrators needing to learn the art of virtualizing Oracle.

VMware VMWorld 2013 Accepted Abstract

I am looking forward to heading out to Moscone Convention Center for VMWorld 2013.  This year, I am co-presenting a session on Virtualizing Mission Critical Oracle RAC with vSphere and vCenter Operations.

Session ID: VAPP5834
Session Title: Virtualizing Mission Critical Oracle RAC with vSphere and vCOPS
Track: Virtualizing Applications
Accepted presentation location: Both at San Francisco and Barcelona

Our Abstract:
“Oracle Real Application Clusters (RAC) are some of the most complex and mission critical platforms to virtualize. This detailed technical session will teach advanced deployment techniques for enterprise virtual platforms. Best practices and lessons learned from numerous enterprise projects will be shared with attendees. We will show how to fully provision advanced clusters in a matter of hours. Save days and even weeks of deploy time by attending this session. Anyone virtualizing Tier1 and Tier0 platforms will gain insights and knowledge of how to properly deploy business critical systems in VMware environments. Understanding key monitoring and performance metrics for Oracle complex systems through vCOPS will be shared with attendees. The secret sauce of customized vCOPS user interfaces for Oracle on VMware will be discussed.”

Presented by Charles Kim, Oracle ACE Director, VMware vExpert

Hard Partitioning in OracleVM

There’s two recommended ways to hard partition in OVM now … all are non-GUI and has to involve modifying the vm.cfg file:
1.  with the xm vcpu-set and xm vcpu-pin command
2.  with the ovm_vmcontrol utility with the vcpuset option
 
Technically, we can still modify the vm.cfg file manually but it is not recommended.  Once we pin the vCPUs, the entries will be reflected in the vm.cfg
 
To verify hard partitioning:
$ xenpm get-cpu-topology

RAC Add Node

I am working on a virtualization first company for one of the largest Data Warehouse projects in the world for the financial industry to rapidly clone RAC clusters and databases in matter of hours.  We can provision up to 3 or 4 node RAC clusters in less than couple of hours and then as needed add nodes to the cluster with ease.

1. On target, create /u01/app/oraInventory (empty) and owned by oracle:dba

2. On the target node, please make sure /u01/app/11.2.0 directory is created and also empty. Make sure that it is owned by oracle:dba 
3. Run the following addnode.ksh on an existing RAC node with parameters replaced as oracle
4. You will be instructed to run root.sh on target node as root

The following are the caveats: 
1. cluvfy is buggy for 11.2.0.3. It had bugs in 11.2.0.2 also. I remember we had to set IGNORE_PREADDNODE_CHECKS to Y back in 11.2.02, and it looks like we still have to. 
2. /u01/app/oraInventory has to be pre-created and owned by oracle:dba and be completely empty 
3. /u01/app/11.2.0 has to be owned by oracle:dba. The /u01/app/11.2.0/grid directory cannot exist … even as an empty directory. The addnode.sh script attempts to do a “mkdir grid” as oracle, and if it fails, it dies. 
4. It died on me twice at “crsctl start listener -n “target_node” … have to create default listener first
5. I did not use the -noCopy method … This working example will copy the Grid Home from source RAC node to the new RAC node. I don’t think it is a big deal … added about 5 minutes to the overall time (see below). 

Copying to remote nodes (Saturday, May 4, 2013 8:52:50 PM CDT)
 ………………………………………………………………………………….. 96% Done. 
Home copied to new nodes 
Saving inventory on nodes (Saturday, May 4, 2013 8:56:03 PM CDT) 
 
 
+ASM1 > cat addnode.ksh
export ORACLE_HOME=/u01/app/11.2.0/grid
export PATH=$ORACLE_HOME/bin:$PATH
cd $ORACLE_HOME/oui/bin
 
export IGNORE_PREADDNODE_CHECKS=Y
 
#./addNode.sh -silent “CLUSTER_NEW_NODES={rhel59drb}” “CLUSTER_NEW_VIRTUAL_HOSTNAMES={rhel59b-vip}” -noCopy
./addNode.sh -silent “CLUSTER_NEW_NODES={rhel59drb}” “CLUSTER_NEW_VIRTUAL_HOSTNAMES={rhel59drb-vip}” “CLUSTER_NEW_PRIVATE_NODE_NAMES={rhel59drb-priv}”
 
——————
 

rhel59dra:/u01/app/oracle/deploy_rac

+ASM1 > ./addnode.ksh
Starting Oracle Universal Installer…
 
Checking swap space: must be greater than 500 MB.   Actual 3186 MB    Passed
Oracle Universal Installer, Version 11.2.0.3.0 Production
Copyright (C) 1999, 2011, Oracle. All rights reserved.
 
 
Performing tests to see whether nodes rhel59drb are available
……………………………………………………… 100% Done.
 
.
—————————————————————————–
Cluster Node Addition Summary
Global Settings
   Source: /u01/app/11.2.0/grid
   New Nodes
Space Requirements
   New Nodes
      rhel59drb
         /: Required 6.47GB : Available 7.27GB
Installed Products
   Product Names
      Oracle Grid Infrastructure 11.2.0.3.0
      Sun JDK 1.5.0.30.03
      Installer SDK Component 11.2.0.3.0
      Oracle One-Off Patch Installer 11.2.0.1.7
      Oracle Universal Installer 11.2.0.3.0
      Oracle USM Deconfiguration 11.2.0.3.0
      Oracle Configuration Manager Deconfiguration 10.3.1.0.0
      Enterprise Manager Common Core Files 10.2.0.4.4
      Oracle DBCA Deconfiguration 11.2.0.3.0
      Oracle RAC Deconfiguration 11.2.0.3.0
      Oracle Quality of Service Management (Server) 11.2.0.3.0
      Installation Plugin Files 11.2.0.3.0
      Universal Storage Manager Files 11.2.0.3.0
      Oracle Text Required Support Files 11.2.0.3.0
      Automatic Storage Management Assistant 11.2.0.3.0
      Oracle Database 11g Multimedia Files 11.2.0.3.0
      Oracle Multimedia Java Advanced Imaging 11.2.0.3.0
      Oracle Globalization Support 11.2.0.3.0
      Oracle Multimedia Locator RDBMS Files 11.2.0.3.0
      Oracle Core Required Support Files 11.2.0.3.0
      Bali Share 1.1.18.0.0
      Oracle Database Deconfiguration 11.2.0.3.0
      Oracle Quality of Service Management (Client) 11.2.0.3.0
      Expat libraries 2.0.1.0.1
      Oracle Containers for Java 11.2.0.3.0
      Perl Modules 5.10.0.0.1
      Secure Socket Layer 11.2.0.3.0
      Oracle JDBC/OCI Instant Client 11.2.0.3.0
      Oracle Multimedia Client Option 11.2.0.3.0
      LDAP Required Support Files 11.2.0.3.0
      Character Set Migration Utility 11.2.0.3.0
      Perl Interpreter 5.10.0.0.2
      PL/SQL Embedded Gateway 11.2.0.3.0
      OLAP SQL Scripts 11.2.0.3.0
      Database SQL Scripts 11.2.0.3.0
      Oracle Extended Windowing Toolkit 3.4.47.0.0
      SSL Required Support Files for InstantClient 11.2.0.3.0
      SQL*Plus Files for Instant Client 11.2.0.3.0
      Oracle Net Required Support Files 11.2.0.3.0
      Oracle Database User Interface 2.2.13.0.0
      RDBMS Required Support Files for Instant Client 11.2.0.3.0
      RDBMS Required Support Files Runtime 11.2.0.3.0
      XML Parser for Java 11.2.0.3.0
      Oracle Security Developer Tools 11.2.0.3.0
      Oracle Wallet Manager 11.2.0.3.0
      Enterprise Manager plugin Common Files 11.2.0.3.0
      Platform Required Support Files 11.2.0.3.0
      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0
      RDBMS Required Support Files 11.2.0.3.0
      Oracle Ice Browser 5.2.3.6.0
      Oracle Help For Java 4.2.9.0.0
      Enterprise Manager Common Files 10.2.0.4.3
      Deinstallation Tool 11.2.0.3.0
      Oracle Java Client 11.2.0.3.0
      Cluster Verification Utility Files 11.2.0.3.0
      Oracle Notification Service (eONS) 11.2.0.3.0
      Oracle LDAP administration 11.2.0.3.0
      Cluster Verification Utility Common Files 11.2.0.3.0
      Oracle Clusterware RDBMS Files 11.2.0.3.0
      Oracle Locale Builder 11.2.0.3.0
      Oracle Globalization Support 11.2.0.3.0
      Buildtools Common Files 11.2.0.3.0
      Oracle RAC Required Support Files-HAS 11.2.0.3.0
      SQL*Plus Required Support Files 11.2.0.3.0
      XDK Required Support Files 11.2.0.3.0
      Agent Required Support Files 10.2.0.4.3
      Parser Generator Required Support Files 11.2.0.3.0
      Precompiler Required Support Files 11.2.0.3.0
      Installation Common Files 11.2.0.3.0
      Required Support Files 11.2.0.3.0
      Oracle JDBC/THIN Interfaces 11.2.0.3.0
      Oracle Multimedia Locator 11.2.0.3.0
      Oracle Multimedia 11.2.0.3.0
      HAS Common Files 11.2.0.3.0
      Assistant Common Files 11.2.0.3.0
      PL/SQL 11.2.0.3.0
      HAS Files for DB 11.2.0.3.0
      Oracle Recovery Manager 11.2.0.3.0
      Oracle Database Utilities 11.2.0.3.0
      Oracle Notification Service 11.2.0.3.0
      SQL*Plus 11.2.0.3.0
      Oracle Netca Client 11.2.0.3.0
      Oracle Net 11.2.0.3.0
      Oracle JVM 11.2.0.3.0
      Oracle Internet Directory Client 11.2.0.3.0
      Oracle Net Listener 11.2.0.3.0
      Cluster Ready Services Files 11.2.0.3.0
      Oracle Database 11g 11.2.0.3.0
—————————————————————————–
 
 
Instantiating scripts for add node (Saturday, May 4, 2013 8:52:48 PM CDT)
.                                                                 1% Done.
Instantiation of add node scripts complete
 
Copying to remote nodes (Saturday, May 4, 2013 8:52:50 PM CDT)
…………………………………………………………………………………..                                 96% Done.
Home copied to new nodes
 
Saving inventory on nodes (Saturday, May 4, 2013 8:56:03 PM CDT)
.                                                               100% Done.
Save inventory complete
WARNING:
The following configuration scripts need to be executed as the “root” user in each new cluster node. Each script in the list below is followed by a list of nodes.
/u01/app/11.2.0/grid/root.sh #On nodes rhel59drb
To execute the configuration scripts:
    1. Open a terminal window
    2. Log in as “root”
    3. Run the scripts in each cluster node
   
The Cluster Node Addition of /u01/app/11.2.0/grid was successful.
Please check ‘/tmp/silentInstall.log’ for more details.
 
 
On the Target Node:  
[root@rhel59drb db_backup]# /u01/app/11.2.0/grid/root.sh
Check /u01/app/11.2.0/grid/install/root_rhel59drb_2013-05-04_21-18-28.log for the output of root script
 

[root@rhel59drb db_backup]# tail -f /u01/app/11.2.0/grid/install/root_rhel59drb_2013-05-04_21-18-28.log

    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/11.2.0/grid
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
User ignored Prerequisites during installation
OLR initialization – successful
Adding Clusterware entries to inittab
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rhel59dra, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 11g Release 2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user ‘root’, privgrp ‘root’..
Operation successful.
Preparing packages for installation…
cvuqdisk-1.0.9-1

Configure Oracle Grid Infrastructure for a Cluster … succeeded

 
——————
 

+ASM1 > crs_stat -t -v

HA Resource                                        Target     State            
———–                                        ——     —–            
ora.DATA.dg                                        ONLINE     ONLINE on rhel59dra
ora.FRA.dg                                         ONLINE     ONLINE on rhel59dra
ora.LISTENER.lsnr                                  ONLINE     ONLINE on rhel59dra
ora.LISTENER_SCAN1.lsnr                            ONLINE     ONLINE on rhel59drb
ora.LISTENER_SCAN2.lsnr                            ONLINE     ONLINE on rhel59dra
ora.LISTENER_SCAN3.lsnr                            ONLINE     ONLINE on rhel59dra
ora.LSNR_GTRRAC.lsnr                               ONLINE     ONLINE on rhel59dra
ora.OCR_VOTE.dg                                    ONLINE     ONLINE on rhel59dra
ora.asm                                            ONLINE     ONLINE on rhel59dra
ora.cvu                                            ONLINE     ONLINE on rhel59dra
ora.dtccrac.db                                     ONLINE     ONLINE on rhel59dra
ora.gsd                                            OFFLINE    OFFLINE          
ora.net1.network                                   ONLINE     ONLINE on rhel59dra
ora.oc4j                                           ONLINE     ONLINE on rhel59dra
ora.ons                                            ONLINE     ONLINE on rhel59dra
ora.registry.acfs                                  ONLINE     ONLINE on rhel59dra
ora.rhel59dra.ASM1.asm                             ONLINE     ONLINE on rhel59dra
ora.rhel59dra.LISTENER_RHEL59DRA.lsnr              ONLINE     ONLINE on rhel59dra
ora.rhel59dra.LSNR_GTRRAC_RHEL59DRA.lsnr           ONLINE     ONLINE on rhel59dra
ora.rhel59dra.gsd                                  OFFLINE    OFFLINE          
ora.rhel59dra.ons                                  ONLINE     ONLINE on rhel59dra
ora.rhel59dra.vip                                  ONLINE     ONLINE on rhel59dra
ora.rhel59drb.ASM2.asm                             ONLINE     ONLINE on rhel59drb
ora.rhel59drb.LISTENER_RHEL59DRB.lsnr              ONLINE     ONLINE on rhel59drb
ora.rhel59drb.LSNR_GTRRAC_RHEL59DRB.lsnr           ONLINE     ONLINE on rhel59drb
ora.rhel59drb.gsd                                  OFFLINE    OFFLINE          
ora.rhel59drb.ons                                  ONLINE     ONLINE on rhel59drb
ora.rhel59drb.vip                                  ONLINE     ONLINE on rhel59drb
ora.scan1.vip                                      ONLINE     ONLINE on rhel59drb
ora.scan2.vip                                      ONLINE     ONLINE on rhel59dra
ora.scan3.vip                                      ONLINE     ONLINE on rhel59dra 
 

Oracle VM vs VMware Technical Discussion

 

TARGET AUDIENCE

The primary audience of this white paper is aimed at Oracle DBAs and technical infrastructure teams that need to support enterprise virtual platforms.   The topic of discussions may be above and beyond a DBA’s normal conversational lingo but the DBA will learn the key buzzwords that relate to both vendors.  Oracle DBAs will learn how virtual infrastructures need to be configured and tuned to properly handle Oracle workloads. 

DBAs and architects will learn technical internals for VMware and OVM infrastructures. The DBAs will be able to effectively communicate with their infrastructure leads and understand what they are getting and what they want out of virtualization. Our goal is to disseminate key best practices for virtualization. DBAs should be able go back to their virtualization administrators (vAdmins) and confirm whether these best practices are being practiced. Also, important performance metrics for virtualization will be revealed. Your measure of success in virtualizing Oracle Databases on VMware or Oracle VM should depend on pre-established performance metrics.

 

VIRTUALIZING ORACLE DATABASES AND APPLICATIONS

Hypervisors today are getting faster with less and less overhead. When you look at benchmarks being published today on running Tier One databases and applications the overhead can get down to 6% or less. This low level of overhead means you can run 80-90% of all database servers in a Virtual Machine. Critical systems that require ten of thousands of IOPs, high IO throughput, and excessive CPU requirements may need more than the 6% of overhead. If your application suffers from performance issues today, your best bet is to stay on the physical servers until your performance issues are isolated and resolved. The rest of the typical business critical applications and database servers can run successfully in a virtual environment.

 

RAPIDLY PROVISION ORACLE ON VIRTUALIZED INFRASTRUCTURE

Imagine a world where your system administrators can provision a fully functional Linux server that is patched with all the up-to-date kernel parameters, updated device drivers, and updated configurations in one hour. The time that you make the request to the time that you get access to a server that has a fully configured Red Hat 5/6 or Oracle Linux 5/6 environment is within one hour. On top of all this, the build is perfect every time. This should be a reality for most companies today. Imagine providing a fully patched Oracle database on 11.2.0.3 with PSU 5 (January 2013 PSU) applied to your customers in 1 hour. There is no reason why this cannot be accomplished today with the infrastructure that is provided by VMware and Oracle. Imagine provisioning RAC clusters in a matter of hours. Imagine being able to provide a fully patched 2 node/3 node /4 node Grid Infrastructure with ASM and a fully patched database within one day. This presentation does not go into the secret sauce of being able to do this but will lead you in the right direction. Oracle and VMware provide the means to be able to provision even the most complicated RAC infrastructure in one day. We no longer spend weeks and even months to setup our RAC environments.

 

CREATE GOLDEN IMAGE TEMPLATES

The concept of creating a golden image applies at all levels of the stack. In the end, we need to create a golden image virtual machine template. Before we can create a golden image VM template, we need to create a golden image OS. This does not come over night but can easily be established. There has to be lot of collaboration between the system administrators as to standards and policies. Furthermore, someone has to be the “owner” of the templates to make sure all the standard build is applied to the golden image template. As we mature within the organization, we can build automation to simplify the build process and parts of the builds that require manual intervention. The level of automation will dictate how long it takes to provision the Linux VM. Obviously, the more you automate, the less time it will take. As DBAs, we will want to focus on creating golden images of the database eco-system. We need to create a golden image Grid Infrastructure stack. We also need to create a golden image database software stack. Finally, we need to create a golden image database to deploy to all the environments. We can automate all of the above components to simplify and reduce the amount of time to provision Oracle databases.

BUILDING AN ENTERPRISE VIRTUAL PLATFORM

Setting up a VirtualBox, VMware Fusion or VMware Workstation VM is pretty simple. However there is a big difference in the skill set required to set up a bare metal hypervisor for running a POC and/or benchmarks. It’s then another skill level to design, configure and implement an enterprise virtual platform for running Tier One platforms. They key to building an enterprise virtual platform is to follow best practices and reference architectures. The levels of best practices that have to be followed include:

• Validate virtualization and software configurations with vendor hardware compatibility lists.

• Follow recommended reference architectures.

• Follow virtualization vendor’s best practices, deployment guides and workload characterizations.

• Review storage vendor recommendations.

• Validate internal best practices for configuring and managing VMs.

As we build out the enterprise virtual platform, standards will need to be created and tightly controlled. Process and procedures for virtual machine deployments will also play a big factor in how successful your virtualization journey becomes.

 

WHY VIRTUALIZE ORACLE AND HADOOP ENVIRONMENTS

• Virtual Servers offer significant advantages over Physical Servers.

• Enabling Oracle or Hadoop as a service in a public or private cloud.

• Cloud providers are making it easy to deploy platforms for POCs, dev and test environments.

• Running a Consistent, Highly Reliable Hardware Environment.

• Standardizing on a Single Common Hardware Platform (software stack).

• Virtualization is a natural step towards the cloud.

• Cloud and virtualization vendors are offering elastic solutions.

 

VIRTUALIZATION FEATURES

These virtualization features offer a lot of additional functionality to Oracle database servers, applications and Hadoop environments.

Virtualization Features

 

We cannot go over all the virtualization features in this paper. We do plan on reviewing all of the terms and features in our presentation. Also at the presentation we will provide the subtle differences between the two vendors.

 






VMOTION / LIVE MIGRATION

vMotion / Live Migration, by far, is one of the biggest benefits of a virtualization infrastructure. With this feature enabled, we can migrate an active VM to another host machine without any downtime or disruptions while maintaining application services to users. Granted the application may experience a slight degradation in performance, there will be no data loss during the few minutes needed to move a VM to another host machine. It will be completely transparent to the applications that the live migration (vMotion) occurred. Imagine if you lost the network card on one of the host machines and need to take the server down for maintenance. In the absence of Oracle VM or VMware, you would experience a complete outage in a non-virtualized world. If you happen to be on a RAC environment, you would run your databases in a reduced capacity. In the virtual world however, we would simply move your database server VM to another host machine, perform our maintenance, reboot your host machine and let the database server VM migrate back. While this is happening, you would never know that it happened.

 

HIGH AVAILABILITY (HA)

With virtualization, we automatically adopt what is known to be HA in the virtualization world. If the host machine crashes for any reason, the VM can failover automatically to a surviving host machine in the cluster. With HA, some companies may be able to forgo on RAC licenses if they are strictly leveraging RAC for high availability. If customers can withstand a 10-15 minute outage for the VM to re-start on a surviving host machine, you maybe able to eliminate your RAC licenses.

 

DISTRIBUTED RESOURCE MANAGEMENT (DRS)

Leveraging the vMotion / Live Migration infrastructure, we can evenly load balance the work load of every host machine in the virtualization cluster. If one host machine becomes over-loaded, we can move the VM or VMs to a less loaded host machine. This automatically happens without the users experiencing any perceived outages. We can establish affinity and anti-affinity rules to even move VMs together with other VMs. Again, we should not be afraid to fully leverage this technology.

 

KEY LINKS FOR ORACLE VM SOFTWARE

In the VMware world, your vAdmins will take care of the needed software. On the Oracle side however, the DBAs will more than likely need to provide the information to the vAdmin or perform the tasks themselves. If you are new to the Oracle VM stack, you will discover that downloading the software will be your first hurdle. The following software products can be downloaded from Oracle EDelivery.

Download OVM

 

Oracle VM Templates provide customers the ability to rapidly and easily deploy a fully patched/configured Oracle virtual machine or multiple virtual machines for RAC deployments. The Oracle VM Templates contains the complete Oracle software stack plus the operating system and related software infrastructure. Lot of the Guest VMs are available from Oracle’s E-Delivery website but the latest patched versions are available from support.oracle.com and you will need a valid CSI and contract to download them. These templates can save customers days or weeks or even months depending on whether you leverage the complete Oracle stack. We can download RAC templates, Oracle 12c Cloud Control Enterprise Manager templates, Siebel templates or even Oracle E-Business Suite templates. For the latest, review the MOS note Pre-Built Grid Infrastructure and Oracle RAC Templates For Oracle VM [ID 1185244.1]. Downloading the latest Oracle VM templates can reduce your VM builds exponentially.

 

KEY LINKS FOR BEST PRACTICES

Lot of the best practices for VMware applies to Oracle VM. Obviously, there are specific best practices when it comes to features that are specific to either of the products. For example, we need to create separate interfaces on the VM host (ESXi host or Oracle VM Server) to segment off management related network traffic (i.e. management related traffic to maintain a network heartbeat or the traffic to perform live migrations (vMotion in VMware)). At a minimum, each physical host needs to have 4 physical network interface cards. 6 Network interface cards will be highly recommended. We will create a bonded network interfaces for the following network workloads:

1. 2 NICs bonded for the public network for all oracle database related traffic

2. 2 NICs bonded for oracle private network between the RAC clusters

3. 2 NICs bonded for communication between the ESXi or Oracle VM Server host machines

All the best practices that are applicable at the VM Guest level apply to both VMware and Oracle VM. For example, we want to enable jumbo frames on the Guest VM. We also want to setup hugepages and disable NUMA at the Guest VM level. In general, we also do not want to over-commit memory or CPUs for production environments. For databases that fit well for consolidation, we can consider over-committing memory or CPUs.

For additional information for best practices for VMware, please read the following articles.

http://info.vmware.com/content/12581_VirtApps_index?src=socmed_BCAblog&xyz= Oracle Databases on VMware – RAC Workload Characterization Study http://www.vmware.com/files/pdf/partners/oracle/Oracle_Databases_on_VMware_-_Workload_Characterization_Study.pdf Oracle Databases on VMware – RAC Deployment Guide http://www.vmware.com/files/pdf/partners/oracle/vmware-oracle-rac-deploy-guide.pdf High Availability Guide http://www.vmware.com/files/pdf/partners/oracle/Oracle_Databases_on_VMware_-_High_Availability_Guidelines.pdf

 

vCloud Suite and vCloud Networking and Security vCloud Editions

http://www.vmware.com/products/datacenter-virtualization/vcloud-suite/compare.html

 

vCloud Networking and Security

http://www.vmware.com/products/datacenter-virtualization/vcloud-network-security/compare-editions.html

 

vCenter Operations

http://www.vmware.com/products/datacenter-virtualization/vcenter-operations-management/compare-editions.html

 

VMware Tech Resource Center (Videos, Whitepapers, Docs)

http://www.vmware.com/products/datacenter-virtualization/vsphere/resources.html

 

Miscellaneous A high level whitepaper on virtualizing Business Critical Apps on VMware

http://www.vmware.com/files/pdf/solutions/VMware-Virtualizing-Business-Critical-Apps-on-VMware_en-wp.pdf

 

Deployment Guide, Reference Architecture, Customer case studies and white papers

http://www.vmware.com/solutions/partners/alliances/oracle-database.html

 

Oracle Databases on VMware – Understanding Support and License :

http://www.vmware.com/files/pdf/techpaper/vmw-understanding-oracle-certification-supportlicensing-environments.pdf

 

VMware Network I/O Control: Architecture, Performance and Best Practices

http://www.vmware.com/files/pdf/techpaper/VMW_Netioc_BestPractices.pdf

 

Esxtop and vscsi Stats

http://communities.vmware.com/docs/DOC-5490 http://communities.vmware.com/docs/DOC-10095

 

Memory Management vSphere 5

http://www.vmware.com/resources/techresources/10206

 

Resource Mgmt vSphere 5

www.vmware.com/files/pdf/mem_mgmt_perf_vsphere5.pdf

 

Achieving a Million IOPS in a single VM with vSphere5

www.vmware.com/files/pdf/1M-iops-perf-vsphere5.pdf V

 

MXNET3 was designed with improving performance in mind.

See, VMware KB 1001805: http://kb.vmware.com/selfservice/documentLinkInt.do?micrositeID=null&externalID=1001805

 

Performance Evaluation of VMXNET3 Virtual Network Device can be found at:

http://www.vmware.com/pdf/vsp_4_vmxnet3_perf.pdf

 

Network I/O Latency in vSphere5

http://www.vmware.com/resources/techresources/10256

 

Preferred BIOS settings (always double check with hardware vendor,

http://www.vmware.com/pdf/Perf_Best_Practices_vSphere4.1.pdf

 

Oracle Database on vSphere Deployment Tips –

http://www.vmware.com/files/pdf/Oracle_Databases_on_vSphere_Deployment_Tips.pdf

 

SCSI Queue Depth – Controlling LUN queue depth throttling in VMware ESX/ESXi

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1008113

 

Monitor disk latency at three distinct layers of the device or HBA, the kernel or ESX hypervisor and the guest or virtual machine.

http://communities.vmware.com/docs/DOC-9279

 

PVSCSI Storage Performance

http://www.vmware.com/pdf/vsp_4_pvscsi_perf.pdf)

 

Snapshot limitations and best practices to minimize problems

http://kb.vmware.com/kb/1025279 Jumbo frames VMXNET3

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1015556

 

1Gb shortcomings:

http://www.vmware.com/files/pdf/techpaper/VMW_Netioc_BestPractices.pdf.

 

The vSphere 4 CPU scheduler

www.vmware.com/files/pdf/perf-vsphere-cpu_scheduler.pdf

 

Some excellent storage links from Chris Sakac (EMC) and Vaughn Stewart (NetApp) VNX and vSphere Techbook

http://www.emc.com/collateral/hardware/technical-documentation/h8229-vnx-vmware-tb.pdf

 

VMAX and vSphere Techbook

http://www.emc.com/collateral/hardware/solution-overview/h2529-vmware-esx-svr-w-symmetrix-wp-ldv.pdf

 

Isilon and vSphere Best Practices Guide

http://www.emc.com/collateral/hardware/white-papers/h10522-bpg-isilon-and-vmware-vsphere5.pdf

http://www.vmware.com/files/pdf/techpaper/VMW-vSphere41-SIOC.pdf

http://www.vmware.com/files/pdf/techpaper/VMW-vSphere41-SIOC.pdf

http://virtualgeek.typepad.com/virtual_geek/2010/08/drs-for-storage.html

Storage I/O Fairness

 

ABOUT THE AUTHOR

Charles Kim is an Oracle ACE Director, an Oracle Certified DBA, and a Certified RAC Expert. Charles specializes in Exadata, RAC, and Virtualization (VMware and Oracle VM) and authored three books: 1. Oracle Database 11g New Features for DBA and Developers 2. Linux Recipes for Oracle DBAs 3. Oracle Data Guard 11g Handbook Charles holds certifications in Oracle, VMware, Red Hat Linux, and Microsoft and has over 21 years of Oracle experience on mission and business critical databases. Charles presents regularly at local, regional, national and international Oracle conferences including IOUG Collaborate, VMware World, and Oracle OpenWorld on topics of RAC, ASM, Linux Best Practices, Data Guard Best Practices, VMware virtualization, Oracle VMware virtualization, and 7×24 High Availability Considerations. Charles is the technical editor of the Automatic Storage Management book by Oracle Press and blogs regularly at http://blog.dbaexpert.com and http://oravm.com.

 

Create VirtualBox Shared Disks for RAC Configuration

In the previous release of Virtualbox, we were able to create a virtual disk and specify the shareable option with the createhd command.  Here’s what the old syntax looked like:

# Create the disks and associate them with VirtualBox as virtual media.
$ VBoxManage createhd –filename asm1.vdi –size 10240 –format VDI –variant Fixed –type shareable –remember

With Virtualbox 4 that option went away, and now we have to issue the modifyhd command and specify that the disk will be shareable.  First, we need to create our virtual disk with the new syntax:

$ VBoxManage createhd –filename asm1.vdi –size 2048 –format VDI –variant Fixed
0%…10%…20%…30%…40%…50%…60%…70%…80%…90%…100%
Disk image created. UUID: 1f4b1d28-23b5-4dfd-89da-4e4546a2f969

Notice the UUID generated from the createhd command.  Subsequent commands with the modifyhd and storageattach options can reference either the disk name or UUID:  Here’s the usage for the modifyhd command:

$ VBoxManage modifyhd
Usage:

VBoxManage modifyhd <uuid>|<filename>
[–type normal|writethrough|immutable|shareable|
readonly|multiattach]
[–autoreset on|off]
[–compact]
[–resize <megabytes>|–resizebyte <bytes>]

In all of our examples, we will reference the virtual disk based on the file name.  To make the newly created virtual disk shareable, we execute the VBoxManage command again with the modifyhd option:

$ VBoxManage modifyhd asm1.vdi -type shareable

Lastly, when we attach the disk to our RAC server, we have to specify that it is a shared disk again.  In this example, the name of our RAC node happens to be ol63a:

$ VBoxManage storageattach ol63a –storagectl “SATA” –port 1 –device 0 –type hdd –medium asm1.vdi –mtype shareable

IOUG 2013 Data Guard Best Practices Abstract Accepted

Session Title: Automate Data Guard Best Practices
Session Number: 614
Track: Database
Session Type: Lecture
Sub-Categorization: High Availability and Data Protection
Initial Submission: Oct 12, 2012 11:32 AM America/Arizona
Status: Submitted
Session Submitter: Charles Kim
Primary Presenter: Charles Kim [Oracle ACE Director – Viscosity North America]
Co-Presenter: Nitin Vengurlekar [CTO – Viscosity North America]
Co-Presenter 2: [Unassigned]
Co-Presenter 3: [Unassigned]
Last Update: Oct 12, 2012 11:58 AM America/Arizona
   
Abstract: Compliance to industry best practices can easily be achieved with automation. This session will disseminate fundamental Data Guard best practices and demonstrate how DBAs can automate setup, configuration, and monitoring of Data Guard environments with assistance from the Date Guard Toolkit (DG Toolkit).

The original Data Guard Menu (DG Menu) was presented and documented in the Oracle Data Guard 11g Handbook published with Oracle Press. We took the DG Menu to another level and now it is called the DG Toolkit. We included a dedicated set of options for building physical standby with best practices in mind and made this into a mature toolkit that anyone can download from http://dataguardbook.com website. We have significantly updated the monitoring and setup menu options as well.

Come see Data Guard best practices in action. The session concentrates on:
o Building the Physical Standby
o Monitoring and Maintaining the Physical Standby
o Configuring Data Guard Broker
o Performing Backup and Recovery with RMAN
o Setting Archive Retention
o Performing Switchovers and Failovers

   
Learning Objective #1: Most importantly, learn how to build the physical standby with ease and automation using the DG Toolkit
Learning Objective #2: Learn how to monitor the physical standby database with DG Toolkit
Learning Objective #3: Learn how to setup the Data Guard Broker with DG Toolkit
Outline / Content Structure: Perform preliminary check prior to starting the Data Guard Build
1. Perform assessments on the source database
2. Perform assessments on the physical standby

Perform detailed steps to build the physical standby database
1. Look at building the physical standby with easy menu steps
2. Look at duplicating the physical standby database

Configure the Data Guard Broker

Perform monitoring of the Data Guard Environment
1. Monitor the physical standby for performance
2. See how far behind we are

Perform RMAN to disk configuration options

# ————————————————————————- #
# Data Guard Menu System #
# Primary Host: prod1 Standby Host: drdb1 #
# Primary DB: DBATOOLS Standby DB: DRDBATOOLS #
# ————————————————————————- #
# 10. Launch Preliminary Check Submenu #
# ————————————————————————- #
# 20. Launch Build Standby Database Submenu #
# ————————————————————————- #
# 30. Launch the Data Guard Broker Submenu #
# ————————————————————————- #
# 40. Launch Monitor Physical Standby Data Guard Submenu #
# ————————————————————————- #
# 50. Launch Monitor Logical Standby Data Guard Submenu #
# ————————————————————————- #
# 60. Launch Automatic Diagnostic Repository (ADR) CLI Submenu #
# ————————————————————————- #
# 100. Launch RMAN Backup to Disk Submenu #
# ————————————————————————- #
# x. Exit #
# ————————————————————————- #

2nd Track: Manageability
Content Level: Mid-Level
Product Line: Active Data Guard, Oracle Database, Real Application Clusters
Company Type: Consultant
Have you presented at an IOUG event before?: Yes
Speaker Guidelines: Yes 

Upcoming: OTN Expert+ Conference

Below is the Final Schedule for the OTN Expert+ Conference on Oct 16, 2012: 7am – 12pm Central Daylight Time:
 
Oct 16, 2012 (All times in Central Daylight Time Zone: GMT – 5):
 
  • 7am – 7:40am – Tariq Farooq, Kai Yu, Charles Kim, Honglin Su
  • 7:45am – 8:25am – Mike Ault
  • 8:30am – 9:10am – Bert Scalzo
  • 9:15am – 9:55am – Tim Gorman
  • 10am – 10:40am – Rich Niemiec
  • 10:40am – 11:15am – Fahad Mirza
  • 11:20am – 12pm – Nitin Vengurlekar
 
Note: There are 5-minute breaks between each session; this is buffer time to get the next speaker setup; we will try to minimize this break as less as possible.
 
Attendance/Speaking Instructions:
  • Please register at: https://www3.gotomeeting.com/register/452999046
  • Please join  the webinar as a regular attendee 15-20 minutes before your time slot; i will then make you a Speaker in GoToWebinar then.
  • Please finish your slide-deck 5-10 minutes before your allocated time-slot ends for questions from the physical/virtual audience.