My RAC project with Openfiler, part I – Openfiler

My current job doesn’t offer me at the moment the opportunity to play with RAC or other stuff, so I decided to build my own RAC on my Windows7-desktop (64-bits, 8GB RAM), using 3 VM’s (VM-workstation , 7.1.3 build-324285) :

  • 2 VM’s (VMware, not OracleVM!) for two RAC-nodes, based on OEL 5.5, for infra and database.
  • 1 VM as my own storage, based on Openfiler 2.3 (free) and ASM as storage manager.


Powered by rPath Linux, Openfiler is a free browser-based network storage management utility that delivers file-based Network Attached Storage (NAS) and block-based Storage Area Networking (SAN) in a single framework. Openfiler supports CIFS, NFS, HTTP/DAV, FTP, however, we will only be making use of its iSCSI capabilities to implement an inexpensive SAN for the shared storage components required by Oracle RAC 11g. A 500GB internal hard drive will be connected to the network storage server (sometimes referred to in this article as the Openfiler server) through an internal embedded SATA II controller. The Openfiler server will be configured to use this disk for iSCSI based storage and will be used in our Oracle RAC 11g configuration to store the shared files required by Oracle Clusterware as well as all Oracle ASM volumes.

This piece of text is taken from another website: http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_10.shtml


My goal: just a little bit hands-on experience with Openfiler, and do some testing with RAC 11gr2, and especially Maybe it’s helpful for somebody else, so I’ll post my experiences. Steps I’m gonna perform.

-          The first post (this post) :

1.       Planning my installation
2.       Create a VM with OpenFiler
3.       Configure Openfiler

-          The second post:

4.       Create a VM as node rac1 and configure ASM
5.       Create a VM as node rac2
6.       Install Oracle RAC Infrastructure
7.       Install Oracle RAC Database software

8.       Install Oracle RAC Database

By |January 17th, 2011|Database, RAC|4 Comments|

Prerequisite-check fails on installing infrastructure: ORCL:VOL1 is not a valid path

While installing a grid – infrastructure on my own RAC-cluster ( on VMware), using ASM with Openfiler as my own SAN, the prerequisite-check fails at step 15 (in the oraInstaller-gui) with :

PRVF-5150 : Path ORCL:VOL1 is not a valid path on all nodes

This is also the case for all the other volumes I created. But… where does this come from? Hmmm.. this turned out to be a unpublished bug, and it can be safely ignored when you are convinced you did it right, and performed some checks:

Note [ID 1210863.1]: Unpublished bug 10026970

By |January 12th, 2011|Database, RAC|0 Comments|

Unable to load module oracleasm with the ‘init’ command

While building my own RAC ( on two VM’s, using a third VM with Openfiler on it as my SAN, I had to dowload, install, configure and load oracleasm / ASMLIB. Loading didn’t  go smoothly at my own project. First I analyzed what I did, steps I took:

Step 1 : Downloading the right packages from the otn-page. It’s crucial at this point  to know exactly which packages you need, otherwise you may get some vague errors.

[root@rac1 sbin]# uname -r
[root@rac1 sbin]# uname -p
[root@rac1 sbin]# uname -i

You need these three packages:

oracleasmlib-2.0 – the Oracle ASM libraries
oracleasm-support-2.0 – utilities needed to administer ASMLib
oracleasm – a kernel module for the Oracle ASM library
By |January 6th, 2011|Database, RAC|0 Comments|

iscsiadm discovery: no output with Openfiler.

I was building my own Oracle RAC 11g cluster ( with Openfiler as my shared storage. Two VM’s as my rac-cluster, one VM with Openfiler as my own SAN (not using the applicance, used the iso-file).  Followed the instructions of the article of Jeffrey Hunter how to build a RAC on OEL and iSCSI, however this article is not based on VM. Will publish my experiences later on.

My Openfiler-VM (named it ‘Openfiler1′) was ready, given access to my both nodes on iSCSI-level, and now I want my rac1-node to discover the iSCSI-drives on my Openfiler-VM.

Command I used on node ‘rac1′, where ‘openfiler1′ is my Openfiler-VM, on a privileged network:

iscsiadm -m discovery -t st –p openfiler1-priv

By |December 31st, 2010|Database, RAC|0 Comments|

Script for setting up ssh on RAC-nodes

Finished a RAC-course a while ago with instructor Harald van Breederode. Noticed that he used a script for setting up ssh on the nodes. Short, powerful. Used it myself with user grid and oracle while installing 11g RAC.

First of all, one file should exist on forehand: $HOME:nodeinfo. Should look like this, one noder per line:


Then the file ssh_setup.sh:

By |December 30th, 2010|Database, RAC|0 Comments|