ASM schijven verplaatsen op NetApp

Op de NetApp aanmaken van Vol’s, Lun’s en desgewenst Qtree’s:

Volume aanmaken;

Name: ORA_DATA_01
Security style: UNIX
Thin Provisioned: UIT (uitgevinkt)
Storage Efficiency: DISABLED
Size: 80 GB
Advanced: enkel AAN (aangevinkt) Update access time when a file is read
% USED: 80%
Resultaat ziet er als volgt uit;

Name: ORA_DATA_01
Status: Online
Maximum Files: 2.49m
Current Files: 105
Language: en (English)
Unicode: Disabled
Qtree aanmaken (niet noodzakelijk oude gewoonte):

Name: ora_data_01
Volume: ORA_DATA_01
Oplocks: UIT (uitgevinkt)
Security Style: UNIX
Lun aanmaken:

Name: ora_data_01.lun
Description: Ora_Rac
Type: Linux
Size: 64 GB
Thin Provisioned: UIT (uitgevinkt)
Initiator Group Name: ASM_RAC (LUN ID (optional) leeg laten)
Resultaat ziet er als volgt uit;

Name: ora_data_01.lun
Container Path: /vol/ORA_DATA_01/ora_data_01
Size: 64 GB
Status: Online
Type: Linux
Serial No: 7T-Kd?E4WiRZ
Description: Ora_Rac
In de RAC omgeving op de NODE1 uitvoeren.

LET OP: de /dev/s.. namen zijn/kunnen per node anders zijn tussen de NODE2, NODE3 en NODE1. Zo valt op dat bij NODE2 de benaming /dev/sdb1: LABEL=”DATA_1″ bij de andere 2 node’s als volgt is,  /dev/sda1: LABEL=”DATA_1″.
Login op de NODE1 als ROOT

[root@NODE1 ~]# iscsiadm -m session –rescan

 

[root@NODE1 ~]# ls -l /dev/disk/by-path

 

total 0

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-0 -> ../../sda

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-0-part1 -> ../../sda1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-1 -> ../../sdb

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-10 -> ../../sdk

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-10-part1 -> ../../sdk1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-11 -> ../../sdl

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-11-part1 -> ../../sdl1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-12 -> ../../sdm

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-12-part1 -> ../../sdm1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-13 -> ../../sdn

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-13-part1 -> ../../sdn1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-14 -> ../../sdo

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-14-part1 -> ../../sdo1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-15 -> ../../sdp

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-15-part1 -> ../../sdp1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-16 -> ../../sdq

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-16-part1 -> ../../sdq1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-17 -> ../../sdr

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-17-part1 -> ../../sdr1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-18 -> ../../sds

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-18-part1 -> ../../sds1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-19 -> ../../sdt

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-19-part1 -> ../../sdt1

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-1-part1 -> ../../sdb1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-2 -> ../../sdc

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-20 -> ../../sdu

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-20-part1 -> ../../sdu1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-21 -> ../../sdv

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-21-part1 -> ../../sdv1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-22 -> ../../sdw

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-22-part1 -> ../../sdw1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-23 -> ../../sdx

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-23-part1 -> ../../sdx1

lrwxrwxrwx 1 root root  9 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-24 -> ../../sdy

lrwxrwxrwx 1 root root 10 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-24-part1 -> ../../sdy1

lrwxrwxrwx 1 root root  9 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-25 -> ../../sdz

lrwxrwxrwx 1 root root 10 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-25-part1 -> ../../sdz1

lrwxrwxrwx 1 root root 10 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-26 -> ../../sdaa

lrwxrwxrwx 1 root root 11 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-26-part1 -> ../../sdaa1

lrwxrwxrwx 1 root root 10 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-27 -> ../../sdab

lrwxrwxrwx 1 root root 11 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-27-part1 -> ../../sdab1

lrwxrwxrwx 1 root root 10 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-28 -> ../../sdac

lrwxrwxrwx 1 root root 11 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-28-part1 -> ../../sdac1

lrwxrwxrwx 1 root root 10 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-29 -> ../../sdad

lrwxrwxrwx 1 root root 11 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-29-part1 -> ../../sdad1

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-2-part1 -> ../../sdc1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-3 -> ../../sdd

lrwxrwxrwx 1 root root 10 Dec  8 11:00 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-30 -> ../../sdae

lrwxrwxrwx 1 root root 11 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-30-part1 -> ../../sdae1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-4 -> ../../sde

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-4-part1 -> ../../sde1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-5 -> ../../sdf

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-5-part1 -> ../../sdf1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-6 -> ../../sdg

lrwxrwxrwx 1 root root 10 Dec  8 11:33 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-6-part1 -> ../../sdg1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-7 -> ../../sdh

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-7-part1 -> ../../sdh1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-8 -> ../../sdi

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-8-part1 -> ../../sdi1

lrwxrwxrwx 1 root root  9 Aug 25 07:26 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-9 -> ../../sdj

lrwxrwxrwx 1 root root 10 Aug 25 07:27 ip-172.17.17.5:3260-iscsi-iqqn.2016-08.com.netapp:sn.101186186-lun-9-part1 -> ../../sdj1

 

[root@NODE1 ~]# fdisk /dev/sdy (ook voor ../../sdz, ../../sdaa, ../..sdab, ../../sdac, ../../sdad, ../../sdae)

 

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won’t be recoverable.

The number of cylinders for this disk is set to 30720.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

software that runs at boot time (e.g., old versions of LILO)

booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help):
m
n voor add a new partition
p primary partition
1 Partition number (1-4)
First Cylinder DEFAULT
Last Cylinder DEFAULT
w write is toepassen en resync

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.
[root@NODE1 ~]# ls -l /dev/disk/by-path

[root@NODE1 ~]# oracleasm listdisks

 

CRS

DATA_1

DATA_10

DATA_2

DATA_3

DATA_4

DATA_5

DATA_6

DATA_7

DATA_8

DATA_9

[root@NODE1 ~]#

 

oracleasm createdisk ORA_DATA_01 /dev/sdy1
oracleasm createdisk ORA_DATA_02 /dev/sdz1
oracleasm createdisk ORA_DATA_03 /dev/sdaa1
oracleasm createdisk ORA_DATA_04 /dev/sdab1
oracleasm createdisk ORA_DATA_05 /dev/sdac1
oracleasm createdisk ORA_DATA_06 /dev/sdad1
oracleasm createdisk ORA_DATA_07 /dev/sdae1

Writing disk header: done

Instantiating disk: done
Desgewenst de status opvragen:

ls /dev/sd*
ls -l /dev/disk/by-path
oracleasm listdisks
oracleasm querydisk /dev/sd*1
/sbin/blkid | grep oracleasm
Uitvoeren op NODE1, NODE2 en NODE3

[root@NODE1 ~]# oracleasm scandisks
[root@NODE1 ~]# iscsiadm -m session –rescan
[root@NODE2 ~]# oracleasm scandisks
[root@NODE2 ~]# iscsiadm -m session –rescan
[root@NODE3 ~]# oracleasm scandisks

 

Reloading disk partitions: done

Cleaning any stale ASM disks…

Scanning system for ASM disks…

Instantiating disk “ORA_DATA_01”

Instantiating disk “ORA_DATA_02”

Instantiating disk “ORA_DATA_03”

Instantiating disk “ORA_DATA_04”

Instantiating disk “ORA_DATA_05”

Instantiating disk “ORA_DATA_06”

Instantiating disk “ORA_DATA_07″

[root@NODE3 ~]# iscsiadm -m session –rescan

 

Rescanning session [sid: 1, target: iqqn.2016-08.com.netapp:sn.101186186, portal: 172.17.17.5,3260] [root@NODE3 ~]#  ls -l /dev/disk/by-path

LET OP: een niet gebruikte ander mogelijkheid voor het STEMPEN.

iscsiadm -m session -r SID –rescan[10]

SID per node:

iqqn.2016-05.com.redhat:NODE3

iqqn.2016-05.com.redhat:NODE1

iqqn.2016-05.com.redhat:NODE2

iscsiadm -m discovery -t st -p target_IP -o new

Inloggen in Cloud Control Enterprise manager.

Op de SR1710 ga via AllTargets ga naar +ASM node [NODE1] DiskGroups kies GROUP <DATA> en login bij ASM met SYS as ASMDBA.

Kies vervolgens ADD disk:

Vinkjes bij de disks en kijk met Show SQL
ALTER DISKGROUP DATA ADD

DISK ‘/dev/oracleasm/disks/ORA_DATA_02’ NAME ORA_DATA_02 SIZE 65530 M

DISK ‘/dev/oracleasm/disks/ORA_DATA_03’ NAME ORA_DATA_03 SIZE 65530 M

DISK ‘/dev/oracleasm/disks/ORA_DATA_04’ NAME ORA_DATA_04 SIZE 65530 M

DISK ‘/dev/oracleasm/disks/ORA_DATA_05’ NAME ORA_DATA_05 SIZE 65530 M

DISK ‘/dev/oracleasm/disks/ORA_DATA_06’ NAME ORA_DATA_06 SIZE 65530 M

DISK ‘/dev/oracleasm/disks/ORA_DATA_07′ NAME ORA_DATA_07 SIZE 65530 M

REBALANCE POWER 0
Return
Kies YES
LET OP: REBALANCE POWER 0

VERWIJDEREN VAN DISKEN IN ASM, LINUX EN NETAPP!!!

Op de SR1710 Cloud Control Enterprise Manager:

Vink de disk aan die je wilt REMOVEN
Kies Advance en REBALANCE POWER 1
Show SQL
ALTER DISKGROUP DATA DROP DISK DATA_0000
Return
Kies YES

REBALANCE zal worden uitgevoerd duurt heeeeeel lang.
Op de NODE1:

[root@NODE1 ~]# /sbin/blkid | grep oracleasm
LET OP: de /dev/s.. namen zijn/kunnen per node anders zijn tussen de NODE2, NODE3 en NODE1. Zo valt op dat bij NODE2 de benaming /dev/sdb1: LABEL=”DATA_1″ bij de andere 2 node’s als volgt is,  /dev/sda1: LABEL=”DATA_1″.
/dev/sdc1: LABEL=”CRS” TYPE=”oracleasm”

 

/dev/sdb1: LABEL=”DATA_2″ TYPE=”oracleasm”

/dev/sde1: LABEL=”DATA_4″ TYPE=”oracleasm”

/dev/sdf1: LABEL=”DATA_5″ TYPE=”oracleasm”

/dev/sdg1: LABEL=”DATA_6″ TYPE=”oracleasm”

/dev/sdh1: LABEL=”DATA_7″ TYPE=”oracleasm”

/dev/sdi1: LABEL=”DATA_8″ TYPE=”oracleasm”

/dev/sdj1: LABEL=”DATA_9″ TYPE=”oracleasm”

/dev/sdk1: LABEL=”DATA_10″ TYPE=”oracleasm”

/dev/sdl1: LABEL=”DATA_11″ TYPE=”oracleasm”

/dev/sdm1: LABEL=”DATA_12″ TYPE=”oracleasm”

/dev/sdn1: LABEL=”DATA_13″ TYPE=”oracleasm”

/dev/sdo1: LABEL=”DATA_14″ TYPE=”oracleasm”

/dev/sdp1: LABEL=”DATA_15″ TYPE=”oracleasm”

/dev/sdq1: LABEL=”DATA_16″ TYPE=”oracleasm”

/dev/sdr1: LABEL=”DATA_17″ TYPE=”oracleasm”

/dev/sds1: LABEL=”DATA_18″ TYPE=”oracleasm”

/dev/sdt1: LABEL=”DATA_19″ TYPE=”oracleasm”

/dev/sdu1: LABEL=”DATA_20″ TYPE=”oracleasm”

/dev/sdv1: LABEL=”DATA_21″ TYPE=”oracleasm”

/dev/sdw1: LABEL=”DATA_22″ TYPE=”oracleasm”

/dev/sdx1: LABEL=”DATA_23″ TYPE=”oracleasm”

/dev/sdy1: LABEL=”ORA_DATA_01″ TYPE=”oracleasm”

/dev/sda1: LABEL=”DATA_1″ TYPE=”oracleasm”

/dev/sdz1: LABEL=”ORA_DATA_02″ TYPE=”oracleasm”

/dev/sdaa1: LABEL=”ORA_DATA_03″ TYPE=”oracleasm”

/dev/sdab1: LABEL=”ORA_DATA_04″ TYPE=”oracleasm”

/dev/sdac1: LABEL=”ORA_DATA_05″ TYPE=”oracleasm”

/dev/sdad1: LABEL=”ORA_DATA_06″ TYPE=”oracleasm”

/dev/sdae1: LABEL=”ORA_DATA_07″ TYPE=”oracleasm”

[root@NODE1 ~]#

 

 

 

Haal met FDISK de partitie’s weg:

[root@NODE1 ~]# fdisk /dev/sdd
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

 

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won’t be recoverable.

The number of cylinders for this disk is set to 30720.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

software that runs at boot time (e.g., old versions of LILO)

booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

 

Command (m for help):
m
d voor delete a partition
1 Partition number (1-4)
w write is toepassen en resync

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

 

Controleren met:
[root@NODE1 ~]# /sbin/blkid | grep oracleasm

Of
[root@NODE1 ~]# ls -l /dev/disk/by-path
[root@NODE1 ~]# iscsiadm -m session –rescan (ook op NODE2 & NODE3)
Rescanning session [sid: 1, target: iqqn.2016-08.com.netapp:sn.101186186, portal: 172.17.17.5,3260] LET OP: gebruik bij het verwijderen derhalve de LABEL naam!!!
Op de NODE1 verwijder na FDISK de disk by LABEL:

 

[root@NODE1 ~]# oracleasm deletedisk -v DATA_3

 

 

Controleren met:
[root@NODE1 ~]# /sbin/blkid | grep oracleasm

Of
[root@NODE1 ~]# ls -l /dev/disk/by-path
[root@NODE1 ~]# iscsiadm -m session –rescan
Rescanning session [sid: 1, target: iqqn.2016-08.com.netapp:sn.101186186, portal: 172.17.17.5,3260] [root@NODE2 ~]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks…

Cleaning disk “DATA_3”

Scanning system for ASM disks…
[root@NODE2 ~]#  ls -l /dev/disk/by-path
[root@NODE3 ~]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks…

Cleaning disk “DATA_3”

Scanning system for ASM disks…
[root@NODE3 ~]#  ls -l /dev/disk/by-path
Extra aandachts punten:

Als je een disk hebt ge-dropped van een ASM diskgroup met (vermoedelijk zonder dat je met FDISK de partitie hebt verwijderd):

ALTER DISKGROUP DATA01 DROP DISK DISK1;

En na een rebalance probeer je en delete krijg je onderstaande melding:

# oracleasm deletedisk -v DISK1
Clearing disk header: oracleasm-write-label: Unable to open device “/dev/oracleasm/disks/DISK1”:
Device or resource busy failed
Unable to clear disk “DISK1”
The system details: 11.2.0.1 2-node RAC

Dan kan het navolgende helpen dit op te lossen:

First of all, I checked that there were no extents on DISK1.

$ . oraenv

ORACLE_SID = [+ASM1] ?
SQL> select PXN_KFFXP,  — physical extent number

XNUM_KFFXP, — virtual extent number

DISK_KFFXP, — disk number

AU_KFFXP    — allocation unit number

from X$KFFXP

where DISK_KFFXP=1;

no rows selected

I cleared the disk header by dd:

# dd if=/dev/zero of=/dev/oracleasm/disks/DISK1 bs=1024 count=100

100+0 records in

100+0 records out

102400 bytes (102 kB) copied, 0.000156 seconds, 656 MB/s

Note: My allocation unit is 1MB that is why I am using bs=1024.

Then deleted disk by oracleasm:

# oracleasm deletedisk DISK1

# oracleasm scandisks    <–Do this step on all nodes

TIPS & TRICKS:

http://docs.oracle.com/cd/E11882_01/server.112/e18951/asmdiskgrps.htm#OSTMG94106 http://dba.stackexchange.com/questions/57113/oracleasm-deletedisk-failed-unable-to-clear-disk