Performance tuning for NetBackup 7.x and 8.x for Solaris 10 and Solaris 11 Project resource allocation

Problem

Resource allocation instructions and settings are inadequate for NetBackup 7.x and projects created under the SMF (Service Management Facility) introduced in Solaris 10.

Error Message

This situation is most commonly identified by the following error message in the NetBackup Job Details.  It occurs when Solaris rejects a request by the bptm or bpdm process for either a shared memory ID or a shared memory segment.

Status Code 89: problems encountered during setup of shared memory

Cause

Versions of NetBackup prior to 7.0 registered the bpcd and vnetd processes with the Solaris 10 Service Management Facility (SMF) for the purpose of having Solaris listen for inbound connections and then start the appropriate vnetd or bpcd process, with the appropriate project, for each connection.  The bptm or bpdm processes started from bpcd inherited the project.  (See TECH62633 in the Related Articles for details).

NetBackup 7.0 changes this behavior by installing the vnetd and bpcd processes as standalone daemons.  Consequently, the project is not associated with vnetd and bpcd and not inherited by the bptm or other processes.  The most common side effect is that the default project does not provide a large enough allocation of shared memory or shared memory identifiers which results in backups failing with status code 89.

Solution

Follow these instructions to register NetBackup processes with Solaris projects created for NetBackup:

To use Solaris projects with NetBackup 7.x, it is necessary to customize the environment so that the project is associated with the NetBackup process of interest any time the process is started. The following examples relate to bptm because it is started from vnetd or bpcd. Similar steps should be successful relative to other NetBackup processes.

Note: For Shared Memory settings and Solaris system tuning, see parameters for Solaris in the NetBackup Planning and Performance Tuning Guide (linked as a Related Article), Chapter 10: OS related tuning factors for UNIX and Linux.

The following settings are tuned for a small in-house test environment and are intended as a point of reference only:

  • Solaris 11.2 master server
  • 1 Solaris 11.2 media server
  • 12 clients

1. Delete any previously created NetBackup project:

$ /usr/sbin/projdel NetBackup

2. Create a Solaris project for NetBackup.  This example creates project 1000, named "NetBackup:"

$ /usr/sbin/projadd -U root -c "NetBackup resource project" -p 1000 NetBackup

3. Execute the following commands to add desired settings for your setup, Message Queues, Shared Memory and Semaphore values:

$ /usr/sbin/projmod -a -K 'project.max-msg-ids=(privileged,1M,deny)' NetBackup
$ /usr/sbin/projmod -a -K 'project.max-sem-ids=(privileged,1M,deny)' NetBackup
$ /usr/sbin/projmod -a -K 'project.max-shm-ids=(privileged,1M,deny)' NetBackup
$ /usr/sbin/projmod -a -K 'project.max-shm-memory=(privileged,32G,deny)' NetBackup
$ /usr/sbin/projmod -a -K 'process.max-file-descriptor=(basic,1M,deny)' NetBackup
$ /usr/sbin/projmod -a -K 'process.max-file-descriptor=(privileged,1M,deny)' NetBackup

4. Use the following command to view the project settings:

$ projects -l NetBackup
NetBackup
      projid : 1000
      comment: "NetBackup resource project"
      users : root
      groups : (none)
      attribs: project.max-msg-ids=(privileged,1M,deny)
               ...
               project.max-shm-memory=(privileged,34359738368,deny)

5. To modify a project attribute, use the projmod command with the -s switch.

For example, to change the maximum shared memory setting to 10GB (10737418240) and the shared memory identifiers to 2K (2048), use the commands:

$/usr/sbin/projmod -s -K 'project.max-shm-memory=(privileged,10G,deny)' NetBackup
$/usr/sbin/projmod -s -K 'project.max-shm-ids=(privileged,2K,deny)' NetBackup

To verify the change was successful and that the project contains just one entry for the tunable attribute that you specified:

$ projects -l NetBackup | grep max-shm
project.max-shm-memory=(privileged,10737418240,deny)
project.max-shm-ids=(privileged,2048,deny)

6. NetBackup project settings need to be associated with NetBackup processes.

Ensure that any scripts that [re]start the NetBackup processes, especially vnetd and bpcd, are associated with the project before forking any child processes.

To ensure association at system boot time, modify the /etc/init.d/netbackup script to make this the second line in the script:
MYPID=$$; newtask -p NetBackup -c $MYPID

To ensure association during scripted [re]start of NetBackup, make the same edit to these scripts and any other scripts used to stop or restart netbackup:

  • /usr/openv/netbackup/bin/goodies/netbackup
  • /usr/openv/netbackup/bin/bp.start_all

Note:  Any custom site-specific changes to a script will need to be reapplied if a future NetBackup release update or hotfix contains an updated copy of that file (script). 

7. Ensure that any ad hoc restart of vnetd or bpcd from the command line makes a similar association.  Be sure to confirm that the processes have been stopped, then create a subshell and associate it with the project before restarting the processes.  That way, the project settings apply only to the processes started within the subshell and not to the login shell which is resumed following the exit from the subshell.

$ ps -ef | egrep 'vnetd|bpcd'
    root 13323     1   0   Aug 16 ?           0:05 /usr/openv/netbackup/bin/bpcd -standalone
    root 13320     1   0   Aug 16 ?           0:14 /usr/openv/netbackup/bin/vnetd -standalone

$ /usr/openv/netbackup/bin/bpcd -terminate
$ /usr/openv/netbackup/bin/vnetd -terminate
$ ps -ef | egrep 'vnetd|bpcd'
$

$ sh
MYPID=$$ ; newtask -p NetBackup -c $MYPID
/usr/openv/netbackup/bin/vnetd -standalone
/usr/openv/netbackup/bin/bpcd -standalone
exit

8. Verify the resource limits at any time with the following command:

$ ps -ef | egrep 'vnetd|bpcd'
root 29318 1 0 14:05:31 ? 0:00 vnetd -standalone
root 29315 1 0 14:05:26 ? 0:00 bpcd -standalone

$ /bin/prctl -n project.max-shm-memory 29318
process: 29318: vnetd -standalone
NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT
project.max-shm-memory
privileged 32GB - deny -
system 16.0EB max deny -

$ ipcs -A
IPC status from as of Mon Dec 1 12:47:11 CST 2014
T ID KEY MODE OWNER GROUP ... PROJECT
Message Queues:
q 44 0x52455051 --rw------- root root ... NetBackup
q 43 0x52455151 --rw------- root root ... NetBackup
T ID KEY MODE OWNER GROUP ... PROJECT
Shared Memory:
m 1275068433 0x5654 --rw-rw-rw- root root ... NetBackup
m 1275068432 0x5643 --rw-rw-rw- root root ... NetBackup
m 16777225 0x88d2d3f0 --rw-rw---- ora dba ... default
T ID KEY MODE OWNER GROUP ... PROJECT
Semaphores:
s 16777324 0x5653 --ra-ra-ra- root root ... NetBackup
s 16777321 0xacb45d9a --ra-r--r-- root root ... NetBackup
s 16777300 0x991c66a4 --ra-ra---- ora dba ... default
s 3 0x6312 --ra-ra-ra- root root ... user.root

Applies To

Solaris 10 and Solaris 11 projects
NetBackup 7.X, 8.X

 

Terms of use for this information are found in Legal Notices.

Read more

How to migrate Raspberry Pi 5 OS from micro SD to NVME m.2 SSD

首先我買了Raspberry Pi CM5後來買了Raspberry Pi CM5 I/O board來當個人電腦使用,系統是安裝在256GB SD卡上運行的很好。用久了在開啟較肥的程式像Web Browser或LiberOffice會有慢半拍的反應,而有了升級NVME m.2 SSD念頭。 因為Raspberry Pi 5支援的最快PCIe gen3 x 4就不去考慮快的Gen4 or Gen5 m.2 SSD。找了ADATA出的 LEGEND 710入門級的產品,會利用HMB(Host Memory Buffer)來加速I/O速度,因為是Raspberry Pi OS kernel會認不得而無法正常使用 事先在SD卡的/boot/firmware/cmdline.txt 加入 kernel command line參數如下,然後重開機m.

By Phillips Hsieh

How to document Home Lab and Network

運維機房和跨域的網路,會遇到各式需求與問題,用對工具才能分析問題,個人覺得最重要的是使用能處理問題的工具。 推薦目前想學和正在使用的平台與軟體,協助將公司/家用機房文件化 佈告欄任務管理 Focalboard 白板可管理任務指派 網路架構文件編寫 netbox 精細管理網路設備與連接線路 IP 資源管理 phpipam 專注網路IP分配 邏輯塊文件編寫 draw.io 視覺化概念圖 機房設備管理 ITDB 管理設備生命週期與使用者

By Phillips Hsieh

如何在Raspberry Pi4上安裝Proxmox for ARM64

第一步 準備好Raspberry Pi 4 / CM4 4GB RAM,這裡要留意CM4如果是買有內建eMMC storage會限制不能使用SD卡開機而限制本地空間容量,如果沒有NAS外接空間或使用USB開機的話,建議買CM4 Lite插上大容量SD卡 第二步 去Armbian官網下載最小化Debian bookworm image https://www.armbian.com/rpi4b/ Armbian 25.2.2 Bookworm Minimal / IOT 然後寫入SD/USB開機碟,寫入方法參考官方文件 https://github.com/raspberrypi/usbboot/blob/master/Readme.md Note: 官方提供的預先設定系統方法,可以在Armbian初次啟動自動化完成系統設定。連結在此 https://docs.armbian.com/User-Guide_Autoconfig/

By Phillips Hsieh

世界越快心越慢

在晚飯後的休息時間,我特別享受在客廳瀏灠youtube上各樣各式創作者的影音作品。很大不同於傳統媒體,節目多是針對大多數族群喜好挑選的,在youtube上我會依心情看無腦的動畫、一些旅拍記錄、新聞時事談論。 尤其在看了大量的Youtube的分享後,我真的感受到會限制我的是我的無知,特別是那些我想都沒想過的實際應用,在學習後大大幫助到我的生活和工作層面。 休息在家時,我喜歡想一些沒做過的菜,動手去設計生活和工作上的解決方案,自己是真的很難閒著沒事做。 如創作文章,陪養新的習慣都能感覺到成長的喜悅,是不同於吃喝玩樂的快樂的。 創作不去限制固定的形式,文字是創作、影像聲音也是創作,記錄生活也是創作,我想留下的就是創造—》實現—》回憶,這樣子的循環過程,在留下的足跡面看到自己一路上的成長、失敗、絕望、重新再來。 雖然大部份的時候去做這些創作也不明白有什麼特別的意義,但不去做也不會留下什麼,所以呀不如反事都去試試看,也許能有不一樣的水花也許有意想不到的結果,投資自己永遠不會是失敗的決定,不是嗎?先問問自己再開始計畫下一步,未來沒人說得準。 像最近看youtube仍大一群人在為DOS開

By Phillips Hsieh