Netbackup Storage Lifecycle Policy (SLP) Cheat Sheet

Problem

 Cheat sheet for SLP (Storage Lifecycle Policy)

Solution

Common SLP Related Commands

Show EMM Image list of Images that were backed up to an SLP STU [ -I / -U ]

nbstlutil list
nbstlutil list –lifecycle <name>
nbstlutil list –backupid <id_value>
nbstlutil list -image_state <value>
nbstlutil list -copy_state <value>
nbstlutil list -frag_state <value>
nbstlutil list –mediaid <media_id>_–state 3

Activate /Inactivate SLP operations

 

nbstlutil inactive –lifecycle <lifecycle name>
nbstlutil inactive –backupid <backupid>
nbstlutil active –lifecycle <lifecycle name>
nbstlutil active –backupid <backupid>

Cancel pending operations on selected image

nbstlutil cancel -backupid <backupid>
nbstlutil cancel -lifecycle <lifecycle>

Show status on Incomplete copies of Lifecycle Managed images

nbstlutil stlilist –lifecycle <lifecycle name>
nbstlutil stlilist –backupid <backupid>
nbstlutil stlilist –image_state <value>
nbstlutil stlilist –image_incomplete
nbstlutil stlilist –image_inactive

List Storage Units

nbstl –l
nbstu -L

States

State image Copy Frag
1 NOT_STARTED NOT_STARTED ACTIVE
2 IN_PROCESS IN_PROCESS TO_BE_DELETED
3 COMPLETE COMPLETE ELIGIBLE_FOR_EXPIRATION
9 NOT_STARTED & INACTIVE NOT_STARTED & INACTIVE N/A
10 IN_PROCESS & INACTIVE IN_PROCESS & INACTIVE N/A

 

Logging

SLP Unified (VX) Logs

Master Server

vxlogcfg -a -p 51216 -o 111 -s DebugLevel=6 -s DiagnosticLevel=6 (nbemm)
vxlogcfg -a -p 51216 -o 143 -s DebugLevel=6 -s DiagnosticLevel=6 (mds / Included in 111, no separate log)
vxlogcfg -a -p 51216 -o 116 -s DebugLevel=6 -s DiagnosticLevel=6 (nbpem)
vxlogcfg -a -p 51216 -o 117 -s DebugLevel=6 -s DiagnosticLevel=6 (nbjm )
vxlogcfg -a -p 51216 -o 118 -s DebugLevel=6 -s DiagnosticLevel=6 (nbrb)
vxlogcfg -a -p 51216 -o 226 -s DebugLevel=6 -s DiagnosticLevel=6 (nbstserv)
vxlogcfg -a -p 51216 -o 272 -s DebugLevel=6 -s DiagnosticLevel=6 (expmgr – Included in 226, no separate log)
vxlogcfg -a -p 51216 -o 219 -s DebugLevel=6 -s DiagnosticLevel=6 (rem – Included in 111, no separate log)
vxlogcfg -a -p 51216 -o 230 -s DebugLevel=6 -s DiagnosticLevel=6 (rdsm)
vxlogcfg -a -p 51216 -o 137 -s DebugLevel=6 -s DiagnosticLevel=6 (libraries / no separate log file)
vxlogcfg -a -p 51216 -o 156 -s DebugLevel=6 -s DiagnosticLevel=6 (nbace / no separate log file)

Media Server

vxlogcfg -a -p 51216 -o 220 -s DebugLevel=6 -s DiagnosticLevel=6 (dps / media – Included in 222, no separate log)
vxlogcfg -a -p 51216 -o 221 -s DebugLevel=6 -s DiagnosticLevel=6 (mpms / media – Included in 222, no separate log)
vxlogcfg -a -p 51216 -o 202 -s DebugLevel=6 -s DiagnosticLevel=6 (stssvc /media – included in 222, no separate log)
vxlogcfg -a -p 51216 -o 222 -s DebugLevel=6 -s DiagnosticLevel=6 (nbrmms / media)
vxlogcfg -a -p 51216 -o 230 -s DebugLevel=6 -s DiagnosticLevel=6 (rdsm / media + master)
vxlogcfg -a -p 51216 -o 137 -s DebugLevel=6 -s DiagnosticLevel=6 (libraries / no separate log file)
vxlogcfg -a -p 51216 -o 156 -s DebugLevel=6 -s DiagnosticLevel=6 (nbace / no separate log file)

SLP Legacy Logs

Master Server

/usr/openv/netbackup/logs/admin
/usr/openv/netbackup/logs/bpdbm

Media Server

/usr/openv/netbackup/logs/bpbrm
/usr/openv/netbackup/logs/bptm
/usr/openv/netbackup/logs/bpdm
/usr/openv/netbackup/logs/bpbkar

DupMgr and ExpMgr

DupMgr runs on a fixed interval and while it is processing it is in a “replication session”:
Session timer is the sleep interval between replication sessions
Manages image copying for SLP only

ExpMgr runs in response to:
Events submitted by REM (oid = 219) in nbemm OR
Bby “diskfull” status in bptm

DupMgr and ExpMgr can and do run in parallel:
While a replication session is in progress, a HWM event will be processed and not wait on the replication session to complete
Only one replication session will be active at any given time
Multiple HWM events can be processed in parallel

Database Tables

EMM_Image / EMM_ImageCopy / EMM_ImageFragment

Additional Information to gather
/usr/openv/var/global/nbstserv
/usr/openv/netbackup/db/ss
/usr/openv/netbackup/db/jobs/trylogs
/usr/openv/netbackup/db/error/log_<ctime>

How to change the duplication session interval

By default, the duplication manager in nbstserv starts a new duplication session 300 seconds after the previous session ends. The session timer can be modified without cycling nbstserv
(1) Edit the parameter DUPLICATION_SESSION_INTERVAL_MINUTES in LIFECYCLE_PARAMETERS file (2) To force a new session to start: nbstlutil new_session

Minimum of x2 duplication sessions to complete processing for an image

The way the code works, it takes at least two dup sessions to complete processing for an image – one to kick off the dup job and one to process the results. There have been several problems reports where people have run into disk full conditions they didn’t expect because their test case filled the disk before any of the copies could be moved to eligible-for-expiration state

SLP definitions not store in /usr/openv/netbackup/db/class

SLP definitions can be found in /usr/openv/netbackup/db/ss

Document ID Title
   
000040271 Best Practices for SLP
000010943 SLP Tape Contention login can spawn multiple duplication jobs
000039508 SLP Tunables
000011301  Duplication not starting for SLP

 

Create Advanced Diskpool

nbdevconfig -creatests -storage_server <server name> -stype AdvancedDisk -st 5 -media_server <media server>
tpconfig -add -storage_server <server name> -stype AdvancedDisk -sts_user_id ANYTHING -password ANYTHING -st 1
nbdevconfig -previewdv -stype AdvancedDisk -storage_server <server name> -media_server <media server> -dvlist /tmp/dvlist
nbdevconfig -createdp -stype AdvancedDisk -dp Advance_DiskPool -storage_servers <server name> -dvlist /tmp/dvlist

common_server_for_dup Setting (Default, Preferred, Required)

nbemmcmd -changesetting -common_server_for_dup < default |preferred |required> -machinename master server name

default – The default option (default) instructs NetBackup to try to match the destination media server with the source media server
preferred – The preferred option instructs NetBackup to search all matching media server selections for the source
required – The required option instructs NetBackup to search all media server selections for the matching source

LIFECYCLE_PARAMETERS

The LIFECYCLE_PARAMETERS (manual creation) file is located in /usr/openv/netbackup/db/config on UNIX and Linux master servers and <install path>\veritas\netbackup\db\config on Windows master servers.

MIN_GB_SIZE_PER_DUPLICATION_JOB 8 / Default value: 8 GB
Adjusting this value, indicated in gigabytes, affects the number and size of duplication jobs. If the MIN_GB_SIZE_PER_DUPLICATION_JOB setting is small, more duplication jobs are created. If it is large, fewer, larger duplication jobs are created.

MAX_GB_SIZE_PER_DUPLICATION_JOB 25 / Default value: 25 GB
This entry controls the maximum size of a duplication job. (When a single image is larger than the maximum size, that one image will be put into its own duplication job.)

MAX_MINUTES_TIL_FORCE_SMALL_DUPLICATION_JOB 30 / Default value: 30 minutes
This value allows duplication jobs to be submitted that do not meet the minimum size criterion

DUPLICATION_SESSION_INTERVAL_MINUTES 5 / Default 5 minutes
Frequency nbstserv looks to see if enough backups have completed and decides whether or not it is time to submit a duplication job(s)

IMAGE_EXTENDED_RETRY_PERIOD_IN_HOURS 2 / Default 2 hours
After duplication of an image fails 3 times, this is the time interval between subsequent retries

DUPLICATION_GROUP_CRITERIA 0 | 1
0 = Use the SLP name / 1 = Use the duplication job priority. Use 1 to indicate that batches be created based on the duplication job priority from the SLP definition

TRESHOLD_JOB_COUNT 100
Enable/Disable logic / 0 is default (disabled) If > 0 nbstserv will check the number of Active/Queued duplication jobs. If the job count is lower than the number specified the logic will be used

SESSION_RUN_TIME_MIN 60 / Default value: 60
This setting specifies the time in minutes that will elapse before batching logic is suspended and duplication jobs are submitted under a time controlled session.

 

Veritas NetBackup 7.5 Changes

Beginning with NetBackup 7.5, you cannot specify Any_Available in the Storage Unit field of an SLP operation. It does not appear in the pick list in the user interfaces. Existing SLPs continue to execute as before if Any_Available is already used in the SLP as long as the SLP is not changed. If the SLP is edited, the Any_Available selections must be replaced with real storage units or storage unit groups before the changes can be successfully committed.

This release introduces a change in syntax for the parameters in the LIFECYCLE_PARAMETERS file, that affects storage lifecycle policies. The administrator can create a LIFECYCLE_PARAMETERS file to customize how the NetBackup storage lifecycle manager (nbstserv) runs duplication and import jobs. The parameters are described in the NetBackup Administrator’s Guide, Volume I.

Note: With NetBackup 7.5, the syntax of the parameters has changed. An equals (=) sign is now used between the parameter name and the value. For example, IMPORT_SESSION_TIMER = 1.

This release contains new and corrected LIFECYCLE_PARAMETER values. The spelling of TRESHOLD_JOB_COUNT has been corrected to THRESHOLD_JOB_COUNT. And the new MAX_IMAGES_PER_SNAPSHOT_REPLICATION_JOB parameter has been added. That parameter sets the maximum number of images that can be included in a snapshot replication job. The value is used to tune the size of replication jobs to avoid overloading the hardware vendor replication infrastructure.

If you try to expire the image or the image copies manually that are not SLP-complete, the request fails with a 1573 error. To expire the image or images, you can do one of the following:

  • Wait for the image or copy to become SLP-complete.
  • Use the nbstlutil cancel command to terminate the SLP processing.
  • Add the -force_not_complete option to the bpexpdate command to force the expiration even if the image or copy is not SLP-complete.

 

If you use an IP address for your host name and use a Storage lifecycle policy (SLP) for a backup and a duplication, your duplication jobs fail with a status 228 error. The clients with the IP address host names have to be named in a backup policy that sends data to an SLP.

In this release, NetBackup performs additional validations before it allows the creation of storage lifecycle policies. In previous versions, NetBackup allowed the creation of all SLPs with undetected errors. After a NetBackup environment is upgraded to 7.5, when an administrator opens a previously permitted, but invalid SLP, the SLP must be corrected in order for it to be saved and run in 7.5.

Read more

世界越快心越慢

在晚飯後的休息時間,我特別享受在客廳瀏灠youtube上各樣各式創作者的影音作品。很大不同於傳統媒體,節目多是針對大多數族群喜好挑選的,在youtube上我會依心情看無腦的動畫、一些旅拍記錄、新聞時事談論。 尤其在看了大量的Youtube的分享後,我真的感受到會限制我的是我的無知,特別是那些我想都沒想過的實際應用,在學習後大大幫助到我的生活和工作層面。 休息在家時,我喜歡想一些沒做過的菜,動手去設計生活和工作上的解決方案,自己是真的很難閒著沒事做。 如創作文章,陪養新的習慣都能感覺到成長的喜悅,是不同於吃喝玩樂的快樂的。 創作不去限制固定的形式,文字是創作、影像聲音也是創作,記錄生活也是創作,我想留下的就是創造—》實現—》回憶,這樣子的循環過程,在留下的足跡面看到自己一路上的成長、失敗、絕望、重新再來。 雖然大部份的時候去做這些創作也不明白有什麼特別的意義,但不去做也不會留下什麼,所以呀不如反事都去試試看,也許能有不一樣的水花也許有意想不到的結果,投資自己永遠不會是失敗的決定,不是嗎?先問問自己再開始計畫下一步,未來沒人說得準。 像最近看youtube仍大一群人在為DOS開

By Phillips Hsieh

知識管理的三個步驟:一小時學會把知識運用到生活上

摘錄瓦基「閱讀前哨站」文章作為自己學習知識管理的內容 Part1「篩選資訊」 如何從海量資訊中篩選出啟發性、實用性和相關性的精華,讓你在學習過程中不再迷失方向。 1. 實用性 2. 啟發性 Part2「提高理解」 如何通過譬喻法和應用法,將抽象的知識與日常生活和工作緊密結合,建立更深刻的理解。 1. 應用法 2. 譬喻法 Part3「運用知識」 如何連結既有知識,跟自己感興趣的領域和專案產生關聯,讓你在運用知識的路途上游刃有餘。 1. 跟日常工作專案、人際活動產生連結 # 為什麼要寫日記? * 寫日記是為了忘記,忘卻瑣碎事情,保持專注力 * 寫日記就像在翻譯這個世界,訓練自己的解讀能力 * 不只是透過日記來記錄生活,而是透過日記來發展生活 #如何寫日記? * 不要寫流水帳式的日記,而是寫覆盤式的日記 當我們試著記錄活動和感受之間的關聯,有助於辦認出真正快樂的事 日記的記錄方式要以過程為主,而非結果 * 感恩日記的科學建議,每日感恩的案例

By Phillips Hsieh
2024年 3月30日 14屆美利達環彰化百K

2024年 3月30日 14屆美利達環彰化百K

這是場半小時就被秒報名額滿的經典賽事, 能順利出賽實屬隊友的功勞, 這次的準備工作想試試新買的外胎, 因為是無內胎用的外胎, 特別緊超級難安裝的, 問了其他朋友才知道, 要沾上肥皂水才容易滑入車框。 一早四點起床準備, 五點集合備好咖啡在車上飲用, 約了六點在彰化田尾鄉南鎮國小, 整好裝四人一起出發前往會場。 被排在最後一批出發, 這次的路線會繞行的員林148上139縣道, 其實在早上五點多天就開始有點飄雨, 大伙就開始擔心不會要雨戰吧! 果不其然才出發準備上148爬坡雨勢越來越大, 戴著防風眼鏡的我在身體的熱氣加上雨水冷凝效果下, 鏡面上滿是霧氣肉眼可視距離才剩不到五公尺, 只能緊依前前方的車友幫忙開路, 之後洪大跟上來我立馬請求他幫忙開路, 上了139停下車把防風眼鏡收起來, 反正下雨天又陰天完全用不到太陽眼鏡了。 雨是邊下邊打雷, 大伙都在這條139上一台一台單車好像避電針, 一時有點害怕不然想平時沒做什麼壞事, 真打到自己就是天意了。 下了139雨勢開始變小, 大伙的速度開始有所提昇, 開高鐵列車的時機己成熟, 物色好列車就跟好跟滿。 最後找了一隊似乎整團有固定在練

By Phillips Hsieh
2023 12月9號 美利達單車嘉年華

2023 12月9號 美利達單車嘉年華

第二次參加美利達環南投賽事, 還記得去年第一次參加這美利達環南投, 還特地提前一天跟車友在魚池住了一晚。 這回用上了剛在7月份剛安裝的車頂架, 安裝了二種不同的攜車架, 都樂這邊可以不用拆車輪直上車頂, YAKIMA這邊選了經濟的款式, 折掉前輪利用前叉固定在攜車架上。 約了唯一一位一起參加的朋友, 二人一早四點約見面, 幫朋友帶上了拿鐵咖啡, 開上日月潭在水社碼頭停好車, 騎往向山遊客中心, 路過美麗的日月潭簡直不要太美了拍一張。 抵達會場己是人山人海了, 跟著大伙排隊順便也看網紅也欣賞名車。 出發就先沿著日月潭順時針騎, 騎到玄裝寺很急停下來上一下廁所, 比賽時都會尿都特別的滿, 一方面是比較緊張,一方面是特別興奮。 這時己經跟車友失散了, 只能獨推沿路看有沒有車友可以一起組隊的, 很可惜在山區大家的實力不一只求平安順騎了, 原則就是有補給就停有食物就吃。 下到水里人群再次聚集起來, 光等紅綠燈就是一條車龍。 騎行了一大圈水里再回到131縣道, 這時背後傳來熟悉的聲音叫菲哥, 終於跟車友重新集合接下來就一路邊聊邊騎。 最後來幾張專業攝影師拍攝的照片 回到終點台上

By Phillips Hsieh