Backup Linux server with PHP

Copy Source http://www.redips.net/php/backup-linux-server/
Tweet

You can find a lot of backup solutions for Linux server. From expensive and multi platform software like NetBackup to simple BASH scripts. As a Linux (LAMP) administrator, I decided to write my own backup script in PHP. I wanted to backup important locations like Web root, crontabs, /etc, /root and copy MySQL dump files. My script should be able to copy created tar.gz files and MySQL dumps to the remote server.

In post LAMP setup: Beginning I suggest how to arrange partitions for the LAMP server. Last mentioned partition was /backup and this is the location to save daily backups for the LAMP server – it’s big enough to keep backup for the last three days. I will not explain backup strategy, but in my case, I am satisfied with archived files to the local directory (partition) and remote server.

At the end, you will see complete PHP Backup class. Now I will show example how to save content of the /etc directory to the local directory.

// initialize Backup class and define local directory
$backup = new Backup(‘/backup/archive’);
// make backup of the /etc directory
$backup->tar(‘/etc’);

After backup is done, you will see log file in the /tmp directory and etc_2009-03-26.tar.gz in the /backup/archive directory. You can name the backup file if you like. For example, you can include /var/spool/cron files to the backup, and name it crontabs:

// initialize Backup class and define local directory
$backup = new Backup(‘/backup/archive’);
// backup crontab files
$backup->tar(‘/var/spool/cron’, ‘crontabs’);

Like in the previous example, crontabs_2009-03-25.tar.gz will be saved to the /backup/archive directory. One of my LAMP servers mounts exported NFS directory to the document root. I have to backup document root, but without mounted directory. So if you have similar situation, you can exclude files from the archive based upon pattern search.

// initialize Backup class and define local directory
$backup = new Backup(‘/backup/archive’);
// backup document root, but without mnt directory
$backup->tar(‘/var/www’, ‘www’, ‘html/mnt/*’);

Third parameter of the method “tar” means “exclude”, so if you need to use exclude parameter, you will have to define and the second parameter – name. All this examples save created archive to the local directory. With “tarc” and “rcopy” methods, archives can be copied to the remote server by scp command. Before you start to use “tarc” and “rcopy” method, you will have to exchange keys between LAMP server and remote server. Here is example how to backup Web server to the local directory and to the remote server:

// initialize Backup class, define local directory and remote server
$backup = new Backup(‘/backup/archive’, ‘user@server1:/backup/lamp1’);
// backup document root, etc and crontab directory
$backup->tarc(‘/var/www’);
$backup->tarc(‘/etc’);
$backup->tarc(‘/var/spool/cron’, ‘crontabs’);

Backup class has option to recursive copy matched files to the remote location. You will have to define start point and the pattern to match files. I have to copy MySQL daily backups to the remote server. Another script – automysqlbackup.sh exports MySQL databases to the file system. Dump files have current date and “sql” in the name, so backup script will copy “sql” files with current date in the name to the user@server1:/backup/lamp1 remote location.

// initialize Backup class, define local directory and remote server
$backup = new Backup(‘/backup/archive’, ‘user@server1:/backup/lamp1’);
// define current date (needed to find recent MySQL dump files)
$today = date(‘Y-m-d’);
// backup document root, etc, root home and crontab files
$backup->tarc(‘/var/www’);
$backup->tarc(‘/etc’);
$backup->tarc(‘/root’, ‘root_home’);
$backup->tarc(‘/var/spool/cron’, ‘crontabs’);
// copy MySQL dump files to the remote server
$backup->rcopy(‘/usr/mysql/export/daily’, “*$today*sql*”);

As you can see, Backup class has many options, but it’s not perfect. It can be extended with ftp option, without need for the local directory, option to define path and name of the log file … I tried to write readable and well commented PHP code, so you shouldn’t have any problem to understand, modify or customize Backup class for your needs.

/**
* Backup class has three public methods
* tar – saves archive to the local directory
* tarc – saves archive to the local directory and copies to the remote destination
* rcopy – recursive copy matched files to the remote location
*
*/
class Backup{
// define private properties
private $log; // pointer to the log object
private $backup_dir; // local directory
private $scp_server; // remote destination

/**
* constructor
*
* @param string $backup_dir – local directory where tar.gz files should be saved
* @param string $scp_server – (optional) remote location to save archives
*/
function __construct($backup_dir, $scp_server=null){
$this->log = new Logging(); // initialize Logging class
$this->backup_dir = $backup_dir; // set local backup directory
$this->scp_server = $scp_server; // set remote location
}

/**
* method saves archive to the local directory and copies to the remote destination
*
* @param string $dir – directory you want to archive
* @param string $name – (optional) name of the created archive
* @param string $exclude – (optional) excluded files from archive based upon pattern
*/
public function tarc($dir, $name=null, $exclude=null){
// call tar method to create archive in the local directory
$tar = $this->tar($dir, $name, $exclude);
// after archive is created, copy archive to the remote location
$this->scp($tar);
}

/**
* method saves archive to the local directory
*
* @param string $dir – directory you want to archive
* @param string $name – (optional) name of the created archive
* @param string $exclude – (optional) files / subtree to exclude from tar
*/
public function tar($dir, $name=null, $exclude=null){
// get local backup directory from the class property
$backup_dir = $this->backup_dir;
// define current date
$today = date(‘Y-m-d’);
// if tar name is not defined, use base name of the given path
if (!$name) $name = basename($dir);
// create complete tar name (path and name)
$tar = “$backup_dir/$name”.”_$today.tar.gz”;
// define excluded files based upon pattern (if needed)
if ($exclude) $exclude = “–exclude=\”$exclude\””;
// remove leading ‘/’ from the path
$dir = substr($dir, 1);
// execute tar command relative from / directory to
// avoid “tar: Removing leading `/’ from member names” warning
$this->run(“tar zcf $tar $exclude -C / $dir”);
// return tar name (needed for tarc method)
return $tar;
}

/**
* recursive copy matched files to the remote location
*
* @param string $dir – directory to start with
* @param string $pattern – pattern to search
*/
public function rcopy($dir, $pattern){
// find files matching pattern
$files = $this->find($dir, $pattern);
// loop through found files and call scp method
foreach ($files as $file) $this->scp($file);
}

/**
* create scp command and call run method
*
* @param string $file – absolute path to the source file
*/
private function scp($file){
// get remote location from the class property
$scp_server = $this->scp_server;
// execute and log scp command if scp server is defined
if ($scp_server) $this->run(“/usr/bin/scp -pq $file $scp_server/”);
else $this->log->lwrite(“Warning: scp server is not defined for $file!”);
}

/**
* method executes given command and logs to the log file
*
* @param string $command – command to execute
*/
private function run($command){
// execute command and redirect STDERR to the STDOUT
$output = shell_exec(“$command 2>&1”);
// log command and command output if exists to the log file
$this->log->lwrite($command);
if ($output) $this->log->lwrite($output);
}

/**
* find files matching a pattern
* using unix “find” command
*
* @return array containing all pattern-matched files or empty array
*
* @param string $dir – directory to start with
* @param string $pattern – pattern to search
*/
private function find($dir, $pattern){
// escape any character in a string that might be used to trick
// a shell command into executing arbitrary commands
$dir = escapeshellcmd($dir);
// if directory exists, then execute find command
if (file_exists($dir)){
// execute “find” and return string with found files
$files = shell_exec(“find $dir -name ‘$pattern’ -print”);
// create array from the returned string (trim will strip the last newline)
$files = explode(“\n”, trim($files));
// return array
return $files;
}
// else write warning to the log and return empty array
else{
$this->log->lwrite(“Warning: $dir does not exist (find)!”);
return Array();
}
}
}

You have probably noticed initialization of the Logging class in the constructor, but you can’t find the code. Logging class is described in Write to a log file with PHP, so you only need to place Logging and Backup class to the same PHP file. I also used code from my previous post Find files with PHP for private method “find”. The only modification is in checking if directory exists.

Read more

How to document Home Lab and Network

運維機房和跨域的網路,會遇到各式需求與問題,用對工具才能分析問題,個人覺得最重要的是使用能處理問題的工具。 推薦目前想學和正在使用的平台與軟體,協助將公司/家用機房文件化 佈告欄任務管理 Focalboard 白板可管理任務指派 網路架構文件編寫 netbox 精細管理網路設備與連接線路 IP 資源管理 phpipam 專注網路IP分配 邏輯塊文件編寫 draw.io 視覺化概念圖 機房設備管理 ITDB 管理設備生命週期與使用者

By Phillips Hsieh

如何在Raspberry Pi4上安裝Proxmox for ARM64

第一步 準備好Raspberry Pi 4 / CM4 4GB RAM,這裡要留意CM4如果是買有內建eMMC storage會限制不能使用SD卡開機而限制本地空間容量,如果沒有NAS外接空間或使用USB開機的話,建議買CM4 Lite插上大容量SD卡 第二步 去Armbian官網下載最小化Debian bookworm image https://www.armbian.com/rpi4b/ Armbian 25.2.2 Bookworm Minimal / IOT 然後寫入SD/USB開機碟,寫入方法參考官方文件 https://github.com/raspberrypi/usbboot/blob/master/Readme.md Note: 官方提供的預先設定系統方法,可以在Armbian初次啟動自動化完成系統設定。連結在此 https://docs.armbian.com/User-Guide_Autoconfig/

By Phillips Hsieh

世界越快心越慢

在晚飯後的休息時間,我特別享受在客廳瀏灠youtube上各樣各式創作者的影音作品。很大不同於傳統媒體,節目多是針對大多數族群喜好挑選的,在youtube上我會依心情看無腦的動畫、一些旅拍記錄、新聞時事談論。 尤其在看了大量的Youtube的分享後,我真的感受到會限制我的是我的無知,特別是那些我想都沒想過的實際應用,在學習後大大幫助到我的生活和工作層面。 休息在家時,我喜歡想一些沒做過的菜,動手去設計生活和工作上的解決方案,自己是真的很難閒著沒事做。 如創作文章,陪養新的習慣都能感覺到成長的喜悅,是不同於吃喝玩樂的快樂的。 創作不去限制固定的形式,文字是創作、影像聲音也是創作,記錄生活也是創作,我想留下的就是創造—》實現—》回憶,這樣子的循環過程,在留下的足跡面看到自己一路上的成長、失敗、絕望、重新再來。 雖然大部份的時候去做這些創作也不明白有什麼特別的意義,但不去做也不會留下什麼,所以呀不如反事都去試試看,也許能有不一樣的水花也許有意想不到的結果,投資自己永遠不會是失敗的決定,不是嗎?先問問自己再開始計畫下一步,未來沒人說得準。 像最近看youtube仍大一群人在為DOS開

By Phillips Hsieh

知識管理的三個步驟:一小時學會把知識運用到生活上

摘錄瓦基「閱讀前哨站」文章作為自己學習知識管理的內容 Part1「篩選資訊」 如何從海量資訊中篩選出啟發性、實用性和相關性的精華,讓你在學習過程中不再迷失方向。 1. 實用性 2. 啟發性 Part2「提高理解」 如何通過譬喻法和應用法,將抽象的知識與日常生活和工作緊密結合,建立更深刻的理解。 1. 應用法 2. 譬喻法 Part3「運用知識」 如何連結既有知識,跟自己感興趣的領域和專案產生關聯,讓你在運用知識的路途上游刃有餘。 1. 跟日常工作專案、人際活動產生連結 # 為什麼要寫日記? * 寫日記是為了忘記,忘卻瑣碎事情,保持專注力 * 寫日記就像在翻譯這個世界,訓練自己的解讀能力 * 不只是透過日記來記錄生活,而是透過日記來發展生活 #如何寫日記? * 不要寫流水帳式的日記,而是寫覆盤式的日記 當我們試著記錄活動和感受之間的關聯,有助於辦認出真正快樂的事 日記的記錄方式要以過程為主,而非結果 * 感恩日記的科學建議,每日感恩的案例

By Phillips Hsieh