Syed Jahanzaib Personal Blog to Share Knowledge !

November 16, 2011

DMASOFTLAB Radius Manager Backup Script !


LAST UPDATED:  3rd-Feb-2017

Following is an customized backup script for DMASOFTLAB Radius Manager database (radius) and other radius manager related files. It creates FULL Backup of all configuration files related to RM & mysql database (radius) in local storage, you can connect your USB or secondary HDD. You can also configure cloud like DROPBOX so that copy of backup should be copied to CLOUD as well, MOST RECOMMENDED.

NOTE: Using S.S.D disk (or raid) are highly recommended as there are less chances of failure for SSD disks, and above all there read/write rates are good plus if you use RAID system, then it will provide redundancy as well.

Modify the script as per your requirements …

Revision History:

[10th January, 2014]    Added various functions like script execution time Logs
[10th January, 2014]    Added LOG file to record all script activity in /var/log/fullbackup.log
[10th January, 2014]    Added Description for various tasks in the scripts
[10th January, 2014]    Howto section added on scheduling to run script on daily basis in night at 00:00 hours


Let’s Start …


 

First create temp folder and create script in it.
mkdir /temp
cd /temp
touch fullbackup.sh
chmod +x fullbackup.sh
touch /var/log/fullbackup.log

Now open the file

nano /temp/fullbackup.sh

and paste the following code.


#!/bin/bash
# Version 2.1 / 3-Feb-2017
# Syed Jahanzaib / Web: https://aacable.wordpress.com / Email: aacable@hotmail.com
# This script will create FULL Backup of MySQL DB (Radius) and RADIUS MANAGER related DATA files.
# We can modify it to do incremental basis backup too, but based on my personal experiences, I prefer to have FULL backup instead of incremental,
# Because you never know what you will going to need in case of disaster recovery
# Adjust below DATA fields accordingly. remove / add desired folders.

# Settings various VARIABLES for the script
# Colors Config . . . [[ JZ . . . ]]
ESC_SEQ="\x1b["
COL_RESET=$ESC_SEQ"39;49;00m"
COL_RED=$ESC_SEQ"31;01m"
COL_GREEN=$ESC_SEQ"32;01m"

# IF YOU HAVE FEDORA or CENTOS, Change the /var/www to /var/www/html/

# Following is FULL
#TARGET="/var/www/radiusmanager /sql_backup /etc /usr/local /var/lib/mysql"

# Following is only RADIUS HTML FILES, mysqldb is separate from this, will come later in the script with mysqldump
TARGET="/var/www/radiusmanager /etc/radiusmanager.cfg /sql_backup /temp /cfg"
SAVEDIR_FULL="/backup"

# For Dropbox , you must activate DROPBOX first. I post guide on it another post.
DROPBOX="/root/Dropbox"
sql_dir="/sql_backup"
radpwd="PASSWORD"

#MYSQL DETAILS
SQLUSER="root"
SQLPASS="PASSWORD"

#LOG FILE
LOG="/var/log/fullbackup.log"

#SET DATE TIME
set $(date)
time=`date |awk '{print $4}'`
YESTERDAY=`date --date='yesterday' +%Y-%m-%d`

rm -fr /var/www/radiusmanager/tmpimages/*
clear

GMAILID="GMAIL-ID@gmail.com"
GMAILPASS="GMAIL-PASSWORD"
ADMINMAIL1="ADMIN1@HOTMAIL.COM"
COMPANY="ZAIB (Pvt) Ltd."

# Set KANNEL Details if you want to send SMS
KHOST="127.0.0.1"
KID="kannel"
KPASS="KANNEL-PASSWORD"
CELL1="03333021909"
RMBACKUPSMSFILE="/tmp/rmbackupsms.txt"
> $RMBACKUPSMSFILE

#############################################
######## START the BACKUP PROCESS ... #######
#############################################

# Start counting start time
start_time=`date +%s`
echo -e "$COL_RED Welcome ! This is Radius Manager Backup Script, It will take backup of RADIUS Database and Folders Following ...
$TARGET
Backup started at $6-$2-$3 Time $time . . .

Powered by Syed.Jahanzaib $COL_RESET"

# Checking if $SAVEDIR_FULL folder is previously present or not . . .
{
if [ ! -d "$SAVEDIR_FULL" ]; then
echo
echo
echo -e "$COL_RED $SAVEDIR_FULL folder not found, Creating it so all backup's should be placed there . . . $COL_RESET"
mkdir $SAVEDIR_FULL
else
echo
echo -e "$COL_GREEN ********* $SAVEDIR_FULL folder is already present , so no need to create it, Proceeding further . . . $COL_RESET"
fi
}

# Checking if $sql_dir folder is previously present or not . . .
{
if [ ! -d "$sql_dir" ]; then
echo
echo
echo -e "$COL_RED $sql_dir folder not found, Creating it MSQL EXPORT/DUMP backup should be placed there . . . $COL_RESET"
mkdir $sql_dir
else
echo
echo -e "$COL_GREEN ********* $sql_dir folder is already present , so no need to create it, Proceeding further . . . $COL_RESET"
fi
}

# Creating MYSQL dump of databases
echo "++++++++++++++++" > $LOG
echo "Main Backup started at $6-$2-$3 Time $time" >> $LOG
echo " " >> $LOG
echo " " >> $LOG
echo
echo "******************************** MYSQL DUMP LOG *************" >> $LOG
echo -e "$COL_GREEN ********* Exporting MYSQL DUMP to $sql_dir ... $COL_RESET"
echo "++++++++++++++++" >> $LOG
echo
echo "Mysql SQL export started at $6-$2-$3 Time $time" >> $LOG
mysqldump -u$SQLUSER -p$SQLPASS radius > $sql_dir/mysql_db_full_$6-$2-$3.sql
echo "++++++++++++++++" >> $LOG
echo "Mysql SQL export ended at $6-$2-$3 Time $time" >> $LOG
echo "++++++++++++++++" >> $LOG
echo " " >> $LOG
echo " " >> $LOG

# GZIP MYSQL D.B
echo "******************************* GZIP LOG Section *************" >> $LOG
echo "GZIP command started at $6-$2-$3 Time $time" >> $LOG
gzip -fv $sql_dir/mysql_db_full_$6-$2-$3.sql >> $LOG
echo "++++++++++++++++" >> $LOG
echo "GZIP command ended at $6-$2-$3 Time $time" >> $LOG
echo "++++++++++++++++" >> $LOG
echo " " >> $LOG
echo " " >> $LOG
echo

# TAR GZIP (mysql)
echo -e "$COL_GREEN ********* TAR - Compressing all Backup Folders to $SAVDIR_FULL ... $COL_RESET"
echo
echo "******************************** TAR All DATA Section *************" >> $LOG
echo "TAR command strted at $6-$2-$3 Time $time" >> $LOG
FILENAME="dma_backup_by_zaib_$6-$2-$3"
tar cfzv $SAVEDIR_FULL/$FILENAME.tgz $TARGET >> $LOG

# COPY BACKUP TO 'DROPBOX' FOLDER, I have disabled it as not every1 may use it.
# cp $SAVEDIR_FULL/$FILENAME.tgz $DROPBOX

echo " " >> $LOG
echo "++++++++++++++++" >> $LOG
echo "TAR command ended at $6-$2-$3 Time $time" >> $LOG
echo "++++++++++++++++" >> $LOG

# Deleting sql db from $sql_dir because its zipped with the above command already and now all data available in single file : )
rm -fr $sql_dir/*
echo

# Print END time
echo "MAIN Backup ended at $6-$2-$3 Time $time"
echo "MAIN Backup ended at $6-$2-$3 Time $time" >> $LOG
echo
echo -e "$COL_GREEN ********* Backup completed to $SAVEDIR_FULL ... $COL_RESET"
echo
echo -e "$COL_RED Backup ended at $6-$2-$3 Time $time . . . $COL_RESET"
end_time=`date +%s`
echo
echo
echo " " >> $LOG
echo " " >> $LOG
echo " " >> $LOG

# Delete files older than 30 days, to prevent disk fillup
echo "Deleting Older files then 30 days, to save disk space . . ."

# echo Deleting Older files then 30 days, to save disk space >> $LOG
find $SAVEDIR_FULL/* -mtime +30 -exec rm {} \;

# Also delete files older than 340 day from dropbox folder
find $DROPBOX/* -mtime +20 -exec rm {} \;

# Print Complete Timings
echo MAIN Backup Completion Time was `expr $end_time - $start_time` s.
echo MAIN Backup Completion Time was `expr $end_time - $start_time` s. >> $LOG
echo

#STORE LAST FILE FILE NAME IN TEMP HOLDER
LASTFILE=`find $SAVEDIR_FULL -type f -mmin -10 > /tmp/lastbfile`
LASTFILESMS=`cat /tmp/lastbfile | sed -e 's/\/temp\///'`

# CHECK FILE SIZE AND COMPARE, IF ITS LESS , THEN ALERT
SIZE=`ls -lh $LASTFILESMS | awk '{print $5}'`
SIZEB=`ls -l $LASTFILESMS | awk '{print $5}'`
if [ $SIZEB -lt 1 ]
then
echo "FAILED FAILED FAILED"
RESULT="FAILED FAILED FAILED!!"
else
echo "SUCCESSFULL!"
RESULT="SUCCESSFULL"
fi
######## PRINT INFO SECTION #########
# Print Fetched Information on Screen , for info to see
echo "Last Backup File is $LASTFILESMS"
echo "GT RM INFO: Backup for $YESTERDAY is completed successfully.
File Name = $LASTFILESMS
Size = $SIZE

Backup Completion Time was `expr $end_time - $start_time` s.
$COMPANY
Powered by Syed Jahanzaib"

############## SMS SECTION ##############

# Send SMS
MSG="GT RM INFO: Backup OF Radius for $YESTERDAY is $RESULT.
File Name = $LASTFILESMS
Size = $SIZE

Backup Completion Time was `expr $end_time - $start_time` s.

$COMPANY
Powered by Syed Jahanzaib"

echo "GT RM INFO: Backup OF Radius for $YESTERDAY is $RESULT.
File Name = $LASTFILESMS
Size = $SIZE

Backup Completion Time was `expr $end_time - $start_time` s.

$COMPANY
Powered by Syed Jahanzaib" > $RMBACKUPSMSFILE

# Send SMS Alert via KANNEL
#echo "Sending SMS ALERT to $CELL1 & $CELL2 ..."
#echo ""
#curl "http://$KHOST:13013/cgi-bin/sendsms?username=$KID&password=$KPASS&to=$CELL1+$CELL2" -G --data-urlencode text@$RMBACKUPSMSFILE
#curl -G "http://localhost/test.php?sender=$SENDER&to=$MOBILE" --data-urlencode "message=$MSG"
############## EMAIL SECTION ##############

# Make sure you install sendEMAIL tool and test it properly before using email section.
#SEND EMAIL Alert As well using sendEMAIL tool using GMAIL ADDRESS.
# If you want to send email , use below ...
echo ""
echo "Sending EMAIL ALERT to $ADMINMAIL1 ..."
/temp/sendEmail-v1.56/sendEmail -t $email -u "GT RM Backup Info for $YESTERDAY / Size=$SIZE" -o tls=yes -s smtp.gmail.com:587 -t $ADMINMAIL1 -xu $GMAILID -xp $GMAILPASS -f $GMAILID -o message-file=$RMBACKUPSMSFILE -o message-content-type=text

# Print Credits : )
echo -e "$COL_GREEN ********* Syed Jahanzaib / aacable@hotmail.com / https://aacable.wordpress.com $COL_RESET"
echo Syed Jahanzaib / aacable@hotmail.com / https://aacable.wordpress.com >> $LOG

🙂

 


Now execute this script ,

After completion see the logs files

nano /var/log/fullbackup.log
OR
cat /var/log/fullbackup.log

Also Visit…

https://aacable.wordpress.com/2012/11/30/dmasoftlab-radius-manager-install-backup-restore-short-reference-guide/


https://aacable.wordpress.com/2014/01/04/automated-installation-script-for-radius-manager-v-4-0-44-1-4-with-latest-patch/


HOWTO SCHEDULE THE SCRIPT TO RUN ON DAILY BASIS

To run this file on daily basis (at 00:00 hours),
Open terminal, (make sure you are logged in with the root user.
type

crontab -e

(if it asks for text editor, select nano ,)

Now paste following code …

@daily  /temp/fullbackup.sh          # Run Daily in night at 00:00 hours

Save & Exit:

Now, based on above selection, cron job will run this command at selected scheduled timings and clear any memory cache


TIP: Remove files older than xx days

When you will implement this script, it will backup every day, and continue to do so, and its a good idea to remove backup files older then 1 month, to save disk space otherwise one day it will chew whole disk space 😀
You can add following in the same backup script at end, so that whenever it will execute backup script, it will delete older files too

echo Deleting Older files then 30 days, to save disk space
# echo Deleting Older files then 30 days, to save disk space  >> /var/log/fullbackup.log
find /backup/* -mtime +30 -exec rm {} \;


> SCRIPT   EXECUTION   RESULT …

 

b2

> EMAIL   ALERT   EXECUTION …

 

b1

> SMS   ALERT   EXECUTION …

 

2016-05-29 05.32.34


Regard’s
Syed Jahanzaib

September 6, 2011

Mikrotik Voucher Template !

Filed under: Mikrotik Related — Tags: , , , , , , , — Syed Jahanzaib / Pinochio~:) @ 1:57 PM

It would be great If MIKROTIK adds feature in USER MANAGER (UM) of adding serial numbers with each ID, So that we can print voucher with serial numbers, and can search ids by corresponding serial number.

I have customized the following vouchers but unable to add serial number.
I am working on MS ACCESS program to import ids passwds from .CSV file ,
then print it using my customized templates and add serial number to each id and store it in its database to prevent Duplication, and also add search function by serial. I will publish it soon.

Voucher Display Sample I am currently using

Mikrotik Voucher Sample

HOWTO Use this template to Print Vouchers for Single or Batch Users !!

First login to your user manager e.g http://192.168.2.1/userman
Now to use the template, goto Settings / Templates and in ROW section box, select all and delete , now paste the complete template in this box. and click on SAVE button.

Now we will add Batch Users (Add Users in Bulk).
Goto Users / Add / Batch Users. Select your desired options and click on ADD.

Now we will Generate Voucher file to print. (html format)
(See Following Image)

Click on DOWNLOAD AS FILE and click Generate. It will then download the vouchers.html file and you can print it.

Following is the Template Code:

<html>
<head>
<meta http-equiv="Content-Language" content="en-us">
<meta http-equiv="Content-Type" content="text/html; charset=windows-1252">
<title>User Manager Voucher Page - By Syed Jahanzaib aacable@hotmail.com</title>
<meta name="description" content="User Manager Voucher Page - By Syed Jahanzaib aacable@hotmail.com">
<meta name="Microsoft Theme" content="none, default">
</head>

<body background="http://192.168.2.3/background_compass.gif" topmargin="5" leftmargin="5" style="background-attachment: fixed">

<table style="color: black; font-size: 11px;" border="2" align="left" width="286" height="300" cellspacing="0" cellpadding="0" id="table1"> <tr>
<td colspan="2" height="69">
<p align="center">
<font size="1">
<img border="0" src="http://192.168.2.3/nae.jpg" width="107" height="67"></font></p>
</td> </tr> <tr height="5px">
<td colspan="2">
<p align="center"><u><b><font color="#0000FF" size="3">Package:
%u_actualProfileName%</font></b></u></td></tr>
<tr>
<font size="2" face="Arial">
<td>
<p align="center"><font size="2" face="Arial Black">Price</font></td>   </font>   <td>
<p align="center"><font size="2" face="Arial Black" color="#FF0000">%u_moneyPaid%</font></td>
</tr>
<tr>
<td>
<font size="2" face="Arial Black">
<p align="center">Prepaid time:</td>   <td>
<p align="center"><font color="#FF0000" face="Arial Black" size="2"><b>%u_timeLeft%</b></font></td>
</tr>
<tr>   <td>
<font size="2" face="Arial Black">
<p align="center">Login:</td>   <td>
<p align="center"><font color="#FF0000"><b>
<font size="2" face="Arial Black">%u_username%</font></b></font></td>   </tr>
<tr>
<font size="2" face="Arial">
<td>
<p align="center"><font size="2" face="Arial Black">Password:</font></td>   <td>
<p align="center">
<font face="Arial Black" color="#FF0000"><b><font size="2">%u_password%</font></b></font></td>
</font>
</tr>
<tr height="20px">
<td colspan="2">
<p align="center"><b><u><font size="2" color="#0000FF">~ Howto Use
This Voucher ~</font></u><font color="#008000" size="2"><u><br>
</u></font></b><font size="2" color="#008000">Please open
<a href="http://ftp.local">http://ftp.local</a> and download <br>
aa-dialer.exe &amp; install it. After installation its icon will appear
on Desktop. Double click on it, and use the above mentioned ID and
Password&nbsp; to connect to the internet .<br>
</font><font size="2" face="Arial Black" color="#FF0000">This ID will
expire in 30 days after its first usage.</font><font size="2" color="#008000"><br>
</font><b><font size="2">Thank You For Choosing AA~Services</font></b></td></tr> <tr>
<td colspan="2" align="right" height="50">
<p align="center"><b><font size="1">AA Network Services</font></b><font size="1"><br>
Support : 92.333.3021909<br>
Email aacable@hotmail.com<br>
Web <a href="http://aacable.com">https://aacable.wordpress.com</a> </font></td> </tr> </table>

</body>
</html>

Note: I used 2 images, one is logo, second is background image, Both files are residing on the Local web server. You have to modify these links and files name to match according to your structure.

Regard’s

SYED JAHANZAIB

August 9, 2011

July 5, 2011

A Success story with Mikrotik and DMASoftlab RADIUS MANAGER [Glass Line Pvt Ltd.] June, 2011


Article by Syed Jahanzaib !

Recently I was contacted by a friend who was really passionate in starting a mini-ISP type network setup for about 3000 users in the interior area of city. (soon it may expand up to 5000+ users). He asked my help to setup a scratch card base fully automatic system where user purchase scratch card, & using User self care portal web site, user may create his new ID or refresh his previous ID or change the service package according to the card package offers. I had previously setup this kind of scenario in a cable.net environment using Mikrotik built-in radius server called ‘User Manager’, but it have very limited basic features and all it can offer was a pre-paid type option and it doesn’t have many accounting features. So I thought I should give a try to more rich feature radius server and after a lot of googling i decided to go with  (FREERADIUS base ) DMASOFTLAB RADIUS MANAGER. A very famous radius server with all the option that a mini-ISP would required at unbelievably low price.

The hardware that I have used for this setup.

*Main Mikrotik = v4.17 x86 / Xeon 3.6Ghz Dual / 2 GB Ram / WD 500 GB Sata Hdd , This MT is serving as a PPPoE Server + NAT + bandwidth shaping. It also redirects HTTP traffic to Proxy server.

* Mikrotik RB750 = Just for HOTSPOT to redirect users to self care portal.
(This can be done on Main MT also, but I prefer it this way)

* Radius Server = DMASoftlab RM v3.9 installed on Fedora v10 / Xeon 3.6Ghz Dual / 4 GB Ram / WD 500 GB x2 Sata Hdd

* SQUID PROXY GW = SQUID v2.7 on UBUNTU Karmic Koala v9.10 / Xeon 3.6Ghz Dual / 8 GB Ram / WD 500 GB x3 SATA HDD (2 HDD reserved for Cache), This server acts as a proxy + Gateway machine for the Mikrotik, It also do URL Filtering blocking ads, it also have ZPH enabled so content available in squid cache should be downloaded at full speed (without package limitation) at user end. It also cache youtube videos using VIDEOCACHE.

* Linux Transparent BRIDGE firewall + DHCP + DNS + MRTG + WEB Server on FEDORA V10 / Xeon 3.6Ghz Dual / 4 GB Ram / WD 500 GB SATA HDD, This server sits between Mikrotik and Users , filtering unwanted traffic, ports and do some other stuff like lightweight DNSMASQ DNS Server,  DHCP server providing ips to users , Web Site with MRTG , Psychostats ranking system for Counter Strike Game, Server Monitoring Scripts and Alerts, PHPBB Forums for Users, and some other cool stuff. DNS+DHCP is hosted on this server to minimize load on main mikrotik machine, alos this machine filters unwanted traffic from passing by to main mikrotik.

In this setup , I have configured HOTSPOT on extra RB750 only to redirect user to my advertisement page, where he is informed that he is not logged in via dialer, either create / refresh his ID from RM User Self Care Portal, or if he already have an id, connect it via dialer. I don’t prefer HotSpot authentication due to various security reasons, mainly due to I had a very bad experience having HOTSPOT hit by ARP-POISONING and many virus flooder that requires default gateway.

When user first login , his PC MAC address is binded with his ID to prevent accessing it from different pcs. Multiple session of same ID is NOT allowed , I provide user with scratch card (with refill code) , which he can use to refill his account according to card amount/package from RM User self care portal. RM demo can be viewed at http://www.dmasoftlab.com/cont/radman

When users with pppoe dialer tries to connect to main Mikrotik, MT verifies its credentials by asking Radius Server for the account validity, if the ID is valid, user connects okay and can use internet , otherwise he gets disconnected. When the User account is expired, he still can login via dialer, but then he is redirect to my local web server page where he is informed that his account is expired and he should visit billing.local page to renew his account using the card.

Please find along with attachment is my Network Diagram (This was initially designed, I made few changes afterward, I removed FTP from MT DMZ to user subnet lan to avoid load on MT , I moved ftp OS from windows to Linux and integrate it with radius authentication using APACHE.

Some other entertainment services that I setup here were:
2 FTP Media Sharing Servers ( 4 TB of data )
2 Live TV Channel streaming over LAN using VLC Media Player Broadcasting
1 Counter Strike 1.6 Dedicated Server with Psychostats Ranking System and adminmod/amxmod
1 Web Server (Ubunut) hosting site u-dear . com , an entertainment portal and hosting other features. It also features monitoring system with MRTG / SMS Alerts via attached Mobile.

About RM: Radius Manager uses a nice web interface for administering the users and the whole system (traffic accounting, tracking of online users, display statistics, maintenance ,account management etc.).

and to add that DMASoftlab customer support guys (specially Mr. Viktor.K) have excellent support and respond instantly even to the dumbest of questions. It is real value for money especially for those who do not have big wallet$.

Network Diagram Layout : (Complete setup guide can found at
https://aacable.wordpress.com/2011/07/19/mikrotik-squid-zph-complete-guide-incomplete-post-i-will-edit-it-later/

GLASSLINE-Network-Presentation-by-zaib Update 03/08/2001

Blog at WordPress.com.

%d bloggers like this: