Basic Guide To Crontab

Well it has been a busy week and now I am back with this basic guide to running cron jobs in linux.

Cron is a time-based job scheduling program which comes shipped with most linux distributions and enables users to execute commands or set of scripts automatically at the specified time. Cron is particularly important for system administration and maintenance though it can be used for any general purpose such as scheduling your porn downloads. My post is based on the Vixie Cron, a popular implementation of Cron by Paul Vixie which is by default the cron program in Ubuntu. Other implementations of the cron are anacron, fcron, and dcron.

The cron daemon runs automatically during the startup and consults the crontabs (shorthand for cron tables) for jobs to executed. Crontabs are nothing but files containing the commands to be run at the specified time, however there is a particular (& simple to remember) syntax for cronjobs to be run. You could directly edit these cron tables files but that's not the recommended way. You should always use the crontab editor to add/update jobs to the crontabs.

Cron searches its spool area (located at /var/spool/cron/crontabs) for crontab files which are named after the user accounts from /etc/passwd. As a matter of precaution, you should not directly manipulate the files in there. Additionally, cron reads the /etc/crontab file and all the files in /etc/cron.d. Also, there are other folders: /etc/cron.daily, /etc/cron.hourly, /etc/cron.monthly, and /etc/cron.weekly. And, the name of folders are obvious so if you put the scripts in one of these folders, your script will run either daily or hourly or monthly or weekly.

Since you got several files associated with cron, you have bunch of options on running the cron jobs in your system. First lets start with the crontab tool which is used to install, deinstall or list the tables used to drive the cron daemon. If the /etc/cron.allow file exists, then you must be listed (one user per line) therein in order to be allowed to use this command. If the /etc/cron.allow file does not exist but the /etc/cron.deny file does exist, then you must not be listed in the /etc/cron.deny file in order to use this command.

The crontab command provides following options:

        -e edit user's crontab
 -l list user's crontab
 -r delete user's crontab
 -i prompt before deleting user's crontab

crontab can be configured to use any of the editors.

To list the user's crontab, use the following command:

$ crontab -l

To delete existing cron table, type:

$ crontab -ir

To install new cron table, type:

$ crontab -e

If you are wishing to add commands that require root privilege for execution, make sure you prepend sudo in the above command to add such commands to crontabs. The cron table expects each line of cron job in the following format:

m h dom mon dow command
i.e.
minute hour day_of_month month day_of_week command_to_run

These columns take the values in the range below:

  Minute (0 - 59)
  Hour (0 - 23)
  Day of month (1 - 31)
  Month (1 - 12)
  Day of the week (0 - 6, 0 representing sunday, 6 saturday)

Apart from these values, the cron entries accept other special characters. In each of these five columns:

• An asterisk (*) stands for "every".
• Slashes (/) are used to describe increments of ranges eg. */15 in minutes column would execute the specified command regularly and repeatedly after 15 minute.
• Commas (,) are used to separate items of a list. eg. using 1,2,3 in the 5th field (day of week) would mean Mondays, Tuesday, and Wednesday.
• Hyphens (-) are used to define ranges. For example, 2-5 in the 5th field would indicate Tuesday to Friday.

Now we know the format of how should each line of cron entry should look like, lets see some examples.

Run backup at 5 a.m every Monday

0 5 * * 1 /bin/mybackup

Run backup at 12:01 a.m monday-thursday

1 0 * * 1-4 /bin/mybackup

Run backup at 12:01 a.m on monday and thursday

1 0 * * 1,4 /bin/mybackup

Run backup every minute

* * * * * /bin/mybackup

Run backup every 15 minutes repeatedly

*/15 * * * * /bin/mybackup

The information below is taken directly from man 5 crontab and can serve as a good reference for special strings in place of the 5 columns:

              @reboot        Run once, at startup.
              @yearly        Run once a year, "0 0 1 1 *".
              @annually      (same as @yearly)
              @monthly       Run once a month, "0 0 1 * *".
              @weekly        Run once a week, "0 0 * * 0".
              @daily         Run once a day, "0 0 * * *".
              @midnight      (same as @daily)
              @hourly        Run once an hour, "0 * * * *".

Now that you are feeling better with cronjobs, we will see how we can add cronjobs in the /etc/crontab file. The different thing about this crontab file is that there is an extra column for user field so that the particular cron entry is executed as the specified user.

The format for cron entry is similar to what we've seen already, with an extra column for user.

m h dom mon dow user command

You can use any text editor such as nano or vi to edit the /etc/crontab file.

Finally, once you update crons, make sure to restart the cron daemon to ensure your new cron entries get read by the daemon.

$ sudo service cron restart

I hope this primer for crontab helps you in your job scheduling job :D


Read more...

Linux Cat Command Examples

Cat is a standard unix tool to concatenate and display the content of files. In this post, I will present some examples of cat command so that you can use them in your scenario.

The cat command displays the content of file on the standard output. If multiple files are specified, the contents of all files will be concatenated and then displayed on the standard output. Likewise, if no file is specified, it will assume standard input (keyboard input) as the input to the command. The Ctrl + d is the shortcut used to save the contents in the appropriate output placeholder specified and exit the cat command.

Print content of file in standard output

samar@samar-Techgaun:~$ cat workers.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12

Print line numbers

samar@samar-Techgaun:~$ cat -n workers.txt 
     1 List of workers, designations & salary (in K):
     2 Kshitiz Director 30
     3 Bikky Manager  20
     4 
     5 
     6 Abhis Sweeper  10
     7 Rajesh Guard  12

Print line numbers for non-empty lines only

samar@samar-Techgaun:~$ cat -b workers.txt 
     1 List of workers, designations & salary (in K):
     2 Kshitiz Director 30
     3 Bikky Manager  20


     4 Abhis Sweeper  10
     5 Rajesh Guard  12

Create a new file

samar@samar-Techgaun:~$ cat > newfile.txt
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
^d

Display content of multiple files

samar@samar-Techgaun:~$ cat workers.txt newfile.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file

Combine multiple files to new file

samar@samar-Techgaun:~$ cat workers.txt newfile.txt > concat.txt
samar@samar-Techgaun:~$ cat concat.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file

Append data to existing file

samar@samar-Techgaun:~$ cat >> newfile.txt 
New line added
^d
samar@samar-Techgaun:~$ cat newfile.txt 
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
New line added

Alternatively, you can use the syntax below if you wish to create new file combining the content of already existing file and standard input.

samar@samar-Techgaun:~$ cat newfile.txt - > myfile
thanks for everything
^d
samar@samar-Techgaun:~$ cat myfile 
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
New line added
thanks for everything

Another possibility is to combine two text files with data from standard input (keyboard) in-between the contents of these two text files.

samar@samar-Techgaun:~$ cat workers.txt - newfile.txt > myfile

----------------------------------

^d
samar@samar-Techgaun:~$ cat myfile 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12

----------------------------------

We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
New line added

Display $ sign at the end of each line

samar@samar-Techgaun:~$ cat -E workers.txt 
List of workers, designations & salary (in K):$
Kshitiz Director 30$
Bikky Manager  20$
$
$
Abhis Sweeper  10$
Rajesh Guard  12$

Display ^I sign instead of TABs

samar@samar-Techgaun:~$ cat -T workers.txt 
List of workers, designations & salary (in K):
Kshitiz^IDirector^I30
Bikky^IManager^I^I20


Abhis^ISweeper^I^I10
Rajesh^IGuard^I^I12

Display files with non-printing characters

samar@samar-Techgaun:~$ cat -v /bin/nc

In the example above, the non-printing characters are replaced with ^ and M- notation except for line breaks and TABs. This can be used to display the contents of binary files which would otherwise have shown gibberish text all over the console.

Show contents with tabs, line breaks and non-printing characters

samar@samar-Techgaun:~$ cat -A /bin/nc

The tab will be substituted by ^I, line breaks with $ and non-printing characters with ^ and M- notation. Actually, the -A switch is equivalent to -vET switch.

Supress/squeeze repeated empty lines

samar@samar-Techgaun:~$ cat -s workers.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20

Abhis Sweeper  10
Rajesh Guard  12

Using -s switch, we can squeeze repeatedly occurring blank lines and replace all the adjacent empty lines with a single empty line in the output. This might be useful to reformat a file with several empty lines in-between (eg. cat -s workers.txt > formatted_workers.txt).

Display last line first

samar@samar-Techgaun:~$ tac workers.txt 
Rajesh Guard  12
Abhis Sweeper  10

Bikky Manager  20
Kshitiz Director 30
List of workers, designations & salary (in K):

It is the tac, not the cat that is doing the magic but just thought that this is the right place to make a note about this little known command.

Edit: Added here-doc examples. Thanks rho dai for pointing me this.

Parameter substitution using here-document strings

samar@samar-Techgaun:~$ cat > test << TEST
samar@samar-Techgaun:~$ I am $USER. My home is $HOME
samar@samar-Techgaun:~$ I came here from $OLDPWD
samar@samar-Techgaun:~$ TEST
samar@samar-Techgaun:~$ cat test 
I am samar. My home is /home/samar
I came here from /home/samar/Downloads

Command expansion example

samar@samar-Techgaun:~$ cat > test << TEST
samar@samar-Techgaun:~$ $(ls /)
samar@samar-Techgaun:~$ TEST
samar@samar-Techgaun:~$ cat test
bin
boot
cdrom
dev
etc
home
initrd.img
initrd.img.old
lib
lost+found
media
mnt
opt
proc
root
run
sbin
selinux
srv
sys
tmp
usr
var
vmlinuz
vmlinuz.old

Parameter substitution turned off

samar@samar-Techgaun:~$ cat > test << 'TEST'
samar@samar-Techgaun:~$ I am $USER. My home is $HOME
samar@samar-Techgaun:~$ I came here from $OLDPWD
samar@samar-Techgaun:~$ TEST
samar@samar-Techgaun:~$ cat test
I am $USER. My home is $HOME
I came here from $OLDPWD

Note the difference between the last example and previous two examples. Enclosing the limit string TEST with quotes prevents the substitutions and expansions.

I hope these examples are useful. :)


Read more...