Uppercase and Lowercase Conversion - Bash Style

After a long long time, I am back with this short post to convert case of strings in bash. While you might have been using tr (Like I did for a while) for this purpose, bash 4 has a built-in way for the case conversion. Withour further ado, here is a session

$ x="samar"

$ echo "${x^}"
Samar

$ echo "${x^^}"
SAMAR

$ y="${x^^}"

$ echo $y
SAMAR

$ echo "${y,}"
sAMAR

$ echo "${y,,}"
samar

I hope this helps ;)


Read more...

Fix Your Ubuntu

Recently Ubuntu has been known for turning into an advertising company and has been accused of not protecting user's privacy so just came across this site that fixes your ubuntu by applying some patches to turn off some of the invasive features of Ubuntu.

FixUbuntu.com


Read more...

Two Ways To Print Lines From File Reversely

Ever tried to print lines in files in the reverse order? You will know two simple methods to print lines from file in the reverse order.

Imagine a file somefile.txt with content something like this:

a
b
c
d
e

Method 1:

$ tac somefile.txt
e
d
c
b
a

Method 2:

$ sort -r somefile.txt
e
d
c
b
a

You can achieve the same effect through other techniques as well but I'll stick to these simple ones :)


Read more...

Linux Cat Command Examples

Cat is a standard unix tool to concatenate and display the content of files. In this post, I will present some examples of cat command so that you can use them in your scenario.

The cat command displays the content of file on the standard output. If multiple files are specified, the contents of all files will be concatenated and then displayed on the standard output. Likewise, if no file is specified, it will assume standard input (keyboard input) as the input to the command. The Ctrl + d is the shortcut used to save the contents in the appropriate output placeholder specified and exit the cat command.

Print content of file in standard output

samar@samar-Techgaun:~$ cat workers.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12

Print line numbers

samar@samar-Techgaun:~$ cat -n workers.txt 
     1 List of workers, designations & salary (in K):
     2 Kshitiz Director 30
     3 Bikky Manager  20
     4 
     5 
     6 Abhis Sweeper  10
     7 Rajesh Guard  12

Print line numbers for non-empty lines only

samar@samar-Techgaun:~$ cat -b workers.txt 
     1 List of workers, designations & salary (in K):
     2 Kshitiz Director 30
     3 Bikky Manager  20


     4 Abhis Sweeper  10
     5 Rajesh Guard  12

Create a new file

samar@samar-Techgaun:~$ cat > newfile.txt
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
^d

Display content of multiple files

samar@samar-Techgaun:~$ cat workers.txt newfile.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file

Combine multiple files to new file

samar@samar-Techgaun:~$ cat workers.txt newfile.txt > concat.txt
samar@samar-Techgaun:~$ cat concat.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file

Append data to existing file

samar@samar-Techgaun:~$ cat >> newfile.txt 
New line added
^d
samar@samar-Techgaun:~$ cat newfile.txt 
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
New line added

Alternatively, you can use the syntax below if you wish to create new file combining the content of already existing file and standard input.

samar@samar-Techgaun:~$ cat newfile.txt - > myfile
thanks for everything
^d
samar@samar-Techgaun:~$ cat myfile 
We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
New line added
thanks for everything

Another possibility is to combine two text files with data from standard input (keyboard) in-between the contents of these two text files.

samar@samar-Techgaun:~$ cat workers.txt - newfile.txt > myfile

----------------------------------

^d
samar@samar-Techgaun:~$ cat myfile 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20


Abhis Sweeper  10
Rajesh Guard  12

----------------------------------

We can create text files
using cat command
once u finish writing,
press ctrl+d to save file
New line added

Display $ sign at the end of each line

samar@samar-Techgaun:~$ cat -E workers.txt 
List of workers, designations & salary (in K):$
Kshitiz Director 30$
Bikky Manager  20$
$
$
Abhis Sweeper  10$
Rajesh Guard  12$

Display ^I sign instead of TABs

samar@samar-Techgaun:~$ cat -T workers.txt 
List of workers, designations & salary (in K):
Kshitiz^IDirector^I30
Bikky^IManager^I^I20


Abhis^ISweeper^I^I10
Rajesh^IGuard^I^I12

Display files with non-printing characters

samar@samar-Techgaun:~$ cat -v /bin/nc

In the example above, the non-printing characters are replaced with ^ and M- notation except for line breaks and TABs. This can be used to display the contents of binary files which would otherwise have shown gibberish text all over the console.

Show contents with tabs, line breaks and non-printing characters

samar@samar-Techgaun:~$ cat -A /bin/nc

The tab will be substituted by ^I, line breaks with $ and non-printing characters with ^ and M- notation. Actually, the -A switch is equivalent to -vET switch.

Supress/squeeze repeated empty lines

samar@samar-Techgaun:~$ cat -s workers.txt 
List of workers, designations & salary (in K):
Kshitiz Director 30
Bikky Manager  20

Abhis Sweeper  10
Rajesh Guard  12

Using -s switch, we can squeeze repeatedly occurring blank lines and replace all the adjacent empty lines with a single empty line in the output. This might be useful to reformat a file with several empty lines in-between (eg. cat -s workers.txt > formatted_workers.txt).

Display last line first

samar@samar-Techgaun:~$ tac workers.txt 
Rajesh Guard  12
Abhis Sweeper  10

Bikky Manager  20
Kshitiz Director 30
List of workers, designations & salary (in K):

It is the tac, not the cat that is doing the magic but just thought that this is the right place to make a note about this little known command.

Edit: Added here-doc examples. Thanks rho dai for pointing me this.

Parameter substitution using here-document strings

samar@samar-Techgaun:~$ cat > test << TEST
samar@samar-Techgaun:~$ I am $USER. My home is $HOME
samar@samar-Techgaun:~$ I came here from $OLDPWD
samar@samar-Techgaun:~$ TEST
samar@samar-Techgaun:~$ cat test 
I am samar. My home is /home/samar
I came here from /home/samar/Downloads

Command expansion example

samar@samar-Techgaun:~$ cat > test << TEST
samar@samar-Techgaun:~$ $(ls /)
samar@samar-Techgaun:~$ TEST
samar@samar-Techgaun:~$ cat test
bin
boot
cdrom
dev
etc
home
initrd.img
initrd.img.old
lib
lost+found
media
mnt
opt
proc
root
run
sbin
selinux
srv
sys
tmp
usr
var
vmlinuz
vmlinuz.old

Parameter substitution turned off

samar@samar-Techgaun:~$ cat > test << 'TEST'
samar@samar-Techgaun:~$ I am $USER. My home is $HOME
samar@samar-Techgaun:~$ I came here from $OLDPWD
samar@samar-Techgaun:~$ TEST
samar@samar-Techgaun:~$ cat test
I am $USER. My home is $HOME
I came here from $OLDPWD

Note the difference between the last example and previous two examples. Enclosing the limit string TEST with quotes prevents the substitutions and expansions.

I hope these examples are useful. :)


Read more...

Enable Auto Correction Of Path In Bash

While using the cd command, its normal to make mistakes while typing the directory path. You can enable auto-correction while typing directory path by enabling a particular shell option.

Minor spelling mistakes will be corrected automatically if the particular shell option cdspell using the SHell OPTions command invoked with shopt command.

When you enable the cdspell shell option, the errors checked for are missing characters, repeated characters, and transposed characters. Once the error is encountered, the corrected path is printed and directory is changed successfully.

samar@samar-Techgaun:~$ shopt -s cdspell
samar@samar-Techgaun:~$ cd Desktp
Desktop
samar@samar-Techgaun:~/Desktop$ cd ../Deskotp/
../Desktop/
samar@samar-Techgaun:~/Desktop$ cd ../Desktoop
../Desktop
samar@samar-Techgaun:~/Desktop$

The line shopt -s cdspell enables the auto-correction while using cd command. The session above shows some of the corrections performed once we enabled the cdspell shell option.

If you want to turn on this particular setting, then add the appropriate line using the command below:

samar@samar-Techgaun:~$ echo "shopt -s cdspell" >> ~/.bash_profile

I hope this counts as useful tips to beginner linux guys ;)


Read more...

Preventing Accidental Overwriting Of Files In Bash Shell

How many times has this happened to you? It used to happen once in a while with me. A Linux user learns to use the redirection operators such as '>' and '>>' but accidental overwriting starts to become common in commands you use and shell scripts you write.

The accidental overwriting of files that happens unintentionally is known as clobbering and it commonly happens while using the '>' redirection operator.

samar@Techgaun:~$ mycmd > myfile

In the above example, the mycmd clobbers any existing data in the myfile file if that file exists already. Worse things may happen sometime. Imagine accidentally typing

samar@Techgaun:~$ mycmd > /etc/passwd

instead of possibly using other redirection operators (like >> or <). Thankfully, you could recover /etc/passwd from either /etc/passwd- or /var/backups/passwd.bak if you hadn't rm'd these files.

To prevent such accidental overwriting, we can set the noclobber environment variable. Below is a session of enabling this variable:

samar@Techgaun:~/Desktop/test$ echo "www.techgaun.com" > myfile
samar@Techgaun:~/Desktop/test$ echo "Overwriting techgaun.com" > myfile
samar@Techgaun:~/Desktop/test$ set -o noclobber
samar@Techgaun:~/Desktop/test$ echo "Retrying to overwrite" > myfile
-bash: myfile: cannot overwrite existing file

As seen above, you have to turn on the noclobber variable using the set -o noclobber command in your shell. However, you might want to intentionally overwrite contents of certain files even when the noclobber is turned on.

samar@Techgaun:~$ mycmd >| myfile

Notice the >| in place of your normal > redirection operator. Using this operator, you can however overwrite the existing files even if the noclobber is turned on.

If you want to turn off the noclobber variable, type the following:

samar@Techgaun:~$ set +o noclobber

You can also permanently turn on the noclobber by the following command:

samar@Techgaun:~$ echo "set -o noclobber" >> ~/.bashrc

Moreover, such accidental overwriting can be prevented by enabling the interactive mode which is available in most of the linux commands. For example, you can write the alias for many commands that are likely to cause accidental overwriting. See some examples of aliases below:

samar@Techgaun:~$ alias rm=rm -i
samar@Techgaun:~$ alias mv=mv -i

You could even keep these aliases in your ~/.bashrc file permanently. Enabling such interactive modes by default in the commands that are more likely to cause accidental overwriting can prevent clobbering in many cases.

I hope this proves useful to you :)


Read more...