Friday, October 21, 2016

Reading and Writing Files in Python

Overview

In Python, you don't need to import any library to read and write files.

The first step is to get a file object.

The way to do this is to use the open function.

File Types

A file is usually categorized as either text or binary.

A text file is often structured as a sequence of lines and a line is a sequence
of characters.

The line is terminated by a EOL (End Of Line) character. 

The most common line terminator is the 
 , or the newline character. 

The backslash character indicates that the next character will be treated as a
newline. 

A binary file is basically any file that is not a text file. Binary files can
only be processed by application that know about the file's structure.

Open ( )

To open a file for writing use the built-i open() function. open() returns a
file object, and is most commonly used with two arguments.

The syntax is:
file_object = open(filename, mode) where file_object is the variable to put the
file object.

The second argument describes the way in which the file will be used.

Mode

The mode argument is optional; 'r' will be assumed if it’s omitted.

The modes can be:

'r' when the file will only be read

'w' for only writing (an existing file with the same name will be erased)

'a' opens the file for appending; any data written to the file is automatically
added to the end. 

'r+' opens the file for both reading and writing.
>>> f = open('workfile', 'w')
>>> print f
Next the file objects functions can be called. The two most common functions are
read and write.

Create a text file

Let's first create a new text file. You can name it anything you like,
in this example we will name it "newfile.txt".
file = open("newfile.txt", "w")

file.write("hello world in the new file
")

file.write("and another line
")

file.close()
If we now look in the newfile.txt, we can see the text that we wrote:
$ cat newfile.txt 
hello world in the new file
and another line

How to read a text file

To read a file, we can use different methods.

file.read( )

If you want to return a string containing all characters in the file, you can
use file.read().
file = open('newfile.txt', 'r')

print file.read()
Output:

hello world in the new file
and another line
We can also specify how many characters the string should return, by using
file.read(n), where "n" determines number of characters.

This reads the first 5 characters of data and returns it as a string.
file = open('newfile.txt', 'r')
print file.read(5)
Output:

hello

file.readline( )

The readline() function will read from a file line by line (rather than pulling
the entire file in at once).

Use readline() when you want to get the first line of the file, subsequent calls
to readline() will return successive lines.

Basically, it will read a single line from the file and return a string
containing characters up to 
.
file = open('newfile.txt', 'r')

print file.readline():
Output:

hello world in the new file

file.readlines( )

readlines() returns the complete ?le as a list of strings each separated by 
file = open('newfile.txt', 'r')

print file.readlines()
Output:

['hello world in the new file
', 'and another line
']

Looping over a file object

For reading lines from a file, you can loop over the file object. 

This is memory efficient, fast, and leads to simple code.
file = open('newfile.txt', 'r')

for line in file:
    print line,
Output:

hello world in the new file
and another line

file.write( )

The write method takes one parameter, which is the string to be written. 

To start a new line after writing the data, add a 
 character to the end.
file = open("newfile.txt", "w")

file.write("This is a test
")

file.write("And here is another line
")

file.close()

Close ( )

When you’re done with a file, call f.close() to close it and free up any system
resources taken up by the open file. 

After calling f.close(), attempts to use the file object will automatically fail.

File Handling Usages

Let's show some example on how to use the different file methods
To open a text file, use:
fh = open("hello.txt", "r")
To read a text file, use:
fh = open("hello.txt","r")
print fh.read()
To read one line at a time, use:
fh = open("hello".txt", "r")
print fh.readline()
To read a list of lines use:
fh = open("hello.txt.", "r")
print fh.readlines()
To write to a file, use:
fh = open("hello.txt","w")
fh.write("Hello World")
fh.close()
To write to a file, use:
fh = open("hello.txt", "w")
lines_of_text = ["a line of text", "another line of text", "a third line"]
fh.writelines(lines_of_text)
fh.close()
To append to file, use:
fh = open("Hello.txt", "a")
fh.write("Hello World again")
fh.close
To close a file, use
fh = open("hello.txt", "r")
print fh.read()
fh.close()

With Statement

Another way of working with file objects is the With statement.

It is good practice to use this statement. 

With the "With" statement, you get better syntax and exceptions handling. 
In addition, it will automatically close the file. The with statement provides a
way for ensuring that a clean-up is always used.
Opening a file using with is as simple as:
with open(filename) as file:
Let's take a look at some examples
with open("newtext.txt") as file: # Use file to refer to the file object
    data = file.read()
    do something with data
You can of course also loop over the file object:
with open("newfile.txt") as f:
    for line in f:
        print line,
Notice, that we didn't have to write "file.close()". That will automatically be
called.

With Examples

Let's show some examples on how we can use this in our every day programming.

Write to a file using With

Write to a file using the With statement
with open("hello.txt", "w") as f:
 f.write("Hello World")

Read a file line by line into an list

This will read the file hello.txt and save the content into "data".
with open(hello.txt) as f:
    data = f.readlines()

Splitting Lines

As a last example, we will show how to split lines from a text file.

The split function in our example, splits the string contained in the variable
data, whenever it sees a space character. 

You can split by whatever you wish, line.split(":") would split the line using
colons.
with open('data.txt', 'r') as f:
    data = f.readlines()

    for line in data:
        words = line.split()
        print words
Output:

Because multiple values are returned by split, they are returned as an array.
['hello', 'world,', 'how', 'are', 'you', 'today?']
['today', 'is', 'saturday']

Wednesday, October 12, 2016

[ERROR] No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK?

This means you are running jenkins with Open JDK, You have to install Oracle JDK for jenkins to run smoothly.

Follow the instructions in below link
http://nixpoint.blogspot.com/2016/10/confused-between-open-jdk-oracle-jdk.html


Confused between Open JDK & Oracle JDK ?


Variations of Java


There are three different editions of the Java Platform: Standard Edition (SE), Enterprise Edition (EE), and Micro Edition (ME). This tutorial is focused on Java SE (Java Platform, Standard Edition).


There are two different Java SE packages that can be installed: the Java Runtime Environment (JRE) and the Java Development Kit (JDK). JRE is an implementation of the Java Virtual Machine (JVM), which allows you to run compiled Java applications and applets. JDK includes JRE and other software that is required for writing, developing, and compiling Java applications and applets.


There are also two different implementations of Java: OpenJDK and Oracle Java. Both implementations are based largely on the same code but OpenJDK, the reference implementation of Java, is fully open source while Oracle Java contains some proprietary code. Most Java applications will work fine with either but you should use whichever implementation your software calls for.


You may install various versions and releases of Java on a single system, but most people only need one installation. With that in mind, try to only install the version of Java that you need to run or develop your application(s).
If Oracle JDK is installed, output will be like below
[root@Ans.Master-~]# java -version
java version "1.7.0_79"
Java(TM) SE Runtime Environment (build 1.7.0_79-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.79-b02, mixed mode)

If it is Open jdk output will be like below

[root@Ans.Master-~]# java -version
java version "1.7.0_15"
OpenJDK Runtime Environment (IcedTea6 1.10pre) (7b15~pre1-0lucid1)
OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode)

How to remove OpenJDK and install Oracle JDK


# yum -y remove java*

Download Oracle JDK


wget --no-cookies --no-check-certificate --header "Cookie: gpw_e24=http%3A%2F%2Fwww.oracle.com%2F; oraclelicense=accept-securebackup-cookie" \
"http://download.oracle.com/otn-pub/java/jdk/7u79-b15/jdk-7u79-linux-x64.rpm"
rpm -ivh jdk-7u79-linux-x64.rpm

[root@Ans.Master-~]# java -version
java version "1.7.0_79"
Java(TM) SE Runtime Environment (build 1.7.0_79-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.79-b02, mixed mode)

Note that java will be installed into /usr/java and establish softlinks as follows:


[root@Ans.Master-~]# ll /usr/bin/java

lrwxrwxrwx. 1 root root 26 Oct 13 01:45 /usr/bin/java -> /usr/java/default/bin/java




Setup Global Environment Variables

We can easily set the environment variables using the export command as shown below.
export JAVA_HOME=/usr/java/jdk1.8.0_25/
export PATH=$PATH:$JAVA_HOME

JAVA_HOME will look for /bin/java so /usr/java/jdk1.8.0_25/ will be right path
But for $PATH we may need to point it to /usr/java/jdk1.8.0_25/bin..not sure if the above step is correct.
If you want JAVA_HOME to be set for every user on the system by default, add the previous line to the/etc/environment file. An easy way to append it to the file is to run this command:

  sudo sh -c "echo export JAVA_HOME=/usr/java/jdk1.7.0_79 >> /etc/environment"
OR
You need to setup global config in /etc/profile OR /etc/bash.bashrc file for all users
If you have multiple java installations in the system you need to make the preferred one as default 



Using Alternatives


The alternatives command, which manages default commands through symbolic links, can be used to select the default Java command.
To print the programs that provide the java command that are managed by alternatives, use this command:
sudo alternatives --config java
Here is an example of the output:
There are 5 programs which provide 'java'.

  Selection    Command
-----------------------------------------------
*+ 1           /usr/java/jdk1.8.0_60/jre/bin/java
   2           /usr/java/jdk1.7.0_79/jre/bin/java


Enter to keep the current selection[+], or type selection number: