Image Recognition using TensorFlow

In this article, we’ll create an image recognition model using TensorFlow and Keras. TensorFlow is a robust deep learning framework, and Keras is a high-level API(Application Programming Interface) that provides a modular, easy-to-use, and organized interface to solve real-life deep learning problems.

Image Recognition:

In Image recognition, we input an image into a neural network and get a label (that belongs to a pre-defined class) for that image as an output. There can be multiple classes for the labeled image. If it belongs to a single class, then we call it recognition; if there are multiple classes, we call it classification. 

In this article, we use a flower dataset with 3670  images with five classes labeled as daisy, dandelion, roses, sunflowers, and tulips. The Image Classification model consists of the following steps:

• Understand data and load data: In this stage, we need to collect image data and label them. If the images are downloaded from other sources, then also they must be preprocessed before using them for training. 
• Build input pipeline: Tensorflow APIs allow us to create input pipelines to generate input data and preprocess them effectively for the training process. The pipeline for an image model aggregates data from files in a distributed file system applies random perturbations to each image and merges randomly selected images into a batch for training.
• Build the model: In this stage, we make choices about parameters and hyperparameters and make decisions about the number of layers to be used in our model. We decide on the input and output sizes of the layers, along with the activation function.
• Train the model: After creating a model, we must create an instance of the model and fit it with our training data. 
• Test the model: The crucial part of this stage is to estimate: the amount of time the model takes to train and specify the length of training for a network depending on the number of epochs to train over.
• Evaluate and improve the accuracy: Evaluating a model means comparing its performance against a validation dataset to analyze its performance through different metrics. The most common metric is ‘Accuracy’, calculated by dividing the amount of correctly classified images by the total number of images in our dataset.

Step 1 : Importing TensorFlow and other libraries 

The first step is to import the necessary libraries and modules such as pyplot, NumPy library, tensor-TensorFlow, os, and PIL.

Step 2: Loading image datasets

The second step is to load the dataset of flowers by downloading the dataset from the URL: “https://storage.googleapis.com/download.tensorflow.org/example_images/flower_photos.tgz” ,so that the copy of the dataset will be available. Here, pathlib module is used to handle the path names of the downloaded image file.

Now, after downloading, we can count total images by using len() method. Here, glob() method is used to find jpg files in the specified directory recursively. 

Output:

3670

We can check that there are 3670 images in the given directory. 

Output:

 

The code given above will display an image of the rose. Here, PIL(Python Image Library )is used to display images.

Step 3: Creating a model 

To work with images, let’s load the images to our disk using tf.keras.utils.image_dataset_from_directory utility. We use a training split 80% of the images for training and 20% for validation when developing our model. 

Training Split:

Found 3670 files belonging to 5 classes.
Using 2936 files for training.

Validation Split: 

Here we are providing a testing dataset to split in an 80:20 ratio, just as we did in the training split in the above code.

Output:

Found 3670 files belonging to 5 classes.
Using 734 files for validation.

We can check the class names by calling the class_names attribute on the training dataset in alphabetical order in the preceding code.

Output:

['daisy', 'dandelion', 'roses', 'sunflowers', 'tulips']

Visualizing the datasets: 

Here we have used pyplot module from matplotlib library to view our training dataset. We can view 25 images from training dataset.

Output:

 

Here, we have created a figure of size(10,10) using plt.figure() function and from using a for loop applied on the training dataset we arrange images using subplot() function and using imshow() function, we displayed the photos on the figure.

Step 4: Creating the model:

Now it is the stage where we design the CNN (Convolutional Neural Network) model. Keras has numerous formats to build models, the Sequential model is the most commonly used model as it consists of three convolution layers (Conv2D, MaxPooling2D, and Dense) with 128 units on top of it is activated by a ReLU activation function(‘relu’). Let’s create model using Sequential() function. 

Step 5: Compiling the model:

To view training and validation accuracy for each training epoch, pass the metrics argument to model.compile() method. Here we have used ‘adam’ optimizer and SparseCategoricalCrossentropy() loss function to evaluate the loss. Here we have used model.summary() method that allows us to view all the layers of the network.

Output:

 

Train the model using model.fit() method that allows the machine to learn patterns by providing training and test/validation dataset to the model.

Output :

 

With each epoch, accuracy is changed.

Visualizing result on training dataset:

Creating plots of accuracy and loss on the training and validation sets to consider bias and variance.

 

Here the plots visualize that training accuracy and validation accuracy.

Conclusion

Now we can have learnt that how to perform image recognition using TensorFlow.