HomeLanguagesHow to read all CSV files in a folder in Pandas?

How to read all CSV files in a folder in Pandas?

In this article, we will see how to read all CSV files in a folder into single Pandas dataframe. The task can be performed by first finding all CSV files in a particular folderĀ using glob() method and then reading the file by using pandas.read_csv() method and then displaying the content.

Approach:

  1. Import necessary python packages like pandas, glob, and os.
  2. Use glob python package to retrieve files/pathnames matching a specified pattern i.e. ā€˜.csv’
  3. Loop over the list of csv files, read that file using pandas.read_csv().
  4. Convert each csv file into a dataframe.
  5. Display its location, name, and content.

Below is the implementation.

Python3




# import necessary libraries
import pandas as pd
import os
import glob
Ā Ā 
Ā Ā 
# use glob to get all the csv filesĀ 
# in the folder
path = os.getcwd()
csv_files = glob.glob(os.path.join(path, "*.csv"))
Ā Ā 
Ā Ā 
# loop over the list of csv files
for f in csv_files:
Ā Ā Ā Ā Ā Ā 
Ā Ā Ā Ā # read the csv file
Ā Ā Ā Ā df = pd.read_csv(f)
Ā Ā Ā Ā Ā Ā 
Ā Ā Ā Ā # print the location and filename
Ā Ā Ā Ā print('Location:', f)
Ā Ā Ā Ā print('File Name:', f.split("\\")[-1])
Ā Ā Ā Ā Ā Ā 
Ā Ā Ā Ā # print the content
Ā Ā Ā Ā print('Content:')
Ā Ā Ā Ā display(df)
Ā Ā Ā Ā print()


Output:

Note: The program reads all CSV files in the folder in which the program itself is present.

RELATED ARTICLES

Most Popular

Dominic
32702 POSTS0 COMMENTS
Milvus
131 POSTS0 COMMENTS
Nango Kala
7076 POSTS0 COMMENTS
Nicole Veronica
12209 POSTS0 COMMENTS
Nokonwaba Nkukhwana
12303 POSTS0 COMMENTS
Shaida Kate Naidoo
7197 POSTS0 COMMENTS
Ted Musemwa
7456 POSTS0 COMMENTS
Thapelo Manthata
7174 POSTS0 COMMENTS
Umr Jansen
7161 POSTS0 COMMENTS