In this article, we will see how to read multiple CSV files into separate DataFrames. For reading only one data frame we can use pd.read_csv() function of pandas. It takes a path as input and returns data frame like
df = pd.read_csv("file path")
Let’s have a look at how it works
Python3
# import moduleimport pandas as pd# read datasetdf = pd.read_csv("./csv/crime.csv") |
Here, crime.csv is the file in the current folder. CSV is the folder that contains the crime.csv file and CSV Reader.ipynb is the file containing the above code.
Output:
It is the data frame that is read from the above function. One more file is present in the folder named – username.csv. To read them both and store them in different data frames use the below code
Python3
# import moduleimport pandas as pd# assign dataset nameslist_of_names = ['crime','username']# create empty listdataframes_list = []# append datasets into the listfor i in range(len(list_of_names)): temp_df = pd.read_csv("./csv/"+list_of_names[i]+".csv") dataframes_list.append(temp_df) |
dataframes_list contains all the data frames separately.
dataframes_list[0]:
dataframes_list[1]:
Here is another approach, now suppose that there are many files, and we don’t know the names and number then, use the below code
Python3
# import modulesimport osimport pandas as pd# assign pathpath, dirs, files = next(os.walk("./csv/"))file_count = len(files)# create empty listdataframes_list = []# append datasets to the listfor i in range(file_count): temp_df = pd.read_csv("./csv/"+files[i]) dataframes_list.append(temp_df) # display datasetsfor dataset in dataframes_list: display(dataset) |
Output:
