DataFrame.set_index() to create index using one more more columns in Pandas

Create index using columns .

options

keys : single column or list of columns which will be used as index
drop: Bool, default True. Delete the column after creating the index
append : Bool, default False. Whether to append column to existing index
inplace: Bool, default False. Modify the existing DataFrame or not.
verify_integrity : Bool, default False. Check for duplicates.

keys

import pandas as pd 
my_dict={'NAME':['Ravi','Raju','Alex','Ron','King','Jack'],
         'ID':[1,2,3,4,5,6],
         'MATH':[80,40,70,70,70,30],
         'ENGLISH':[80,70,40,50,60,30]}
my_data = pd.DataFrame(data=my_dict)
my_data.set_index('NAME')
print(my_data)

Output

   NAME  ID  MATH  ENGLISH
0  Ravi   1    80       80
1  Raju   2    40       70
2  Alex   3    70       40
3   Ron   4    70       50
4  King   5    70       60
5  Jack   6    30       30

inplace

Modify the DataFrame or not

my_data.set_index('NAME',inplace=True)
print(my_data)

Output

      ID  MATH  ENGLISH
NAME                   
Ravi   1    80       80
Raju   2    40       70
Alex   3    70       40
Ron    4    70       50
King   5    70       60
Jack   6    30       30

drop

By default the column is deleted ( drop=True ) after marking it as index.

my_data_mod=my_data.set_index('NAME',drop=False)
print(my_data_mod)

Output

      NAME  ID  MATH  ENGLISH
NAME                         
Ravi  Ravi   1    80       80
Raju  Raju   2    40       70
Alex  Alex   3    70       40
Ron    Ron   4    70       50
King  King   5    70       60
Jack  Jack   6    30       30

verify_integrity

We have changed the DataFrame by using duplicate value for NAME column. Now if we will set the verify_integrity=True then we will get ValueError like this

ValueError: Index has duplicate keys: Index(['Ron'], dtype='object', name='NAME')

By changing like this verify_integrity=False we can supress the error and continue.

my_data_mod=my_data.set_index('NAME',verify_integrity=False)
print(my_data_mod)

Output

      ID  MATH  ENGLISH
NAME                   
Ravi   1    80       80
Raju   2    40       70
Alex   3    70       40
Ron    4    70       50
King   5    70       60
Ron    6    30       30

append

Default value is False We will check with append=True

my_data_mod=my_data.set_index('NAME',append=True)
print(my_data_mod)

Output is here

        ID  MATH  ENGLISH
  NAME                   
0 Ravi   1    80       80
1 Raju   2    40       70
2 Alex   3    70       40
3 Ron    4    70       50
4 King   5    70       60
5 Jack   6    30       30

Now let us make append=False

my_data_mod=my_data.set_index('NAME',append=False)
print(my_data_mod)

Output

      ID  MATH  ENGLISH
NAME                   
Ravi   1    80       80
Raju   2    40       70
Alex   3    70       40
Ron    4    70       50
King   5    70       60
Jack   6    30       30

Using set_index in DateTime columns

We can get all records of year 2020 and month March by this. Note that st_date is our datetime column

print(my_data.set_index('st_date')['2020-03'])

Similarly we can get all records between two periods like this.

print(my_data.set_index('st_date')['2019-03':'2019-04'])

You can get more examples of using date column at Exercise3

Pandas reset_index() date_range() to_datetime() period_range()

Numpy arrays Python & MySQL Python- Tutorials

Subhendu Mohapatra

Author & Instructor at plus2net

I write and maintain practical tutorials on Python, PHP, SQL, JavaScript, HTML, jQuery, and web development at plus2net. The tutorials focus on clear explanations, working examples, and code that readers can test and adapt while learning.

About the author Watch on YouTube

Connect:

Subscribe to our YouTube Channel here