Filter Data

Pandas allow us to filter rows based on a specific condition. To filter rows, write the condition inside brackets:

filtered_df = df[df["number_column"] > 5]
filtered_df = df[df["string_column"] == "String Match"]

To combine multiple conditions, use the & (and) keyword and the | or keyword. Every condition must be in parenthesis ():

filtered_df = df[(df['number_column'] >= 3) & (df['string_column'] == 'String Match')]

The not keyword is ~ (not greater than 5):

filtered_df = df[~df["number_column"] > 5]

To retrieve all of the not-empty values from a specific column:

filtered_df = df[~df["column"].isna()]

To check if a value is in an array:

filtered_df = df[df['column'].isin(['value1', 'value2', 'value3'])]