apache spark - Trim string column in PySpark dataframe

Question

After creating a Spark DataFrame from a CSV file, I would like to trim a column. I've tried:

df = df.withColumn("Product", df.Product.strip())

df is my data frame, Product is a column in my table

But I get the error:

Column object is not callable

Any suggestions?

Answer 1

from pyspark.sql.functions import trim

df = df.withColumn("Product", trim(col("Product")))