csv - Replacing part of string in python pandas dataframe

Question

I have a similar problem to the one posted here:

Pandas DataFrame: remove unwanted parts from strings in a column

I need to remove newline characters from within a string in a DataFrame. Basically, I've accessed an api using python's json module and that's all ok. Creating the DataFrame works amazingly, too. However, when I want to finally output the end result into a csv, I get a bit stuck, because there are newlines that are creating false 'new rows' in the csv file.

So basically I'm trying to turn this:

'...this is a paragraph.

And this is another paragraph...'

into this:

'...this is a paragraph. And this is another paragraph...'

I don't care about preserving any kind of ' ' or any special symbols for the paragraph break. So it can be stripped right out.

I've tried a few variations:

misc['product_desc'] = misc['product_desc'].strip('
')

AttributeError: 'Series' object has no attribute 'strip'

here's another

misc['product_desc'] = misc['product_desc'].str.strip('
')

TypeError: wrapper() takes exactly 1 argument (2 given)

misc['product_desc'] = misc['product_desc'].map(lambda x: x.strip('
'))
misc['product_desc'] = misc['product_desc'].map(lambda x: x.strip('
'))

There is no error message, but the newline characters don't go away, either. Same thing with this:

misc = misc.replace('
', '')

The write to csv line is this:

misc_id.to_csv('C:UsersjlalondeDesktopmisc_w_id.csv', sep=' ', na_rep='', index=False, encoding='utf-8')

Version of Pandas is 0.9.1

Thanks! :)

Answer 1

strip only removes the specified characters at the beginning and end of the string. If you want to remove all , you need to use replace.

misc['product_desc'] = misc['product_desc'].str.replace('
', '')