if you edit wp-rss, wp-rss2 and wp-atom you can add <[CDATA[ ….. ]]> around your content and it will validate again.
the 3 lines in wp-rss.php
25) <title><![CDATA[<?php the_title_rss() ?>]]></title>
29) <description><![CDATA[<?php the_excerpt_rss(get_settings('rss_excerp
t_length'), 2) ?>]]></description>
and
33) <description><![CDATA[<?php the_content_rss('', 0, '', get_settings(
'rss_excerpt_length'), get_settings('rss_encoded_html')) ?>]]></description>
the 5 lines in wp-rss2.php
22) <title><![CDATA[<?php the_title_rss() ?>]]></title>
31) <title><![CDATA[<?php the_title_rss() ?>]]></title>
38) <description><![CDATA[<?php the_excerpt_rss('', 2) ?>]]></descri
ption>
40) <description><![CDATA[<?php the_excerpt_rss(get_settings('rss_ex
cerpt_length'), 2) ?>]]></description>
and
41) <content:encoded><![CDATA[<?php the_content('', 0, '') ?>]]></co
ntent:encoded>
and the 4 lines in wp-atom.php
18) <title><![CDATA[<?php bloginfo_rss('name') ?>]]></title>
30) <title><![CDATA[<?php the_title_rss() ?>]]></title>
36) <summary type="text/html" mode="escaped"><![CDATA[<?php the_exce
rpt_rss(get_settings('rss_excerpt_length'), 2) ?>]]></summary>
38) <content type="text/html" mode="escaped" xml:base="<?php permali
nk_single_rss() ?>"><![CDATA[<?php the_content('', 0, '') ?>]]></content>
I really haven’t tested these changes much, but they validated for me and thats where I stopped.
I am using the enhanced textile2 plugin and had the same problem as you.