Yes, five times slower is annoying, especially since I do the annotate/diff dance fairly often to track down code history.
Updates are normally a lot faster since subversion caches more data locally than cvs. Diffs between old revisions take about the same time.