"It might not be quite what you're used to, but the command line interface is really worth learning. It's not very difficult, and the process could even help you better understand what SVN is doing. It's really quick and understanding how it works makes integrating it into your build process or other scripts a breeze.
If you'd prefer a GUI the common options are usually integration with your IDE (Subclipse) or RapidSVN, though I don't have much experience with either."
I really like Tortoise SVN and would love to have something just like it for Linux. In the meantime, I've tried quite a few Linux SVN clients and the only one that seemed to have the most complete set of SVN functionality in a usable package was Kdesvn
It has free and paid versions, but the free version should cover 90% of your needs. It also has the advantage that it is cross-platform (java) so if you like it enough you can use it on windows too.
I agree with jtb that at least some familiarity with the command line version is advantageous (then again, that's what I use on linux.)
I've become a bit disenchanted with TortoiseSVN as it seems the latest release (1.6.3) has some sort of conflict with ESET/NOD32 anti-virus which fubared a colleague's laptop (twice).
Actually, I've become disenchanted with any software that hooks into Windows Explorer too deeply - too easy for bugs to cause your system serious issues."