Well, it all depends on what you want to do. The lenses you have give you pretty complete focal length coverage.

A fisheye would be different, but how much do you need a fisheye? If you do want one, the Canon 8-15/4L is about the best fisheye out there for the EOS system, so it's an excellent choice.

The Canon 17-40/4L is also a very good lens, though it's not superwide on an APS-C body. You might miss the 10-16mm range of your 10-22, but that depends how often you use that focal length range.

So the bottom line is that both the lenses you suggest are excellent choices - if they meet your photographic needs. If you don't use your 10-22 much, getting rid of it and adding the two lenses you suggest might make sense, but it all depends on the type of photography you want to do.