Soaking hard rubber is never recommended but you can wipe it with a wet cloth either with or without soap. If wet soapy cloth doesn't doesn't do it use a sponge which is a little bit more coarse. Soon as you have removed the ink wipe the entire cap dry. Let us know how this works for you.