If you're going to start cleaning your bike, here's a few things I use that really help to keep a bike clean.
Park Chain Keeper - when you pull the rear wheel off, slide this on so you can clean your chain, and keep it from rubbing on the frame, and the grease/oils from dripping onto your wheel.
Muc-Off Nano Tech Bike Cleaner Rock N Roll Absolute Dry Lube - 4oz Park Cassette Lockring Tool - You really need a chain whip for holding the cassette when you use the lock ring tool, but holding the cassette with a rag I can get the lock ring off. With the lock ring off, you pull the cassette off and wipe each cog clean, make it look brand new in about 5 minutes.
Go easy with the water, low pressure, and don't spray directly into your bottom bracket, headset, or hubs.