Earlier today we rode down to our friends' place for breakfast. It was around -18 C with a cold N wind. Perhaps 8 or 9 km one-way. Slow going because the trails and side streets had not been cleared from the last snowfall.
I wore layers - briefs, long underwear, t-shirt, a cycling bib, long-sleeved pullover shirt, hoodie, nylon cycling jacket, and a warm vest. Winter boots on the feet, gauntlets over thin gloves on the hands, and a balaclava and the hoodie's hood and cycling helmet on my head. Fingers are always a problem for me in the winter - my wife has just ordered heated gloves for me.
When it gets really cold (in excess of -30 C) I add a neoprene facemask and ski goggles (which means the glasses get carried in a case in my pannier). I can see well enough to ride without them.
Good for you, considering taking up this hardy winter sport!