I used a zero-degree sleeping bag, and stayed warm enough. As long as your 20-degree bag is from a good company (Marmot, The North Face, etc.), you should be fine if you use a liner. You can also wear extra layers at night, including your down jacket, if necessary.
