Does Muscle Stack Or Fade?

You many understand my question at first but here is what i mean - if you build muscle in your leg every time you put it under strenuous exercise (running long distance) does the muscle fade away if you don't keep using it, or does it continuously stack up through your whole life? and how much muscle is built purely through growth?