Definitely if you're in survival mode, and that's The Game for the next few sessions, you're counting every arrow and x% break after using.
In the past, magic ammunition was one-use in our group, but I suspect that has fallen by the wayside in recent campaigns.
Generally, at the start of every campaign, for the first session or two, the missile player will announce to me that they are combing the battlefield for their spent ammunition while the other characters are looting, and I go "yeah, yeah, you find all your arrows." and after that they stop mentioning it. It's like marching order, once it's set, I'll assume that's always how things will be.