In a word, yes. Exactly how much depends on the rate of daily uptake and the water volume. Add more and test reqularly until your desired level is reached. Your replacement schedule is not keeping up with the depletion rate.......IMO your should have continous replacement as in a doser or reactor for best results....the next best thing is to do it daily......adding everyother day, weekly or bi-weekly will have a yo-yo effect on your system that will produce less than optimal results and will be more obvious as the daily uptake for alk increases......If you are going to use Baking Soda, I might suggest adding it to your topoff water so that it is at least replaced with the consistency that you top off.
Is this all that you are dosing currently? If so, your tanks Ca demand is most likely low and being replaced by reqular water changes, but eventually will catch up and need to be replaced daily like the Alk.......A supplementation schedule should be considered now before that occurs and you are prepared. Good Luck!!!