That's correct. It also happens with new games and DLC as well where the influx of new players increases the TA score (more players and less with achievements). Once that settles and more players are getting achievements, the score drops and evens out over time.
e.g. an achievement on Xbox from Forza Horizon where there were a lot of players, and only a handful achieved this one. It was worth 5000 TA score. Then, when people started unlocking it more and more, the score dropped to 250-ish:
https://www.trueachievements.com/a633432/playedlist-achievem...