Accuracy loss varies with the individual rifle
And may not amount to anything noticable. Or it may, depending on a lot of variables. Many benchrest shooters clean after 20 rnds. Big game hunters (who know that they are doing) don't clean during the hunt, unless the have to, or can fire a fouling shot before taking to the field, because of the change in POI between a clean barrel and a "fouled" one.
Varmint hunters may clean after a set number of rounds, or at the end of the days shooting, or they may wait until they actually see a drop in the accuracy. Everybody does it a little different. The only harm you can do by cleaning (as long as it is done properly) is to change the point of impact of the first shot. For some rifles it is a relatively small thing, for others it is bigger.
The only way to be sure for your rifle and load is to spend some time shooting it. Keep track of how many rounds you fire (without cleaning) before group sizes begin to open up (and make sure that barrel heat and shooter fatigue are not the causes) When groups open up to where you are not comfortable with them anymore, that it the max number of shots you ought to shoot before cleaning the barrel. It is time comsuming, and costs a bit in ammo, but if you really want to know how much your gun/ammo combination will go before losing accuracy due to fouling, that's the way to go about it. Anything else is just a guess.
Cleaning before you reach the point of losing accuracy hurts nothing (except for the clean bore/fouled bore issue) and every rifle/ammo combination is an individual, as some ammo fouls more than others.
One thing you should do is sight in your rifle carefully, then clean it. Then go back to the range and fire that first shot carefully, and then the second, noting any change in point of impact. Once you know how far off the "clean bore shot" is from the fouled bore group, you will have a good basis for knowing how your rifle will shoot in the field, clean or dirty.