Target URL cache maximum limit

@Sven

Hello @Sven
When target url cache exceeds too much, I can see that the performance drops.
I hope that one day I can see there is one target URL cache limit. so, I can set sth like 500,000 in it and new targets won't be added if target URLs reach that point.

Best wishes

Thats unlikely the problem as only a small part from the file is loaded to memory and cut from the end of the file. It processes them and reads another batch. The size of the file should really not matter at all.