[Possible Bug] Link Processor don't get all verified links ?
@Sven .. Link Processor don't get all verified links. I suspected this
yesterday and I monitored it today. I guess it's not working properly.
Today , I made 230 k verified backlinks in SER but the api only got 102 k links !!!!
When I select all projects >> show verified urls >> send to indexer ..it works good.
I'm not sure if it's a bug in the @linkprocessor's api itself or in SER ?... please check.
Today , I made 230 k verified backlinks in SER but the api only got 102 k links !!!!
When I select all projects >> show verified urls >> send to indexer ..it works good.
I'm not sure if it's a bug in the @linkprocessor's api itself or in SER ?... please check.
Comments
I'm not the only one with this problem by the way... please take a look here
https://forum.gsa-online.de/discussion/comment/72144/#Comment_72144
Can you debug and test it plz ?
They told me they remove dup URLs so that might explain some discrepancy. But no way it could account for the amount of missing links you are seeing.
@gooner .. manual sending works like a clock. The automatic sending is always way less. What % of links are you missing in your tests ?
@Sven ..create a new project ..let it run for while and then compare the verified number with the number on link processor control panel ..You will most likely find the problem.
hmm just checked it all again ... no problems on my code as far as I can see.
URLs get not sent if:
a) URL is the same and was sent before
b) PR or DoFollow only is checked in indexer options
c) a timeout occurres while sending the data to the indexer (make sure it is high enough)
Maybe it's a problem in the service itself ?
The way links are sent to that new service is the same as in every other indexing service. The code is 1:1 except that the URLs or parameters are different. So from @mamadou 's experience it should be an issue on link processor but I guess that there must be some other issue.
However next version will try to send the query to each server again if no reply was given...just in case the server is over loaded or some network problem happens.
@sven Users reported the issue with other indexing services here - https://forum.gsa-online.de/discussion/comment/70102
So, it is very strange that the same issue is happining on two different services.
@linkprocessor Im aware of the problem. I hope the next version where it retries to send things is improving things. Can you check if your server may sometimes be overloaded and just reply with an empty reply? Thats the only reason I see why it would fail. Also whats the response time? Should always be under 30seconds right?
It is strange that problem happen when GSA is regularly posting and sending to indexing services, but does not happen when user click on "send links to indexing services"...
@linkprocessor ..I hope you give this problem high priority in the next few days. People are having very very low indexation percentage because of this problem and they are blaming the service itself not this bug! and they are leaving your service. ( one of the heavy users here told me that he stopped using your service for low indexation % ) ..In my tests while I send links manually .. your service have a very good indexation % but you MUST fix this issue as soon as possible.
Currently , I 'm sending all my links manually once per day but I don't want to stay like this forever!.
I see last post in this thread - https://forum.gsa-online.de/discussion/comment/70102
It was made on April 10:
"Today I stopped SER to update to 8.16 and problem disappeared, SER didn't start to suddenly send tons of links once it stopped. I also checked both indexers and looks like the amount of links it should get was sent, so far so good"
When did you see this issue last time?
@JudderMan ... did you compare your verified links number with the Link processor stats ?