Skip to content

url > crawl online should include http in each url

GiorgosKGiorgosK Greece
edited August 2012 in Bugs
when using url > crawl online it does a good job at collecting urls
but it puts the in the textbox without http:// at the front and then edit dialog complains about urls not having http:// in front

Comments

  • SvenSven www.GSA-Online.de

    Sorry but thats something I can not reproduce. It is always adding "http://" or "https://" in front. If you have something else in the box it is not added from the "Crawl Online" function.

  • GiorgosKGiorgosK Greece
    no it is from crawl online only

    but I realized if you feed it initial URL without http:// and press crawl
    it will happily take it but then all urls fetched would be without http://

    perhaps this needs taking care of
  • SvenSven www.GSA-Online.de
    I have added a check now for the starting URL. It gets it's http:// if it is missing.
Sign In or Register to comment.