Skip to content

[Scripting] **Quick Question/Answer Thread**

OzzOzz
edited August 2012 in New Engines/Platforms
What is the difference between %random% and %random_option% (if there is any)?

Comments

  • SvenSven www.GSA-Online.de

    %random% does not exists but %random-1-100% which will give you a random number between 1 and 100

    %random_option% will choose a random entry from a selection form box or will create a 2 chars long random word if the form field is no box but a input box.

  • OzzOzz
    thedatahub.ini
    line 58: auto modify=2

    What's the function for variable "2"?
  • SvenSven www.GSA-Online.de

    0 = don't change anything

    1 = modify content with line breaks and other things

    2 = modify content with line breaks only (and on very long sentences only to make it look better)

  • OzzOzz
    url must have=*://thedatahub.org/*|*://www.thedatahub.org/*

    this needs to be present on static Web 2.0 sites, right? if its not present all crawled URLs which usually can not be identified yet, will be identified as a Web 2.0 with missing "url must have=".
  • SvenSven www.GSA-Online.de
    yes, should be present for maybe later use.
  • OzzOzz
    Is it helpful for SER to add the "Activation successful"-messages to "submit success=" in [Register_Step1] once an account was approved by email?
  • SvenSven www.GSA-Online.de
    no, thats only used for form submissions right now.
  • OzzOzz
    edited September 2012
    can you confirm that recaptcha (or any other captcha) fields don't need to be defined in [Register] and a field like "recaptcha_response_field=%captcha%" is useless once you have defined all other fields and disable "set unknown variable=%leave%"?
  • SvenSven www.GSA-Online.de
    yes, recaptcha as well as adcopy and adscaptcha are handled automatically. No need to define that.
  • OzzOzz
    good to know :D

    this is fixing one of my bugs to test new engines. GSA logged "captcha not solvable by service" in those cases.
  • SvenSven www.GSA-Online.de
    Yes might be because you only use CS as captcha system?
  • OzzOzz
    no, for testing i use shanibpo as 2nd service only
  • OzzOzz
    Is there a way to limit %random_options% to specific number or range if the field has multiple checkboxes?

    I'm asking just of curiosity, because I scripted a Web 2.0 which is working to some point (finally!!). However, the languages my character can speak are...

    Languages spoken: English, Cantonese, Mandarin, Japanese, German, Itallian, Burmese, Shanghainese, Vietnamese

    BTW, I want to use this engine for another tutorial how to script Web 2.0's. 
  • SvenSven www.GSA-Online.de
    hmm you can use also the direct value like ..=English or if the values or captions of that form variable are numbers you can also use %random-X-Y% (X=min, Y=max). But the random_option is really only choosing something randomly.
  • OzzOzz
    edited September 2012
    thx, it's not that important anyway. i was just asking for the case it might come in handy. i don't know, if this case exists (probably never) :)
  • OzzOzz
    image

    Is this a "form id=" or not? this form is labeled as "form class=signup_form_login_lb".
  • SvenSven www.GSA-Online.de

    The "form id" is really only the id="xyz" in the form tag.  The name="xyz" is used for the "form name" variable in the following way:

    form name=<name> - <button caption>

    or

    form name=FORMX - <button caption> if no "name=" is used in that form (X represents the form position on that website 1,2,3...).


  • awintawint
    edited March 2013
    i do not get this
    web=%url_domain%%url_path%%url_parameters%

    Is it the same as web=%url%?   

    any different?
  • SvenSven www.GSA-Online.de
    it is skipping http:// and https:// as that is probably not wanted here.
  • andrzejekandrzejek Polska
    I need to extract password, often in different language ex. of email

    login: %login%
    password: %password%


    login: %login%
    haslo: %password%


    [pass_pw]
    type=extract
    front1=%login%
    front2=\n
    front3=.*:
    back1=\n
    back2=<
    remove html=1
    static=1

    Not working, is it possible to handle that?
  • andrzejekandrzejek Polska
    front1=: %login%

    to match better in case there is "welcome %login%" 
  • SvenSven www.GSA-Online.de
    have alook in the drupal - blog engine. I used that : %login
  • andrzejekandrzejek Polska
    edited July 2015
    Can you implement things like that ex. xrumer http://pastebin.com/WY4gWbKU
    • 0 - a reference to lowercase,
    • 1 - a reference as it is in the HTML -code,
    • 2 - link with the anchor text in the lower register,
    • 3 - The text before the link (introduced in XRumer 7.7.42),
    • 4 - reference parameter «ID» (introduced in XRumer 7.7.42),
    • 5 - setting the reference «CLASS» (introduced in XRumer 7.7.42)

    AddLinkRule ([1, 'board,',
    1, '. 0.htm',
    1, 'action', false
    ], URL_TOVIEW);
    This rule specifies the program that all the references that contain «board» and «.0.htm«, but do not contain «action» - are on view in this section of the forum.

    something to ignore forms: http://pastebin.com/wEtvutwq

    {IN_FORM}type="submit" name="lostpwsubmit"
    ?task=edit_profile&done=avatar
  • SvenSven www.GSA-Online.de
    even though it looks good, I don't see much use in this. XRummer seems to do all this checking for any submission. Even for engines not being part of the definition. This costs time and resources and I don'T see any advantage (except for form class parsing).
  • andrzejekandrzejek Polska
    Good points, and yes class/id seems ok.

    Will that work?

    [variable]
    type=memo
    must be filled=1
    default=1

    try to continue without verification=%variable%
  • SvenSven www.GSA-Online.de
    will not work as macros are not resolved in this. 
  • andrzejekandrzejek Polska
    easycalccheck=%question% <label for='easycalccheck'>;<input

    can you explain how that works?
  • SvenSven www.GSA-Online.de
    this will extract the question text between <label for='easycalccheck'> and <input. If you do not specify anything behind %question%, it is trying to get that automatically (test between two input fields).
  • andrzejekandrzejek Polska
    Can you explain how mathematic captchas are solved?
    E.x i wonder how ser will perform on + and - signs in different languages like example of question:

    400 plus 200 equals (english)
    400 dodac 200 rowne (polish)
    etc.

    And how we can modify them 
  • SvenSven www.GSA-Online.de
    Have a look in the file calc_replace.dat. A question is extracted, chars in it are replaced with that data and then a math task as 1 + 2 is searched for. If found, its a math to be solved for it.
  • andrzejekandrzejek Polska
    Thank you, what about "text captcha found and skipped" ?
    I mean, what option (in project settings ?) will turn ON text captcha solving?
  • andrzejekandrzejek Polska
    Can we use that syntax?

    easycalccheck=%question% <label for='easycalccheck'>;<input|<next label>;<
  • SvenSven www.GSA-Online.de

    this found and skipped is only shown if you use the option to skip/randomize "if a form field can not be filled" is set. If you set it to "Ask user", it will ask you.


  • andrzejekandrzejek Polska
    So if am using ex. bandit im text captcha solver what option should be there?
  • SvenSven www.GSA-Online.de
    edited July 2015

    You can still have it to RANDOMIZE. Of course the services will be asked first.

    Order to resolve is the following:

    1. try to answer this by itself in case a math captcha is detected or one of the many 1000's known questions

    2. service is asked if enabled

    3. user is asked (ASK USER setting) or submission is skipped (SKIP, RANDOMIZE) as a randomized answer to the question will most likely not be successful.

  • AnonymousAnonymous
    @Sven What new engines in version 9.93 has been added? Is trac new engine?
  • SvenSven www.GSA-Online.de
    I think it was "soapbox.alexsci" and "amazon.com" ?
  • andrzejekandrzejek Polska
    I think there is issue with keep subdomain./ Here is my engine:

    enabled=1
    default checked=0
    engine type=MY_Custom
    dofollow=1
    anchor text=1
    creates own page=1
    uses pages=0
    posted domain check=0
    multiple posts per account=1
    url must have1=mydomain.com
    keep subdomain=mydomain.com

    image

    Once it added my links to 192 subdomains then it stop. Sometimes it stop like that at 22

    image

    And after a while i can see:

    image


    But using this option, it works fine.
    image
  • SvenSven www.GSA-Online.de
    sorry but I need this engine to debug this.
  • andrzejekandrzejek Polska
    edited August 2015
    Fixed it on my own. Thanks

    Do we need anything like 

    custom mode=1
    auto modify=1
    in setup article section for the option image work?
    beacuse in preview its working, in posting its not
  • putinchmoputinchmo Ukraine
    Please see what you can do https://forum.gsa-online.de/discussion/18441/what-is-joomla-k2-of-600-successful-registrations-only-20-confirmed-links#latest
  • cefegecefege
    edited August 2015
    This field has a SPAM protection. Each time the name= and id= get a randomly generated number. So how can I tell SER to chose this field withought relying on name and id?

    <input class="form-control" data-content="This should be a unique combination of numbers and letters that you'll be able to remember... but no one else will be able to figure out." data-toggle="popover" id="a3a09e4a87e917b05223f5b3e8aa15e7" name="a3a09e4a87e917b05223f5b3e8aa15e7" type="password" data-original-title="" title="">
  • SvenSven www.GSA-Online.de

    [spam_detection_name]

    type=extract

    front1=data-content="This should be a unique combination of numbers and letters that

    front2=name="

    back="


    ...


    add fixed data= %spam_detection_name% =

    add fixed data condition=
    data-content="This should be a unique combination of numbers and letters that

  • cefegecefege
    edited August 2015
    @sven
    Why front1 and front2?

    I understand we use fron1 to extract the ID=value and front2 to extract the name= value right? But why do we need both? Shouldn't one of them suffice?

    Also on front1, I am guessing you shortened the string? Shouldn't the complete string be:
    front1=data-content="This should be a unique combination of numbers and letters that you'll be able to remember... but no one else will be able to figure out." data-toggle="popover" id="


    Where do I add this part?In the registration stepts(since I encounter this antispam problem there) or in [spam_detection_name]?

    add fixed data= %spam_detection_name% =

    add fixed data condition=
    data-content="This should be a unique combination of numbers and letters that

    Does this work?

    add fixed data= %spam_detection_name% = %password%


    I have 5 fields with this antispam that I need to extract from the page?(username,email,email verrif,password,password verrif).

    Do I create an "extract"  for all?([spam_detection_name],[spam_detection_email],[spam_detection_email_verrif],[spam_detection_password],[spam_detection_password_verrif]


    Thanks!

  • SvenSven www.GSA-Online.de

    front1 and front2 are searched in sequence. First SER searches for front1 and if found searches from that position for front2 and so on. Then it takes that stuff fron that position to the location written in "back=...".

    ---

    add fixed data has to be put in the section where the submission takes place.

    ---

    as I understood your copied stuff, it is an empty variable without content right? If not then you have to extract the content as well or simply use

    *=%leave% to not define any other fields automatically.

  • cefegecefege
    I am using this syntax on the register step:
    add fixed data= %spam_detection_username% = %login%
    add fixed data condition=This username will be your permanent site handle, and is public and searchable

    and it dosen't work, no form match.

    I am trying to add the username which is the login. 
    Is this syntax correct?
    add fixed data= %spam_detection_username% = %login%

    Also is it possible to do:
    add fixed data1=...
    add fixed data1 condition=..

    add fixed data2=...
    add fixed data2 condition=..

    etc
  • andrzejekandrzejek Polska
    add fixed data=%spam_detection_username%=%login%
    add fixed data condition=This username will be your permanent site handle, and is public and searchable

    If  you want to add multiple terms then:

    add fixed data=%nr1%=%login%;nr2=login
    add fixed data condition=nr1match;nr2match



  • andrzejekandrzejek Polska
    edited August 2015
    Is it possible to create 2x extra steps?

    extra step 1
    link type=profile url
    extra step 2
    link type=forum post


  • SvenSven www.GSA-Online.de
    sorry no. Just STEP1 and EXTRA_STEP1.
  • andrzejekandrzejek Polska
    Now we need to extract password fields id's. They are automatically generated.

    [password1]
    type=extract
    front1=<input type="password" id="
    back="
    must have=!ls_password

    [password2]
    type=extract
    front1=<input type="password" id="
    back="
    must have=!ls_password|!%password1%

    I thought that will work, but its not. Any hints so we wont match password1 in password2>?

    Also, maybe SER can match by     <input type="password" ?
  • SvenSven www.GSA-Online.de

    must have can not have variables sorry. You have to solve it differently. Remember you can use alternative front stuff like

    front1=try1|try2|try3|...


  • andrzejekandrzejek Polska
    I know that but its not a solution here, i will post tomorrow whats the problem with examples.
  • andrzejekandrzejek Polska
    edited August 2015
    So here is example 
    http://www.scriptcode.net/member.php?mod=register
    http://bbs.akxw.cn/member.php?mod=register

    Almost all of these websites got generated fields.
    SER can recognize the form but most of the data is posted via add fixed data.
    (like username password, password2 and email)

    For username it seems easy, beacuse first match will pickup username field:

    front1=<input type="text" id="
    back="

    Next thing are passwords, first is picked up using

    front1=<input type="password" id="
    back="

    As you can see the second password input is different

    <input type="password" id="bRV7Vl" name="" size="25" tabindex="1" class="px" required />

    <input type="password" id="kKijt3" name="" size="25" tabindex="1" value="" class="px" required /></td>

    1. tabindex="1" class="px"
    2. tabindex="1" value=""

    I tried using many backs to match back2=tabindex="1" value="" but i couldnt get it to work.

    For e-mail we want to use

    front1=<input type="text" id="
    back="

    But we have to match nr.2 aswell.


    Now, what's the solution here? I already thought about custom script on my domain where SER visits that and then gets back custom field names - but really is that the best solution here?:)



    @ also being able to use variable in must have= could solve the problem
  • SvenSven www.GSA-Online.de

    hmm why don't you use the labels here?

    you can use this...

    *user name:*=%login%

    *Password:*=%password%

    *Confirm Password:*=
    %password%

    *Email:*=%your e-mail%

  • andrzejekandrzejek Polska
    edited August 2015
    regsubmit=yes  [type: HIDDEN]
    formhash=23c7d1d7  [type: HIDDEN]
    referer=http://www.scriptcode.net/  [type: HIDDEN]
    activationauth=  [type: HIDDEN]
    regsubmit=true  [type: HIDDEN]


    Beacuse ser cant fill any fields by default :) I wouldn't ask here if that would work...
  • SvenSven www.GSA-Online.de

    so how about this...

    [varnameX]

    type=extract

    front1=User name:

    front2=id="

    back="

    ....

    add fixed data=%varnameX%=%login%;

  • andrzejekandrzejek Polska
    There is thousands of target sites, in many different languages, (mostly chinese...encoding...).

    for example : http://bbs.akxw.cn/member.php?mod=register

    用户名 = username and got 8 matches in source code... also login field (in top corner) for username name="username"

    but for registration name="_au1sername_akxw_bbs"

    ....
  • SvenSven www.GSA-Online.de

    ok then this...

    [varname_user]

    type=extract

    front=<input type="text" id="

    back="


    [varname_mail]

    type=extract

    front1=<input type="text" id="

     front2=<input type="text" id=" 

    back="

    [varname_pw2]

    type=extract

    front1=<input type="password" id=" 

    front2=<input type="password" id=" 

    back="


    [varname_pw1]

    type=extract

    front1=<input type="password" id=" 

    back="

  • andrzejekandrzejek Polska
    I got a problem with SER inserting my keyword into article:

    [Article]
    type=memo
    allow html=1
    must be filled=1
    hint=The full article comes here.
    auto modify=1
    auto add anchor url=2
    auto add anchor url content=%file-auto_anchor-article.dat%
    custom mode=1
    html to custom link format=1
    custom link format=%url%

    comment=asd; http://nicewebsite.com, awesome website


    image
    image


    using awesome website %link%

    comment=awesome website asd - http://nicewebsite.com -

    this is directly from debug "log"


    Just trying your solution above
  • andrzejekandrzejek Polska
    edited August 2015
    Yes it is working thank you, but a question here, from what i see %variable%
    cant be used in add fixed data=%variable% right? Do you plan to support that?


    Can we send SER text captcha in variable?
    If yes, how? Example:

    [textcaptchaquestion]
    type=extract
    front1=x
    back=y
    url=./urlfortextcaptcha.txt

    For example:






    [textcaptcha1]
    type=extract
    front1=sectplcode[2] + '
    back='
    url=./misc.php?mod=secqaa&action=update&idhash=%captchaquestionhash1%

    source of that url: 

    if($('secqaa_qSkzCZnA')) {
    	var sectpl = seccheck_tpl['qSkzCZnA'] != '' ? seccheck_tpl['qSkzCZnA'].replace(//g, 'codeqSkzCZnA') : '';
    	var sectplcode = sectpl != '' ? sectpl.split('') : Array('
    ',': ','
    ','');
    	var string = '' + sectplcode[0] + 'ŃéÖ¤ÎĘ´đ' + sectplcode[1] + '' +
    		' ťťŇť¸ö' 
    		' img src="' + STATICURL + 'image/common/none.gif" width="16" height="16" class="vm">' +
    		sectplcode[2] + '1000+799=' + sectplcode[3];
    	evalscript(string);
    	$('secqaa_qSkzCZnA').innerHTML = string;
    }


    then using

    add fixed data=easycalccheck=%question% fixed:%textcaptcha1%


     result:


    image
Sign In or Register to comment.