Skip to content

Keyword Generator - Made in Java - For Scraping

2456

Comments

  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Update (Despite the little interest - the development continues....)
    - Added Compression Functionality under Various Tools
    It will compress multiple files from a folder to a selected destination.

    Example:

    image

    image

    image

    image
    Inside the new Compressed File:

    image

    Will possibly add:
    - Decompression of files
    - Progressbar for all tasks under 'Various Tools'



  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    edited April 2015
    Update:

    After some serious coding - Additional language support for the Keyword Generator part is now possible!

    Here is a raw demo:

    Source - Thai
    image



    Result - Unique Keywords Thai:
    image

    Once I have some spare time - I will implement support of various languages in the Graphical Part of the Tool Box.

    In Theory - it should be possible to cover plenty of various languages;)

    That means that 'the switches' i.e the radio buttons, will enforce which language is used, when generating keywords.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png

    Test and preview of Japanese Language:


    image


    Result:

    image


    All good:)

    Actual implementation in the GUI (Grafical User Interface) will be handled asap...

    Next update should show generation from the actual program - so stay tuned;)
  • Very nice . PM me Paypal :)
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    @spammasta
    Many thanks for your support:)

    Once it's ready for a launch - I will shoot you a pm;)

    Some minor things still needs to be adjusted, before it's first release.

    However we are getting close to a first release - Give it a couple of days more...

    The development will continue after first release, meaning more features added and potential bugs will be solved.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Update - Language Sorting Algorihtms implemented in the GUI

    1. Demo: Thai Selection

    image

    image

    image

    Result:
    image
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Update - Language Sorting Algorihtms implemented in the GUI

    1. Demo: Englsh Selection

    image

    image

    image

    Result:
    image
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Update - Language Sorting Algorihtms implemented in the GUI

    1. Demo: Portuguese Selection
    image

    image

    Result:
    image
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    That means the following:
    - Support for:
    English, Greek, Portuguese, Japanese and Thai implemented and working!

    Final adjustments before first release:
    Before first version is released some minor adjustments and bugs needs to be fixed.
    No additional features will be added before release - only fixing and cleaning.
    - Expect a few days time from now.

    Thread will be updated here, once first release is ready;)
    The development will continue - as a donor you are supporting the future of this software.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Well I couldn't resist it:P

    - Added one more multi-feature before I begin to clean up:

    image

    Clicking on the monitor - will result in a pop-up showing cpu-ursage etc....

    image

    This new Statusbar will become Super Handy in terms of future updates!
    It will replace several progressbars and make the overall interface more streamlined...

    Future opdates of the program will globally use this New Taskbar and notify about running tasks...
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Initiated Cleanup and Preparation of first official launch.

    Completed tasks:
    - Added specific icon in the GUI
    - Added needed confirmation dialogs
    - Cleaned up file-selectors (all know shows .txt files as default)

    image


    TO DO before launch:
    - Change some listeners and their respective evaluations
    - Add program update log file
    - Adjust GUI
    - Compile final program and launch

    Expected timeframe:
    3-5 days
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    edited April 2015
    A few To-Do Completed:

    image

    Change Log:

    image

    - Made a Stress Test with at large file (Worked)
    - Adjusted a few listerners (Still some to go)

    image

    - Added Multi-Functionality in 'Latin' sorting algorithm - Now it covers more languages

    To-DO
    - Fix remaining listeners
    - Adjust GUI
    - Compile and Lanch
  • Can you able to make any video for this scraper.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    edited April 2015
    @redfoxseo

    Sure, however please notice the program will feature 2 different kind of scrapers:

    1. The one you see present now ---> 'Url Keyword Scraper'

    2. Upcomming feature 'Article Scraper' ---> Not present at the moment.

    The current one - i.e the 'Url Keyword Scraper', takes a list with x-amount of target links.

    It will then visit each target, and scrape the meta-keywords.

    During the process of visiting the site targets, 30 threads are used to ensure speed.

    Those 'Meta Keywords' will be added to an internal list...

    Finally before writing out the result list, it will remove all duplicates and ensure only unique keywords are left out in the final list.

    The other feature - the non present one (Article Scraper) is still under development, and it will be added to the Tool-Box, once it is ready;)

    In both cases - A small video demonstration is optimal, to show what is going on... and I will add them later;)

  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    edited April 2015
    Update:


    Prior to release, Registration Protection has been added:

    image

    image

    image

    Activated Program starts up - and will no longer ask for input on next startup:

    image

    This is to ensure that the program stays among donors only.

    That leaves very little left to do before it's released:)
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Update:

    - Enhanced URL KeyWord Scraper, so it shows:
    Processed Targets in Real Time (Green)
    Loaded Targets (Blue)

    image

    Compiled the Program and Tested it on a seperate machine:
    - Shows how it will be distributed as *FINAL*

    image

    Registration and execution both went flawless:)

    There are 2 minor issues left, I would like to fix before calling it ready to release...

    So once I have those 2 fixed - it's ready for you guys to tryout:)

  • PM me your paypal.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    @gsasurfer
    Thank you for your support:)

    Will pm you very soon - stay tuned;)
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    - Added use of Progressbar in URL KeyWord Scraper:

    image

    That gives a good visual of processed target-urls:
    1. Real Time view of processed targets (Green)
    2. Progressbar--> Overall Progress

    That leaves only one more tiny thing to fix, before I release it....
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    And here is a sample with more targets loaded:

    image

    Processing fast - using 30 threads...
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Allright - Ladies & Gentlemen:)

    Before I announce that Scraping Tool-Box 1.0 is ready to launch today, I would like to issue out some important information:

    1. This software is not sold - It is released to interested donors only (Support of development)
    2. Version 1.0 is far from finished - it is a process, where version 1.0 is initial release.
    3. Interested may make a donation of 5$ via PayPal - In return they receive the following:

    A. Current Final Compiled Version i.e Scraping Tool-Box 1.0.
    B. Serial + Activation-key
    C: As a donor you are entitled to receive future updates of the program
    - Make sure you inform Paypal, that this is a DONATION - otherwise the payment will be rejected.


    FAQ:
    Q: Why is the URL Keyword Scraper sometimes really slow, when approaching the last targets?
    A: Some sites takes longer to load or respond than others. Threads are also being cleaned up.

    Q: Why are there not a decompress feature?
    A: Well, it's not finished. More features, including this one will come over time.

    Q: I can't start the Application?
    A: Make sure you have the latest Java Installed on your system, please visit this site:

    *Known Potential Bugs:
    If Notepad is installed in different location than the default installation settings.
    Fix: Contact me, and I will remove and recompile the application

    Last Fixes and Improvements:
    - Changed the GUI a little:

    image


    image

    image

    image

    image

    image

    image

    Addtional Information:

    I will contant those who have contacted me via PM or in this thread.
    Please be patient - Time constraints and real life issues can slow the processing:D

    Scraping Tool-Box 1.0 is ready to release later today, and I will start contacting interested asap.
    Stay tuned - It's comming today;)
  • Can you make the video as well to see how it works.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    @redfoxseo

    I will try my best and add some later:)

    In the meantime, here is a book to get you started:


    1. Download the book to a location on your harddrive.
    2. Start the program and activate the tab: Keyword Generator
    3. Select the book above as source
    4. Select destination (where the final list should be stored)
    5. Select 'English' as sorting algorithm
    6. Press 'Go' button

    - A few seconds or minutes later, depending on your machine, you will have a new fresh list with unique keywords.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    edited April 2015
    @redfoxseo


    Demo of Keyword Generator

    More videos will follow - quite time consuming to make, and I'm not a Video Guru:P


  • lol.. i don't have the time to read my own history... :))
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Video 2


    I will try to add addtional videos - however time is in to contact some people soon and release it:)
    Best way is by trying it out;)

    Please note:
    Some sites are down, slow etc...it will influence the result of course...
    On top of that, threads must also be cleaned out.

    This video should give you an idea about how it works though;)
  • I understood what are you trying to say and it is related to the software, is there any trial version of this software ?
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    Sorry Wrong Video - One more try:

  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    @redfoxseo

    Hmm...sorry, no trials as the program is distributed via donations.

    In other words:

    5$ makes you a donor and that entitles you to the program and updates;)

    The donation itself, is only to support the future development of the application.

    So - it's not sold, actually it's free and driven by it's donors.
  • magicallymagically http://i.imgur.com/Ban0Uo4.png
    PM's has been distributed to those who either asked for it in this thread or via PM.

    Everyone are still welcome to contact me via PM or here in this thread.

    As stated before - This is just the beginning! 
    The development will continue, and more features added over time.

Sign In or Register to comment.