Not getting any results from medium or quora

googlealchemist

I was testing each source individually to see what i wanted to use for my needs...and noticed medium and quora are not returning any results. I used a couple different very broad, common keywords the first time....then switched the kw to these other very broad keywords shown in the screenshot.

I know both sources have plenty of information on basicaly everything these days so I'm not sure whats going on

Sven

fixed for next update

googlealchemist

Sven said:

fixed for next update

still not getting anything from medium...using various very broad keywords

[11:57:14] Starting "Scraping Articles (search/custom)"...

[11:57:16] Last page: 1 | Results: 7 | URL: https://medium.com/search?q=home improvement

[11:57:16] Last page: 1 | Results: 6 | URL: https://medium.com/search?q=construction

[11:57:17] Result 01 - Unable to extract content for https://medium.com/tag/construction-vehicles?source=search_post--------------------construction_vehicles-----------------

[11:57:17] Result 01. Length:    244 Chars | Title: Home Improvement | URL: https://medium.com/tag/home-improvement?source=search_post--------------------home_improvement-----------------

[11:57:18] Result 02 - Unable to extract content for https://medium.com/tag/home-improvement-services?source=search_post--------------------home_improvement_services-----------------

[11:57:18] Result 03. Length:    196 Chars | Title: Home Improvement Tips | URL: https://medium.com/tag/home-improvement-tips?source=search_post--------------------home_improvement_tips-----------------

[11:57:18] Result 02. Length:    255 Chars | Title: Construction Industry | URL: https://medium.com/tag/construction-industry?source=search_post--------------------construction_industry-----------------

[11:57:19] Result 04 - unrelevant content (keywords missing) for https://medium.com/tag/home-improvement-ideas?source=search_post--------------------home_improvement_ideas-----------------

[11:57:20] Result 05. Length:    322 Chars | Title: Home Improvement 2 | URL: https://medium.com/tag/home-improvement-2?source=search_post--------------------home_improvement_2-----------------

[11:57:20] Result 03. Length:    444 Chars | Title: Construction Equipment | URL: https://medium.com/tag/construction-equipment?source=search_post--------------------construction_equipment-----------------

[11:57:20] Result 06 - unrelevant content (keywords missing) for https://medium.com/tag/home-improvement-designs?source=search_post--------------------home_improvement_designs-----------------

[11:57:21] Result 07 - Unable to extract content for https://medium.com/jobs-at-medium/work-at-medium-959d1a85284e?source=search_post-------------------------------------

[11:57:23] Result 04. Length:    331 Chars | Title: Construction Company | URL: https://medium.com/tag/construction-company?source=search_post--------------------construction_company-----------------

[11:57:23] Result 05 - Unable to extract content for https://medium.com/jobs-at-medium/work-at-medium-959d1a85284e?source=search_post-------------------------------------

[11:57:47] Result 06 - HTTP Return Code 0 for https://medium.com/tag/construction-management?source=search_post--------------------construction_management-----------------

[11:57:47] Saving 6 data sets to disk...

[11:57:47] Starting "Removing duplicate content"...

[11:57:47] Starting "Filtering Content"...

[11:57:47] Starting "Generating Articles"...

[11:57:47] MixParagraph: extracting paragraphs and titles from 6 data sets...

[11:57:47] MixParagraph: extracted 0 paragraphs

[11:57:47] Amount of words from all data sets: 0

[11:57:47] Not enough unused content left. There where 0 new articles created.

[11:57:47] Sorry, not enough content to create any article. Try to select more sources or use more keywords.

[11:57:49] Finished.

[12:00:25] Starting "Scraping Articles (search/custom)"...

[12:00:26] Last page: 1 | Results: 5 | URL: https://medium.com/search?q=business

[12:00:27] Result 01. Length:    270 Chars | Title: Business Models | URL: https://medium.com/tag/business-models?source=search_post--------------------business_models-----------------

[12:00:27] Last page: 1 | Results: 5 | URL: https://medium.com/search?q=health

[12:00:27] Last page: 1 | Results: 3 | URL: https://medium.com/search?q=news

[12:00:27] Result 02. Length:    739 Chars | Title: Business Intelligence | URL: https://medium.com/tag/business-intelligence?source=search_post--------------------business_intelligence-----------------

[12:00:27] Result 01. Length:    277 Chars | Title: Healthy Foods | URL: https://medium.com/tag/healthy-foods?source=search_post--------------------healthy_foods-----------------

[12:00:28] Result 03. Length:    229 Chars | Title: Business Strategy | URL: https://medium.com/tag/business-strategy?source=search_post--------------------business_strategy-----------------

[12:00:28] Result 04. Length:   2511 Chars | Title: Work at Medium | URL: https://medium.com/jobs-at-medium/work-at-medium-959d1a85284e?source=search_post-------------------------------------

[12:00:28] Result 01. Length:    270 Chars | Title: News Home | URL: https://medium.com/tag/news-home?source=search_post--------------------news_home-----------------

[12:00:28] Result 02. Length:   2511 Chars | Title: Work at Medium | URL: https://medium.com/jobs-at-medium/work-at-medium-959d1a85284e?source=search_post-------------------------------------

[12:00:29] Result 03 - unrelevant content (keywords missing) for https://medium.com/tag/news-articles?source=search_post--------------------news_articles-----------------

[12:00:29] Result 02. Length:    277 Chars | Title: Health Recipe | URL: https://medium.com/tag/health-recipe?source=search_post--------------------health_recipe-----------------

[12:00:30] Result 03. Length:    280 Chars | Title: Health Foods | URL: https://medium.com/tag/health-foods?source=search_post--------------------health_foods-----------------

[12:00:30] Result 04. Length:   2511 Chars | Title: Work at Medium | URL: https://medium.com/jobs-at-medium/work-at-medium-959d1a85284e?source=search_post-------------------------------------

[12:00:33] Result 05. Length:    207 Chars | Title: Business Development | URL: https://medium.com/tag/business-development?source=search_post--------------------business_development-----------------

[12:00:52] Result 05 - unrelevant content (keywords missing) for https://medium.com/tag/healthy-lifestyle?source=search_post--------------------healthy_lifestyle-----------------

[12:00:52] Saving 11 data sets to disk...

[12:00:52] Starting "Removing duplicate content"...

[12:00:52] Starting "Filtering Content"...

[12:00:52] Starting "Generating Articles"...

[12:00:52] MixParagraph: extracting paragraphs and titles from 8 data sets...

[12:00:52] MixParagraph: extracted 2 paragraphs

[12:00:52] Amount of words from all data sets: 312

[12:00:53] Not enough unused content left. There where 0 new articles created.

[12:00:53] Sorry, not enough content to create any article. Try to select more sources or use more keywords.

[12:00:53] Finished.

googlealchemist

still similar issues with quora as well...what am i doing wrong? 

[12:03:22] Starting "Scraping Articles (search/custom)"...

[12:03:23] Last page: 1 | Results: 0 | URL: https://www.quora.com/search?q=construction&type=post

[12:03:24] Page: 1 | Results: 9 | URL: https://www.quora.com/search?q=home improvement&type=post

[12:03:25] Result 01 - Unable to extract content for https://mvztxrozvpcspatn.quora.com/Facts-Everyone-Should-Know-Before-getting-Marriage

[12:03:25] Result 02 - Unable to extract content for https://roofingsolution.quora.com/Selection-of-EPDM-Rubber-Roofing-System

[12:03:25] Result 03 - Unable to extract content for https://www.quora.com/Why-do-mobile-homes-not-have-fencing/answer/Steph-Groom-2

[12:03:25] Result 04 - Unable to extract content for https://homeremodel.quora.com/https-www-quora-com-What-do-you-love-to-decorate-in-a-room-answer-Eric-Smith-3331

[12:03:26] Result 05 - Unable to extract content for https://homeremodel.quora.com/Good-for-a-mancave-https-www-quora-com-How-do-you-finish-a-room-without-drywall-answer-Brian-Freeman-37

[12:03:26] Result 06 - Unable to extract content for https://quickhomerepairs.quora.com/Hacks-of-the-Day-1-Use-a-potato-to-unscrew-a-broken-lightbulb-Cut-the-potato-in-half-Push-the-soft-side-into-the-br

[12:03:26] Result 07 - Unable to extract content for https://homedecoritems.quora.com/Happy-Holi-Host-the-Perfect-House-Party-with-Vibrant-Holi-Decoration-Ideas

[12:03:27] Result 08 - Unable to extract content for https://homeremodel.quora.com/I-have-done-it-both-ways-many-times-https-www-quora-com-When-replacing-an-exterior-door-is-it-necessary-to-also-repl

[12:03:27] Result 09 - Unable to extract content for https://homeremodel.quora.com/Too-drippy-for-brush-application-https-www-quora-com-How-do-you-apply-a-Thompson-water-seal-answer-Brian-Freeman-37

[12:03:28] Last page: 2 | Results: 0 | URL: https://www.quora.com/search?q=home improvement&type=post

[12:03:28] Starting "Removing duplicate content"...

[12:03:28] Starting "Filtering Content"...

[12:03:28] Starting "Generating Articles"...

[12:03:28] MixParagraph: extracting paragraphs and titles from 0 data sets...

[12:03:28] MixParagraph: extracted 0 paragraphs

[12:03:28] Amount of words from all data sets: 0

[12:03:28] Not enough unused content left. There where 0 new articles created.

[12:03:28] Sorry, not enough content to create any article. Try to select more sources or use more keywords.

[12:03:29] Finished.

[12:02:36] Starting "Scraping Articles (search/custom)"...

[12:02:37] Page: 1 | Results: 8 | URL: https://www.quora.com/search?q=health&type=post

[12:02:37] Page: 1 | Results: 8 | URL: https://www.quora.com/search?q=news&type=post

[12:02:37] Result 01 - Unable to extract content for https://www.quora.com/What-s-the-worst-thing-a-doctor-has-done/answer/Carol-Rogers-DeArmitt

[12:02:37] Result 02 - Unable to extract content for https://www.quora.com/As-an-ER-nurse-have-you-ever-taken-care-of-someone-who-was-alert-and-responsive-but-their-lab-work-or-imaging-told-a-far-different-story-as-to-how-seriously-ill-they-really-were/answer/Brittany-Brown-1162

[12:02:37] Page: 1 | Results: 7 | URL: https://www.quora.com/search?q=business&type=post

[12:02:38] Result 01 - Unable to extract content for https://www.quora.com/What-is-the-most-inspiring-thing-you-read-today/answer/Trisha-Cruz-39

[12:02:38] Result 02 - Unable to extract content for https://lolmeme.quora.com/Which-photograph-deserves-7910-views-34

[12:02:38] Result 03 - Unable to extract content for https://www.quora.com/What-do-doctors-do-when-a-patient-cant-pay-for-life-saving-surgery-Will-the-surgeon-let-the-patient-die-or-perform-the-surgery-at-his-her-own-expense/answer/John-Cinder

[12:02:38] Result 04 - Unable to extract content for https://www.quora.com/As-a-doctor-what-made-you-most-uncomfortable-when-a-patient-took-off-his-her-clothes/answer/Glyn-Burtt

[12:02:38] Result 01 - Unable to extract content for https://www.quora.com/What-are-some-destruction-level-999-tweets/answers/282838463

[12:02:38] Result 02 - Unable to extract content for https://www.quora.com/What-are-the-reasons-why-D-Mart-is-profitable-while-other-retail-chains-are-dealing-with-losses/answer/Sushang-Agnihotri-1

[12:02:38] Result 03 - Unable to extract content for https://www.quora.com/How-do-you-tell-a-bride-that-her-wedding-dress-is-inappropriate/answer/Marina-Lezos

[12:02:38] Result 04 - Unable to extract content for https://resilientwomeneverywhere.quora.com/ti-58541359

[12:02:38] Result 05 - Unable to extract content for https://www.quora.com/What-does-a-doctor-do-when-a-patient-comes-in-for-an-exam-and-smells-really-bad/answer/Shreya-Thacker-4

[12:02:38] Result 06 - Unable to extract content for https://www.quora.com/As-a-doctor-or-nurse-have-you-ever-encountered-a-patient-who-was-too-gross-to-touch/answer/Latasha-Deanne

[12:02:38] Result 03 - HTTP Return Code 429 for https://summation.net/2019/01/07/spend-lots-and-lots-of-time-alone/

[12:02:38] Result 05 - Unable to extract content for https://mademesmilenow.quora.com/What-screenshots-can-attract-357654335K-views-in-a-single-day-2

[12:02:39] Result 07 - Unable to extract content for https://www.quora.com/As-a-doctor-or-nurse-whats-the-most-horrible-thing-youve-ever-seen-in-a-patient-which-you-cant-forget/answer/Mark-A-Goldman

[12:02:39] Result 08 - Unable to extract content for https://www.quora.com/Why-do-people-get-so-mad-when-someone-doesnt-want-to-get-vaccinated/answer/Ajinkya-M-5

[12:02:39] Result 06 - Unable to extract content for https://www.quora.com/Which-photo-deserves-17-5K-upvotes/answer/Inam-Tanveer-Talks

[12:02:39] Result 04. Length:  14478 Chars | Title: Astronauts explain why nobody has visited the moon in more than 45 years - and the reasons are depressing | URL: https://www.businessinsider.com/moon-missions-why-astronauts-have-not-returned-2018-7

[12:02:39] Result 05. Length:   3119 Chars | Title: A 39-year-old coronavirus patient who could hardly breathe posted a stark video from the ICU to warn people who think it won't happen to them | URL: https://www.businessinsider.com/coronavirus-woman-hospital-warns-people-who-doubt-will-affect-them-2020-3

[12:02:39] Page: 2 | Results: 1 | URL: https://www.quora.com/search?q=health&type=post

[12:02:39] Result 07 - Unable to extract content for https://www.quora.com/What-incident-has-traumatized-you-for-good/answer/Christin-Taggart

[12:02:39] Result 06 - unrelevant content (keywords missing) for https://www.businessinsider.com/girl-tweets-smart-fridge-mom-confiscated-devices-viral-2019-8

[12:02:40] Result 01 - Unable to extract content for https://www.quora.com/As-a-doctor-what-is-the-biggest-mistake-that-youve-made/answer/Laszlo-B.-Tamas

[12:02:40] Result 07 - Unable to extract content for https://worldofeverything1.quora.com/AMAZING-STORY-OF-CHEETOS

[12:02:40] Last page: 3 | Results: 0 | URL: https://www.quora.com/search?q=health&type=post

[12:02:41] Result 08 - Unable to extract content for https://lolmeme.quora.com/Which-screenshot-deserves-90M-views-and-upvotes-93

[12:02:41] Last page: 2 | Results: 0 | URL: https://www.quora.com/search?q=business&type=post

[12:02:41] Last page: 2 | Results: 0 | URL: https://www.quora.com/search?q=news&type=post

[12:02:41] Saving 2 data sets to disk...

[12:02:41] Starting "Removing duplicate content"...

[12:02:41] Starting "Filtering Content"...

[12:02:41] Starting "Generating Articles"...

[12:02:41] MixParagraph: extracting paragraphs and titles from 2 data sets...

[12:02:41] MixParagraph: extracted 11 paragraphs

[12:02:41] Amount of words from all data sets: 1771

[12:02:42] Not enough unused content left. There where 2 new articles created.

[12:02:42] Finished.

googlealchemist

im not here to complain or say anything is wrong with the software...im guessing the problem is on my end somehow...but im unsure what to change to get results...

not getting anything from bbc

[12:34:34] Starting "Scraping Articles (search/custom)"...

[12:34:35] Last page: 1 | Results: 0 | URL: https://www.bbc.co.uk/search?q=health&filter=news&suggid=

[12:34:35] Last page: 1 | Results: 0 | URL: https://www.bbc.co.uk/search?q=business&filter=news&suggid=

[12:34:35] Last page: 1 | Results: 0 | URL: https://www.bbc.co.uk/search?q=news&filter=news&suggid=

[12:34:36] Starting "Removing duplicate content"...

[12:34:36] Starting "Filtering Content"...

[12:34:36] Starting "Generating Articles"...

[12:34:36] MixParagraph: extracting paragraphs and titles from 0 data sets...

[12:34:36] MixParagraph: extracted 0 paragraphs

[12:34:36] Amount of words from all data sets: 0

[12:34:36] Not enough unused content left. There where 0 new articles created.

[12:34:36] Sorry, not enough content to create any article. Try to select more sources or use more keywords.

[12:34:36] Finished.

googlealchemist

same for brave

Sven

I see medium getting parsed - few chars per article but still extracting it

quora: not a good choice I guess as all returned articles have little content

brave: seems down/crypting things

--

Please check if you use proxies for scraping...try turning them off and see if it changes.

googlealchemist

Sven said:

I see medium getting parsed - few chars per article but still extracting it

quora: not a good choice I guess as all returned articles have little content

brave: seems down/crypting things

--

Please check if you use proxies for scraping...try turning them off and see if it changes.

ok thanks, just wanted to make sure it wasnt something i was doing wrong on my end.

that was with a brand new scrape directly using no proxies

googlealchemist

for quora , since they tend to be shorter articles, would there be a setting i can adjust where it will pull all of the sentences to mix into my content?

what about bbc?

Sven

haven't checked BBC, but quora is just not suitable. The sentences are not really worth anything there.

Sven

bbc news is fixed in next update