IBM Data & AI

Welcome to the idea forum for IBM Data & AI (Formerly Analytics) Clients! 

 

IBM Employees:

The correct URL for entering your ideas is https://hybridcloudunit-internal.ideas.aha.io

 

Clients:

Our team welcomes any feedback  and suggestions you have for improving our offerings / products!  This forum allows us to connect your offering / product improvement ideas with IBM product and engineering teams.

 

If you have not registered on this portal please click on the following link and register.  To complete registration you will need to open the email you will receive from Aha to confirm your identity.  https://ibm.biz/AnalyticsIdeasPortalRegister

 

Problem to crawle dynamically generated website content

At the moment the Watson Explorer Foundational Components Webcrawler(Seed "URLs") cannot execute javascript when crawling a webpage. This prevents the retrieval of dynamically generated website content (e.g. with Angular).
We are using Watson Explorer Foundational Components version 11.0.2.
  • Guest
  • Dec 14 2018
  • Will not implement
Customer Name
Role Summary
  • Attach files
  • Admin
    YUTAKA MORIYA commented
    December 14, 2018 17:57

    There are some technical reasons why Javascript is not executed during crawling. It is recommended to crawl the underneath database directly if possible

NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "anonymous@euprivacy.out" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions