javascript rendering

[wukimidaire]

hi there superstar,

Tiered of the fixed subscriptions at other providers, really like the technical dept of spider.cloud and it credits-on-the-go subscription model.
Only thing, haven't figured out on how to scrape data that is only available with javascript rendering.

What are my options here?

[j-mendez]

hi there superstar,

Tiered of the fixed subscriptions at other providers, really like the technical dept of spider.cloud and it credits-on-the-go subscription model. Only thing, haven't figured out on how to scrape data that is only available with javascript rendering.

What are my options here?

Hi @wukimidaire you can use the param request: chrome to crawl the pages with google chrome headless. Depending on the website you also need to use params like disable_intercept and disable_ads etc to get the content you need.

[wukimidaire]

i can't find these settings on the api documentation on the crawler section, you are sure they are out there?

[wukimidaire]

I did found request: chrome

[j-mendez]

Click the show more button under the Advance tab.