Busted! Iframes that are holding you back from getting more data
You may have experienced that your data collection fell off without knowing why. Well, you might want to check this out: iframe
A website is composed of HTML documents, and sometimes an HTML document can be embedded inside another HTML document on a web page. This is called an iframe (inline frame) and some content may be nested in an iframe, which disables web scraping.
Luckily, rest assured that Listly's web scraping service automatically detects iframes. Here's our spotting an iframe while looking at Zillow, an online real estate marketplace.
In this case, the iframe contains an ad, not a listing, so it doesn't affect the web scraping results. That being said, if you have trouble collecting information from a website and it seems to have something to do with an iframe, come try us out!