With Listly Scheduler, you can extract data from any website at scheduled times. To set a scheduler, please follow the instructions:1. Click Listly Whole or Listly Part to scrape a website.2. Select a tab that contains the data you want.3. Clic…

A proxy server acts on behalf of a user, and it's a computer system or a router that works as an intermediary between a server and a client. Setting up a proxy in a specific region or country will you to gain full access to the content whi…

As part of Group Extraction, Folder Group Extraction allows you to collect web data from multiple pages that require a login. As you know, you can simply extract data from multiple public pages using Group Extraction, but private pages require …

Listly currently offers English, Korean, and Chinese. If you want to switch your language, select the language in the upper right corner.

Listly periodically removes schedulers to prevent server overloads if it detects that you have no available credits. Please go check out your available credits first and then email us. You can request us to top up your credit to set up a schedu…

There were a lot of questions about scraping Instagram followers or posts for marketing purposes. Yes, you can scrape data such as Instagram post URLs and comments, but we'd say that Instagram is one of the toughest service for scraping an…

Yes, you can download either image URLs that you've scraped – make sure you check the Hyperlink box when downloading data – or images directly using an image downloader. Note that the hyperlinks refer to the URLs pointing to image files on…

By default, Listly displays four taps (Top-4) that are highly likely to have the information you scraped from your target website. If any of them contains the data you need, click Top-30 and re-select the tab that includes the information you n…

Unfortunately, the simple answer is No. That said, you can set up your web scraping task for a specific time and get a date at a scheduled time. You can also get email notifications once your data scraping is complete. Please note that this may…

Yes, we do offer a custom scraping service. You may want to check out Listly’s Action Script. For further information, pleas contact the Listly team.

Sometimes, simply clicking Refresh may work. Listly offers the Screenshot feature so that you can check out error messages with this automatic screenshot feature. It allows you to determine if the problem is specific to server settings, missing…

No, you don’t need to learn anything about coding if you collect data with Listly. Listly’s users include professionals from programmers non-tech savvy professionals, including realtors, marketers, researchers, and fresh graduate students looki…

A free trial period starts once the Listly team upgrades your account upon user request. Please note that the Listly trial is time-limited, and you can try out our advanced, paid features for 3 days only. Trial periods can not be extended, and …

What are parent and child pages?Knowing website structures can help you better understand what and how much data you’re scraping with Listly. Simply put, a parent page is a home page that has multiple child pages. Let’s say you’re collecting pr…

Group extraction allows you to extract data from multiple web pages at once. With this feature, you can collect data without doing repetitive tasks since Listly looks for common patterns in data and groups them together available for download. …

Unfortunately, it is not hard to get real-time data that change every minute and second. You may want to create a scheduled task for scraping a website at a scheduled time, but it is also not available for collecting ever-changing data, such as…

You can check out the extraction speed in the bar design (blue) to the top right. If you increase the speed, you can extract data at high speed. That said, your target website will be hig…

You can not only request an individual proxy server but use the servers provided by Listly. If you buy a proxy server for your use only, you will be much more likely to extract data from a website without getting blocked. Some of our users buy …

You can request an individual proxy server by contacting us directly. The Listly team will provide a server and a payment link once you select a price range and a region.

Have you set up a proxy server? It depends on the websites, but you may want to check out Add Settings on your Databoard and add a proxy server from a different country. Once you configure the settings, lower the extraction speed by one or two …

We offer domestic and international customer services via email. As most of them are related to technical issues, we’ll have no choice but to raise plan prices if the Listly support team spends more time troubleshooting via phone or video calls…

Listly offers the Action Script service that allows you to do various mouse click and keyboard actions on behalf of you. You can add your custom code to the Action Script field (Add Settings → Action Script) and automate repetitive actions with…

Auto LoginThis is an experimental feature for beta testing. Please note that Listly stores the ID and Password information as a plain text without encryption and remove the information after your data extraction finishes. We will delete all the…

The Listly API is available to users who are on Listly Business plan. For more details, please see the Pricing page!

The Listly API is an interface for creating your database or connecting to Google Sheets without any extra code.

If you have the HTML source code of a web page, you can upload your file(s) and fetch data right away!

Web scraping, or web crawling, is legal if you scrape data publicly available. However, it is not legal if you scrape confidential data for profit, such as personally identified information and copyrighted data, and we do not recommend collecti…

HTTP headers are used to manipulate additional information during HTTP requests or responses to help your web scraping avoid from getting blocked.

Absolutely! Listly is free to use with the Free plan. You can upgrade to a paid plan, such as Lite or Business, if you need more URLs to scrape and want to use advanced features: group extraction, auto-scroll & auto-click, extraction speed …

Have you ever encountered this error message before? This error happens when a network protocol is missing before a website URL. It is an inherent, very first part of a web address (before…

ActionScript is useful when scraping specific elements that require mouse or keyboard actions to load more data on a website, as shown below. If you are curious about how to use both the ActionScript and Group Extraction features in Listly, ple…

Sure, check out our new feature, Parts!Listly’s Part used to allow users to select and scrape a specific part of a website, and not it's been updated to Parts. As its name implies, this feature allows you to select multiple sections of a w…

Yes, you can scrape a website that has different web elements by using Parts and Group Extraction. Say, your destination website includes different types of web pages as in the image above. The fi…

In brief, you can use the Plain Text option when extracting the text from a website, such as the text content in news articles or posts. It will be helpful when scraping text pages regularly or data from websites that do not allow you to copy a…

When you click the element(s) 2 or 3 times to scrape data using Tabs, the Listly tool will automatically pick up a pattern in what you have clicked. There may be cases where unnecessary elements are selected; if this is the case, you could chan…

Action Templates is a feature that can simulate mouse clicks or keyboard events, meaning that it helps you automate interacting with the HTML document such as mouse/keyboard events, once setup is complete. Why do they matter?First thing…

The highlight feature has been newly launched for user convenience! When scraping data using Whole, some tabs (or patterns) you'll want to see will be highlighted in green, as in the image below. In cases where data is stored or displayed …

Unfortunately, the Listly team does not store data in the local storage to maintain our user privacy and data security. Deleting a group is permanent, so please proceed with care when deleting the CSS selector or any other settings. For further…

There may be some cases where hyperlinks are not visible on a website and are marked as no_link in Excel, as shown in the screenshot below. This is because your destination website — intentionally or unintentionally — hide where the links point…

Hello,Starting March 11, 2024, we are increasing the price of Proxy so we can continue to bring you uninterrupted access to proxy servers that you can enjoy the seamless data collection experience. The price of Proxy will change from $50/month …

If you have trouble getting logged out automatically, you may want to double-check if your account was logged in from another browser/machine. As per policy, Listly prevents two or more sessions with the same account from one user.As it require…

If you encountered an error message saying "Error. Cannot download data." you could fix it by redoing your scraping such that each group has fewer URLs than you added at the beginning. It happens because there are too many data cards …

There are several ways to avoid CAPTCHAs when scraping web data.Use paid CAPTCHA-solving services. This is one of the fastest and most reliable ways to deal with CAPTCHAs, and there are actually many options you can take because many CAPTCHA so…

Proxies and VPNs (Virtual Private Networks) have something in common in that they serve as intermediaries in your internet connection, rerouting your traffic and changing your IP address. However, they're different in how they operate and …

Starting May 22, 2024, we're making some changes to our subscription models, including the Free plan.View previous notice: [Important Notice] Upcoming Changes to Subscription ModelsChanges for the Free plan 10 URLs for basic features are p…

If you're unsure which proxy works best for you and want to learn more about our proxy service, you're in the right place!Types of proxies and prices Datacenter proxy - assigns a client a random IP address from its pool that belongs t…

Yes, you can pull a list of items from Amazon into either Excel or Google Sheets using Listly!Who can use this feature?Available on Listly Business 1. Go to your destination page, which displays data within a single page and allows you …

Listly Referral Program allows free plan users to invite friends and get rewarded.Who's eligible?Anyone on the Free plan is eligible for Listly's referral program! Listly's referral program works as follows.1. Refer a fri…

Yes, it is possible to extract data from Instagram, including posts, comments, hashtags, and more. However, it is important to note that any data extraction should be conducted ethically and in compliance with Instagram's policies.Instagra…

Some websites require two-factor authentication (e.g., a one-time code via text message, push-app notification, etc.) for security. If you're trying to scrape such a website, it is highly recommended to log in and use the Tabs feature, as …

You can cancel your proxy (Datacenter, ISP, Residential, Mobile) subscription by emailing the Listly team at hello@listly.io up to 24 hours before your next scheduled payment to avoid further charges. As Listly buys proxy servers from proxy ser…

With Listly's image downloader extension, you can directly download images by image URL in Listly. Check out Listly's Chrome extension for free download & trial and the Extract images from any website article for more details abou…

The Part Selection Error occurs when you attempt to scrape a specific part of a website using Parts and repeat this scraping task across multiple pages. This error may be caused by one or more reasons, such as(1) Incorrect Part selection(2) Une…