Proxy servers and anonymity

A proxy server or proxy acts as an intermediary between Dexi and the website being processed. Proxies allow Dexi robots to more accurately simulate organic traffic and avoid being blocked.

All Dexi accounts have free and unmetered access to ~160 proxies suitable for general data exraction. Due to advanced bot detection or We recommend the use of anonymous proxies from specialized providers.

My robot is getting blocked...what do I do?

First, make sure you're not violating any of the site's Terms of Service by extracting data from them.

If you're getting blocked, you'll need your own private proxies since the free ones provided by the Dexi platform are shared between all our users.

How can I get more proxies?

Dexi recommends proxies from oxylabs.io and/or brightdata.com.

How can I add my own proxies to Dexi?

Once you've obtained your proxy, you'll need to link it to your Dexi account.

Go to Settings > Proxies and you'll find your Proxy groups. You need to create a proxy group before you can add your own proxies.

1. Click the create proxy group button
   

2. Fill out the required fields:
   

   1. Name: name of the proxy group
   2. Type: proxy group type (Datacenter, Residential, Mobile or Other)
   3. Tags: you can create your custom tags
   4. Public: determine whether your poxy group should be visible to other users.
   5. Provider: select proxy provider

3. Click save

4. Select the proxy group you want to import proxies, by clicking the proxy group name.

5. Go to Proxies tab.

6. You can either import one IP at a time be clicking add proxy button, or

7. You can import proxies in bulk, by clicking import proxies.

How can I use my own proxies?

If you want to use your own proxies, in different parts of the Dexi platform, eg: extractor settings or configuration settings, you will need to click on the relevant proxy field. You will then get a dialog box, as depicted below.

The Dexi platform monitors configured proxies and automatically disables those that no longer respond. We also measure proxy performance by downloading a 1 MB file through the proxy once a week.

Incidentally, this means the maximum measurable speed is 1024 Kb/sec (or ~10 Mb/s). This is the minimum speed of all dexi.io proxies, but they usually perform closer to 100 Mb/s, depending on traffic levels.

Proxy tag hierarchy

The proxy tag hierarchy will pick Dexi proxies if no proxy tags are specified at the account level. If tag(s) are specified, then proxies from these tags will be used instead.