Proxy servers and anonymity
  • 17 May 2024
  • 2 Minutes to read
  • Contributors
  • Dark
  • PDF

Proxy servers and anonymity

  • Dark
  • PDF

Article summary

A proxy server or proxy acts as an intermediary between Dexi and the website being processed. Proxies allow Dexi robots to more accurately simulate organic traffic and avoid being blocked.

All Dexi accounts have free and unmetered access to ~160 proxies suitable for general data exraction. Due to advanced bot detection or We recommend the use of anonymous proxies from specialized providers.

My robot is getting blocked...what do I do?

First, make sure you're not violating any of the site's Terms of Service by extracting data from them.

If you're getting blocked, you'll need your own private proxies since the free ones provided by the Dexi platform are shared between all our users.

How can I get more proxies?

Dexi recommends proxies from and/or

How can I add my own proxies to Dexi?

Once you've obtained your proxy, you'll need to link it to your Dexi account.

Go to Settings > Proxies and you'll find your Proxy groups. You need to create a proxy group before you can add your own proxies.

  1. Click the create proxy group button
    Create proxy group

  2. Fill out the required fields:
    Add proxy group dialog

    1. Name: name of the proxy group
    2. Type: proxy group type (Datacenter, Residential, Mobile or Other)
    3. Tags: you can create your custom tags
    4. Public: determine whether your poxy group should be visible to other users.
    5. Provider: select proxy provider
  3. Click save

  4. Select the proxy group you want to import proxies, by clicking the proxy group name.

  5. Go to Proxies tab.

  6. You can either import one IP at a time be clicking add proxy button, or

  7. You can import proxies in bulk, by clicking import proxies.

How can I use my own proxies?

If you want to use your own proxies, in different parts of the Dexi platform, eg: extractor settings or configuration settings, you will need to click on the relevant proxy field. You will then get a dialog box, as depicted below.
Select proxies

Defining which proxies to use

You can either select to use proxies by proxy group or tags. You can do this via the proxy mode dropdown field.

The Dexi platform monitors configured proxies and automatically disables those that no longer respond. We also measure proxy performance by downloading a 1 MB file through the proxy once a week.

Incidentally, this means the maximum measurable speed is 1024 Kb/sec (or ~10 Mb/s). This is the minimum speed of all proxies, but they usually perform closer to 100 Mb/s, depending on traffic levels.

Proxy tag hierarchy

The proxy tag hierarchy will pick Dexi proxies if no proxy tags are specified at the account level. If tag(s) are specified, then proxies from these tags will be used instead.

OrderProxy level
FirstProxy tag is specified on a run/configuration level.
SecondProxy tag is specified on the robot level.
ThirdProxy tag is specified on account level.
FourthUse a Dexi system proxy if no proxy tags are available on the levels listed above.

Was this article helpful?