Handle invalid URLs
  • 17 May 2024
  • 1 Minute to read
  • Contributors
  • Dark
    Light
  • PDF

Handle invalid URLs

  • Dark
    Light
  • PDF

Article summary

Similar to the invalid products, in the Sources tab you can view invalid URLs as well in the Issues column. When URLs are tagged as invalid it means that those URLs were not available for the Product URLs robot or the product details associated with that URL were not available for the Product Info robot.

Here are some examples and resolutions for invalid URLs:

  • If the url is not of interest or out of scope, you can ignore it the same way you ignore invalid products.
  • If the information is the only thing missing (the URL is intact) this could mean that the Product Info robot was unable to extract product information from a particular URL. To resolve this, the Product Info robot has be to fixed in order to ensure that it can extract the information.
  • Missing information can also be caused by the robot outputting URLs that do not match the input. If this is case you can either make the robot match the input and output URL or ignore the issue.
  • If the URL is missing (and therefore the information) that means the Robot Check found URLs that were not in the Product URLs robot output. This can happen because the Robot Check is doing much broader search than the Product URLs robot. If the URL is not necessary you can ignore it. If the URL is necessary, fix the Product URLs robot to include those URLs. You can also make the Robot Check more specific, for example output less URLs that you don't need.
  • Example: The Product Info robot is directed to the following URL provided by the Product URLs robot: https://mystore.com/products/123. However, that URL is immediately redirected to https://mystore.com/products/123?view=standard. This would cause a URL error because the robot is unable to see that https://mystore.com/products/123 was in fact there. The way to fix that is to return the input URL as the output URL in the Product Info robot.
Quick fix

The two most common fixes for invalid URLs or products is to 1) fix the robot or 2) ignore the value.


Was this article helpful?