Contents x
    Get your data!
    • 17 May 2024
    • 3 Minutes to read
    • Contributors
    • Print
    • Dark
      Light
    • PDF
    Contents

    Get your data!

    • Updated on 17 May 2024
    • 3 Minutes to read
    • Contributors
    • Print
    • Dark
      Light
    • PDF
    Article summary

    sThere are two types of data you can extract from a product index:

    • Raw data
    • Mapped data

    Get raw data from product index

    You need to create a new Pipes robot that can do transformations — and more — to get the raw output in the format you need and integrate the data with external sources, if necessary.

    1. Go to the Dashboard.
    2. Click New robot.
    3. Select the Pipes robot.
    4. Name your Pipes robot something easily identifiable, like Market Index Raw Export.
    Naming consistency

    This name is used to the generate any CSV files that are uploaded, so make sure the names matches what you expect to see.

    1. Click Create new robot.
    2. In the robot, drag the For each product in index node into the grid. The Edit pipe node screen displays.

    z product_manager edit_pipe_node_screen for_each_product_in_index.png

    Edit pipe node screen fields
    • Type of products
      • Raw – Generate the raw data output.
      • Mapped – Generate data that has been mapped.
      • Invalid – Generate data that was marked as invalid.
    • Only include the latest check box – Only return the rows that were seen in the latest execution of the index.
    • Include muted
      • No
      • Brands only
      • Models only
      • All
    1. Name your Pipes robot.
    2. Select the index from the drop-down that you want to export data from.
    3. Select Raw from the Type of products field.
    4. Fill out the remaining fields according to your requirements.
    5. Click Update.
    6. Now you can do data transformations on the output.
    7. Once you’re done adding transformations, click Update.
    8. Set up a configuration (run) for your Pipes robot. When you execute this configuration you should get the transformed data as a result. You can also configure integrations and more!

    Get mapped data from product index

    Similar to the process for getting raw data, the process for getting mapped data is the same. You need to create a new Pipes robot that can do transformations — and more — to get the raw output in the format you need and integrate the data with external sources, if necessary.

    1. Go to the Dashboard.
    2. Click New robot.
    3. Select the Pipes robot.
    4. Name your Pipes robot something easily identifiable, like Market Index Raw Export.
    Naming consistency

    This name is used to the generate any CSV files that are uploaded, so make sure the names matches what you expect to see.

    1. Click Create new robot.
    2. In the robot, drag the For each product in index node into the grid. The Edit pipe node screen displays.

    z product_manager edit_pipe_node_screen for_each_product_in_index.png

    1. Name your Pipes robot.
    2. Select the index from the drop-down that you want to export data from.
    3. Select Mapped from the Type of products drop-down.
    4. Fill out the remaining fields according to your requirements.
    5. Click Update.
    6. Now you can do data transformations on the output.
    7. Once you’re done adding transformations, click Update.
    8. Set up a configuration (run) for your Pipes robot. When you execute this configuration you should get the transformed data as a result. You can also configure integrations and more!

    Execute a robot automatically

    You can schedule your Pipes robot to execute whenever new data is available in the product index. Complete the steps below for your robot that is gathering raw or mapped data.

    1. Go to Products.
    2. Select the necessary product index.
    3. Go to the Settings tab.
    4. Select the Pipes robot you just created above in the Index Mapped field.
    Tips and tricks!
    • Robots selected in the Index Mapped field execute automatically when all products have been reviewed.
    • You can add as many robots to the Index Mapped field as you want and trigger multiple executions.
    1. Click Save.

    You can also add users to the product index in the Assigned users field. Assigned users will receive updates for tasks that need to be completed manually, such as if there are new products that need to be mapped.

    Was this article helpful?
    What's Next