Skip to Main Content
Customer Feedback

We love feedback from you on our products and the problems in your daily work that you would like us to solve. Please describe the challenge you're encountering and your desired outcome. Be as detailed as possible.

For technical issues or bugs please head to Support or our Developer Community. You can assign up to 20 votes in total. Thank you for your feedback.

Status explanation: 'Future Consideration' = Continuing to collect further feedback, not planned at this time. 'Investigating' = Prioritized for deeper customer and feasibility investigations ahead of planning development.

Status Gathering interest
Product PIM
Created by Guest
Created on May 20, 2022

Refresh Published Products Job Batching

From my experience with one of our clients, the PIM: Refresh Published Products job regularly has an issue at some point while pulling in 100k+ products. When it does die at some point during that pull, its extremely frustrating to invest another 8+ hours in running again. Its usually somethign stupid like a server restart, url confict or something like that too. It would be idea if it could do batches or have a way to not require re=running for all 100k products when 80k of them did pull in already. I like how the publish approved products basically resumes with the remaining approved products.

  • Guest
    Reply
    |
    Jan 26, 2023

    Hi Arthur,

    This would work for our use case. Thanks!

  • Guest
    Reply
    |
    Jan 26, 2023

    My initial thought is that we could capture a "refreshed on" date in PIM as we process the product records and add an option to skip any products that were already refreshed within the lookback period. Something like this might work and not be too difficult but I need to vet it with the team. This isn't something that we're likely to do in the near term but certainly a good enhancement when we take a look at the refresh job.

  • Guest
    Reply
    |
    Jan 25, 2023

    Just to clarify, its only the Refresh Published Products that would probably need this feature.

  • Guest
    Reply
    |
    Jan 25, 2023

    Hi Arthur,

    I figured it would be fairly complex. I'm sure you have better ideas, but maybe an optional start/end number or something like that? Assuming it always pulls in the same order (probably date published?)

    PS - Sorry for all the typos there, I realized I had a lot rereading it.

  • Guest
    Reply
    |
    Jan 25, 2023

    Hi Scott,

    The refresh job is trickier since it uses a lookback period to determine what data to pull to commerce. Since the publish job is updating products from approved to published as it runs, if it needs to be restarted it will only have a subset of products to publish. I have some ideas for parameters to the refresh job that could make it run in a more similar fashion and this is something we will consider in the future.

    -Arthur