OroCommerce Forums

Covering OroCommerce topics, including community updates and company announcements.

Forums OroCommerce Price Import performance

This topic contains 2 replies, has 2 voices, and was last updated by  Merlin 2 days, 9 hours ago.

  • Creator
    Topic
  • #40678

    Merlin
    Participant

    Hello,

    last week we imported 65.000 products into our orocommerce system. That worked very well and the performance was also good. The product import took about 5 hours.

    On Monday two days ago I started the price import (about 75.000 prices) and the Reindex process as well as the oro_pricing.price_lists.cpl.resolve_prices process has still not gone through. But the qoueue wokers are running permanent (60 workers).

    Can you give me a recommendation on how to get the Reindex process as well as the oro_pricing.price_lists.cpl.resolve_prices process processed faster?

    I used this command:
    php bin/console oro:import:price-list:file var/import_export/price_20190930.csv –email=***@***.de –priceListId=1

    I also get the finished Mail without errors.

    Version: oro/commerce 3.1.4
    enable_price_sharding: false

    Best regards
    Merlin

    • This topic was modified 2 weeks ago by  Merlin.
    • This topic was modified 2 weeks ago by  Merlin.
Viewing 2 replies - 1 through 2 (of 2 total)
  • Author
    Replies
  • #40747
    Andrey Yatsenko
    Andrey Yatsenko
    Moderator

    To make 60 workers work with the best performance you have to have about 60 CPU threads, is it the case? if not, try to decrease the number of workers to the number of CPU threads, it should improve the performance as otherwise consumers are concurrently accessing the same CPU resources and it could take more time to switch between processes than to process messages itself.

    #40748

    Merlin
    Participant

    Hey Andrey,

    thank you.

    I have already reduced the number of workers to 10 in the meantime (we have 14 CPU’s). It has become a little faster.

    But the import still hasn’t gone through yet. Because jobs of the type “oro_pricing.price_lists.cpl.resolve_prices” are still processed. This job then always generates a reindex process. Is this necessary and why are there so many “oro_pricing.price_lists.cpl.resolve_prices” jobs?

    Best regards

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

You will be redirected to [title]. Would you like to continue?

Yes No