OroCRM Forums

Covering OroCRM topics, including community updates and company announcements.

Forums Forums OroCRM OroCRM – Installation/Technical Issues or Problems oro_message_consumer keeps writing into consumer_prod log file

This topic contains 7 replies, has 2 voices, and was last updated by Michael Michael 6 months ago.

Starting from March 1, 2020 the forum has been switched to the read-only mode. Please head to StackOverflow for support.

  • Creator
    Topic
  • #41331

    roc.liu
    Participant

    Hi there,

    I have recently installed oroCRM to centOS according to the official guidance from:
    https://doc.oroinc.com/backend/setup/dev-environment/manual-installation/crm-ce

    Versions:
    OS CentOS v7.4 (recommended OS)
    Web server Nginx v.1.12
    Database MySQL v.5.7
    PHP PHP-FPM and PHP CLI v.7.1
    Other tools NodeJS v.6.14, Git v.1.8.3, Composer v.1.6.4, Supervisord v.3.3

    I am able to start the application and access the admin page. However I found the log file (/usr/share/nginx/html/oroapp/var/logs/consumer_prod-***.log) being kept writing with new data. The file reaches to 50GB in less than 90 mins. Onces it reaches the size of the disk, the processes oro_message_consumer_00 ~ 04 failed to run and give error messages saying: exited too quickly.

    Please help.

    thanks millions,

    Roc

    Trade Depot Ltd.

Viewing 7 replies - 1 through 7 (of 7 total)
  • Author
    Replies
  • #41332
    Michael
    Michael
    Keymaster

    Hi Roc,

    That’s highly unusual.

    Can you take a look at what are the last records in that log file?

    #41333

    roc.liu
    Participant

    thanks for your prompt reply Michael.

    a chunk of the log is:
    [2020-01-30 01:22:37] app.ERROR: Unexpected exception occurred during queue message processing {“exception”:”[object] (Symfony\\Component\\Filesystem\\Exception\\IOException(code: 0): Failed to create \”/usr/share/nginx/html/oroapp/public/sitemaps/1/1580347354\”: mkdir(): Permission denied. at /usr/share/nginx/html/oroapp/vendor/symfony/symfony/src/Symfony/Component/Filesystem/Filesystem.php:105)”,”topic”:”oro.seo.generate_sitemap_by_website_and_type”} {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapByWebsiteAndTypeProcessor”,”message_id”:”oro.5e322fdaf3c098.20223406″,”message_body”:”{\”websiteId\”:1,\”type\”:\”page\”,\”version\”:1580347354,\”jobId\”:77550}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_by_website_and_type”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_by_website_and_type”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fdaf3c098.20223406″,”timestamp”:1580347354},”message_priority”:2,”elapsed_time”:”185 ms”,”memory_usage”:”135.35 MB”}
    [2020-01-30 01:22:37] app.ERROR: Unexpected exception occurred during queue message processing {“exception”:”[object] (Symfony\\Component\\Filesystem\\Exception\\IOException(code: 0): Failed to create \”/usr/share/nginx/html/oroapp/public/sitemaps/1/1580347354\”: mkdir(): Permission denied. at /usr/share/nginx/html/oroapp/vendor/symfony/symfony/src/Symfony/Component/Filesystem/Filesystem.php:105)”,”topic”:”oro.seo.generate_sitemap_by_website_and_type”} {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapByWebsiteAndTypeProcessor”,”message_id”:”oro.5e322fdadb6292.72541237″,”message_body”:”{\”websiteId\”:1,\”type\”:\”category\”,\”version\”:1580347354,\”jobId\”:77549}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_by_website_and_type”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_by_website_and_type”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fdadb6292.72541237″,”timestamp”:1580347354},”message_priority”:2,”elapsed_time”:”354 ms”,”memory_usage”:”137.28 MB”}
    [2020-01-30 01:22:38] app.ERROR: An error occurred while writing robots.txt file to /usr/share/nginx/html/oroapp/public/robots.txt [] {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapIndexProcessor”,”message_id”:”oro.5e322fde420d44.46929460″,”message_body”:”{\”version\”:1580347354,\”websiteId\”:1}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_index_by_website”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_index_processor”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fde420d44.46929460″,”timestamp”:1580347358},”message_priority”:2,”elapsed_time”:”8 ms”,”memory_usage”:”134.25 MB”}
    [2020-01-30 01:22:38] app.ERROR: Unexpected exception occurred during queue message processing {“exception”:”[object] (Oro\\Bundle\\SEOBundle\\Exception\\RobotsTxtFileManagerException(code: 0): An error occurred while writing robots.txt file to /usr/share/nginx/html/oroapp/public/robots.txt at /usr/share/nginx/html/oroapp/vendor/oro/commerce/src/Oro/Bundle/SEOBundle/Manager/RobotsTxtFileManager.php:76)”,”topic”:”oro.seo.generate_sitemap_index_by_website”} {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapIndexProcessor”,”message_id”:”oro.5e322fde420d44.46929460″,”message_body”:”{\”version\”:1580347354,\”websiteId\”:1}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_index_by_website”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_index_processor”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fde420d44.46929460″,”timestamp”:1580347358},”message_priority”:2,”elapsed_time”:”8 ms”,”memory_usage”:”134.25 MB”}

    hope this helps.

    regards,

    Roc

    #41334

    roc.liu
    Participant

    ALL OF THESE HAPPEN AFTER I HAVE IMPORTED OVER 6,000 CONTACTS INTO THE SYSTEM.

    There are some new error messages:
    [2020-01-31 02:58:13] consumer.NOTICE: Message processed: REJECT. Execution time: 0 ms {“status”:”REJECT”,”time_taken”:0} {“processor”:”Oro\\Bundle\\DataAuditBundle\\Async\\AuditChangedEntitiesRelationsProcessor”,”message_id”:”oro.5e2767b3895294.82503416″,”message_body”:”{\”entities_inserted\”:[{\”entity_class\”:\”Oro\\\\Bundle\\\\ContactBundle\\\\Entity\\\\ContactEmail\”,\”entity_id\”:4678,\”change_set\”:{

    Thanks,

    Roc

    • This reply was modified 6 months ago by  roc.liu.
    #41341

    roc.liu
    Participant

    Hello Michael,

    any update on this issue?

    Thanks,

    Roc

    #41342
    Michael
    Michael
    Keymaster

    Hello Roc,

    So have done something after examining the errors in the log?

    For example there was an error about the application not being able to create a directory for storing a sitemap – did the errors go away after you have fixed the filesystem permissions?

    #41343

    roc.liu
    Participant

    Hi Michael,

    Nope. I have given the entire directory 777. It should not be the file permission issue.

    Does it keep writing to the log when it cannot create directory?

    Thanks,

    Roc

    #41353
    Michael
    Michael
    Keymaster

    I do not have access to your application, so I cannot know if it keeps writing errors after you modified the permissions or not.

    Please fix the permissions, restart the consumer, and check the log file to see if there are any new errors added to the log file.
    If there are errors – read what the application complains about (i.e. what directory permissions should be fixed), and repeat again until there are no new “app.ERROR:” records appearing in the log.

Viewing 7 replies - 1 through 7 (of 7 total)

The forum ‘OroCRM – Installation/Technical Issues or Problems’ is closed to new topics and replies.

You will be redirected to [title]. Would you like to continue?

Yes No