oro_message_consumer keeps writing into consumer_prod log file

Hi there,

I have recently installed oroCRM to centOS according to the official guidance from:
https://doc.oroinc.com/backend/setup/dev-environment/manual-installation/crm-ce

Versions:
OS CentOS v7.4 (recommended OS)
Web server Nginx v.1.12
Database MySQL v.5.7
PHP PHP-FPM and PHP CLI v.7.1
Other tools NodeJS v.6.14, Git v.1.8.3, Composer v.1.6.4, Supervisord v.3.3

I am able to start the application and access the admin page. However I found the log file (/usr/share/nginx/html/oroapp/var/logs/consumer_prod-***.log) being kept writing with new data. The file reaches to 50GB in less than 90 mins. Onces it reaches the size of the disk, the processes oro_message_consumer_00 ~ 04 failed to run and give error messages saying: exited too quickly.

Please help.

thanks millions,

Roc

Trade Depot Ltd.

Topic

[MichaelKeymaster]

Hi Roc,

That’s highly unusual.

Can you take a look at what are the last records in that log file?

[roc.liuParticipant]

thanks for your prompt reply Michael.

a chunk of the log is:
[2020-01-30 01:22:37] app.ERROR: Unexpected exception occurred during queue message processing {“exception”:”[object] (Symfony\\Component\\Filesystem\\Exception\\IOException(code: 0): Failed to create \”/usr/share/nginx/html/oroapp/public/sitemaps/1/1580347354\”: mkdir(): Permission denied. at /usr/share/nginx/html/oroapp/vendor/symfony/symfony/src/Symfony/Component/Filesystem/Filesystem.php:105)”,”topic”:”oro.seo.generate_sitemap_by_website_and_type”} {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapByWebsiteAndTypeProcessor”,”message_id”:”oro.5e322fdaf3c098.20223406″,”message_body”:”{\”websiteId\”:1,\”type\”:\”page\”,\”version\”:1580347354,\”jobId\”:77550}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_by_website_and_type”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_by_website_and_type”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fdaf3c098.20223406″,”timestamp”:1580347354},”message_priority”:2,”elapsed_time”:”185 ms”,”memory_usage”:”135.35 MB”}
[2020-01-30 01:22:37] app.ERROR: Unexpected exception occurred during queue message processing {“exception”:”[object] (Symfony\\Component\\Filesystem\\Exception\\IOException(code: 0): Failed to create \”/usr/share/nginx/html/oroapp/public/sitemaps/1/1580347354\”: mkdir(): Permission denied. at /usr/share/nginx/html/oroapp/vendor/symfony/symfony/src/Symfony/Component/Filesystem/Filesystem.php:105)”,”topic”:”oro.seo.generate_sitemap_by_website_and_type”} {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapByWebsiteAndTypeProcessor”,”message_id”:”oro.5e322fdadb6292.72541237″,”message_body”:”{\”websiteId\”:1,\”type\”:\”category\”,\”version\”:1580347354,\”jobId\”:77549}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_by_website_and_type”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_by_website_and_type”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fdadb6292.72541237″,”timestamp”:1580347354},”message_priority”:2,”elapsed_time”:”354 ms”,”memory_usage”:”137.28 MB”}
[2020-01-30 01:22:38] app.ERROR: An error occurred while writing robots.txt file to /usr/share/nginx/html/oroapp/public/robots.txt [] {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapIndexProcessor”,”message_id”:”oro.5e322fde420d44.46929460″,”message_body”:”{\”version\”:1580347354,\”websiteId\”:1}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_index_by_website”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_index_processor”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fde420d44.46929460″,”timestamp”:1580347358},”message_priority”:2,”elapsed_time”:”8 ms”,”memory_usage”:”134.25 MB”}
[2020-01-30 01:22:38] app.ERROR: Unexpected exception occurred during queue message processing {“exception”:”[object] (Oro\\Bundle\\SEOBundle\\Exception\\RobotsTxtFileManagerException(code: 0): An error occurred while writing robots.txt file to /usr/share/nginx/html/oroapp/public/robots.txt at /usr/share/nginx/html/oroapp/vendor/oro/commerce/src/Oro/Bundle/SEOBundle/Manager/RobotsTxtFileManager.php:76)”,”topic”:”oro.seo.generate_sitemap_index_by_website”} {“processor”:”Oro\\Bundle\\SEOBundle\\Async\\GenerateSitemapIndexProcessor”,”message_id”:”oro.5e322fde420d44.46929460″,”message_body”:”{\”version\”:1580347354,\”websiteId\”:1}”,”message_properties”:{“oro.message_queue.client.topic_name”:”oro.seo.generate_sitemap_index_by_website”,”oro.message_queue.client.processor_name”:”oro_seo.async.generate_sitemap_index_processor”,”oro.message_queue.client.queue_name”:”oro.default”},”message_headers”:{“content_type”:”application/json”,”message_id”:”oro.5e322fde420d44.46929460″,”timestamp”:1580347358},”message_priority”:2,”elapsed_time”:”8 ms”,”memory_usage”:”134.25 MB”}

hope this helps.

regards,

Roc

[roc.liuParticipant]

ALL OF THESE HAPPEN AFTER I HAVE IMPORTED OVER 6,000 CONTACTS INTO THE SYSTEM.

There are some new error messages:
[2020-01-31 02:58:13] consumer.NOTICE: Message processed: REJECT. Execution time: 0 ms {“status”:”REJECT”,”time_taken”:0} {“processor”:”Oro\\Bundle\\DataAuditBundle\\Async\\AuditChangedEntitiesRelationsProcessor”,”message_id”:”oro.5e2767b3895294.82503416″,”message_body”:”{\”entities_inserted\”:[{\”entity_class\”:\”Oro\\\\Bundle\\\\ContactBundle\\\\Entity\\\\ContactEmail\”,\”entity_id\”:4678,\”change_set\”:{

Thanks,

Roc

• This reply was modified 3 years, 8 months ago by  roc.liu.

[roc.liuParticipant]

Hello Michael,

any update on this issue?

Thanks,

Roc

[MichaelKeymaster]

Hello Roc,

So have done something after examining the errors in the log?

For example there was an error about the application not being able to create a directory for storing a sitemap – did the errors go away after you have fixed the filesystem permissions?

[roc.liuParticipant]

Hi Michael,

Nope. I have given the entire directory 777. It should not be the file permission issue.

Does it keep writing to the log when it cannot create directory?

Thanks,

Roc

[MichaelKeymaster]

I do not have access to your application, so I cannot know if it keeps writing errors after you modified the permissions or not.

Please fix the permissions, restart the consumer, and check the log file to see if there are any new errors added to the log file.
If there are errors – read what the application complains about (i.e. what directory permissions should be fixed), and repeat again until there are no new “app.ERROR:” records appearing in the log.

[Author]

Replies