Cron job not added to table `oro_message_queue_job` and Job List

This topic contains 4 replies, has 2 voices, and was last updated by kiatsiong.ng 3 years, 3 months ago.

Starting from March 1, 2020 the forum has been switched to the read-only mode. Please head to StackOverflow for support.

Creator

Topic

April 8, 2019 at 9:51 pm #38489

kiatsiong.ng

Participant

I can see the cron schedule is loaded with oro:cron:definitions:load. However, it doesn’t get added to the Job List (table oro_message_queue_job).

This is the command class:

<?php

namespace Stars\Bundle\LoggerEventBundle\Command;

use Doctrine\DBAL\Connection;
use Doctrine\DBAL\ParameterType;
use Doctrine\Dbal\Statement;
use Doctrine\ORM\EntityManagerInterface;
use Oro\Bundle\CronBundle\Command\CronCommandInterface;
use Symfony\Component\Console\Command\Command;
use Symfony\Component\Console\Input\InputInterface;
use Symfony\Component\Console\Input\InputOption;
use Symfony\Component\Console\Output\OutputInterface;

use Stars\Bundle\EmgsiheDbBundle\Dbal\Connection as ConnEmgsihe;
use Stars\Bundle\LoggerEventBundle\Entity\ActionData;


class InsertActionDataCommand extends Command implements CronCommandInterface
{
    /**
     * Command name
     */
    const COMMAND_NAME = 'oro:cron:sc-logger-event:insert-action-data';

    /**
     * The max number of events to read from STARS
     */
    const LIMIT_EVENTS = 80;

    /**
     * Connection for emgsihe DB
     * 
     * @var Connection
     */
    private $connection;

    /**
     * @var EntityManagerInterface
     */
    private $entityManager;

    public function __construct(ConnEmgsihe $connEmgsihe, EntityManagerInterface $entityManager)
    {
        $this->connection = $connEmgsihe->getConnection();
        $this->entityManager = $entityManager;
        parent::__construct();
    }

    /**
     * {@inheritDoc}
     */
    public function isActive()
    {
        return true;
    }

    /**
     * {@inheritDoc}
     */
    public function getDefaultDefinition()
    {
        return '*/1 * * * *';
    }

    /**
     * {@inheritdoc}
     */
    public function configure()
    {
        $this
            ->setName(static::COMMAND_NAME)
            ->setDescription('Insert unserialized action_data to table sc_stars_logger_event_action_data')
            ->addOption(
                'limit',
                'l',
                InputOption::VALUE_OPTIONAL,
                'The max number of events to read from STARS.',
                self::LIMIT_EVENTS
            );
    }

    /**
     * {@inheritDoc}
     */
    protected function execute(InputInterface $input, OutputInterface $output)
    {
        $limit = (int) $input->getOption('limit') ?: self::LIMIT_EVENTS;
        $t1 = microtime(true);
        $cnt = $this->insertByEntity($limit);
        $dt = (microtime(true) - $t1);
        $output->writeln(sprintf('<comment>Rows Inserted:</comment> %d', $cnt));
        $output->writeln(sprintf('<comment>Seconds Took:</comment> %f', $dt));
    }

    /**
     * Get the event_id for retrieving the next records from emgsihe DB
     */
    public function getEventId(): int
    {
        $sql = '
            SELECT event_id FROM sc_stars_logger_event_action_data
            ORDER BY event_id DESC
            LIMIT 1
        ';
        $stmt = $this->entityManager->getConnection()->prepare($sql);
        $stmt->execute();

        $id = (int) $stmt->fetchColumn() + 1;

        return $id;
    }

    /**
     * Get the events from emgsihe DB
     */
    public function getReadStatement(int $limit, int $fromEventId): Statement
    {
        $fromEventId = $fromEventId ?: $this->getEventId();

        $sql = '
            SELECT event_id, action_data FROM scicom_logger_event
            WHERE event_id >= :fromEventId
            LIMIT :limit
        ';

        $stmt = $this->connection->prepare($sql);
        $stmt->bindValue('fromEventId', $fromEventId, ParameterType::INTEGER);
        $stmt->bindValue('limit', $limit, ParameterType::INTEGER);
        $stmt->execute();

        return $stmt;
    }

    /**
     * Insert rows by entity
     */
    public function insertByEntity(int $limit = self::LIMIT_EVENTS, int $fromEventId = 0): int
    {
        $stmt = $this->getReadStatement($limit , $fromEventId);
        $cnt = 0;
        while ($row = $stmt->fetch()) {
            $data = $this->prepEntityFields($row['action_data']);
            $cnt += count($data);
            foreach ($data as $datum) {
                $entity = new ActionData();
                $entity->setEventId((int) $row['event_id'])
                    ->setField($datum['field'])
                    ->setFrom($datum['from'])
                    ->setTo($datum['to']);
                $this->entityManager->persist($entity);
            }
            $this->entityManager->flush();
        }
        return $cnt;
    }

    /**
     * Prepare entity fields, try to correct unserialize error
     */
    protected function prepEntityFields($actionData): array
    {
        // Ensure we have UTF-8 encoding
        if (!preg_match('%^(?:
            [\x09\x0A\x0D\x20-\x7E]            # ASCII
          | [\xC2-\xDF][\x80-\xBF]             # non-overlong 2-byte
          | \xE0[\xA0-\xBF][\x80-\xBF]         # excluding overlongs
          | [\xE1-\xEC\xEE\xEF][\x80-\xBF]{2}  # straight 3-byte
          | \xED[\x80-\x9F][\x80-\xBF]         # excluding surrogates
          | \xF0[\x90-\xBF][\x80-\xBF]{2}      # planes 1-3
          | [\xF1-\xF3][\x80-\xBF]{3}          # planes 4-15
          | \xF4[\x80-\x8F][\x80-\xBF]{2}      # plane 16
            )*$%xs', $actionData)) {
            $actionData = iconv('CP1252', 'UTF-8', $actionData);
        }

        $data = @unserialize($actionData);
        if ($data === null) {
            $data2 = preg_replace_callback('!s:\d+:"(.*?)";!s', function($m) { return "s:" . strlen($m[1]) . ':"'.$m[1].'";'; }, $actionData);
            $data = @unserialize($data2);
        }
        if (empty($data)) {
            $data = [[
                'field' => 'serialize_error',
                'from'  => $actionData,
                'to'    => null
            ]];
        }
        return $data;
    }
}

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

<?php

namespace Stars\Bundle\LoggerEventBundle\Command;

use Doctrine\DBAL\Connection;

use Doctrine\DBAL\ParameterType;

use Doctrine\Dbal\Statement;

use Doctrine\ORM\EntityManagerInterface;

use Oro\Bundle\CronBundle\Command\CronCommandInterface;

use Symfony\Component\Console\Command\Command;

use Symfony\Component\Console\Input\InputInterface;

use Symfony\Component\Console\Input\InputOption;

use Symfony\Component\Console\Output\OutputInterface;

use Stars\Bundle\EmgsiheDbBundle\Dbal\Connection as ConnEmgsihe;

use Stars\Bundle\LoggerEventBundle\Entity\ActionData;

class InsertActionDataCommand extends Command implements CronCommandInterface

{

/**

* Command name

const COMMAND_NAME = 'oro:cron:sc-logger-event:insert-action-data';

/**

* The max number of events to read from STARS

const LIMIT_EVENTS = 80;

/**

* Connection for emgsihe DB

* @var Connection

private $connection;

/**

* @var EntityManagerInterface

private $entityManager;

public function __construct(ConnEmgsihe $connEmgsihe, EntityManagerInterface $entityManager)

{

$this->connection = $connEmgsihe->getConnection();

$this->entityManager = $entityManager;

parent::__construct();

}

/**

* {@inheritDoc}

public function isActive()

{

return true;

}

/**

* {@inheritDoc}

public function getDefaultDefinition()

{

return '*/1 * * * *';

}

/**

* {@inheritdoc}

public function configure()

{

$this

->setName(static::COMMAND_NAME)

->setDescription('Insert unserialized action_data to table sc_stars_logger_event_action_data')

->addOption(

'limit',

'l',

InputOption::VALUE_OPTIONAL,

'The max number of events to read from STARS.',

self::LIMIT_EVENTS

);

}

/**

* {@inheritDoc}

protected function execute(InputInterface $input, OutputInterface $output)

{

$limit = (int) $input->getOption('limit') ?: self::LIMIT_EVENTS;

$t1 = microtime(true);

$cnt = $this->insertByEntity($limit);

$dt = (microtime(true) - $t1);

$output->writeln(sprintf('<comment>Rows Inserted:</comment> %d', $cnt));

$output->writeln(sprintf('<comment>Seconds Took:</comment> %f', $dt));

}

/**

* Get the event_id for retrieving the next records from emgsihe DB

public function getEventId(): int

{

$sql = '

SELECT event_id FROM sc_stars_logger_event_action_data

ORDER BY event_id DESC

LIMIT 1

$stmt = $this->entityManager->getConnection()->prepare($sql);

$stmt->execute();

$id = (int) $stmt->fetchColumn() + 1;

return $id;

}

/**

* Get the events from emgsihe DB

public function getReadStatement(int $limit, int $fromEventId): Statement

{

$fromEventId = $fromEventId ?: $this->getEventId();

$sql = '

SELECT event_id, action_data FROM scicom_logger_event

WHERE event_id >= :fromEventId

LIMIT :limit

$stmt = $this->connection->prepare($sql);

$stmt->bindValue('fromEventId', $fromEventId, ParameterType::INTEGER);

$stmt->bindValue('limit', $limit, ParameterType::INTEGER);

$stmt->execute();

return $stmt;

}

/**

* Insert rows by entity

public function insertByEntity(int $limit = self::LIMIT_EVENTS, int $fromEventId = 0): int

{

$stmt = $this->getReadStatement($limit , $fromEventId);

$cnt = 0;

while ($row = $stmt->fetch()) {

$data = $this->prepEntityFields($row['action_data']);

$cnt += count($data);

foreach ($data as $datum) {

$entity = new ActionData();

$entity->setEventId((int) $row['event_id'])

->setField($datum['field'])

->setFrom($datum['from'])

->setTo($datum['to']);

$this->entityManager->persist($entity);

}

$this->entityManager->flush();

}

return $cnt;

}

/**

* Prepare entity fields, try to correct unserialize error

protected function prepEntityFields($actionData): array

{

// Ensure we have UTF-8 encoding

if (!preg_match('%^(?:

[\x09\x0A\x0D\x20-\x7E] # ASCII

| [\xC2-\xDF][\x80-\xBF] # non-overlong 2-byte

| \xE0[\xA0-\xBF][\x80-\xBF] # excluding overlongs

| [\xE1-\xEC\xEE\xEF][\x80-\xBF]{2} # straight 3-byte

| \xED[\x80-\x9F][\x80-\xBF] # excluding surrogates

| \xF0[\x90-\xBF][\x80-\xBF]{2} # planes 1-3

| [\xF1-\xF3][\x80-\xBF]{3} # planes 4-15

| \xF4[\x80-\x8F][\x80-\xBF]{2} # plane 16

)*$%xs', $actionData)) {

$actionData = iconv('CP1252', 'UTF-8', $actionData);

}

$data = @unserialize($actionData);

if ($data === null) {

$data2 = preg_replace_callback('!s:\d+:"(.*?)";!s', function($m) { return "s:" . strlen($m[1]) . ':"'.$m[1].'";'; }, $actionData);

$data = @unserialize($data2);

}

if (empty($data)) {

$data = [[

'field' => 'serialize_error',

'from' => $actionData,

'to' => null

]];

}

return $data;

}

I can run the command in CLI:

[kiat@reporting misoro]$ sudo -u nginx php bin/console oro:cron:sc-logger-event:insert-action-data
Rows Inserted: 2187
Seconds Took: 2.670428

[kiat@reporting misoro]$ sudo -u nginx php bin/console oro:cron:sc-logger-event:insert-action-data

Rows Inserted: 2187

Seconds Took: 2.670428

What did I miss?

Creator

Topic

Viewing 4 replies - 1 through 4 (of 4 total)

Author

Replies

April 8, 2019 at 11:46 pm #38491

kiatsiong.ng

Participant

In var/logs/prod.log:

[2019-04-09 06:36:02] console.ERROR: An error occurred while running command “‘oro:cron’ –env=prod”. The command “oro:cron:sc-logger-event:insert-action-data” does not exist. {“exit_code”:1,”exception”:”[object] (Symfony\\Component\\Console\\Exception\\CommandNotFoundException(code: 0): The command \”oro:cron:sc-logger-event:insert-action-data\” does not exist. at /usr/share/nginx/html/misoro/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:484)”,”arguments”:{“command”:”oro:cron”},”options”:{“env”:”prod”}} []
[2019-04-09 06:36:02] console.ERROR: Error thrown while running command “oro:cron –env=prod”. Message: “The command “oro:cron:sc-logger-event:insert-action-data” does not exist.” {“exception”:”[object] (Symfony\\Component\\Console\\Exception\\CommandNotFoundException(code: 0): The command \”oro:cron:sc-logger-event:insert-action-data\” does not exist. at /usr/share/nginx/html/misoro/vendor/symfony/symfony/src/Symfony/Component/Console/Application.php:484)”,”command”:”oro:cron –env=prod”,”message”:”The command \”oro:cron:sc-logger-event:insert-action-data\” does not exist.”} []

April 8, 2019 at 11:51 pm #38492

kiatsiong.ng

Participant

It turns out that I needed to clear cache at prod:

[kiat@reporting misoro]$ sudo -u nginx php bin/console oro:cron --env prod


  The command "oro:cron:sc-logger-event:insert-action-data" does not exist.


oro:cron [-h|--help] [-q|--quiet] [-v|vv|vvv|--verbose] [-V|--version] [--ansi] [--no-ansi] [-n|--no-interaction] [-e|--env ENV] [--no-debug] [--disabled-listeners DISABLED-LISTENERS] [--current-user CURRENT-USER] [--current-organization CURRENT-ORGANIZATION] [--] <command>

[kiat@reporting misoro]$ sudo -u nginx php bin/console cache:clear --env prod

 // Clearing the cache for the prod environment with debug false

 [OK] Cache for the "prod" environment (debug=false) was successfully cleared.

[kiat@reporting misoro]$ sudo -u nginx php bin/console oro:cron --env prod
[kiat@reporting misoro]$

[kiat@reporting misoro]$ sudo -u nginx php bin/console oro:cron --env prod

The command "oro:cron:sc-logger-event:insert-action-data" does not exist.

[kiat@reporting misoro]$ sudo -u nginx php bin/console cache:clear --env prod

// Clearing the cache for the prod environment with debug false

[OK] Cache for the "prod" environment (debug=false) was successfully cleared.

[kiat@reporting misoro]$ sudo -u nginx php bin/console oro:cron --env prod

[kiat@reporting misoro]$

December 30, 2019 at 2:30 am #41192

saikatcdac

Participant

Hi Kiatsiong.ng

I am new in Oro and i was trying to create a demo cron job but unable to do that. So if possible will you help me to understand to create a simple Oro cron in my local system. I am using Ubuntu 18 and Oro CRM version latest one. I have created a folder under src directory as like same you have mentioned in your code. Then what should i do? Or how can i create a simple cron job where after running the cron the hello world string will be printed on screen or something like that. Actually i am not getting the cron things how it’s work in Oro.

Thanks
Saikat

December 30, 2019 at 6:42 pm #41205

kiatsiong.ng

Participant

Here’s my notes on setting up cron job and creating a cron job in Oro Platform.

This reply was modified 3 years, 3 months ago by kiatsiong.ng.
This reply was modified 3 years, 3 months ago by kiatsiong.ng.
This reply was modified 3 years, 3 months ago by kiatsiong.ng.

Author

Replies

Viewing 4 replies - 1 through 4 (of 4 total)

The forum ‘OroPlatform – Programming Questions’ is closed to new topics and replies.

OroPlatform Forums