Suggestions for optimizing cron work

1. No, you can’t do this, because if your mass operations simultaneously with the minute crone do something with the same contact, you will get data loss 2. Abrupt cron interruptions - this will also be a problem, since you obviously do not understand whether it is working now or just waiting 3. it all depends on how much memory you allocated to crons, you can give so much memory that they are enough to process 200K records

Thanks Igor. Now I have launched a mass action to change the stage for 5500 processes. After a couple of minutes, I see that 500 processes have already changed the stage, the rest are still waiting in line. I see that the process is underway. When starting a mass change of 120,000 customer cards in 1.5 hours, not a single card was changed. Cron just stopped. Therefore, I dare to conclude that sometimes it's not about waiting, but about failure due to a large number of tasks. From this situation, you need to provide a way out. Make an auto-check and restart if it freezes (if you reject a manual restart. Or make protection that would not allow exceeding the capacity limit. And so I do a standard operation and get a freeze. Looks like a bug. 3. Is memory allocation done by you? Or is it about the server's shared memory? How much is allocated now?

By the way, I launched in 5500 processes I changed the stage. At the stage, I send a message to the viber bot. The procedure took an hour. Minute kroner hangs all this time. It turns out that during working hours I can’t make a newsletter, because the rest of the processes will stop. I agree that you do not know the features of the system, so my suggestions may be incorrect. But I see a problem. What solution do you see? Changing resources? After all, clients can be with big tasks?

[quote] Ptashkin Sergey Client wrote: Therefore, I dare to conclude that sometimes it's not about waiting, but about failure due to a large number of tasks. From this situation, you need to provide a way out. Make an auto-check and restart if it freezes (if you reject a manual restart. Or make protection that would not allow exceeding the capacity limit. [/quote] restarts and checks are done by the server settings and not by the system, the system cannot understand the cron is running or has crashed from memory. Memory throttling is also on the server side. [quote] Ptashkin Sergey Client wrote: And so I do a standard operation and get a freeze. Looks like a bug. [/quote] I described to you the reason why this happens, since the system is installed on different servers with different capacities, then I have no right to limit the number of data sent to cron [quote] Ptashkin Sergey Client wrote: 3. Is memory allocation done by you? Or is it about the server's shared memory? How much is allocated now? [/quote] Memory (memory_limit) is allocated on the server for php scripts, configured by the system administrator, in this case you have 512 megabytes to run a minute cron [quote] Ptashkin Sergey Client wrote: By the way, I launched in 5500 processes I changed the stage. At the stage, I send a message to the viber bot. The procedure took an hour. Minute kroner hangs all this time. It turns out that during working hours I can’t make a newsletter, because the rest of the processes will stop. I agree that you do not know the features of the system, so my suggestions may be incorrect. But I see a problem. What solution do you see? Changing resources? After all, clients can be with big tasks? [/quote] the solution here is just increasing the memory

[/quote] the solution here is just increasing the memory [/quote] Thank you. Changed to 4 GB. Trying

Igor, we could not cope with the task on our own, I ask for your help. Yesterday changed in the php.ini file memory_limit = 512M to memory_limit = 4096M then restart Apache After that, the minute cron runs tasks for 2 minutes. This morning the php.ini file was empty. And you said we made a mistake. Today the file was restored and everything worked. Changed again and the problem reappeared. Igor, I do not insist that you do our training. We are ready to entrust this task to professionals. You can evaluate this task and we will pay for it. Thanks

[quote] Ptashkin Sergey Client wrote: Igor, we could not cope with the task on our own, I ask for your help. Yesterday changed in the php.ini file memory_limit = 512M to memory_limit = 4096M then restart Apache After that, the minute cron runs tasks for 2 minutes. This morning the php.ini file was empty. And you said we made a mistake. Today the file was restored and everything worked. Changed again and the problem reappeared. Igor, I do not insist that you do our training. We are ready to entrust this task to professionals. You can evaluate this task and we will pay for it. Thanks [/quote] 1h

OK. There are 9 hours of improvements on the balance sheet. You can run. If not difficult, write in what we made a mistake.

Now the ShopSupplier_Processor_Avail process often hangs in the crown runs 70 seconds Haven't seen this before. I don't understand the reason.

Good afternoon. Igor, the task is not urgent, but I would like to clarify the deadline in order to understand that the task has not been forgotten. Thanks

I also ask for help with free disk space. Give recommendations, please. Do you need to enlarge the disk, or do you need to clean something up?

[quote] Ptashkin Sergey Client wrote: OK. There are 9 hours of improvements on the balance sheet. You can run. If not difficult, write in what we made a mistake. [/quote] I registered the settings, wrote off 1 hour [quote] Ptashkin Sergey Client wrote: Now the ShopSupplier_Processor_Avail process often hangs in the crown runs 70 seconds Haven't seen this before. I don't understand the reason. [/quote] this is a recalculation of the availability of goods [quote] Ptashkin Sergey Client wrote: I also ask for help with free disk space. Give recommendations, please. Do you need to enlarge the disk, or do you need to clean something up? [/quote] I cleaned the logs on the disk and the garbage, the memory was freed

Thanks Igor. Could you suggest a list of work that is recommended to be done on the server with a certain frequency. So that I understand that once a month (or two) it is necessary to pay and carry out a series of service work. Sending 2000 messages via turbosms. Cron hangs for an hour. The wishes for optimization remain in force so that minute actions do not stop at this time. Maybe you can come up with something else.