I have got insighted into your worker implementation. While I found that worker has heavily write to Mongo.
I thought it might not be a good performance on saving result. Why not writing to redis (cache) firstly to instead of saving to MongoDB in order to handle more I/O operations to gain more performance.
I have got insighted into your worker implementation. While I found that worker has heavily write to Mongo.
I thought it might not be a good performance on saving result. Why not writing to redis (cache) firstly to instead of saving to MongoDB in order to handle more I/O operations to gain more performance.