Intelligent & distributed cron scheduler for linux required
$10-100 USD
Cerrado
Publicado hace casi 2 años
$10-100 USD
Pagado a la entrega
I am having a process named replicate which runs on each machine/host a long time and consumes a lot of resources (disk-io, network-bandwidth, high CPU)
Goal is to reduce the network load by running all process replicate overall all hosts in a sequence
The replicate process is highly dependent on the previous data of the host and is therefore changing its runtime/exectime
I need a distributed cron job scheduler, which is able to:
- register new hosts, which need to be distributed scheduled
- to monitor start and end time
- to monitor missing starts or missing end times (operation not started or operation not terminated)
- to manage all replicate processes from a central point
- to define an order of the hosts
- to define group of hosts, which have to run the hosts of the given group in a sequence (e.g. datacenter US-CA, datacenter US-NY, ... to limit bandwidth per datacenter), but the groups itself can run in parallel (e.g. host in sequence of US-CA and hosts in sequence of US-NY can run in parallel)
- the hosts fetch the distributed cron and update the local cron accordingly
Programming languages allowed?
- bash
- java
delivery:
- into our git (will be shared to you)
- well documented code (inline and in form of a preview as [login to view URL])
Hi,
I have over 6 years experience On it And Understand That You are looking for a intelligent & distributed cron scheduler. , And I can I am available immediately to start For you .
Please read my recent jobs and see the 100% success rate.
Thanks a lot .
What you need is to put your replicate program inside a prism. The prism will first raise a flag (containing the start time and other necessary information) making it identify-able across the network. It then should execute your program and lower the flag only after completion of the job (re-logging the finish time and other necessary information).
The main algorithm for determining which cronjob should run at what time will need to see how many processes are already in progress and whenever there are enough resources available to run another replicate program, it checks the last finish time and the overall time it took for each server. Now prioritized based on groups of servers that do not have any recent replicate program ran, a priority list is calculated in realtime and the servers are scheduled according to their number in the queue.
As the cronjobs have a limited number of env values available to them, we will need to either run this main program as a separate script on one of the servers (remotely controlling the replicate activity on other servers). Another approach could be some central database server where each cronjob connects to in order to request permission to run replicate or not. In such a case this will mean that each server will be executing the priority calculation algorithm according to its own cronjob, and will only run the replicate if it is given a go ahead from one main system.
Need to discuss Further.
Regards.
I have 10 years of experience as Linux admin and I am RHCE Certified as well.. Need project as I am physically handicapped.. I will give you quality work on time..
Hi
Greetings!
I am available right now for the project discussion and can start the project
on an immediate basis. I have understood your project requirement
I have7++ experience in design and development. I can handle projects from small
styling to full development from scratch. I will provide a good result in a short time
and satisfy you fully.
We have experienced developers in
Java
System Admin
Linux
Network Administration
Programming
WHY-ME:
» Ready to Start as Immediate& Proper Testing.
» Keep your Data & Website Secure: Daily Progress Updates.
» You will get 30-days FREE BUG-SUPPORT even after Project-Completion
Please give me in touch and let's discuss more detail about your task via chat.
Project milestones will be decided during chat
Thanks and Regards
Arpit Jain
Black Grapes Softech