-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathTODO.txt
More file actions
31 lines (25 loc) · 1.13 KB
/
TODO.txt
File metadata and controls
31 lines (25 loc) · 1.13 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
--- TODO ---
scale proportionally (using a scaling factor) to the job request rate + queue size
make allocation message to workers, which allows for:
- also add IP to this message so the worker can check whether the right client is providing the data
- notifying the controller if the job data never reached the worker
- checking if result request matches ip of job
split controller into multiple files
nicer experiment administration
nicer experiment framework at client
what if worker is killed / dies / scaled down before client has received all data
what if worker crashes while it is pending?
maintain precedence over restarted jobs + account for job restarts in the job completion time
retrieve status reports as client until result is produced (polling)
controller faster ip resolution
clean client interface + meerdere file uploads
remove debug crap
allow again for controller restarts
write bootstrapper for controller that hands it its ip
--- QUESTIONS/POSSIBILITIES ---
retrieve status reports as client until result is produced
priority system for jobs
increase security
less http
--- IF WE ARE RICH ---
Worker restarts after scaling down