`unique: until_and_while_executing` not working as expected

[vitalis]

After migration to version 4.0.7,4.0.8 I see that uniqueness is not working as expected as you can see in the output:

irb(main):027:0> workers = Sidekiq::Workers.new
=> #<Sidekiq::Workers:0x00000004a11900>
irb(main):028:0> workers.each do |process_id, thread_id, work|
irb(main):029:1* puts work.inspect
irb(main):030:1> end
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[145], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"ace6250faf2a85c8c558b8b6", "created_at"=>1446634581.3064704, "enqueued_at"=>1446634581.3064966}, "run_at"=>1446635992}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"7dfdf300ee6bbec3149f60e0", "created_at"=>1446634574.1902678, "enqueued_at"=>1446634574.1903222}, "run_at"=>1446634606}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"c85855fa281b950be773e1c1", "created_at"=>1446634087.754324, "enqueued_at"=>1446634087.7543488}, "run_at"=>1446634504}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"56aa3b9f8f31180631048216", "created_at"=>1446634070.827466, "enqueued_at"=>1446634070.8274908}, "run_at"=>1446634251}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"e1ea22bdccfd481dc57c0921", "created_at"=>1446634065.8611274, "enqueued_at"=>1446634065.8611522}, "run_at"=>1446634149}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"d2fe824efec0fed63b44ff8c", "created_at"=>1446632879.7874873, "enqueued_at"=>1446632879.787629}, "run_at"=>1446633968}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"08c52d9453952b9c19bc05ce", "created_at"=>1446634078.8398259, "enqueued_at"=>1446634078.8398504}, "run_at"=>1446634404}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"2eec4d13b6e0bcc6bc972187", "created_at"=>1446634581.295088, "enqueued_at"=>1446634581.295115}, "run_at"=>1446634798}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[134], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"6bb4670034b6a22bfd3f4c71", "created_at"=>1446634581.3053825, "enqueued_at"=>1446634581.3054092}, "run_at"=>1446635988}
{"queue"=>"default", "payload"=>{"class"=>"IngestionBroadcasterJob", "args"=>[109], "retry"=>false, "queue"=>"default", "backtrace"=>true, "unique"=>"until_and_while_executing", "unique_expiration"=>3600, "jid"=>"81a8189b831237976c80eca5", "created_at"=>1446632873.4227843, "enqueued_at"=>1446632873.4228897}, "run_at"=>1446633657}
=> ["ip-10-67-177-246:1002:da5d95cc2bbe", "ip-10-67-177-246:1006:5c10155eebe1", "ip-10-67-177-246:1011:5a22aff43b52", "ip-10-67-177-246:975:abdb8ea40357", "ip-10-67-177-246:978:86ad03b21d3c", "ip-10-67-177-246:982:cf74c54af63c", "ip-10-67-177-246:986:f5e2324acff6", "ip-10-67-177-246:990:60f6534af83f", "ip-10-67-177-246:994:83b3cd84a478", "ip-10-67-177-246:998:c1b5c7ffe1ec"]

[mhenrixon]

I can't really do much with that information. Need some type of failing example, preferably in an isolated test. With what you just posted it would be near impossible to figure out what is going on.

[mhenrixon]

By the way, how long does the job take to finish? Are you sure you ar enot after UntilExecuted? Do you understand the differences between the two?