-
Notifications
You must be signed in to change notification settings - Fork 21
/
ChangeLog.txt
2220 lines (1968 loc) · 79.4 KB
/
ChangeLog.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Release Notes
* 1/16/2024
* 0.1.1 parameter parsing for HTTP GET methods
* 1/15/2024
* 0.1.0 migration to werkzeug and cleanup of FastCGI specific configurations
* 9/27/2023
* 0.0.66 formatting using black and autopep8
* 5/25/2022
* 0.0.30 for containerization
* 2/18/2020
* added use_only_local_data
* 11/12/2019
* 0.0.23
* fixed for wheel
* 11/8/2019
* 0.0.22
* enabled wheel
* fixed for pip+virtualenv
* 11/7/2019
* 0.0.21
* added python 2/3 compatibility
* added pip and virtual env support
* 9/3/2019
* token-based auth
* 8/26/2019
* changed sub dataset names
* changed heartbeat timeout to be configurable
* 8/22/2019
* removed zero padding in _sub
* using only 5 digits in SUBCOUNTER_SUBID_SEQ
* 8/21/2019
* taking ddm blacklist into account for site inputs
* 4/23/2019
* supplemental error for lost-heartbeat jobs
* 4/10/2019
* added memory_leak to jobs
* 4/2/2019
* added fullFlag in getJediTasksInTimeRange
* 3/26/2019
* using supError* for invalid batchID
* using supError* for worker's error reporting
* 3/15/2019
* added express for task.currentprio>=1500
* 3/11/2019
* added fake in specialHandling
* 2/28/2019
* added useZipToPin
* 2/18/2019
* to set nEvents to zip
* 2/12/2019
* enhanced getOfflineRunning for analy
* 2/5/2019
* not to reassign throttled jobs
* not to throttle short jobs
* 2/1/2019
* added checkFailureCountWithCorruptedFiles
* 1/29/2019
* added es_toolong
* 1/25/2019
* added corrupted events
* 1/18/2019
* checking batchID in updateJob
* 12/21/2018
* to reduce attempts for esmerge
* 12/19/2018
* to change MCORE to SCORE for small ES jobs
* 12/5/2018
* to take into account objstoreIDs of zip files when making esmerge
* 11/14/2018
* one sub per job for ART
* 10/30/2018
* added list_ptest_prod_sources
* 10/22/2018
* added proc_status
* sending ioIntensity
* fixed ppE for maxAttempt
* 10/16/2018
* added decAttOnFailedES
* 10/5/2018
* added discardEvents in retryTask
* 9/26/2018
* added grace_period in eraseDataset
* 9/25/2018
* moved file lock from getEvents to ppE
* 9/7/2018
* added scattered in getEventRanges
* 7/24/2018
* added rc_test2
* 7/23/2018
* added reloadInput
* 7/16/2018
* fixed recoverLostFiles to update nEvents in input and output datasets
* 6/19/2018
* added noChildRetry to recoverLostFiles
* 6/18/2018
* added hasReadyEvents
* 6/13/2018
* added harvester_slots
* 6/10/2018
* added useBrokerOff in catchall
* 5/30/2018
* enabled aggressive heartbeat check
* 5/23/2018
* added transpath to global share
* 5/22/2018
* added guid check in Adder
* 5/18/2018
* added EC_WorkerDone
* 5/17/2018
* added syncLevel to updateWorker
* 5/8/2018
* added getJobStatisticsPerSiteResource
* 5/7/2018
* schedconfig.capability
* 4/25/2018
* improved getSitesShareDDM to reflect new endpoint association
* 4/10/2018
* added updateJobsInBulk
* 4/9/2018
* added nJobs and computingElement to workers
* 4/6/2018
* added sj
* fixed getJobs for notDiscardEvents
* 3/28/2018
* added harvester_dialogs
* 3/20/2018
* not to discard events
* 3/16/2018
* reset stateChangeTime for retried es merge
* to avoid himem for es merge
* 3/15/2018
* input files in ZIP_MAP
* changed ordering of event ranges
* 3/15/2018
* fixed Freezer not to close sub datasets if resurrected consumer could use them
* moved from astorages0 to astorages (AGIS request)
* 3/13/2018
* fill HS06sec for jobs without task (e.g. HC)
* 3/12/2018
* fixed ppE to reset more attributes
* changed RSE for _sub of ES jobs
* 2/28/2018
* changed command messages to INFO
* 2/23/2018
* added a protection against non-integer transExitCode
* added a protection not to close dis datasets if resurrected consumer could use them
* changed ppE not to resurrect consumers killed in defined
* 2/20/2018
* changed --keepUnmerged to kill jobsets if no events got started
* 2/16/2018
* added more info when dispatchDBlock failed
* 2/15/2018
* changed get/updateEvents to take local pilot owner into account
* 2/6/2018
* locking job in active4 when ppE and getEvents
* 2/2/2018
* fixed resurrect consumers for consumers killed in assigned
* 1/25/2018
* added comprehensive heartbeat
* 1/22/2018
* added es_preempted
* 1/18/2018
* added checkEventsAvailability
* 1/15/2018
* added nStandby
* 1/8/2018
* using keepUnmerged to reassign jobs
* to kill all consumers when a consumer is killed
* 12/6/2017
* changed to avoid reattempts of ES jobs when jobseed is std or status is not online or brokeroff
* 11/29/2017
* changed JD to allow xml=json
* 11/24/2017
* added a hint to (un)throttle users
* disabled OracleEI for https://cern.service-now.com/service-portal/view-incident.do?n=INC1529405
* 11/21/2017
* allowing incexec for exhausted
* 11/20/2017
* Using AES_MINEVENTSFORMCORE = max(AES_MINEVENTSFORMCORE, schedconfig.corecount)
* 11/10/2017
* Changed HS06sec formula to actualcorecount * corepower * duration
* 11/8/2017
* setting jobsetID in JEDI_Dataset_Contents
* using separate site attribute for jobseed
* 11/1/2017
* sending ES consumers to SCORE if there are not enough events
* added harvester_id and worker_id in getJobs
* 10/10/2017
* updated hint in getJobs
* 10/09/2017
* setNoRetry to update also files in running status
* added usePrefetcher
* 10/06/2017
* added PQ.status=paused
* 10/05/2017
* DDMSpec.getAssociatedEndpoint choosing endpoint with lowest order
* 10/02/2017
* enabling TEST and SPECIAL endpoints
* 9/27/2017
* added resurrectConsumers
* 9/26/2017
* using DATADISK for analysis staging-in
* 9/12/2017
* locking a file in getEventRanges
* 8/30/2017
* metadata registration for ES files
* 8/17/2017
* added registerEsFiles
* changed AdderAtlas to catch InvalidRSEExpression
* 8/15/2017
* removed sleep in copyArchive
* removed FOR UPDATE when counting events for now
* 8/9/2017
* fixed ppE to exclusively count num of unprocessed events
* 8/8/2017
* improved setMerge to try local if remote is unavailable
* fixed ppE to keep job status when old job is closed in jobsDefined/Waiting
* improved ppE to take unifiedPQ into account
* fixed ppE to set resource_type to merge
* 7/26/2017
* setting cancelled/failed to es_killed/es_aborted
* not to kill consumers in inactive sites when associated consumers are active
* 7/25/2017
* added protection against duplicated submission by group users
* added blank pilots to harvesterCtl
* 7/17/2017
* changed ES merge to choose sites with wnconnectivity
* 7/12/2017
* added background and resourceType in getJob
* setting background-able flag
* 7/10/2017
* added command_lock stuff
* 7/6/2017
* added tighter isolation for check of concurrent running consumers
* 7/3/2017
* added checkJobStatus
* 6/29/2017
* added reportWorkerStats and harvesterCtl
* 6/26/2017
* WQ-GS alignment
* 5/26/2017
* fixed killJob with keepUnmerged not to discard evens
* changed SetupAtlas to make _sub when esMergeOnOS is used
* 5/23/2017
* changed retryJob to reset computingSite to ES merge jobs
* 5/17/2017
* introduced timeout for throttled jobs
* changed ES merge to avoid jobseed=es
* 5/8/2017
* added nSimEvents
* changed managed to fail when nevents is not set
* 5/3/2017
* fixed eventStatus=merged for objStore_ID=None
* 5/2/2017
* added unified PQs
* added inFilePosEvtNum
* fixed ppE not to duplicate ES merge jobs
* 4/25/2017
* fake co-jumbo
* added path_convention
* 4/24/2017
* resource_type tagging
* 4/18/2017
* added subDeleter
* 4/14/2017
* added noExecStrCnv
* 4/6/2017
* zip outputs
* 3/20/2017
* fixed increaseAttemptNr for maxAttempt<attemptNr
* 3/15/2017
* changed propageR to trigger recalculation of task params based on nDone
* 3/14/2017
* removed SE check in Adder
* 2/16/2017
* added getProxy
* changed killTask.py not to kill holding by default
* 2/10/2017
* added DBProxyFiltered
* 2/6/2017
* Protection against undef
* 2/3/2017
* using schedconfig.dn to specify pilot owners
* 2/2/2017
* added columns for new memory monitor
* 1/30/2017
* fixed EiOra for empty streamName
* fixed updateEventRanges
* 1/27/2017
* removed dq2 dependency
* 1/23/2017
* added CAP_RUNNING_USER_JOBS
* 1/11/2017
* fixed fingers for RFC proxy
* 12/15/2016
* added mergeEsOnOS
* using new filename format for ES merge for rel20 or higher
* 12/2/2016
* changed to update stateChangeTime properly
* 12/1/2016
* removed retry for analysis in Watcher
* 11/25/2016
* added pilot_killed
* 11/24/2016
* Updated MySQL DB schema
* 11/18/2016
* added task_id and account to prestaging rules
* 11/14/2016
* made timeout value for analysis rebrokerage configurable
* added maxWalltime to getJob response
* 11/11/2016
* removed dependencies on se, seprodpath, setokens in schedconfig
* 11/10/2016
* added recoverLostFiles
* 11/2/2016
* added es_heartbeat and es_merge_failed
* 10/31/2016
* disabled ES file registration
* fixed del flag for failed ES merge jobs
* 10/28/2016
* fixed localEsMergeNC
* 10/27/2016
* changed rebro to kill starting jobs
* changed starting jobs not to update modification time
* 10/20/2016
* reduced timeout for activated user jobs to 6h from 24h
* 10/18/2016
* jedi_events.error_code
* jobsubstatus=pilot_finished
* 10/17/2016
* allowing cancelled jobs to register log files
* 10/15/2016
* eventStatus=fatal
* 9/20/2016
* checking sutck merging jobs
* 9/16/2016
* setting DEL flag to event ranges
* 9/15/2016
* added tier to SiteSpec
* 9/12/2016
* added multi zip support for ES
* 9/7/2016
* using soft erase for dis and sub
* adding all production sites to WORLD by default
* 8/29/2016
* added accesptJson to get/update event ranges
* 7/28/2016
* using w instead of d to get OS info
* 7/25/2016
* tagging of shares
* removed obsoleted memcached code
* 7/14/2016
* using bulk fetch for files in storeJobs
* 7/12/2016
* registering and deleting ES files in rucio
* 7/8/2016
* added jumbo job stuff
* 7/1/2016
* changed Savanna to JIRA in notifications
* fixed killUnfinishedJobs
* 6/28/2016
* added a protection to DyPD2P for large user datasets
* 6/23/2016
* added avalancheTask
* fixed Watcher to correctly change jobParams for pmerge
* 6/21/2016
* fixed datasetMgr to delete dis for panda.um
* 6/20/2016
* more informative message for closed clones
* 6/13/2016
* added keepUnmerged to killJob
* removed datatype check from EP
* 6/7/2016
* changed to sort files for ES since file order is important for positional event number
* 6/6/2016
* resetting batchID for retry
* 6/2/2016
* removed scope from tmpin
* 5/31/2016
* fixed event range generation with multiple inputs
* 5/20/2016
* added a protection against unique constraint ATLAS_RUCIO.DIDS_GUID_IDX violation
* added a protection against too long scope
* setting panda_id and campaign to file metadata
* 5/25/2016
* imporved getJediTaskDetails
* added writeInputToFile
* fixed Watcher for time-outed ES merge not to update ES jobs
* 5/9/2016
* reduced memory consumtion and removed redundant file lookups in SetupperAtlas
* 5/4/2016
* changed to copy ES merge trf to job.transformation
* changed ES jobs to go from merging to failed when associated ES jobs go to failed
* 5/3/2016
* using merging for ES jobs while ES merge is running
* 5/2/2016
* changed AdderAtlas to work without srm endpoints with OS endpoint
* added localEsMergeNC
* 4/28/2016
* changed getJob to send json if clients accept it
* 4/17/2016
* fixed killUnusedEvent* to check jobsetID
* 4/13/2016
* fixed insertTaskParam to update JEDI taskparam table when task is running
* fixed listDatasetByGUIDs to regard UnknownDatasetException as fatal
* 4/11/2016
* changed to accept retry(newOpts) when analy tasks are running
* changed getJob for retried ES merge jobs
* fixed double counting in getCriteria
* 4/10/2016
* changed propageResult for cloned jobs to set jobset_id
* 4/8/2016
* setting destinationse for log of ES merge
* 4/7/2016
* changed not to send ES merge to short queue
* changed not to send log info to ES merge
* using -details richtype for EI
* recording jobsetIDs and their history for ES
* 4/6/2016
* fixed fairshare for WORLD
* introduced connection pool for EI lookup
* 4/5/2016
* fixed updateUnmergeDS for running
* changed submitJobs to require FQANs for atlas
* fixed ppE to use sites with corecount=null when looking for score
* fixed killUnusedESC to kill running consumers when killAll
* added prod role check in submitJob
* 4/4/2016
* fixed nucleus.getAssoicatedEndpoint for dst:
* 4/1/2016
* changed updateRelatedEventServiceJobs to update stateChangeTime
* 3/31/2016
* added Oracle EI stuff
* 3/24/2016
* fixed getEventRanges to kill unused consumers if no more events
* 3/23/2016
* fixed cloned jobs to set pandaIDs in Dataset_Contents
* added changeTaskModTimePanda and triggerTaskBrokerage
* fixed AdderAtlas for RSEProtocolNotSupported
* added checkClonedJob
* changed localEsMerge to send merge jobs to score
* 3/21/2016
* changed checkTaskStatus to allow updates in exhausted
* fixed retryJob not to add metadata
* fixed ES merge retry to take attemptNr into account
* fixed killESC for multiple inputs
* 3/18/2016
* resetting ramCount to 0 for ES merge
* 3/16/2016
* added putLogToOS
* added newParams in retryTask
* changed dispatcher to ignore fairshare for ES merge
* 3/14/2016
* introduced jobSubStatus=pilot_closed
* 3/10/2016
* added isSuperUser
* 3/9/2016
* added changeTaskSplitRule
* added changeTaskAttribute
* fixed ppEvt for nucleus without localEsMerge
* 3/8/2016
* fixed to properly decrease priorities for group analysis
* 3/7/2016
* using is_local in DdmSpec
* 3/2/2016
* changed retryTask for running tasks to reactivate failed inputs
* 2/29/2016
* fixed updateForPilotRetryJEDI to update outPandaID
* 2/25/2016
* changed SiteSpec.isDirectIO to take direct_access_lan into account
* 2/23/2016
* added getAssoicatedEndpoint to DdmSpec
* 2/22/2016
* added allowWanInputAccess
* 2/19/2016
* setting jobSubStatus to upstream jobs when merge is failed
* 2/18/2016
* fixed getCriteria for groups without wildcards
* 2/17/2016
* added getDispatchDatasetsPerUser
* 2/16/2016
* using datasets.currentfiles to store dis size
* 2/15/2016
* using 14days lifetime for panda rules
* added altStgOut
* 2/12/2016
* changed NucleusSpec to ignore SPECIAL
* added protection against space_*=None
* added softkill for ES preemption
* using asynchronous rules for GEN dis
* 2/9/2016
* added mode to reassignTaskTo*
* added file check for assigned jobs
* changed HC DN for glexec
* 2/8/2016
* added esPreemption
* 2/4/2016
* added nucleus and eventService to jobSpec
* 2/3/2016
* changed retryTask so that failed jobs in pending/running/scouting tasks can be retried
* 2/1/2016
* added reassignTaskToNucleus
* 1/29/2016
* changed to allow satellites in destinationSE
* 1/28/2016
* setting nucleus to destinationSE
* 1/27/2016
* removed __str__ in DdmSpec
* 1/26/2016
* added getDNsForS3
* added protection not to change failed jobs to holding
* 1/25/2016
* sending objStoreIDs for ES merge
* added network configurator and corepower collection
* 1/19/2016
* changed addMetaData to limit the size of json for failed jobs
* 1/18/2016
* changed to update status of ES jobs when ES-merge is done
* enabled a protection for transferring->holding and holding->holding with final heartbeats
* 1/12/2016
* changed AdderAtlas for alternative stage-out
* added objstoreID to updateEventRange
* changed eventLookupClientEI to use new EI client
* 1/11/2016
* changed killJob so that 51 goes forward even if commandToPilot was already set
* 1/5/2016
* using DISK for prestaging
* 12/28/2015
* fixed updateUnmerged so that merging jobs fail only when max attempt is reached
* 12/15/2015
* removed redundant log sending
* added days to getScriptOfflineRunning
* fixed dispatcher to release lock in finally
* 12/12/2015
* killing pending jobs in small chunks to avoid timeout
* added protection in panda.py for cgi exception
* 12/9/2015
* changed AtlasAdder so that jobs don't go to transferring if only log
* removed panda_ddm_relation
* 12/8/2015
* fixed input duplication check for multiple consumers
* using DISK for tape prestaging for analysis
* 12/7/2015
* inroduced jobStatus=closed
* changed Adder to send notification when --destSE doesn't work
* 12/2/2015
* added a protection in insertNewJob to avoid duplicated input usage
* 11/30/2015
* added a protection for late insert of metadata
* 11/26/2015
* added jobStatus=closed
* changed Nucleus to remove ATLAS when getting endpoint with spacetoken
* 11/23/2015
* fixed pseudo files in propagateResult
* current
* added max/minrss
* using std by default for jobSeed
* changed not to reset nooutput when pmerge is done
* fixed getSiteSpecs not to propagate ddm endpoints to clients
* added nucleus stuff
* improved error message when pilot produced a wrong file
* added changeTaskCputime
* using Express for urgent or high prio input
* checking metadata before closing sub datasets to avoid a rucio bug
* fixed datasetMgr to avoid lookup for nonexistent datasets
* fixed datasetMgr to take distributed dataset into account
* fixed for internal merge + zero suppression
* changed AdderGen and AdderAtlas to treat missing files more properly
* added allowNoOutput
* improved checkInputFiles
* changed copyFileRecord to update JEDI files too
* diabled inputFileCheck in Adder for pilotRetry
* fixed propageteResult for killed merging after pmerge incremented attemptNr
* added RSENotFound
* patched AdderAtlas for MWT2 PRODDISK
* added dynamicNumEvents stuff
* changed checkTaskStatus
* changed copyFileRecord to work with original or w/o original
* changed regexp to look for unmerged files
* registring location for GEN
* fixed user group accounting for mergeOutput
* capping number of running user jobs
* changed fairshare to work with HS06
* removed exception in fairshare so that T1 uses cloud.fairshare if empty
* added ESMERGERECOVERABLE. Eventually should be taken care of by retrial module
* added giveGUID to EventPicking
* changed hint for JEDI_Events
* added some ES error codes
* updating nEventsUsed only for input datasets
* added CloserAtlasPlugin
* initializing DBProxy._logger when importing module since resetting in JediDBProxy was broken
* added machinery to leave files where they are produced
* using Express for urgent or prio>1000
* added NOWAIT in killEventServiceConsumers
* added NOWAIT in killJob
* added validation check for pmerge
* added disableFurtherAttempt not to retry killed pmerge
* added hint for JEDI_Events
* using executemany to insert event ranges
* fixed retryJob for ES merge
* added WORLD
* removed rse from registerNewDataset for _sub
* fixed ppEvent not to generate merge jobs when there are failed events in another process
* setting rule lifetime to hc_test,install,gangarbt
* changed SA not to pin replicas at LOCALGROUP etc
* setting activity for registerDatasetLocation
* refreshing fairshre table every 15min
* using group account for group.* with destSE
* using "User Subscriptions" for user's rules
* changed the limit to reassign jobs at inactive sites to prio=800
* sending tobekilled to updateJob for already killed jobs
* fixed bulk getJob for user jobs
* changed ppEvt to keep failed event records for ES
* changed getCriteriaForProdShare for urgent to ignore fairshare
* added nJobs in getJob
* removed datri stuff from EP
* added hasValueInCatchall
* keep records in SiteData for 48h
* changed to reassign high prio jobs in activated/starting when sites are inactive
* changed lastStart to be updated only by managed/user/panda
* using rucio in getScriptOfflineRunning
* removed registerDispatchDatasetLocation
* changed to retry ES merge when lost heartbeat
* added convertRSE for PRODDISK retirement
* added updateEventRanges
* using rucio API instead of DaTRI
* updating lastStart
* id in fairshare
* added taskID to getJob
* introduced prio limit in shares with throttled
* changed code=51 to force-kill
* fixed ppEvent for catchall=None
* added more debug info to insertDataset
* added soft flag to reassignTask
* removed old hint for 10.2.0.4
* added job cloning stuff
* added max/avgRSS etc
* resetting startTime to endTime when starting jobs are killed
* removed pinning for panda.um
* changed Setupper not to make redundant rule for panda.um
* reduced timeout for high prio holding jobs
* added -info to eventLookupClientEI
* changed dispatcher to send DDM endpoints
* added jediTaskID in getEventRanges
* set file status to failed when consumers are killed
* improved eventLookupClientEI for 0 matching
* changed EventPicking to use EI
* reduced timeout for lost-heartbeat to 2h from 6h
* using tape replicas at T1
* added 51 in killJob
* added shareMgr.py
* setting activity for _dis and _sub
* reduced interval for low prio jobs to finish
* fixed offlineRunning
* setting a very large priority to ES merge jobs
* reset doing datasets to kick updateUnmergedDatasets
* setting hidden metadata to _dis/_sub
* changed AdderAtlas to regard InvalidPath as fatal
* changed TA to ignore clouds with mcshare=0
* added exhausted
* fixed getScriptOfflineRunning for ATLASPANDA-185
* Added ALICE-Titan client scripts under test/alice/
* Added LSST client scripts under test/lsst/
* introduced maxFailuer in JEDI_Dataset_Contents
* changed to use list_dataset_replicas of Rucio API
* added support for valiable number of outputs
* changed updateJobStatus to pin waiting consumers
* fixed to update file status when jobs are timed out when aCT is transferring files
* added localEsMerge
* sorting datasetIDs to avoid dead-lock
* added NOWAIT to updateJobStatus
* fixed reassignTask.py
* setting proper jobDefID when attemptNr>1 as well
* adding NOWAIT to finalizePendingJobs
* improved error message of getScriptOfflineRunning
* fixed ppEventServiceJob not to update modTime for file and jobO
* changed TA to work with mcshare(TW)=0
* added a protection to EP for missing replica metadata
* changed timeout for staring to 48h
* changed getOriginPandaIDs to return only one origin
* changed timeout for starting jobs to 12h
* changed to keep endTime when jobs are killed
* changed to ignore heartbeats when job is in merging
* checking job status in updateEventRange
* using Production Input/Output as subscription activities
* recording throttled into jobs_statuslog
* changed the task brokerage to use negative weight based on missing input size
* fixed propagateResult for pmerge to update T_TASK.total_events
* changed TA to use sites where data is fully or partially available
* removed old machinery to reassign reprocessing jobs
* changed killUnusedEsConsumers to kill running jobs as well
* cleanup in taskBuffer
* added checkInvalidCharacters
* added olderThan to reassignSite
* changed reaper to expired
* cleanup of the brokerage
* fixed reassignSite for options
* using stateChangeTime for heartbeat check of starting jobs
* changed starting jobs not to be updated by subsequent heartbeats
* using panda instead of user account in EP
* removed setReplicaMetaDataAttribute from EP
* added partial finish
* setting None to pre-merged log files when sending ES merge jobs
* added protection to SetupperAtlas against new files copied after JEDI file lookup
* fixed EventPicking to use only complete replicas
* removed constraint with T1 data from TA
* added soft finish
* using ignore_availability when making subscriptions
* making _dis w/o source when missing at T1
* fixed ES retry
* changed not to use pre-merged log files from failed jobs
* changed TA to use old=True for listDatasetReplicas
* sending sourceSite to the pilot
* UnsupportedOperation as fatal
* channged getJob to ignore fairshare for pmerge
* registering LB info to log
* changed for jobName
* added recordRetryHistory in insertNewJob
* filling outPandaID
* using rucio API for file registration
* fixed rebro for jobDef=0
* fixed rebro for defined
* changed TA to take secondary volume into account
* fixed TA for dataset aggregation
* fixed reassignSite
* added increaseRamLimitJEDI
* fixed lockJobsForReassign
* added killUnfinishedJobs
* fixed retryJob for pseudo_input
* fixed cyclic import in panda_config
* fixed for UNDEFINED in jobReport.json
* sending prodDBlocks to the pilot
* changed updateJob to avoid row lock contantation
* setting subJobStatus to cancelled ES jobs
* extracting # of events from json
* fixed getFreeDiskSize in PD2P
* added retry for ES merge when ERR_ESMERGERECOVERABLE
* fixed getScriptOfflineRunning for did
* fixed killJob for ES
* chnaged Setupper for InvalidRSEExpression
* changed Adder to extract important DDM error messages
* setting lifetime to _dis
* added throttled
* changed for originpandaid
* changed event-picking to work with non deterministic URLs
* introduced EventServiceLastUnprocessed
* added reqID
* fixed increaseAttemptNr to increase max attempt for secondary datasets
* fixed to increment nFilesUsed when merging is killed before merge generation
* added protection against orphaned merge jobs
* using rucio api for _dis
* fixed event-picking for rucio
* fixed DDM for unicode
* introduced timeout for starting
* added increaseAttemptNr
* fixed checkRucioDataset
* fixed method emulator in DDM
* changed to work with rucio containers
* cleanup to work without specialHandling=ddm:rucio
* added protection against empty RSE Expression
* using nevents=null for log files
* ReplicaNotFound as a fatal error
* using rucio when backEnd is None
* added protection to AdderAtlas for uncatchable exceptions
* fixed getJob for input log files of ES merge
* moved analysis tape rebro from copyArchive to runRebro
* considering high prio before mcore in the brokerage
* forcing ddmBackEnd=rucio for anal tasks
* changed for maxAttemptES