Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jackhammer CLI #100

Open
dkogue opened this issue Jun 18, 2018 · 33 comments
Open

Jackhammer CLI #100

dkogue opened this issue Jun 18, 2018 · 33 comments

Comments

@dkogue
Copy link

dkogue commented Jun 18, 2018

Please is there a way to interact with jackhammer via CLI.I would like to schedule some scanning job using tools I have in jackhammer. So i want to do this via CLI. Any suggestion please? Thanks in advance.

@kmadhusudhan
Copy link
Contributor

sorry , we do not have CLI version

@dkogue
Copy link
Author

dkogue commented Jun 20, 2018

Thanks for your feedback.
I have added owaps zap but when I scan no alerts is generated. Is there something I am missing in my zap.rb code? Is it possible to see application level logs in jackhammer (for example to see if the zap.rb is generating some error)

Here is my code......
require 'pipeline/tasks/base_task'
require 'pipeline/util'
require 'tempfile'
require 'json'

 #Change class name as scanner name, class name should be in CamelCase  

class Pipeline::Zap < Pipeline::BaseTask
Pipeline::Task.add self
include Pipeline::Util

    def initialize(trigger, tracker)
        super(trigger, tracker)
    @name = 'Zap' #ex: ArachniScanner
    @description = "Zap is a web app security scanner " #example: Arachni Scanner is web app security scanner 
        @stage = :code
        @labels << "code" 
     end
     def run
         # Below line creates scannername.xml tmp file for storing scanner results,change tmp file name with your scanner name  
         @results_file = Tempfile.new(['zap','xml'])
      
         #cd /home/usr/local/bin
         #Dir.chdir '/opt/zaproxy'
         #runsystem('zap-cli', '--zap-path', '/opt/zaproxy start', '--start-options ','-config api.key gnvjdk36eiug4btn2405d7ooi7')
         

         Below line runs the scanner #ex: runsystem(true, "arachni", "#{@trigger.path}","--report-save-path", "#{@afr_path}")

          runsystem(true,"zap-cli","--zap-path","/opt/zaproxy", "start")

          runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7","quick-scan","-s","xss", "sqli","-r","#{@trigger.path}","-l","Informational")
          
          runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7", "report", "-o","xml", "#{@results_file.path}")

          #runsystem(true,'zap-cli', '-v', '--api-key', 'gnvjdk36eiug4btn2405d7ooi7', 'quick-scan','-s','xss', 'sqli', '-r' ,"#{@trigger.path}", '-o', "#{@results_file.path}")
          #runsystem(true, "zap_reporter", "#{report_file.path}","--reporter=xml:outfile=#{@result_xml_path}")


      #parsing results to json
      @results = JSON.parse(File.read("#{@results_file}"))
     end
 def analyze
       
        #if already parser worker is written , please replace Parser section code without comment ,And you can discard rest of lines untill end of method definition 
    #please check your parser worker in $APPLICATION_PATH/web/app/worker. 
     #worker name will be scaner_name_upload_worker.rb ex: arachni_upload_worker.rb 
    ##########################Parser section code##################
      ZapUploadWorker.perform_async(@trigger.scan_id,@result_xml_path)
      #ZapUploadWorker.new.perform(@trigger.scan_id,@results_file.path)
     # Above line upload the results to jackhammer
      
    
     rescue Exception => e
        Pipeline.warn e.message
        Pipeline.warn e.backtrace
     end
ensure
 # FileUtils.rm @results_file #file gets deleted after parsing is done
end
 # Check , if the scanner is installed
def supported?
    unless File.exist?('/opt/zaproxy/zap')
        Pipeline.notify "Install zap-cli: 'pip install --upgrade zapcli'"
        return false
    else
        return true
    end

end

Thanks in advance

@dkogue
Copy link
Author

dkogue commented Jun 22, 2018

@kmadhusudhan @shadsidd @sampathmende
please Team I need your help. I have been trying to add zap to jackhammer the whole week and I have not succeeded. when I ran a scan it shows complete (which is done in a fraction of second) but no alerts show. Any help will be much appreciated.
Question: Is it possible to check from jackhammer level why zap scanner is not generating any alerts or if the scan ran at all?
Thank you all !

@kmadhusudhan
Copy link
Contributor

kmadhusudhan commented Jun 22, 2018

@dkogue

  1. Tool name need to configure from UI and need to enable , please refer Userguide.
  2. After configuring a tool add target and run the scan.
  3. check logs in log/sidekiq.log file , please check wether tool running against scan .
  4. if any error throws by your tool ,it will be logged in log/sidekiq.log or log/scans/[scanid].log, check this file from application root directory

@dkogue
Copy link
Author

dkogue commented Jun 23, 2018

@kmadhusudhan

Thanks for your swift feedback. That perfectly what I did. and my log file in my jackhammer dir is empty.
did you try to add zap yourself? I will keep digging but if you have any idea that can help me please share. Thanks!

@dkogue
Copy link
Author

dkogue commented Jun 24, 2018

@kmadhusudhan @shadsidd
Her is my sidekiq logs. apparently my "dynamic_scan_worker" is failing. I will highly appreciate your help.
Thanks in advance.

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

*** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-06-24T07:39:45.949Z 68 TID-gr1rmquxs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Loading Schedule
2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-06-24T07:39:45.955Z 68 TID-gr1rmquxs INFO: Schedules Loaded
root@dom-VirtualBox:/var/lib/docker/overlay2/9a9e44afe9aa85a91ef4bc14969855211a34f134f210ff5f4227a0190d0b80f9/diff/home/app/log# cat sidekiq.log

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

*** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-06-24T07:39:45.948Z 68 TID-gr1rmquxs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-06-24T07:39:45.949Z 68 TID-gr1rmquxs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Loading Schedule
2018-06-24T07:39:45.951Z 68 TID-gr1rmquxs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-06-24T07:39:45.955Z 68 TID-gr1rmquxs INFO: Schedules Loaded
2018-06-24T07:54:08.164Z 68 TID-gr1swt0hk DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: start
Loading scanner...
2018-06-24T07:54:08.533Z 68 TID-gr1swt0hk DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: fail: 0.369 sec
2018-06-24T07:54:08.534Z 68 TID-gr1swt0hk WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826848.1637225,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826848.1637225}"}
2018-06-24T07:54:08.534Z 68 TID-gr1swt0hk WARN: TypeError: no implicit conversion of nil into String
2018-06-24T07:54:08.534Z 68 TID-gr1swt0hk WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'
/home/app/app/workers/dynamic_scan_worker.rb:82:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
2018-06-24T07:54:36.277Z 68 TID-gr1swt19w DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: start
Loading scanner...
2018-06-24T07:54:36.355Z 68 TID-gr1swt19w DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: fail: 0.078 sec
2018-06-24T07:54:36.357Z 68 TID-gr1swt19w WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826876.2770114,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1529826876.3559597},"jobstr":"{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826876.2770114,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]}"}
2018-06-24T07:54:36.357Z 68 TID-gr1swt19w WARN: TypeError: no implicit conversion of nil into String
2018-06-24T07:54:36.357Z 68 TID-gr1swt19w WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'
/home/app/app/workers/dynamic_scan_worker.rb:82:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
2018-06-24T07:55:39.023Z 68 TID-gr1sc0704 DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: start
Loading scanner...
2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: fail: 0.058 sec
2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 DynamicScanWorker JID-ca05b11ba4ddb09cf2a862f9 INFO: Adding dead DynamicScanWorker job ca05b11ba4ddb09cf2a862f9
2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826939.022467,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1529826939.081275},"jobstr":"{"class":"DynamicScanWorker","args":[7,10],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ca05b11ba4ddb09cf2a862f9","created_at":1529826848.161588,"enqueued_at":1529826939.022467,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1529826848.5338473,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'","/home/app/app/workers/dynamic_scan_worker.rb:82:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1529826876.3559597}"}
2018-06-24T07:55:39.081Z 68 TID-gr1sc0704 WARN: TypeError: no implicit conversion of nil into String
2018-06-24T07:55:39.082Z 68 TID-gr1sc0704 WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in ensure in perform'
/home/app/app/workers/dynamic_scan_worker.rb:82:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-1.0.2/lib/sidekiq-status/server_middleware.rb:50:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'

@kmadhusudhan
Copy link
Contributor

@dkogue
given logs says your tool is not counted for scanning , got to settings=>Scan tools => List tools=>[Scan Type], enable your tool from here and do the rescan

@dkogue
Copy link
Author

dkogue commented Jun 24, 2018

@kmadhusudhan
I have done the same and zap is enable. I don't know why it is not counting the added tool. Any idea what can be the cause? Thanks for all your feedback, much appreciated.

@dkogue
Copy link
Author

dkogue commented Jun 24, 2018

@sampathmende @alex-rad
I seen some of your posts. trying to add zap to jackhammer but with no avail. Your input or advice will be much appreciated. Thanks in advance.

@kmadhusudhan
Copy link
Contributor

kmadhusudhan commented Jun 25, 2018

please run the below commands , lets check if your tool listed . if it is listed please restart sidekiq by running 'bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml'

root@cd881aaaf1f1:/home/app# rails c
Running via Spring preloader in process 12377
Loading production environment (Rails 4.2.7.1)
[1] pry(main)> Setting.pipeline
=> {"npm_registry"=>"https://registry.npmjs.org/",
"tasks_for"=>
{"Ruby"=>"BundleAudit,Brakeman,Dawnscanner",
"JavaScript"=>"NPM,RetireJS,NodeSecurityProject,Snyk",
"CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject,Snyk",
"Java"=>"Xanitizer,FindSecurityBugs,PMD",
"WebScanners"=>"Arachni"},
"pmd_path"=>"/home/app/tools/pmd-bin-5.5.1",
"findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6",
"xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.4",
"truffle_hog_path"=>"/home/app/tools/truffleHog",
"commit_start_date"=>nil,
"commit_end_date"=>nil,
"commits_depth"=>nil,
"enabled_tools"=>"NPM,NodeSecurityProject,RetireJS,Snyk,Brakeman,BundleAudit,Dawnscanner,Arachni,Wpscan,AndroScanner,Nmap,TruffleScanner,Xanitizer",
"checkmarx_server"=>nil,
"checkmarx_user"=>nil,
"checkmarx_password"=>nil,
"checkmarx_log"=>nil}
[2] pry(main)>

@dkogue
Copy link
Author

dkogue commented Jun 25, 2018

@kmadhusudhan
Here is the output. My tool is not listed. Can I add it manually? if yes how please. Thanks.
root@1becc9fa2d77:/home/app# rails c
Running via Spring preloader in process 322
Loading production environment (Rails 4.2.7.1)
[1] pry(main)> Setting.pipeline
=> {"npm_registry"=>"https://registry.npmjs.org/",
"tasks_for"=>
{"Ruby"=>"BundleAudit,Brakeman,Dawnscanner",
"JavaScript"=>"NPM,RetireJS,NodeSecurityProject",
"CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject",
"Java"=>"Xanitizer,FindSecurityBugs,PMD",
"WebScanners"=>"Arachni"},
"pmd_path"=>"/home/app/tools/pmd-bin-5.5.1",
"findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6",
"xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.0",
"truffle_hog_path"=>"/home/app/tools/truffleHog",
"commit_start_date"=>nil,
"commit_end_date"=>nil,
"commits_depth"=>nil,
"enabled_tools"=>
"FindSecurityBugs,NPM,NodeSecurityProject,RetireJS,Brakeman,BundleAudit,Dawnscanner,Arachni,Wpscan,AndroScanner,Nmap,TruffleScanner",
"checkmarx_server"=>nil,
"checkmarx_user"=>nil,
"checkmarx_password"=>nil,
"checkmarx_log"=>nil}
[2] pry(main)>

@dkogue
Copy link
Author

dkogue commented Jun 25, 2018

@kmadhusudhan
I managed to make my too listed as shown bellow, I added zap gem to the Gemifile. But now none of the tools are able to scan. This is very frustrating, please help.

root@d1f6e20245be:/home/app# rails c
Running via Spring preloader in process 594
Loading production environment (Rails 4.2.7.1)
[1] pry(main)> Setting.pipeline
=> {"npm_registry"=>"https://registry.npmjs.org/",
"tasks_for"=>
{"Ruby"=>"BundleAudit,Brakeman,Dawnscanner",
"JavaScript"=>"NPM,RetireJS,NodeSecurityProject",
"CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject",
"Java"=>"Xanitizer,FindSecurityBugs,PMD",
"WebScanners"=>"Arachni"},
"pmd_path"=>"/home/app/tools/pmd-bin-5.5.1",
"findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6",
"xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.0",
"truffle_hog_path"=>"/home/app/tools/truffleHog",
"commit_start_date"=>nil,
"commit_end_date"=>nil,
"commits_depth"=>nil,
"enabled_tools"=>
"FindSecurityBugs,NPM,NodeSecurityProject,RetireJS,Brakeman,BundleAudit,Dawnscanner,Arachni,Wpscan,AndroScanner,Nmap,TruffleScanner,Zap",
"checkmarx_server"=>nil,
"checkmarx_user"=>nil,
"checkmarx_password"=>nil,
"checkmarx_log"=>nil}
[2] pry(main)>


have this error when I run this command:
bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml
root@d1f6e20245be:/home/app# bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml
bundler: command not found: RAILS_ENV=production
Install missing gem executables with bundle install

  1. I bundle install and run again but same error
  2. From which directory should I execute the ' bundle exec RAILS_ENV=production sidekiq -C config/sidekiq.yml' command.

thanks, lets make this work so we can share it with the community. if it is not yet possible to add all tools or zap as I am doing now please let me know. It is consuming a lot of my time.

Thanks.

@kmadhusudhan
Copy link
Contributor

@dkogue
once its listed in the pipeline , Not required to restart sidekiq . Sidekiq worker will pick the the tool automatically . rebuild the jackhammer required when you do any code changes. if the any tool is not working for you i given list of steps to verify in #77

@dkogue
Copy link
Author

dkogue commented Jun 27, 2018

@kmadhusudhan
what do you think can be the cause of the scanner not loading?

@dkogue
Copy link
Author

dkogue commented Jul 1, 2018

I think it is scanning now but there is issue with reporting. below is my log. kindly help to make this work.

2018-07-01T01:12:22.571Z 69 TID-gp65p7y2k DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: start
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x0055b16a1b7dc8
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x0055b16a1b7dc8
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-01T01:12:22.617Z 69 TID-gp65p7y2k DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: fail: 0.047 sec
2018-07-01T01:12:22.618Z 69 TID-gp65p7y2k WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407542.570743,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[5,6],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ad137b807555b4552ce42976\",\"created_at\":1530407542.5703247,\"enqueued_at\":1530407542.570743}"} 2018-07-01T01:12:22.618Z 69 TID-gp65p7y2k WARN: TypeError: no implicit conversion of nil into String 2018-07-01T01:12:22.618Z 69 TID-gp65p7y2k WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'
/home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
_2018-07-01T01:13:02.366Z 69 TID-gp65p7xwg DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: start
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x0055b16997d338
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x0055b16997d338
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-01T01:13:02.408Z 69 TID-gp65p7xwg DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: fail: 0.042 s_ec
2018-07-01T01:13:02.409Z 69 TID-gp65p7xwg WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407582.36445,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530407582.4087877},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[5,6],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"ad137b807555b4552ce42976\",\"created_at\":1530407542.5703247,\"enqueued_at\":1530407582.36445,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530407542.6180234,\"retry_count\":0,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]}"}
2018-07-01T01:13:02.409Z 69 TID-gp65p7xwg WARN: TypeError: no implicit conversion of nil into String
2018-07-01T01:13:02.409Z 69 TID-gp65p7xwg WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread' 2018-07-01T01:13:59.994Z 69 TID-gp6551vho DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: start Loading scanner... Mounting http://testasp.vulnweb.com/Default.asp? with #<Pipeline::URLMounter:0x0055b1672bfe08> Mounted http://testasp.vulnweb.com/Default.asp? with #<Pipeline::URLMounter:0x0055b1672bfe08> Processing target...http://testasp.vulnweb.com/Default.asp? Running tasks in stage: wait Running tasks in stage: mount Running tasks in stage: file Running tasks in stage: code Running tasks in stage: live Running tasks in stage: done Generating report...[:to_s] Running base reoprt... 2018-07-01T01:14:00.045Z 69 TID-gp6551vho DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: fail: 0.051 sec 2018-07-01T01:14:00.045Z 69 TID-gp6551vho DynamicScanWorker JID-ad137b807555b4552ce42976 INFO: Adding dead DynamicScanWorker job ad137b807555b4552ce42976 2018-07-01T01:14:00.046Z 69 TID-gp6551vho WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407639.9941664,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530407640.0457242},"jobstr":"{"class":"DynamicScanWorker","args":[5,6],"retry":2,"queue":"dynamic","backtrace":true,"jid":"ad137b807555b4552ce42976","created_at":1530407542.5703247,"enqueued_at":1530407639.9941664,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530407542.6180234,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'\"],\"retried_at\":1530407582.4087877}"} 2018-07-01T01:14:00.046Z 69 TID-gp6551vho WARN: TypeError: no implicit conversion of nil into String 2018-07-01T01:14:00.046Z 69 TID-gp6551vho WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'
/home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread

@dkogue
Copy link
Author

dkogue commented Jul 1, 2018

I have notice that zap.rb is not mounted in the container tasks directory as shown in below log.

root@lab-VirtualBox:/home/lab/jackhammer/web/app/lib/pipeline/tasks# ls
andro_scanner.rb brakeman.rb findsecbugs.rb nsp.rb snyk.rb zap.rb
arachni.rb bundle-audit.rb nmap.rb pmd.rb truffle_scanner.rb
base_task.rb dawnscanner.rb npm.rb retirejs.rb xanitizer.rb


root@3a436074e18b:/home/app/lib/pipeline/tasks# ls
andro_scanner.rb brakeman.rb findsecbugs.rb nsp.rb snyk.rb
arachni.rb bundle-audit.rb nmap.rb pmd.rb truffle_scanner.rb
base_task.rb dawnscanner.rb npm.rb retirejs.rb xanitizer.rb

@kmadhusudhan
Copy link
Contributor

@dkogue ,
can you please pull 9290131 and rerun the scan , we will get the clear logs .

@dkogue
Copy link
Author

dkogue commented Jul 1, 2018

same log I think. but why my zap.rb is not mounting as indicated in my last comment. thanks for your assistance

6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
2018-07-01T11:25:52.116Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: start
2018-07-01T11:25:52.123Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: start
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe254035c80
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe254035c80
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe268754e08
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe268754e08
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: fail: 0.071 sec
2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: Adding dead DynamicScanWorker job 21caf89fe3d5c11ec17303e6
2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,9],"retry":2,"queue":"dynamic","backtrace":true,"jid":"21caf89fe3d5c11ec17303e6","created_at":1530444287.057154,"enqueued_at":1530444352.1159604,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444287.1016653,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444352.187723},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,9],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"21caf89fe3d5c11ec17303e6\",\"created_at\":1530444287.057154,\"enqueued_at\":1530444352.1159604,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530444287.1016653,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444313.4484363}"}
2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: TypeError: no implicit conversion of nil into String
2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread' 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: fail: 0.066 sec 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: Adding dead DynamicScanWorker job 76521a8eee48dd4782db9eaa 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,8],"retry":2,"queue":"dynamic","backtrace":true,"jid":"76521a8eee48dd4782db9eaa","created_at":1530444245.7496054,"enqueued_at":1530444352.1221764,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444245.803329,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444352.1894608},"jobstr":"{"class":"DynamicScanWorker","args":[7,8],"retry":2,"queue":"dynamic","backtrace":true,"jid":"76521a8eee48dd4782db9eaa","created_at":1530444245.7496054,"enqueued_at":1530444352.1221764,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444245.803329,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'\"],\"retried_at\":1530444293.4157581}"} 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: TypeError: no implicit conversion of nil into String 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'
/home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

*** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-07-01T11:29:03.530Z 70 TID-gq8kzl25c INFO: Loading Schedule
2018-07-01T11:29:03.531Z 70 TID-gq8kzl25c INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-07-01T11:29:03.543Z 70 TID-gq8kzl25c INFO: Schedules Loaded
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Loading Schedule
2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Schedules Loaded
2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Starting processing, hit Ctrl-C to stop
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

*** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Loading Schedule
2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-07-01T13:42:26.784Z 70 TID-gnn8jzjmk INFO: Schedules Loaded
root@3a436074e18b:/home/app/log#
root@3a436074e18b:/home/app/log#
root@3a436074e18b:/home/app/log# > sidekiq.log
root@3a436074e18b:/home/app/log# cat sidekiq.log
root@3a436074e18b:/home/app/log# clear

root@3a436074e18b:/home/app/log# cat sidekiq.log
2018-07-01T13:48:03.414Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: start
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x005579c9e79df0
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x005579c9e79df0
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-01T13:48:03.715Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: fail: 0.302 sec
2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[1,1],"retry":2,"queue":"dynamic","backtrace":true,"jid":"fe056252f93ca0fe10dc7962","created_at":1530452883.4118361,"enqueued_at":1530452883.4134464,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530452883.7158911,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[1,1],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"fe056252f93ca0fe10dc7962\",\"created_at\":1530452883.4118361,\"enqueued_at\":1530452883.4134464}"} 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: TypeError: no implicit conversion of nil into String 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'
/home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
root@3a436074e18b:/home/app/log#

1 similar comment
@dkogue
Copy link
Author

dkogue commented Jul 1, 2018

same log I think. but why my zap.rb is not mounting as indicated in my last comment. thanks for your assistance

6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
2018-07-01T11:25:52.116Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: start
2018-07-01T11:25:52.123Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: start
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe254035c80
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe254035c80
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe268754e08
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x007fe268754e08
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: fail: 0.071 sec
2018-07-01T11:25:52.187Z 69 TID-ox5rehtjw DynamicScanWorker JID-21caf89fe3d5c11ec17303e6 INFO: Adding dead DynamicScanWorker job 21caf89fe3d5c11ec17303e6
2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,9],"retry":2,"queue":"dynamic","backtrace":true,"jid":"21caf89fe3d5c11ec17303e6","created_at":1530444287.057154,"enqueued_at":1530444352.1159604,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444287.1016653,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444352.187723},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[7,9],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"21caf89fe3d5c11ec17303e6\",\"created_at\":1530444287.057154,\"enqueued_at\":1530444352.1159604,\"error_message\":\"no implicit conversion of nil into String\",\"error_class\":\"TypeError\",\"failed_at\":1530444287.1016653,\"retry_count\":1,\"error_backtrace\":[\"/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444313.4484363}"}
2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: TypeError: no implicit conversion of nil into String
2018-07-01T11:25:52.188Z 69 TID-ox5rehtjw WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?' /home/app/app/workers/dynamic_scan_worker.rb:71:in perform'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread' 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: fail: 0.066 sec 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc DynamicScanWorker JID-76521a8eee48dd4782db9eaa INFO: Adding dead DynamicScanWorker job 76521a8eee48dd4782db9eaa 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[7,8],"retry":2,"queue":"dynamic","backtrace":true,"jid":"76521a8eee48dd4782db9eaa","created_at":1530444245.7496054,"enqueued_at":1530444352.1221764,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444245.803329,"retry_count":2,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"],"retried_at":1530444352.1894608},"jobstr":"{"class":"DynamicScanWorker","args":[7,8],"retry":2,"queue":"dynamic","backtrace":true,"jid":"76521a8eee48dd4782db9eaa","created_at":1530444245.7496054,"enqueued_at":1530444352.1221764,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530444245.803329,"retry_count":1,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'\",\"/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'\",\"/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'\"],\"retried_at\":1530444293.4157581}"} 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: TypeError: no implicit conversion of nil into String 2018-07-01T11:25:52.189Z 69 TID-gp655dwgc WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'
/home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

*** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-07-01T11:29:03.528Z 70 TID-gq8kzl25c INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-07-01T11:29:03.530Z 70 TID-gq8kzl25c INFO: Loading Schedule
2018-07-01T11:29:03.531Z 70 TID-gq8kzl25c INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-07-01T11:29:03.543Z 70 TID-gq8kzl25c INFO: Schedules Loaded
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-07-01T11:52:15.751Z 379 TID-gnl66qcrs INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Loading Schedule
2018-07-01T11:52:15.754Z 379 TID-gnl66qcrs INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Schedules Loaded
2018-07-01T11:52:15.756Z 379 TID-gnl66qcrs INFO: Starting processing, hit Ctrl-C to stop
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION

*** Mocha deprecation warning: Change require 'mocha' to require 'mocha/setup'.

*** Mocha deprecation warning: Test::Unit or MiniTest must be loaded before Mocha.

*** Mocha deprecation warning: If you're integrating with a test library other than Test::Unit or MiniTest, you should use require 'mocha/api' instead of require 'mocha'.

2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Running in ruby 2.3.0p0 (2015-12-25 revision 53290) [x86_64-linux]
2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: See LICENSE and the LGPL-3.0 for licensing details.
2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org
2018-07-01T13:42:26.768Z 70 TID-gnn8jzjmk INFO: Booting Sidekiq 4.2.10 with redis options {:url=>"redis://redis:6379"}
2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Loading Schedule
2018-07-01T13:42:26.771Z 70 TID-gnn8jzjmk INFO: Scheduling scanner_scheduler {"every"=>"1d", "class"=>"SchedulerScanner", "queue"=>"default"}
2018-07-01T13:42:26.784Z 70 TID-gnn8jzjmk INFO: Schedules Loaded
root@3a436074e18b:/home/app/log#
root@3a436074e18b:/home/app/log#
root@3a436074e18b:/home/app/log# > sidekiq.log
root@3a436074e18b:/home/app/log# cat sidekiq.log
root@3a436074e18b:/home/app/log# clear

root@3a436074e18b:/home/app/log# cat sidekiq.log
2018-07-01T13:48:03.414Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: start
Loading scanner...
Mounting http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x005579c9e79df0
Mounted http://testasp.vulnweb.com/Default.asp? with #Pipeline::URLMounter:0x005579c9e79df0
Processing target...http://testasp.vulnweb.com/Default.asp?
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-01T13:48:03.715Z 70 TID-gnn9txwfk DynamicScanWorker JID-fe056252f93ca0fe10dc7962 INFO: fail: 0.302 sec
2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: {"context":"Job raised exception","job":{"class":"DynamicScanWorker","args":[1,1],"retry":2,"queue":"dynamic","backtrace":true,"jid":"fe056252f93ca0fe10dc7962","created_at":1530452883.4118361,"enqueued_at":1530452883.4134464,"error_message":"no implicit conversion of nil into String","error_class":"TypeError","failed_at":1530452883.7158911,"retry_count":0,"error_backtrace":["/home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'","/home/app/app/workers/dynamic_scan_worker.rb:71:in perform'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in <module:Sidekiq>'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in module:Sidekiq'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog'","/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'"]},"jobstr":"{\"class\":\"DynamicScanWorker\",\"args\":[1,1],\"retry\":2,\"queue\":\"dynamic\",\"backtrace\":true,\"jid\":\"fe056252f93ca0fe10dc7962\",\"created_at\":1530452883.4118361,\"enqueued_at\":1530452883.4134464}"} 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: TypeError: no implicit conversion of nil into String 2018-07-01T13:48:03.716Z 70 TID-gnn9txwfk WARN: /home/app/app/workers/dynamic_scan_worker.rb:71:in exist?'
/home/app/app/workers/dynamic_scan_worker.rb:71:in perform' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:167:in execute_job'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:139:in block (5 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:36:in block in module:Sidekiq'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:135:in block (4 levels) in process' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:128:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-status-0.7.0/lib/sidekiq-status/server_middleware.rb:37:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/active_record.rb:6:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-middleware-0.3.0/lib/sidekiq-middleware/server/unique_jobs.rb:18:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-statistic-1.2.0/lib/sidekiq/statistic/middleware.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/server/logging.rb:10:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-retries-0.4.0/lib/sidekiq/retries/server/middleware.rb:15:in call' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:130:in block in invoke'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/middleware/chain.rb:133:in invoke' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:134:in block (3 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/logging.rb:32:in with_context' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:132:in block (2 levels) in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:183:in stats' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:131:in block in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq.rb:35:in block in <module:Sidekiq>' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:126:in process'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:82:in process_one' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/processor.rb:70:in run'
/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:17:in watchdog' /root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/sidekiq-4.2.10/lib/sidekiq/util.rb:26:in block in safe_thread'
root@3a436074e18b:/home/app/log#

@dkogue dkogue closed this as completed Jul 1, 2018
@dkogue dkogue reopened this Jul 1, 2018
@dkogue
Copy link
Author

dkogue commented Jul 1, 2018

@kmadhusudhan
Normally Zap should have been in the WebServer listed tools right? is that mean is still not counted ? Please help I want to make it work but need your help since you are the developer. Thanks in advance.

{"npm_registry"=>"https://registry.npmjs.org/",
"tasks_for"=>
{"Ruby"=>"BundleAudit,Brakeman,Dawnscanner",
"JavaScript"=>"NPM,RetireJS,NodeSecurityProject",
"CoffeeScript"=>"NPM,RetireJS,NodeSecurityProject",
"Java"=>"Xanitizer,FindSecurityBugs,PMD",
"WebScanners"=>"Arachni"},
"pmd_path"=>"/home/app/tools/pmd-bin-5.5.1",
"findsecbugs_path"=>"/home/app/tools/findsecbugs-cli-1.4.6",
"xanitizer_path"=>"/home/app/tools/Xanitizer-3.1.0",
"truffle_hog_path"=>"/home/app/tools/truffleHog",
"commit_start_date"=>nil,
"commit_end_date"=>nil,
"commits_depth"=>nil,
"enabled_tools"=>
"FindSecurityBugs,NPM,NodeSecurityProject,RetireJS,Brakeman,BundleAudit,Dawnscanner,Wpscan,AndroScanner,Nmap,TruffleScanner,Zap",
"checkmarx_server"=>nil,
"checkmarx_user"=>nil,
"checkmarx_password"=>nil,
"checkmarx_log"=>nil}

@dkogue
Copy link
Author

dkogue commented Jul 1, 2018

@kmadhusudhan @zee7han Further log from the scans directory. Please assist. Thanks in advance.

root@ccbdb44aff92:/home/app/log/scans# cat 5.log
Error occurred while running dynamicscan ...["/home/app/lib/pipeline/tasks/zap.rb:10:in <class:Zap>'", "/home/app/lib/pipeline/tasks/zap.rb:9:in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:122:in block in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:121:in each'", "/home/app/lib/pipeline/tasks.rb:121:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline/scanner.rb:3:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:238:in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:in run'", "/home/app/app/workers/dynamic_scan_worker.rb:42:in block (2 levels) in perform'"] sending notification mail..for scan id.5 Error occurred while running dynamicscan ...["/home/app/lib/pipeline/tasks/zap.rb:10:in class:Zap'", "/home/app/lib/pipeline/tasks/zap.rb:9:in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:122:in block in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:121:in each'", "/home/app/lib/pipeline/tasks.rb:121:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline/scanner.rb:3:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:238:in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:in run'", "/home/app/app/workers/dynamic_scan_worker.rb:42:in block (2 levels) in perform'"]
sending notification mail..for scan id.5
Error occurred while running dynamicscan ...["/home/app/lib/pipeline/tasks/zap.rb:10:in <class:Zap>'", "/home/app/lib/pipeline/tasks/zap.rb:9:in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:122:in block in <top (required)>'", "/home/app/lib/pipeline/tasks.rb:121:in each'", "/home/app/lib/pipeline/tasks.rb:121:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline/scanner.rb:3:in <top (required)>'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:238:in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:in run'", "/home/app/app/workers/dynamic_scan_worker.rb:42:in `block (2 levels) in perform'"]
sending notification mail..for scan id.5

@kmadhusudhan
Copy link
Contributor

kmadhusudhan commented Jul 2, 2018

i could see there is a syntax error in zap.rb at line 10 . And also in run method "Below line runs the scanner " need be comment , this is not a ruby syntax

def run
# Below line creates scannername.xml tmp file for storing scanner results,change tmp file name with your scanner name
@results_file = Tempfile.new(['zap','xml'])

     #cd /home/usr/local/bin
     #Dir.chdir '/opt/zaproxy'
     #runsystem('zap-cli', '--zap-path', '/opt/zaproxy start', '--start-options ','-config api.key gnvjdk36eiug4btn2405d7ooi7')
     

     Below line runs the scanner #ex: runsystem(true, "arachni", "#{@trigger.path}","--report-save-path", "#{@afr_path}")

      runsystem(true,"zap-cli","--zap-path","/opt/zaproxy", "start")

      runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7","quick-scan","-s","xss", "sqli","-r","#{@trigger.path}","-l","Informational")
      
      runsystem(true,"zap-cli","--api-key","gnvjdk36eiug4btn2405d7ooi7", "report", "-o","xml", "#{@results_file.path}")

      #runsystem(true,'zap-cli', '-v', '--api-key', 'gnvjdk36eiug4btn2405d7ooi7', 'quick-scan','-s','xss', 'sqli', '-r' ,"#{@trigger.path}", '-o', "#{@results_file.path}")
      #runsystem(true, "zap_reporter", "#{report_file.path}","--reporter=xml:outfile=#{@result_xml_path}")


  #parsing results to json
  @results = JSON.parse(File.read("#{@results_file}"))
 end `

@dkogue
Copy link
Author

dkogue commented Jul 2, 2018

@kmadhusudhan

thanks for your feedback. kindly find below my current scans log. dynamic_scan_worker sames not to work. We are almost there I think :)

root@ccbdb44aff92:/home/app/log/scans# cat 7.log
Error occurred while running dynamicscan ...["/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:246:in rescue in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:237:in scan'", "/root/.rbenv/versions/2.3.0/lib/ruby/gems/2.3.0/gems/owasp-pipeline-0.8.7/lib/pipeline.rb:45:in run'", "/home/app/app/workers/dynamic_scan_worker.rb:42:in block (2 levels) in perform'"]
sending notification mail..for scan id.7

@kmadhusudhan
Copy link
Contributor

kmadhusudhan commented Jul 2, 2018

i could see some error thrown by pipeline.rb, runsystem method is defined inside pipeline . can you please run the each line from run method in rails console and figure out where is the issue . i think zap-cli is not installed inside docker
runsystem(true,"zap-cli","--zap-path","/opt/zaproxy", "start") , it will convert to shell command

@dkogue
Copy link
Author

dkogue commented Jul 2, 2018

@kmadhusudhan
Ok I will check that right way. also I think the update on dynamic_scan_worker.rb is not working well because arachni which used to run is not running anymore

@dkogue
Copy link
Author

dkogue commented Jul 2, 2018

@kmadhusudhan
So I have cleaned everything and cloned jackhammer. A web scan with arachni came out successful with 6 informational alerts. But when I look at the sidekiq log I have noticed that DynamicScanWorker failed as well but still scan completed. I am saying this because I was having the same error when I added Zap, only that it didnt present any alert. May be there is a problem with DynamicScanWorker that we need to fix.

I also noticed that when I restart the sidekiq, even arachni doesnt not provide any result.
2018-07-02T22:59:58.050Z 69 TID-gtiua2h8k DynamicScanWorker JID-4e3c3da9c3a3942bedb199b5 INFO: start
Loading scanner...
Mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x007fbf28177c28
Mounted https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x007fbf28177c28
Processing target...https://prdpc02lu.paycash.eu/login?lang=en
Running tasks in stage: wait
Running tasks in stage: mount
Running tasks in stage: file
Running tasks in stage: code
code - Arachni - #Set:0x007fbf3803b520
Running tasks in stage: live
Running tasks in stage: done
Generating report...[:to_s]
Running base reoprt...
2018-07-02T23:00:38.188Z 69 TID-gtiua2h8k DynamicScanWorker JID-4e3c3da9c3a3942bedb199b5 INFO: fail: 40.139 sec
2018-07-02T23:00:38.189Z 69 TID-gtiua2h8k DynamicScanWorker JID-4e3c3da9c3a3942bedb199b5 INFO: Adding dead DynamicScanWorker job 4e3c3da9c3a3942bedb199b5

@dkogue
Copy link
Author

dkogue commented Jul 3, 2018

@kmadhusudhan @shadsidd
Here is my latest progress. log after scanning. I will fill paste my code and then the log. Thanks for your support .

Issue: Scan complete without any alerts
Observation: after the Running tasks in stage: code the zap instance need to run but I am not sure if it is running.

***Zap.rb code
require 'pipeline/tasks/base_task'
require 'pipeline/util'
require 'tempfile'
require 'json'

#Change class name as scanner name, class name should be in CamelCase

class Pipeline::Zap < Pipeline::BaseTask
Pipeline::Tasks.add self
include Pipeline::Util

def initialize(trigger, tracker)
    super(trigger, tracker)
@name = 'Zap' #ex: ArachniScanner
@description = "Zap is a web app security scanner " #example: Arachni Scanner is web app security scanner 
    @stage = :code
    @labels << "code" 
 end
 def run
     # Below line creates scannername.xml tmp file for storing scanner results,change tmp file name with your scanner name  
     @results_file = Tempfile.new(['zap','xml'])
  
     #cd /home/usr/local/bin
     #Dir.chdir '/opt/zaproxy'
     #runsystem('zap-cli', '--zap-path', '/opt/zaproxy start', '--start-options ','-config api.key gnvjdk36eiug4btn2405d7ooi7')
     

     #Below line runs the scanner #ex: runsystem(true, "arachni", "#{@trigger.path}","--report-save-path", "#{@afr_path}")

      runsystem(true,"zap-cli","--zap-path","/home/app/ZAP_2.7.0", "start", "--start-options" ,'-config api.disablekey=true')

      runsystem(true,"zap-cli","quick-scan","-s","xss", "sqli","-r","#{@trigger.path}","-l","Informational")
      
      runsystem(true,"zap-cli", "report", "-o","xml", "#{@results_file.path}")

      #runsystem(true,'zap-cli', '-v', '--api-key', 'gnvjdk36eiug4btn2405d7ooi7', 'quick-scan','-s','xss', 'sqli', '-r' ,"#{@trigger.path}", '-o', "#{@results_file.path}")
      #runsystem(true, "zap_reporter", "#{report_file.path}","--reporter=xml:outfile=#{@result_xml_path}")

  #parsing results to json
  @results = JSON.parse(File.read("#{@results_file}"))
 end

def analyze
#if already parser worker is written , please replace Parser section code without comment ,And you can discard rest of lines untill end of method definition
#please check your parser worker in $APPLICATION_PATH/web/app/worker.
#worker name will be scaner_name_upload_worker.rb ex: arachni_upload_worker.rb
##########################Parser section code##################
#ZapUploadWorker.perform_async(@trigger.scan_id,@result_xml_path)
ZapUploadWorker.new.perform(@trigger.scan_id,@results_file.path)
# Above line upload the results to jackhammer

 rescue Exception => e
    Pipeline.warn e.message
    Pipeline.warn e.backtrace
 end

ensure
#FileUtils.rm @results_file #file gets deleted after parsing is done
end

Check , if the scanner is installed

def supported?
unless File.exist?('/home/app/ZAP_2.7.0')
Pipeline.notify "Install zap-cli: 'pip install --upgrade zapcli'"
return false
else
return true
end

end

Scans log*

root@417f9b0dccf0:/home/app/log/scans# cat 6.log
[2018-07-03 08:18:04 +0000] Loading scanner...
[2018-07-03 08:18:04 +0000] Mounting ... https://prdpc02lu.paycash.eu/login?lang=en
[2018-07-03 08:18:04 +0000] Mounting target: https://prdpc02lu.paycash.eu/login?lang=en
[2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::DockerMounter:0x0055bd7c3d5948
[2018-07-03 08:18:04 +0000] In Docker mounter, target: https://prdpc02lu.paycash.eu/login?lang=en became: lang=en ... wondering if it matched .docker
[2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::FileSystemMounter:0x0055bd7c3d5038
[2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::GitMounter:0x0055bd7c3d4cf0
[2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::IPMounter:0x0055bd7c3d46d8
[2018-07-03 08:18:04 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x0055bd7c3d41b0
[2018-07-03 08:18:04 +0000] Mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x0055bd7c3d41b0
[2018-07-03 08:18:04 +0000] Mounted https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x0055bd7c3d41b0
[2018-07-03 08:18:04 +0000] Processing target...https://prdpc02lu.paycash.eu/login?lang=en
[2018-07-03 08:18:04 +0000] Running tasks in stage: wait
[2018-07-03 08:18:04 +0000] Running tasks in stage: mount
[2018-07-03 08:18:04 +0000] Running tasks in stage: file
[2018-07-03 08:18:04 +0000] Running tasks in stage: code
[2018-07-03 08:18:04 +0000] Running tasks in stage: live
[2018-07-03 08:18:04 +0000] Running tasks in stage: done
[2018-07-03 08:18:04 +0000] Have 0 items pre ZAP filter.
[2018-07-03 08:18:04 +0000] Have 0 items post ZAP filter.
[2018-07-03 08:18:04 +0000] Generating report...[:to_s]
[2018-07-03 08:18:04 +0000] Running base reoprt...
sending notification mail..for scan id.6
[2018-07-03 08:18:46 +0000] Loading scanner...
[2018-07-03 08:18:46 +0000] Mounting ... https://prdpc02lu.paycash.eu/login?lang=en
[2018-07-03 08:18:46 +0000] Mounting target: https://prdpc02lu.paycash.eu/login?lang=en
[2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::DockerMounter:0x0055bd7ca6ac40
[2018-07-03 08:18:46 +0000] In Docker mounter, target: https://prdpc02lu.paycash.eu/login?lang=en became: lang=en ... wondering if it matched .docker
[2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::FileSystemMounter:0x0055bd7ca6a218
[2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::GitMounter:0x0055bd7ca69ca0
[2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::IPMounter:0x0055bd7ca697c8
[2018-07-03 08:18:46 +0000] Checking about mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x0055bd7ca68dc8
[2018-07-03 08:18:46 +0000] Mounting https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x0055bd7ca68dc8
[2018-07-03 08:18:46 +0000] Mounted https://prdpc02lu.paycash.eu/login?lang=en with #Pipeline::URLMounter:0x0055bd7ca68dc8
[2018-07-03 08:18:46 +0000] Processing target...https://prdpc02lu.paycash.eu/login?lang=en
[2018-07-03 08:18:46 +0000] Running tasks in stage: wait
[2018-07-03 08:18:46 +0000] Running tasks in stage: mount
[2018-07-03 08:18:46 +0000] Running tasks in stage: file
[2018-07-03 08:18:46 +0000] Running tasks in stage: code
[2018-07-03 08:18:46 +0000] Running tasks in stage: live
[2018-07-03 08:18:46 +0000] Running tasks in stage: done
[2018-07-03 08:18:46 +0000] Have 0 items pre ZAP filter.
[2018-07-03 08:18:46 +0000] Have 0 items post ZAP filter.
[2018-07-03 08:18:46 +0000] Generating report...[:to_s]
[2018-07-03 08:18:46 +0000] Running base reoprt...

@dkogue
Copy link
Author

dkogue commented Jul 4, 2018

@kmadhusudhan
I will appreciate your feedback on the above log please.
Also do think we can integrate SSlzye to jackhammer. wondering how we present the alert though. Any ideas from you will be appreciated.
Thank you for your assistance through out.

@dkogue
Copy link
Author

dkogue commented Jul 4, 2018

I had indicated this earlier, why default scans (Arachni, nmap) work for sometime and then after do not work when scan. the data base is very slow. same dynamicscan error message for all scan.

This is really, really frustrating. Even the demo site has some scans pending for days. giving up....

@wheelq
Copy link

wheelq commented Apr 11, 2019

Is the CLI still not supported?
Is there any wrapper available?

@rgplvr
Copy link
Contributor

rgplvr commented Apr 11, 2019 via email

@wheelq
Copy link

wheelq commented Apr 11, 2019

thank you

@rgplvr
Copy link
Contributor

rgplvr commented Apr 12, 2019 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants