RPM Probes and data collection via SSH / netconf #232

bodleytunes · 2018-08-02T10:25:46Z

Hi

Seems to be failing to scrape any data from the vMX router regarding RPM probes.

Can see messages in the logs that opennti is connecting on port 22 then nothing is happening, as a result the python script is seeing no returned data from the initial "show version"

Aug  2 09:57:02   inetd[7754]: /usr/sbin/sshd[84038]: exited, status 255
Aug  2 09:57:02   sshd[84039]: Accepted password for jon from 10.55.89.10 port 42306 ssh2
Aug  2 09:58:02   sshd[84403]: Did not receive identification string from 10.55.89.10

root@opennti-vm:/home/jon/open-nti# make cron-debug
docker exec -i -t opennti_con /usr/bin/python /opt/open-nti/open-nti.py -s -c
Importing credentials file: /opt/open-nti/data/credentials.yaml 
Importing host file: /opt/open-nti/data/hosts.yaml 
Importing commands file: /opt/open-nti/data/commands.yaml 
Importing junos parsers file: ['show-route-summary.parser.yaml', 'file-list-detail-var-rundb-juniper.eph_iceaaa.parser.yaml', 'show-firewall.parser.yaml', 'show-task-memory.parser.yaml', 'show-services-l2tp-summary.parser.yaml', 'show-bgp-summary.parser.yaml', 'show-route-summary.table.bgp.l3vpn.0.parser.yaml', 'show-pfe-statistics-traffic.parser.yaml', 'show-chassis-routing-engine.parser.yaml', 'show-network-access-aaa-radius-servers-detail.parser.yaml', 'show-mpls-lsp.parser.yaml', 'show-route-summary.table.inet.0.parser.yaml', 'show-route-summary.table.l2circuit.0.parser.yaml', 'show-isis-statistics.parser.yaml', 'show-services-stateful-firewall-flow-analysis.parser.yaml', 'show-snmp-get-jnxOperatingCPU-RE.yaml', 'show-krt-state.parser.yaml', 'show-chassis-fpc.parser.yaml', 'show-subscribers-summary.parser.yaml', 'show-system-configuration-database-usage.parser.yaml', 'show-snmp-statistics.parser.yaml', 'show-interfaces-media.parser.yaml', 'show-route-summary.table.inet.3.parser.yaml', 'show-ldp-traffic-statistics.parser.yaml', 'show-services-rpm-probe-results.parser.yaml', 'show-snmp-get-jnxOperatingCPU-FPC.yaml', 'show-system-buffers.parser.yaml', 'show-system-core-dumps.parser.yaml', 'show-task-io.parser.yaml', 'show-pppoe-statistics.parser.yaml', 'show-version.parser.yaml', 'show-system-storage.parser.yaml', 'show-services-nat-pool-detail.parser.yaml', 'show-security-ipsec-statistics.parser.yaml', 'show-system-virtual-memory.parser.yaml', 'show-lwaftr-statistics.parser.yaml', 'show-services-stateful-firewall-subscriber-analysis.parser.yaml', 'show-route-summary.table.inet6.0.parser.yaml', 'show-system-resource-monitor-summary.parser.yaml', 'show-bfd-session-summary.parser.yaml', 'show-subscribers-summary-port.parser.yaml', 'show-policer-default-arp-policer.parser.yaml', 'show-l2-learning-global-mac-count.parser.yaml', 'show-services-video-monitoring-mdi-flow-fpc-slot-1.parser.yaml', 'show-system-statistics-icmp.parser.yaml', 'show-task-accounting.parser.yaml', 'show-lwaftr-state.parser.yaml', 'show-ddos-protection-protocols-statistics-terse.parser.yaml', 'show-system-processes-extensive.parser.yaml', 'show-bgp-neighbor-10.255.0.206.parser.yaml', 'show-igmp-snooping-statistics.parser.yaml', 'show-network-access-aaa-statistics-address-assignment-pool.parser.yaml', 'rtsockmon.parser.yaml'] 
Importing pfe parsers file: ['.gitignore'] 
Getting hosts that matches the specified tags
The following hosts are being selected:  ['10.100.103.100']
Collector Thread-1 scheduled with following hosts: ['10.100.103.100']
Connecting to host: 10.100.103.100
[10.100.103.100]: Executing command: show version | display xml
[10.100.103.100]: Parsing command: show version | display xml
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/opt/open-nti/open-nti.py", line 573, in collector
    hostname_tmp = xml_data.xpath(hostname_xpth)[0].text.strip()
AttributeError: 'NoneType' object has no attribute 'strip'

Any ideas why its not seemingly logging in and running the commands properly?

Cheers!
Jon.

The text was updated successfully, but these errors were encountered:

psagrera · 2018-08-02T15:47:27Z

What platform and junos versin are you using in your setup ?

Could you please paste here the output of show version | display xml ?

Regards

Pablo

bodleytunes · 2018-08-02T23:08:10Z

vMX 18.2 Trial Version will paste show version tomorrow

…

On Thu, 2 Aug 2018 at 16:48 psagrera ***@***.***> wrote: What platform and junos versin are you using in your setup ? Could you please paste here the output of show version | display xml ? Regards Pablo — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#232 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAly5y2AuBC2Ogje-EOBHh5KQQye-UbRks5uMx9ngaJpZM4VsBtx> .

bodleytunes · 2018-08-03T07:58:57Z

Here is show version:

FreeBSD/amd64 (Amnesiac) (ttyu0)

login: root
Password:
Last login: Wed Aug  1 18:11:58 from 10.55.89.10

--- JUNOS 18.2R1.9 Kernel 64-bit  JNPR-11.0-20180614.6c3f819_buil
At least one package installed on this device has limited support.
Run 'file show /etc/notices/unsupported.txt' for details.
root@:~ # cli
{master}
root> show version | display xml 
<rpc-reply xmlns:junos="http://xml.juniper.net/junos/18.2R1/junos">
    <software-information>
        <host-name></host-name>
        <product-model>vmx</product-model>
        <product-name>vmx</product-name>
        <junos-version>18.2R1.9</junos-version>
        <package-information>
            <name>os-kernel</name>
            <comment>JUNOS OS Kernel 64-bit  [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>os-libs</name>
            <comment>JUNOS OS libs [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>os-runtime</name>
            <comment>JUNOS OS runtime [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>zoneinfo</name>
            <comment>JUNOS OS time zone information [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>netstack</name>
            <comment>JUNOS network stack and utilities [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-libs</name>
            <comment>JUNOS libs [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>os-libs-compat32</name>
            <comment>JUNOS OS libs compat32 [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>os-compat32</name>
            <comment>JUNOS OS 32-bit compatibility [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>junos-libs-compat32</name>
            <comment>JUNOS libs compat32 [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-runtime</name>
            <comment>JUNOS runtime [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>vmguest</name>
            <comment>JUNOS Packet Forwarding Engine Simulation Package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>sflow-platform</name>
            <comment>JUNOS sflow mx [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>py-extensions</name>
            <comment>JUNOS py extensions [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>          
        <package-information>
            <name>py-base</name>
            <comment>JUNOS py base [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>os-vmguest</name>
            <comment>JUNOS OS vmguest [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>os-crypto</name>
            <comment>JUNOS OS crypto [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
        <package-information>
            <name>na-telemetry</name>
            <comment>JUNOS na telemetry [18.2R1.9-C1]</comment>
        </package-information>
        <package-information>
            <name>junos-libs-compat32-platform</name>
            <comment>JUNOS mx libs compat32 [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-runtime-platform</name>
            <comment>JUNOS mx runtime [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-platform</name>
            <comment>JUNOS common platform support [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-openconfig</name>
            <comment>JUNOS Openconfig [0.0.0.10]</comment>
        </package-information>
        <package-information>
            <name>junos-net-platform</name>
            <comment>JUNOS mtx network modules [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-modules</name>  
            <comment>JUNOS modules [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-modules-platform</name>
            <comment>JUNOS mx modules [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-libs-platform</name>
            <comment>JUNOS mx libs [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-dp-crypto-support-platform</name>
            <comment>JUNOS mtx Data Plane Crypto Support [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>junos-daemons</name>
            <comment>JUNOS daemons [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>          
        <package-information>
            <name>junos-daemons-platform</name>
            <comment>JUNOS mx daemons [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jsim-wrlinux</name>
            <comment>JUNOS Simulation Linux Package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jsim-pfe-vmx</name>
            <comment>JUNOS Simulation Package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-urlf</name>
            <comment>JUNOS Services URL Filter package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-traffic-dird</name>
            <comment>JUNOS Services TLB Service PIC package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-telemetry</name>
            <comment>JUNOS Services Telemetry [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-ssl</name>
            <comment>JUNOS Services SSL [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-softwire</name>
            <comment>JUNOS Services SOFTWIRE [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-sfw</name>
            <comment>JUNOS Services Stateful Firewall [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>           
            <name>jservices-rpm</name>
            <comment>JUNOS Services RPM [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-pcef</name>
            <comment>JUNOS Services PCEF package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-nat</name>
            <comment>JUNOS Services NAT [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-mss</name>
            <comment>JUNOS Services Mobile Subscriber Service Container package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-mobile</name>
            <comment>JUNOS Services MobileNext Software package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-lrf</name>
            <comment>JUNOS Services Logging Report Framework package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-llpdf</name>
            <comment>JUNOS Services LL-PDF Container package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-jflow</name>
            <comment>JUNOS Services Jflow Container package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-jdpi</name>
            <comment>JUNOS Services Deep Packet Inspection package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>           
            <name>jservices-ipsec</name>
            <comment>JUNOS Services IPSec [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-ids</name>
            <comment>JUNOS Services IDS [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-idp</name>
            <comment>JUNOS IDP Services [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-hcm</name>
            <comment>JUNOS Services HTTP Content Management package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-fwdd</name>
            <comment>JUNOS Services Flowd MS-MPC Software package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-crypto-base</name>
            <comment>JUNOS Services Crypto [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-cpcd</name>
            <comment>JUNOS Services Captive Portal and Content Delivery Container package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-cos</name>
            <comment>JUNOS Services COS [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-appid</name>
            <comment>JUNOS AppId Services [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>           
            <name>jservices-alg</name>
            <comment>JUNOS Services Application Level Gateways [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jservices-aacl</name>
            <comment>JUNOS Services AACL Container package [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jsd-jet-1</name>
            <comment>JUNOS Extension Toolkit [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jinsight</name>
            <comment>JUNOS J-Insight [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jdocs</name>
            <comment>JUNOS Online Documentation [20180628.003405_builder_junos_182_r1]</comment>
        </package-information>
        <package-information>
            <name>jail-runtime</name>
            <comment>JUNOS jail runtime [20180614.6c3f819_builder_stable_11]</comment>
        </package-information>
    </software-information>
    <cli>
        <banner>{master}</banner>
    </cli>
</rpc-reply>

{master}
root>

3fr61n · 2018-08-03T08:30:58Z

Hi, Just to test... could you please add a hostname to the vmx?
regards

bodleytunes · 2018-08-03T09:02:01Z

working now but I've rebuilt everything so not sure what the fix was. :(

Could very well been the lack of hostname.

3fr61n · 2018-08-03T09:10:38Z

The strip function with ‘null’ string

…

Sent from my iPhone

On 3 Aug 2018, at 11:02, Jon Clayton ***@***.***> wrote: working now but I've rebuilt everything so not sure what the fix was. :( Could very well been the lack of hostname. — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

bodleytunes · 2018-08-03T15:49:59Z

So fix was to add a hostname to router, otherwise throws exception if there is not one, makes perfect sense!

bodleytunes closed this as completed Aug 3, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RPM Probes and data collection via SSH / netconf #232

RPM Probes and data collection via SSH / netconf #232

bodleytunes commented Aug 2, 2018 •

edited

Loading

psagrera commented Aug 2, 2018

bodleytunes commented Aug 2, 2018 via email

bodleytunes commented Aug 3, 2018

3fr61n commented Aug 3, 2018

bodleytunes commented Aug 3, 2018

3fr61n commented Aug 3, 2018 via email

bodleytunes commented Aug 3, 2018

RPM Probes and data collection via SSH / netconf #232

RPM Probes and data collection via SSH / netconf #232

Comments

bodleytunes commented Aug 2, 2018 • edited Loading

psagrera commented Aug 2, 2018

bodleytunes commented Aug 2, 2018 via email

bodleytunes commented Aug 3, 2018

3fr61n commented Aug 3, 2018

bodleytunes commented Aug 3, 2018

3fr61n commented Aug 3, 2018 via email

bodleytunes commented Aug 3, 2018

bodleytunes commented Aug 2, 2018 •

edited

Loading