An error can be observed during parallel compilation of net-snmp.

[JiangHeng12138]

when i use make -j32 to compile net-snmp，Sometimes the following errors occur：

[  185s] libtool: link: ar cru .libs/libnetsnmpmibs.a  mibgroup/ip-mib/ipAddressPrefixTable/ipAddressPrefixTable.o mibgroup/ip-mib/ipDefaultRouterTable/ipDefaultRouterTable.o mibgroup/mibII/mta_sendmail.o mibgroup/ucd-snmp/diskio.o mibgroup/ucd-snmp/lmsensorsMib.o mibgroup/host/hrh_storage.o mibgroup/host/hrh_filesys.o mibgroup/host/hrSWInstalledTable.o mibgroup/host/hrSWRunTable.o mibgroup/host/hr_system.o mibgroup/host/hr_device.o mibgroup/host/hr_other.o mibgroup/host/hr_proc.o mibgroup/host/hr_network.o mibgroup/host/hr_print.o mibgroup/host/hr_disk.o mibgroup/host/hr_partition.o mibgroup/ip-mib/ipAddressTable/ipAddressTable.o mibgroup/ip-mib/ipAddressPrefixTable/ipAddressPrefixTable_interface.o mibgroup/ip-mib/ipAddressPrefixTable/ipAddressPrefixTable_data_access.o mibgroup/ip-mib/ipDefaultRouterTable/ipDefaultRouterTable_interface.o mibgroup/ip-mib/ipDefaultRouterTable/ipDefaultRouterTable_data_access.o mibgroup/ip-mib/ipDefaultRouterTable/ipDefaultRouterTable_data_get.o mibgroup/ip-mib/ipIfStatsTable/ipIfStatsTable.o mibgroup/ip-mib/ipIfStatsTable/ipIfStatsTable_interface.o mibgroup/ip-mib/ipIfStatsTable/ipIfStatsTable_data_access.o mibgroup/ip-mib/ipv4InterfaceTable/ipv4InterfaceTable.o mibgroup/ip-mib/ipv6InterfaceTable/ipv6InterfaceTable.o mibgroup/ip-mib/ipv6ScopeZoneIndexTable/ipv6ScopeZoneIndexTable.o mibgroup/sctp-mib/sctpScalars.o mibgroup/util_funcs/header_simple_table.o mibgroup/snmpv3/snmpEngine.o mibgroup/snmpv3/snmpMPDStats.o mibgroup/snmpv3/usmStats.o mibgroup/snmpv3/usmUser.o mibgroup/mibII/system_mib.o mibgroup/mibII/sysORTable.o mibgroup/mibII/snmp_mib.o mibgroup/mibII/vacm_vars.o mibgroup/mibII/setSerialNo.o mibgroup/mibII/at.o mibgroup/mibII/ip.o mibgroup/mibII/tcp.o mibgroup/mibII/icmp.o mibgroup/mibII/udp.o mibgroup/mibII/ipv6.o mibgroup/ucd-snmp/disk_hw.o mibgroup/ucd-snmp/proc.o mibgroup/ucd-snmp/versioninfo.o mibgroup/ucd-snmp/pass.o mibgroup/ucd-snmp/pass_persist.o mibgroup/ucd-snmp/loadave.o mibgroup/agent/extend.o mibgroup/ucd-snmp/errormib.o mibgroup/ucd-snmp/file.o mibgroup/ucd-snmp/dlmod.o mibgroup/ucd-snmp/proxy.o mibgroup/ucd-snmp/logmatch.o mibgroup/ucd-snmp/memory.o mibgroup/ucd-snmp/vmstat.o mibgroup/notification/snmpNotifyTable.o mibgroup/notification/snmpNotifyFilterProfileTable.o mibgroup/notification-log-mib/notification_log.o mibgroup/target/snmpTargetAddrEntry.o mibgroup/target/snmpTargetParamsEntry.o mibgroup/target/target.o mibgroup/target/target_counters.o mibgroup/agent/nsTransactionTable.o mibgroup/agent/nsModuleTable.o mibgroup/agent/nsDebug.o mibgroup/agent/nsCache.o mibgroup/agent/nsLogging.o mibgroup/agent/nsVacmAccessTable.o mibgroup/disman/event/mteScalars.o mibgroup/disman/event/mteTrigger.o mibgroup/disman/event/mteTriggerTable.o mibgroup/disman/event/mteTriggerDeltaTable.o mibgroup/disman/event/mteTriggerExistenceTable.o mibgroup/disman/event/mteTriggerBooleanTable.o mibgroup/disman/event/mteTriggerThresholdTable.o mibgroup/disman/event/mteTriggerConf.o mibgroup/disman/event/mteEvent.o mibgroup/disman/event/mteEventTable.o mibgroup/disman/event/mteEventSetTable.o mibgroup/disman/event/mteEventNotificationTable.o mibgroup/disman/event/mteEventConf.o mibgroup/disman/event/mteObjects.o mibgroup/disman/event/mteObjectsTable.o mibgroup/disman/event/mteObjectsConf.o mibgroup/disman/schedule/schedCore.o mibgroup/disman/schedule/schedConf.o mibgroup/disman/schedule/schedTable.o mibgroup/utilities/override.o mibgroup/etherlike-mib/dot3StatsTable/dot3StatsTable.o mibgroup/etherlike-mib/dot3StatsTable/dot3StatsTable_data_get.o mibgroup/etherlike-mib/dot3StatsTable/dot3StatsTable_data_set.o mibgroup/etherlike-mib/dot3StatsTable/dot3StatsTable_data_access.o mibgroup/etherlike-mib/dot3StatsTable/dot3StatsTable_interface.o mibgroup/host/data_access/swinst.o mibgroup/host/data_access/swrun.o mibgroup/host/hrSWRunPerfTable.o mibgroup/util_funcs.o mibgroup/if-mib/data_access/interface.o mibgroup/ip-mib/ipAddressTable/ipAddressTable_interface.o mibgroup/ip-mib/ipAddressTable/ipAddressTable_data_access.o mibgroup/ip-mib/data_access/defaultrouter_common.o mibgroup/ip-mib/data_access/defaultrouter_linux.o mibgroup/ip-mib/data_access/systemstats_common.o mibgroup/ip-mib/data_access/systemstats_linux.o mibgroup/ip-mib/ipIfStatsTable/ipIfStatsTable_data_get.o mibgroup/if-mib/ifTable/ifTable_interface.o mibgroup/if-mib/ifTable/ifTable_data_access.o mibgroup/if-mib/ifTable/ifTable.o mibgroup/ip-mib/ipv4InterfaceTable/ipv4InterfaceTable_interface.o mibgroup/ip-mib/ipv4InterfaceTable/ipv4InterfaceTable_data_access.o mibgroup/ip-mib/ipv6InterfaceTable/ipv6InterfaceTable_interface.o mibgroup/ip-mib/ipv6InterfaceTable/ipv6InterfaceTable_data_access.o mibgroup/ip-mib/ipv6ScopeZoneIndexTable/ipv6ScopeZoneIndexTable_interface.o mibgroup/ip-mib/ipv6ScopeZoneIndexTable/ipv6ScopeZoneIndexTable_data_access.o mibgroup/rmon-mib/etherStatsTable/etherStatsTable.o mibgroup/rmon-mib/etherStatsTable/etherStatsTable_data_get.o mibgroup/rmon-mib/etherStatsTable/etherStatsTable_data_set.o mibgroup/rmon-mib/etherStatsTable/etherStatsTable_data_access.o mibgroup/rmon-mib/etherStatsTable/etherStatsTable_interface.o mibgroup/sctp-mib/sctpScalars_common.o mibgroup/sctp-mib/sctpScalars_linux.o mibgroup/sctp-mib/sctpTables_common.o mibgroup/sctp-mib/sctpAssocRemAddrTable.o mibgroup/sctp-mib/sctpAssocLocalAddrTable.o mibgroup/sctp-mib/sctpLookupLocalPortTable.o mibgroup/sctp-mib/sctpLookupRemPortTable.o mibgroup/sctp-mib/sctpLookupRemHostNameTable.o mibgroup/sctp-mib/sctpLookupRemPrimIPAddrTable.o mibgroup/sctp-mib/sctpLookupRemIPAddrTable.o mibgroup/sctp-mib/sctpAssocTable.o mibgroup/sctp-mib/sctpTables_linux.o mibgroup/util_funcs/get_pid_from_inode.o mibgroup/tcp-mib/tcpConnectionTable/tcpConnectionTable.o mibgroup/tcp-mib/tcpListenerTable/tcpListenerTable.o mibgroup/hardware/sensors/hw_sensors.o mibgroup/hardware/sensors/lmsensors_v3.o mibgroup/udp-mib/udpEndpointTable/udpEndpointTable.o mibgroup/util_funcs/header_generic.o mibgroup/mibII/updates.o mibgroup/mibII/vacm_context.o mibgroup/mibII/data_access/at_linux.o mibgroup/mibII/data_access/at_unix.o mibgroup/mibII/kernel_linux.o mibgroup/mibII/ipAddr.o mibgroup/mibII/var_route.o mibgroup/mibII/route_write.o mibgroup/mibII/tcpTable.o mibgroup/mibII/udpTable.o mibgroup/ip-mib/ip_scalars.o mibgroup/util_funcs/restart.o mibgroup/ucd-snmp/pass_common.o mibgroup/notification/snmpNotifyTable_data.o mibgroup/header_complex.o mibgroup/snmp-notification-mib/snmpNotifyFilterTable/snmpNotifyFilterTable_data_storage.o mibgroup/snmp-notification-mib/snmpNotifyFilterTable/snmpNotifyFilterTable.o mibgroup/notification/snmpNotifyFilterProfileTable_data.o mibgroup/target/snmpTargetAddrEntry_data.o mibgroup/target/snmpTargetParamsEntry_data.o mibgroup/etherlike-mib/data_access/dot3stats_linux.o mibgroup/hardware/memory/hw_mem.o mibgroup/hardware/memory/memory_linux.o mibgroup/hardware/fsys/hw_fsys.o mibgroup/hardware/fsys/fsys_mntent.o mibgroup/host/data_access/swinst_pkginfo.o mibgroup/host/data_access/swrun_procfs_status.o mibgroup/hardware/cpu/cpu.o mibgroup/hardware/cpu/cpu_linux.o mibgroup/if-mib/data_access/interface_linux.o mibgroup/if-mib/data_access/interface_ioctl.o mibgroup/ip-mib/data_access/ipaddress_common.o mibgroup/ip-mib/data_access/ipaddress_linux.o mibgroup/ip-mib/data_access/ipv6scopezone_common.o mibgroup/ip-mib/data_access/ipv6scopezone_linux.o mibgroup/rmon-mib/data_access/etherstats_linux.o mibgroup/tcp-mib/data_access/tcpConn_common.o mibgroup/tcp-mib/data_access/tcpConn_linux.o mibgroup/tcp-mib/tcpConnectionTable/tcpConnectionTable_interface.o mibgroup/tcp-mib/tcpConnectionTable/tcpConnectionTable_data_access.o mibgroup/tcp-mib/tcpListenerTable/tcpListenerTable_interface.o mibgroup/tcp-mib/tcpListenerTable/tcpListenerTable_data_access.o mibgroup/udp-mib/udpEndpointTable/udpEndpointTable_interface.o mibgroup/udp-mib/udpEndpointTable/udpEndpointTable_data_access.o mibgroup/if-mib/ifXTable/ifXTable.o mibgroup/ip-mib/inetNetToMediaTable/inetNetToMediaTable.o mibgroup/ip-mib/inetNetToMediaTable/inetNetToMediaTable_interface.o mibgroup/ip-mib/inetNetToMediaTable/inetNetToMediaTable_data_access.o mibgroup/ip-mib/ipSystemStatsTable/ipSystemStatsTable.o mibgroup/ip-mib/ipSystemStatsTable/ipSystemStatsTable_interface.o mibgroup/ip-mib/ipSystemStatsTable/ipSystemStatsTable_data_access.o mibgroup/ip-forward-mib/ipCidrRouteTable/ipCidrRouteTable.o mibgroup/ip-forward-mib/inetCidrRouteTable/inetCidrRouteTable.o mibgroup/snmp-notification-mib/snmpNotifyFilterTable/snmpNotifyFilterTable_interface.o mibgroup/snmp-notification-mib/snmpNotifyFilterTable/snmpNotifyFilterTable_data_access.o mibgroup/ip-mib/data_access/ipaddress_ioctl.o mibgroup/udp-mib/data_access/udp_endpoint_common.o mibgroup/udp-mib/data_access/udp_endpoint_linux.o mibgroup/if-mib/ifXTable/ifXTable_interface.o mibgroup/if-mib/ifXTable/ifXTable_data_access.o mibgroup/ip-mib/data_access/arp_common.o mibgroup/ip-mib/data_access/arp_netlink.o mibgroup/ip-mib/data_access/scalars_linux.o mibgroup/ip-forward-mib/ipCidrRouteTable/ipCidrRouteTable_interface.o mibgroup/ip-forward-mib/ipCidrRouteTable/ipCidrRouteTable_data_access.o mibgroup/ip-forward-mib/inetCidrRouteTable/inetCidrRouteTable_interface.o mibgroup/ip-forward-mib/inetCidrRouteTable/inetCidrRouteTable_data_access.o mibgroup/ip-forward-mib/data_access/route_common.o mibgroup/ip-forward-mib/data_access/route_linux.o mibgroup/ip-forward-mib/data_access/route_ioctl.o mib_modules.o auto_nlist.o
[  185s] ar: mibgroup/ip-forward-mib/ipCidrRouteTable/ipCidrRouteTable_interface.o: No such file or directory

This error will not occur when I add the following dependency in agent/Makefile.in:

-libnetsnmpmibs.$(LIB_EXTENSION)$(LIB_VERSION): ${LMIBOBJS} $(AGENTLIB) $(USELIBS)
+libnetsnmpmibs.$(LIB_EXTENSION)$(LIB_VERSION): ${LMIBOBJS} $(AGENTLIB) $(USELIBS) subdirs

[JiangHeng12138]

when use make -j32, perl/Makefile in Makefile.in should dependecy subdirs:

@@ -181,7 +181,7 @@ perlmodules: perlmakefiles subdirs

 perlmakefiles: perl/Makefile net-snmp-config-x

-perl/Makefile: perl/Makefile.PL
+perl/Makefile: perl/Makefile.PL subdirs

Otherwise, make test will occur an error.

AgentX trap sending support using agentxtrap ............................ ok
AgentX subagent in Perl (using NetSNMP::agent) .......................... 
not ok 1 - found 0 copies of 'hello world' in output (/tmp/snmp-test-T115agentxperl_simple-530769/output-simple_run530769-1); expected 1
not ok 2 - found 0 copies of 'hello again world' in output (/tmp/snmp-test-T115agentxperl_simple-530769/output-simple_run530769-2); expected 1
Dubious, test returned 1 (wstat 256, 0x100)
Failed 2/3 subtests 
Proxy GET support ....................................................... ok

when i add this dependecy, make test will work well.

AgentX trap sending support using agentxtrap ............................ ok
AgentX subagent in Perl (using NetSNMP::agent) .......................... ok
Proxy GET support ....................................................... ok

I also observed some libraries(-lnetsnmpmibs -lnetsnmpagent ) are not linked in NetSNMP/agent/agent.so, when make test failed

# make test success
gcc  -shared -Wl,-z,relro -Wl,-z,now -specs=/usr/lib/rpm/openEuler/openEuler-hardened-ld -L/usr/local/lib -fstack-protector-strong -Wl,-z,relro -Wl,-z,now  agent.o  -o ../blib/arch/auto/NetSNMP/agent/agent.so  \
   -L/usr/lib64 -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/snmplib/.libs -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/snmplib -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/agent/.libs -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/agent -lnetsnmpmibs -lnetsnmpagent -lnetsnmp -lperl   \

#make test failed
gcc  -shared -Wl,-z,relro -Wl,-z,now -specs=/usr/lib/rpm/openEuler/openEuler-hardened-ld -L/usr/local/lib -fstack-protector-strong -Wl,-z,relro -Wl,-z,now  agent.o  -o ../blib/arch/auto/NetSNMP/agent/agent.so  \
   -L/usr/lib64 -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/snmplib/.libs -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/snmplib -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/agent/.libs -L/home/abuild/rpmbuild/BUILD/net-snmp-5.8/agent -lnetsnmp -lperl   \

[bvanassche]

Thank you for the detailed report. Parallel compilation should have been fixed by commit 855e1c2.

[JiangHeng12138]

I'm not sure if there are other errors in parallel compilation.
I just solved the errors by observing the log.
Hope there's no problem with parallel compilation...Do you have any plans to completely examine/troubleshoot the parallel compilation problem?

[bvanassche]

I'd like to get parallel compilation working. I just noticed that an additional dependency is required to fix parallel compilation. See also commit 9ea3d8b.

[JiangHeng12138]

Hi @bvanassche

libnetsnmpagent.$(LIB_EXTENSION)$(LIB_VERSION):    ${LLIBAGENTOBJS} $(USELIBS)
    $(LIB_LD_CMD) $(AGENTLIB) ${LLIBAGENTOBJS} $(USELIBS) ${LAGENTLIBS} @LD_NO_UNDEFINED@ $(LDFLAGS) $(PERLLDOPTS_FOR_LIBS) @AGENTLIBS@
    $(RANLIB) $(AGENTLIB)

libnetsnmpmibs.$(LIB_EXTENSION)$(LIB_VERSION): ${LMIBOBJS} $(AGENTLIB) $(USELIBS)
    $(LIB_LD_CMD) $(MIBLIB) ${LMIBOBJS} $(AGENTLIB) $(USELIBS) @LD_NO_UNDEFINED@ $(LDFLAGS) ${LMIBLIBS} $(PERLLDOPTS_FOR_LIBS) @AGENTLIBS@
    $(RANLIB) $(MIBLIB)

Does libnetsnmpagent should depend on subdirs?

[bvanassche]

I think so. Please take a look at commit 3d09c66.

[bvanassche]

I have removed commit 3d09c66 because it introduced a circular dependency.

[JiangHeng12138]

@bvanassche sorry, I check agent/Makefile.in again, I think libnetsnmpagent should not depend on subdirs, what's your opinion?
The following code is the last line of agent/makefile.in

#
# dependency for snmplib object. it's here because the headers listed
# are relative to the agent directory.

subdirs: agentlib
# wait for agentlib before building 'subdirs' target

[bvanassche]

I have tried the following patch:

diff --git a/agent/Makefile.in b/agent/Makefile.in
index 7087669be20a..b0fea474ea2f 100644
--- a/agent/Makefile.in
+++ b/agent/Makefile.in
@@ -299,7 +299,7 @@ getmibstat.o: mibgroup/kernel_sunos5.c
 snmpd$(EXEEXT):	${LAGENTOBJS} $(USELIBS) $(AGENTLIB) $(HELPERLIB) $(MIBLIB) $(LIBTARG) 
 	$(LINK) $(CFLAGS) -o $@ ${LAGENTOBJS} ${LDFLAGS} ${OUR_AGENT_LIBS}
 
-libnetsnmpagent.$(LIB_EXTENSION)$(LIB_VERSION):    ${LLIBAGENTOBJS} $(USELIBS)
+libnetsnmpagent.$(LIB_EXTENSION)$(LIB_VERSION): ${LLIBAGENTOBJS} $(USELIBS) subdirs
 	$(LIB_LD_CMD) $(AGENTLIB) ${LLIBAGENTOBJS} $(USELIBS) ${LAGENTLIBS} @LD_NO_UNDEFINED@ $(LDFLAGS) $(PERLLDOPTS_FOR_LIBS) @AGENTLIBS@
 	$(RANLIB) $(AGENTLIB)
 
@@ -339,9 +339,3 @@ installmibgroupheaders:
 @mib_module_list_deps@
 
 mib_modules.lo: mibgroup/mib_module_inits.h
-#
-# dependency for snmplib object. it's here because the headers listed
-# are relative to the agent directory.
-
-subdirs: agentlib
-# wait for agentlib before building 'subdirs' target

but with that patch error messages similar to the following appear (every attempt results in a different error message):

libtool: link: ( cd ".libs" && rm -f "libnetsnmpagent.la" && ln -s "../libnetsnmpagent.la" "libnetsnmpagent.la" )
mibgroup/mibII/data_access/at_unix.lo: line 13: unexpected EOF while looking for matching `''
mibgroup/mibII/data_access/at_unix.lo: line 15: syntax error: unexpected end of file
make[1]: *** [Makefile:1270: libnetsnmpmibs.la] Error 2
make: *** [Makefile:674: subdirs] Error 1
+ return 2

Does the above indicate that a dependency mibgroup/* dependency is missing from libnetsnmpagent?

[JiangHeng12138]

yes, I think so. I encounter the same error. when I revert this patch, the error disappears.

[Srivalli231]

Why does mibgroup add to the subdirs? Agent/Makefile.in will compile the c file in mibgroup directory, so I recommend deleting mibgroup in subdirs.

diff --git a/Makefile.in b/Makefile.in
index 4448009..de3105a 100644
--- a/Makefile.in
+++ b/Makefile.in
@@ -15,8 +15,8 @@ mysubdir=agent
 #
 # what to install
 #
-SUBDIRS=helpers mibgroup
-FTSUBDIRS=mibgroup helpers
+SUBDIRS=helpers
+FTSUBDIRS=helpers

 INSTALLSBINPROGS= @SNMPD@
 INSTALLLIBS    = libnetsnmpagent.$(LIB_EXTENSION)$(LIB_VERSION)

@bvanassche

[Srivalli231]

the patch is as follow:

diff --git a/agent/Makefile.in b/agent/Makefile.in
index 4448009..dbf5998 100644
--- a/agent/Makefile.in
+++ b/agent/Makefile.in
@@ -15,8 +15,8 @@ mysubdir=agent
 #
 # what to install
 #
-SUBDIRS=helpers mibgroup
-FTSUBDIRS=mibgroup helpers
+SUBDIRS=helpers
+FTSUBDIRS=helpers

 INSTALLSBINPROGS= @SNMPD@
 INSTALLLIBS    = libnetsnmpagent.$(LIB_EXTENSION)$(LIB_VERSION)
@@ -273,9 +273,9 @@ FTAGENTOBJS=snmpd.ft @other_ftagentobjs@
 #
 # Define OBJS and LOBJS for clean target (just this directory)
 #
-OBJS           = $(LIBAGENTOBJS)  $(AGENTOBJS)  mib_modules.o  auto_nlist.o
-LOBJS          = $(LLIBAGENTOBJS) $(LAGENTOBJS) mib_modules.lo auto_nlist.lo
-FTOBJS         = $(LLIBAGENTFTS) $(FTAGENTOBJS) mib_modules.ft auto_nlist.ft
+OBJS           = $(LIBAGENTOBJS) $(MIBOBJS)  $(AGENTOBJS)  mib_modules.o  auto_nlist.o
+LOBJS          = $(LLIBAGENTOBJS) $(LMIBOBJS) $(LAGENTOBJS) mib_modules.lo auto_nlist.lo
+FTOBJS         = $(LLIBAGENTFTS) $(FTMIBOBJS) $(FTAGENTOBJS) mib_modules.ft auto_nlist.ft

 FEATUREFILE     = $(top_builddir)/include/net-snmp/agent/features.h

[bvanassche]

The above patch has been applied on the v5.9 and master branches. Thanks for the patch!