ION Open Source Release 4.1.4-b.1 (Beta Release)

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
= NOTES ON RELEASE 4.1.4-b.1 =
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

This beta release represents a major milestone with the completion of the RTEMS 6.1
port, significant improvements to code quality and portability, new networking
capabilities, and enhanced utilities for bundle management and CFDP file transfers.

RTEMS 6.1 Real-Time Operating System Port

• Full RTEMS 6.1 Port: ION has been successfully ported to RTEMS 6.1 for ARM64
  (AArch64) platforms, featuring:
  • Support for RTEMS libbsd (FreeBSD network stack) integration
  • UDP-based LTP networking tested and verified in QEMU simulation
  • 64-bit addressing support (SPACE_ORDER=3)
  • ION Admin Public API for configuration (no configuration files required)
  • Comprehensive documentation in arch-rtems/ directory
  • Template implementation for adaptation to specific hardware platforms
  • CI/CD workflow integration for RTEMS builds

Dual-Stack IPv4/IPv6 Networking Support

IMPORTANT NOTE ON DUAL-STACK NETWORKING: The dual-stack IPv4/IPv6 capability
will automatically use the network address family returned by hostname resolution.
Most operating systems return IPv6 addresses first when available, and ION's network
stack will use the first entry returned. If a host is not properly configured for
the returned address family, this may cause network address family conflicts,
resulting in connection failures for TCP, UDP, and LTPCLA (which runs over UDP).
The most reliable approach is to use explicit IP addresses if known. If using
hostnames, ensure all hosts resolve to the correct address family as the first entry
in DNS resolution.

• LTPCL Dual-Stack: Added experimental dual-stack IPv4 and IPv6 support for the
  LTP Convergence Layer, allowing nodes to communicate over both protocol versions
  simultaneously.

• TCPCL Dual-Stack: Implemented dual-stack IPv4 and IPv6 support for the TCP
  Convergence Layer with regression tests.

• UDPCL Dual-Stack: Previously introduced in 4.1.4-a.2, further refined and tested
  for production use.

New Bundle Management Utilities

• bpinspect: New utility for inspecting, filtering, and managing bundles in ION's
  custody. Features include:

  • Bundle listing with detailed metadata
  • Filtering by source, destination, creation time, and other attributes
  • Suspend and resume operations for selective bundle processing
  • Critical bug fix for bp_suspend functionality

• bptracker: Enhanced interactive mode for demonstration of bundle tracking
  capabilities, providing fine-grained control over individual bundles with:

  • Flexible send syntax
  • Real-time bundle status monitoring
  • Source routing record (SRR) parsing improvements

• bpcrash_hard: New testing utility for validating ION's crash recovery and
  reversibility features under extreme failure conditions.

CFDP Enhancements

• Enhanced cfdptest Utility: Major improvements to the CFDP testing tool:

  • Transaction tracking and summary display
  • Per-transaction control commands (cancel, suspend, resume)
  • Terminology updates (ack → closure-reqt) for RFC compliance
  • Reset command (R) to clear source/destination filenames
  • Version command (v) for build information
  • Updated man pages and usage documentation

• Empty File Transfer: ION now correctly handles CFDP transfers of zero-byte files.

• Automatic Proxy Launch: CFDP server proxy (bpcpd) can now be automatically
  launched through cfdprc configuration file.

• Event Reporting: Enhanced CFDP event reporting API with more detailed file
  transfer status and progress information, including closureRequested field.

LTP Protocol Improvements

• Dynamic Parameter Control: New capability for direct configuration of LTP
  maxRetries and segment loss rate parameters with updated regression tests.

• Default Value Behavior: Updated default parameter handling for improved
  reliability and performance.

Code Quality and Standards Compliance

• C18/C99 Compliance: Updated build system to prefer C18 (ISO 9899:2018) standard
  with fallback to C99, ensuring maximum portability and standards compliance.

• Strict Compiler Warnings: Enforced -Wextra, -Wstrict-prototypes, and -pedantic
  compiler flags across the entire codebase, resolving hundreds of warnings to
  improve code quality and catch potential bugs.

• Thread Safety: Implemented thread-safe versions of iToa, uToa, vastToa, and
  uvastToa functions with proper type-specific conversions for 32-bit systems.

• POSIX Compliance: Refactored POSIX named semaphore implementation with reference
  counting and deferred deletion to mitigate race conditions, particularly for
  bpcp utility.

Security and Stability Fixes

• Extension Block Overflow: Fixed buffer overflow vulnerability when processing
  non-standard extension blocks. Added regression test for memory allocation
  vulnerabilities.

• BPSec Configuration: Corrected handling of bundles with no CRC and no BIB,
  with tests to verify proper rejection of invalid security configurations.

• NULL Source EID Handling: Fixed bug in handling NULL source EIDs and state
  changes between bundle list and cancel operations.

• Race Condition Fixes: Addressed semaphore cleanup race conditions in bpcp and
  resource lock initialization issues.

Contact Graph Routing (CGR) Enhancements

• Adjacent Contact Support: Prototype support for adjacent contact routing with
  documentation and test cases.

• Routing Visualization: Automated generation of routing visualization data
  through cgrfetch utility improvements, enabling graphical analysis of routing
  decisions.

• CGR Analysis Tools: Refactored cgr-test and asymmetric-range tests to produce
  sample CGR analysis data with comprehensive usage documentation.

Platform Portability Improvements

• macOS Compatibility: Resolved multiple platform-specific issues including
  compilation syntax errors and system() call restrictions with active child
  processes.

• FreeBSD Support: Updated for compatibility with FreeBSD networking stack and
  build environment, including tar-over-ssh deployment for CI/CD.

• Solaris Support: Addressed compiler warnings specific to Solaris and added
  timeout protections for test suite stability.

• ARM Architecture: Fixed ARM default unsigned char issues in tcpcli.c and other
  platform-specific type handling.

• MUSL libc: Enhanced compatibility with MUSL C library and Clang compiler, though
  semaphore limitations require single-instance deployment per host.

Build System Enhancements

• Configure Options: New options to selectively disable DGR and BSSP modules
  (--disable-dgr, --disable-bssp) for minimal builds.

• ion-core Build: Per-extension build options for customized ion-core package
  configurations.

• Development Makefiles: Continued maintenance and updates to manual Makefile.dev
  system for i86_64-fedora platform, including support for new executables:

  • SPP convergence layer (sppcli, sppclo)
  • New test utilities (entropy_test, sdr_test_util)
  • Bundle inspection tool (bpinspect)
  • Additional diagnostic tools

Testing and CI/CD Improvements

• Regression Test Suite: Enhanced test infrastructure with:

  • Optional test designation for non-critical tests
  • Improved cleanup handling for failed tests
  • Timeout mechanisms to prevent hanging tests
  • Preservation of test logs (PRESERVE_TEST_LOG default to 1)
  • Automated ION security database initialization

• GitHub Actions Workflows: Updated CI/CD pipelines with:

  • RTEMS-specific build workflow
  • Submodule initialization improvements
  • Workspace cleanup between runs
  • ion.log capture and custom timeout support
  • JSON dependency validation

• Cross-Platform Testing: Expanded test coverage across Linux, macOS, FreeBSD,
  and Solaris platforms with platform-specific accommodations.

Documentation Updates

• Public API Documentation: Added comprehensive online documentation for ION's
  public administrative API set.

• RTEMS Documentation: Complete documentation package for RTEMS 6.1 port in
  arch-rtems/ directory, including:

  • Installation and build instructions
  • Key fixes and troubleshooting guide (KEY-FIXES-SUMMARY.md)
  • UDP network status and configuration (UDP-NETWORK-STATUS.md)
  • Platform-specific customization guidelines

• Man Page Updates: Updated documentation for LTP maxRetries parameter
  clarification and deprecated maxber usage in regression tests.

Deprecations and Cleanup

• maxber Parameter: Deprecated use of maxber in regression tests; updated
  documentation to clarify proper usage.

• Legacy Code Removal: Continued cleanup of obsolete code including old dtnperf
  (now part of dtnsuite).

• SBSP References: Removed confusing SBSP references from build flags and include
  paths.

Known Issues and Limitations

• MUSL libc: Named semaphore limitations restrict deployment to one ION instance
  per host; many regression tests will fail due to this constraint.

• RTEMS Port: Template implementation requires adaptation to specific hardware
  platforms and BSPs; loopback testing defaults to 127.0.0.1.

• Dual-Stack Networking: IPv4/IPv6 dual-stack features remain experimental;
  production deployments should be thoroughly tested.

Developer Notes

• Thread Synchronization: Refactored libams to use platform abstraction layer for
  thread synchronization.

• Type Conversions: Created type-specific ToString functions (vastToa, uvastToa,
  size_tToa) for improved type safety and 32/64-bit compatibility.

This beta release includes 162 commits since ION 4.1.4-a.2, representing extensive
testing, refinement, and new capabilities. Users are encouraged to test thoroughly
in their environments and report any issues through the GitHub issue tracker.