v3.2.0

v3.2.0 (2023-12-05)

Highlights

• The new --from-file option lets you pass setting values to meltano config from files and STDIN, thanks to @XshubhamX!

• The new option --merge-state lets you run partial full-table pipelines, for example when you want to refresh a single stream without losing the state of other streams.

• Environment variables are now expanded in array settings, for example MY_BUCKET will now expanded in the example below:

  plugins:
    extractors:
    - name: tap-spreadsheets-anywhere
      variant: ets
      pip_url: git+https://github.com/ets/tap-spreadsheets-anywhere.git smart_open[s3]
      config:
        tables:
        - name: customers
          path: s3://${MY_BUCKET}
          pattern: files/customers\.csv\.*gz
          start_date: '2017-05-01T00:00:00Z'
          key_properties: [id]

✨ New

• #8184 Log Meltano version and Operating System at invocation of CLI -- Thanks @ashu565!
• #8228 Support setting configuration from files and STDIN -- Thanks @XshubhamX!
• #8194 Allow escaping stream names with periods in select rules
• #8241 Support Python 3.12
• #8215 Support authenticating to Azure state backend without a connection string -- Thanks @XshubhamX!
• #8258 Add a --merge-state flag to meltano run to merge the current pipeline state with that of the latest run
• #8268 Expand environment variables in array setting values

🐛 Fixes

• #8249 Display special characters in column names in the output of meltano select --list
• #8227 Validate input to settings with kind: options
• #8232 Interval validation for meltano schedule set -- Thanks @XshubhamX!
• #8225 Redirect tap's stderr to /dev/null during a configuration test -- Thanks @raiatul14!
• #8301 Interactive config now indicates that you're typing a redacted value -- Thanks @abastola0!

📚 Documentation Improvements

• #8267 Add Q4 Changelog
• #8260 Add information about database schema destination -- Thanks @EChaffraix!
• #8259 Fix links in v3 migration guide
• #8251 Fix dbt model in part3.mdx -- Thanks @diegoquintanav!
• #8214 Document other supported ways of configuring an S3 endpoint URL
• #8211 Sync sidebar order with index page link-lists, remove broken /index links -- Thanks @mjsqu!
• #8209 Remove broken link (reference/index) and order links to match sidebar -- Thanks @mjsqu!
• #8210 Add tabs for all remaining env/cli/config settings -- Thanks @mjsqu!
• #8201 Use tabs for examples on settings page -- Thanks @mjsqu!
• #8200 Update contribution guidelines -- Thanks @mjsqu!
• #8155 Add september changelog

Full Changelog: v3.1.0...v3.2.0