- Added smart engine memory limit (#3407)
- Improve log message and add explicit matching on spu dispatcher loop (#3413)
- "fluvio profile add" cmd (#3419)
- Added topic-level deduplication mechanism (#3385)
- Inject timestamp to record in SmartModule context (#3389)
- Replica assignment (#3422)
- Put bash argument inside quotes in smartmodule publish (#3401)
- Properly handle produce operation failure (#3405)
- Log connector name and version on startup (#3356)
- Added topic config (#3350)
- Update syn to 2.0 on test crates (#3366)
- Support time bound in lookback engine (#3369)
- Added topic deduplication mechanism 1/2 (#3392)
- Update dep (#3360)
- Update fluvio install URL to use Hub (#3373)
- Update toolchain to new rust version (#3394)
- Fix smdk publish with --push flag (#3352)
- Fix --push flag on smdk and cdk publish (#3370)
- Typo in chrono dep (#3380)
- Fix re-usable workflow for publishing smartmodules (#3347)
- Add
apiVersionto connector template (#3382) - Use explicit
Resulttype from std on generated code (#3393) - Ci, fix fluvio-run aarch-unknown-linux-musl release (#3395)
- Migrate to OnceLock (#3364)
HUB_API_BPKG_AUTHas part of thefluvio-hub-util(#3363)Recordinstance getters for timestamps (#3387)- Copy keys-value output behavior from
fluvio consumetosmdk test(#3391)
- Fluvio-socket, improve connect error message (#3324)
- Lookback is not passed from connectors (#3332)
- Don't require Cargo project to start connector from ipkg (#3340)
- Report error if lookback is used on producer (#3310)
- Support
lookbackin test (#3317) - Added
look_backto smartmodule proc macro (#3276) - Support
look_backon SmartEngine (#3304) - Support
look_backon SPU (#3306) - Fluvio-schema, batch id (#3283)
- Add option to run publish without build again (#3296)
- Use dynamic value for
LogLevelon deployment (#3312)
- Add more multiplexing_test (#3249)
- Cdk deploy log level support (#3278)
- Introduce zstd compression (#3185)
- Update connector-publish.yml (#3255)
- Prebuild artifacts for publish and deploy (#3252)
- Cleanup after publishing packages (#3259)
- Fix udeps issue (#3280)
- Improve error logs while rendering interpolated strings (#3266)
- Use kebab case for group names on hub packages (#3264)
- Improve Feedback on CDK (#3243)
- Set compression algorithm behind feature flag (#3275)
- Simplified control plane api (#3073)
- Add helper method to get utf8 from data (#3236)
- Move x records outputed from smdk test to --verbose #3169 (#3234)
- Add message about record too large on produce cli (#3242)
cdk builduses a default target (#3222)cdk testandcdk deployuses a default target (#3247)- Remove existing
.hubwhen packing connectors (#3227) - Add materialize view rfc (#3232)
- Update third party dep (#3220)
- Use current git rev for generated connector project (#3225)
- Use
.huband.DS_Storefor gitignore (#3239) - Ensure readme is included in manifest (#3230)
- Add toml-diff to workspace (#3191)
- Secrets in connector meta (#3194)
- Add support to string interpolation (#3138)
- Support k8 v1.26 (#3196)
- Added keymgmt roundtrip test (#3199)
- Add binary to manifest of connector meta (#3203)
- Add max_bytes to connector consumer option (#3209)
- Use workspace deps for serde_yaml (#3140)
- Update cargo-generate to release version (#3166)
- Updates for rust 1.69 (#3179)
- Post release 0.10.7 notes (#3176)
- Update dep (#3160)
- Enable test again on CI (#3132)
- Properly close multiplexer (#3170)
- Minor code changes for pem 2 dep update (#3172)
- Fix toolchain reference (#3180)
- Fix aggregate-initial description and organize Producer/Consumer options (#3177)
- Use
.huboverhuband delete if exists (#3193) - Fix fluvio hub utils (#3198)
- Add tests to
SecretNamestruct (#3200)
- Parse input as boolean (#3157)
- Improve modularity of smartengine (#3152)
- Explicit set of errors to retry (#3137)
- K8ClusterStateDispatcher start returns handle (#3173)
- Upgrade wasmtime to 0.8.0 and dep (#3175)
- Introduce utilily to check k8s resource names (#3163)
- Clean up dep (#3189)
- Move more dep to workspace (#3190)
- Introduce
apiVersiontoConnectorConfigin order to allow backward c… (#3206)
- Remove manual enum encoding/decoding (#3165)
- Remove unused dep in storage and move dep to workspace (#3181)
- Remove package (#3188)
- Apply SmartModule Transformation For Producer (#3014)
- Docs, Example of aggregation sm with initial value (#3126)
- Smdk, Use relative paths in generated package-meta (#3123)
- Add support to detect secret on sequences (#3131)
- Multiple dependency updates
- Pin to specific rust release (#2967)
- Added target info on
cdk publish(#3075) - Supply
archtag on publish if not set (#3080) - Add
-p package_nameincdk publish(#3097) - Remove unnecessary bounds for encoder and decoder derive macro (#3030)
- Add target option to connector download (#3079)
- CLI forward and compatibility (#3048)
- SmartModule CLI watch (#3064)
- Disallow untagged or named enum without constant mapping (#3061)
- Use consistent naming for connector config example file (#3077)
- Fluvio hub, use hubref for nonstandard configs (#3086)
- Relax
cdksecrets validation (#3093) - Enabled
--fileand--key-separatorto be used together, fix--keyhandling when producing lines (#3092) - Fail fast if socket is stale (#3054)
- Set max api version for derived stream (#3041)
- Disable default
fluviofeatures for sdk (#3098)
- Upload bpkg logic (#3028)
- Remove secrets and parameters from connector meta config (#3022)
- Migrate fluvio admin api to anyhow (#3016)
- Enhance deploy options (#2968)
- Retry monitoring if there is a failure (#2975)
- Support secrets in connector sdk (#2983)
- Fluvio connector support update (#2992)
- Cdk publish to hub (#2979)
- Optimize smdk Smoke Test (#2972)
- Add bpkg_token to publish workflow (#3004)
- Fluvio-hub-x, update dep cargo_toml to 0.15 (#3007)
- Publicly expose partitioning structs and traits (#2969)
- Remove v1 topic spec (#2987)
- Add 'cdk test' command (#2948)
- Add download connector package command (#2944)
- Add Hub support for installing binary packages (#2942)
- Add support for OpenSSL as an optional dependency for Fluvio (#2923)
- Add support for local deploy from
ipkgfile for Connector Development Kit (CDK) (#2939) - Add support custom configs in connector SDK (#2910)
- Add cluster shutdown support (#2912)
- Add sink connector support to SDK (#2906)
- Fix
read_recordsto truncatemax_offsettoend_offsetof current segment if it is larger than that so we can read records of that segment without failures (#2950) - Fix use
i64overu64for fuel measure to align with wasmtime (#2945) - Fix use
anyhowoverthiserror(#2916) - Fix CLI help text typo (#2918)
- Fix replace
Smart Moduleocurrences withSmartModule(#2913) - Fix split Custom Config and Common Config Separate custom config from common config (#2917)
- Fix exposes
retryfunction by re-exporting for common connector crate (#2922) - Fix recover from invalid segments (#2909)
- Fix remove connector metadata and API (#2887)
- Add
fluvio cluster status(#2824) - Display fetch status (#2872)
- Emphasize flush in docs (#2850)
- fix measurement of outbound metrics in SmartEngine (#2865)
- Fix
smdkload and test when package name contains-(#2863)
- Add hub private packages (#2828)
- Update wasmtime to 0.3.0 (#2831)
- Benchmarking tool behaviour on timeout (#2838)
- Correct producer throughput measurement (#2839)
- Release batches lock (#2840)
- Improve performance for
RecordAccumulatorinbatches(#2799) - Replace
PartitionId,PartitionCountandReplicationFactoraliased types to useu32overi32(#2799) - Standardize reading records from CLI input (#2756)
- Smdk publish signing error w/ cross-fs tmp file (#2767)
- Smkd template dir includes default gitignore (#2768)
- Clap-command updates (#2766)
- Reduce wasm size by stripping symbols (#2774)
- Remove old comment from src (#2778)
- Ci-dev workflow fix (#2783)
- Fluvio-test harness bug (#2790)
- Added chain support to producer (#2753)
- Capability to validate WASM files (#2760)
- Added smartmodule chain support for consumer (#2759)
- Benches with criterion and dedicated workflow (#2770)
- Benches for SmartModuleInput encoding (#2773)
- Use
content: writepermission for benchmarks (#2775) - Check for
Smart.tomlfile to be present in cwd (#2739) - Introduce
ByteBufforSmartModuleSpec(#2738) - Fluvio cli update check (#2679)
- Update cargo generate to use
Default(#2786) - Moved versioned socket to fluvio-socket crate (#2797)
- Added chaining support to smdk test (#2784)
- Added chaining support to fluvio-cli (#2812)
- Add additional test for encoding/decoding version (#2761)
- Update dev version (#2817)
- Add throughput control to fluvio producer (#2512)
- Added blocking on Producer if the batch queue is full (#2562)
- Initial support for SmartEngine v2 (#2610)
- SmartModule chaining (#2618)
- Add
smdk(#2632) - Support to build
SmartModulesusingsmdk build(#2638) - SmartModule Load Phase 1 (#2639)
- Add fluvio sm download (#2656)
- Add instrumentation to client producer (#2717)
- Added metrics to smartengine (#2726)
- Add otel to consumer (#2725)
- Add record counters to spu (#2731)
- Metric endpoint (#2737)
- Update clap to v4 (#2670)
smdktest Mode (#2636)- Generate SmartModules using
smdk(#2630) - Add
smdkpublish (#2657) - Add
smdkinstall support in CLI and release (#2648) - Rewrite
test-crate-versionin Rust (#2595) smdkgenerate template (#2677)- Add non-interactive
smdk generateflow (#2693) - Use
localhostasproxy-addrfor k8s cluster on macOS (#2740) - Add prompt for project group in
smdk generate(#2746) - Use dynamic local port for k8 port forwarding (#2578)
- Producer stat (#2743)
- Added
DeliverySemantictofluvio-cli. (#2508) - CLI: Added ability to delete multiple connectors, smartmodules and topics with one command. (#2427)
- Added
--use-k8-port-forwardingoption tofluvio cluster start. (#2516) - SmartModule package: add missing metadata (#2532)
- Adds feedback and debug info to 'smart-module create' (#2513)
- Prevent collisions between namespaces (#2539)
- Added proxy support during packages installation (#2535)
- Restrict usage of
--initial,--extra-paramsand--join-topicinfluvio consume. Those options only should be accepted when using specific smartmodules. (#2476) - Rename
--smartmoduleoption influvio consumeto--smart-module. `--smartmodule is still an alias for backward compatibility. (#2485) - Measure latency for stats using macro. (#2483)
- Keep serving incoming requests even if socket closed to write. (#2484)
- Support async response in multiplexed socket. (#2488)
- Drop write lock before async IO operations. (#2490)
- Add
Clonetrait toDefaultProduceRequest. (#2501) - Add
AtMostOnceandAtLeastOncedelivery semantics. (#2503)
- Move stream publishers to connection-level context (#2452)
- Prefer ExternalIP to InternalIP if configured in kubernetes (#2448)
- Add
fluvio connector config <connector-name>(#2464) - Add performance counters to producer (#2424)
- Upgrade to fluvio-future 0.4.0 (#2470)
- Add support to detecting smartmodule type from WASM payload on SPU (#2457)
- Require
versionfield in connector yaml. (#2472)
- Improve CLI error output when log_dir isn't writable (#2425)
- Fix issue in producer when sending more than one batch in a request (#2443)
- Fix bug in
last_partition_offsetupdate when handling smartmodules on SPU (#2432) - Re-allow string, dictionaries and lists as options to
parameterssection in connector yaml. (#2446)
- Revert 0.9.28 updates to Connector yaml config (#2436)
- Upgrade to Wasmtime 0.37 (#2400)
- Allow Cluster diagnostics to continue even if profile doesn't exist (#2400)
- Add timeout when creating SPG (#2364)
- Log fluvio version and git rev on client creation (#2403)
- Display multi-word subcommand aliases in CLI help info (#2033)
- Add filter-map support to SmartProducer (#2418)
- Fix
wasifunctions binding relying on order (#2428) - Add top level
producerandconsumerentries to connector yaml configurations. (#2426) - Allow string, dictionaries and lists as options to
parameterssection in connector yaml. (#2426)
- Support installing clusters on Google Kubernetes Engine (#2364)
- Make Zig Install more reliable (#2388)
- Add path setting hint for fish shell in install script (#2389)
- Fix typo in
change_listenerfunction influvio_typescrate (#2382)
- Increase default
STORAGE_MAX_BATCH_SIZE(#2342)
- Set timestamp in Records while producing. (#2288)
- Support
ReadCommittedisolation in SPU for Produce requests #2336 - Improve error messages and add
--fixoption tofluvio cluster checkto autofix recoverable errors (#2308) - Producer must respect ReadCommitted isolation #2302
- Add
{{time}}option to--formatinfluvio consumeto display record timestamp (#2345)
- CLI: Migrate all fluvio crates to
comfy-tablefromprettytable-rs(#2285) - Storage: Enforce size based retention for topic (#2179)
- Don't try to use directories as smartmodule if passed as argument (#2292)
- CLI: Profile export (#2327)
- Add
TYPEcolumn tofluvio connector list(#2218) - Use
Clapinstead ofStructOptfor all CLI (#2166) - Re-enable ZSH completions (#2283)
- Disable versions from displaying in CLI subcommands (#1805)
- Increase default
MAX_FETCH_BYTESin fluvio client (#2259) - Add
fluvio-channeltofluvio updateprocess (#2221)
- Add topic level compression configuration (#2249)
- Add producer batch related options for
fluvio produce(#2257)
- Make store time out configurable (#2212)
- Add a
sizefield in thefluvio partition listoutput. This field represents the size of logs in the partition. (#2148) - Add support for partial CA Intermediate Trust Anchors (#2232)
- Fix Installer problem with self-signed certs (#2216)
- Report SPU error codes to FutureRecordMetadata (#2228)
- Optimize partition size computation (#2230)
- Fix fluvio-test configuration to support data generator (#2237)
- Add compression support. (#2082)
- Add
connector update -c configto update the running configuration of a given existing managed connector (#2188) - Handle large number of produce and consumers (#2116)
- Disable
fluvio updatewhen using pinned version channel (#2155) - Deprecate redundant
create_topicflag from the connectors configuration (#2200)
- Add WASI support to SmartEngine (#1874)
- Fix incorrect behavior when consuming with a given offset in a partition with batches with more than one record. (#2002)
- Add
versioncolumn tofluvio connector list(#2145) - Reimport metadata for tableformat in fluvio client (#2175)
- Change log level for admin actions to info in SC public services (#2177)
- Fix problem with zero copy (#2181)
- Show Platform version for fluvio run (#2104)
- Fix batching producer for WASM platforms (#2120)
- Make Test runner more reliable (#2110)
- Fix connector crd to store version (#2123)
- Remove max version requirements (#2106)
- Optimize memory allocation (#2069)
- Translate
_with-in connector parameters (#2149)
- Change default values of TopicProducerConfig (#2069)
- Enhance CLI Diagnostics with system info (#2069)
- Don't HTML escape output from CLI consumer using
--format(#1628)
- Consume with end (#1940)
- Return base offset in partition produce response (#2025)
- Simple Topic Retention with time (#2019)
- Uninstall sys chart when cluster is deleted (#2032)
- Upgrade Wasmtime 0.32 (#2038)
- Add auto-batching to Producer (#2000)
- Add support for 3rd party connectors (#2027)
- Introduce channels into CLI (#2021)
- Upgrade to Zig 0.9 and LLVM 13 (#2046)
- Add API to converting to list type from metadata (#2052)
- Check if the local cluster exists during installation (#2041)
Note: For existing CLI users, we recommend following the instructions to re-install their CLI. This is a requirement in order to use Fluvio CLI Channels.
- Add support for tuple structs in fluvio-protocol derived macros. (#1828)
- Expose fluvio completions in the top-level subcommand. (#1850)
- Make installation more reliable (#1961)
- Add Spinner to
fluvio consumecommand. (#1881) - Change CLI multi-word subcommand names to use kebab-case. (#1947
- Update subcommand descriptions for consistency #1948)
- Add
fluvio connector logs <connector name>(#1969).
- Fix connector create with
create_topicoption to succeed if topic already exists. (#1823) - Add
#[smartstream(filter_map)]for filtering and transforming at the same time. (#1826) - Add table display output option to consumer for json objects (#1642)
- Streamlined Admin API (#1803)
- Add SpuDirectory trait to Fluvio Client (#1863)
- Add
fluvio consume <topic> --output=full_tableto render row updates over fullscreen terminal screen (#1846) - Fix macOS kubernetes cluster management (#1867)
- Persist aggregate accumulator across file batches (#1869)
- Make Fluvio cluster working on Apple Silicon (#1896)
- Rename
fluvio tabletofluvio tableformat(#1918) - Restrict max version in fluvio client (#1930)
- Use version from the client in SmartEngine to encode/decode input/output (#1924)
- Add examples for ArrayMap. (#1804)
- Report error when missing #[1462] attribute in SmartStream (#1462)
- Fix consumer read after restart #[1815] attribute in SmartStream (#1815)
- Added smartengine feature flag to fluvio client which adds ability to apply smartstream on producer. (#1788)
- Reconnect producer to SPU if network error. (#770)
- Merge fluvio-protocol-{api,core,codec} crates into fluvio-protocol (#1594)
- Add
#[smarstream(array_map)]for expanding one record into many (#1335) - Add capability to use input parameters in smartstreams (#1643)
- Make it easier to debug inline chart (#1779)
- Improve error handling for socket timeout (#791)
- Report error when using invalid WASM in SmartStream consumer (#1713)
- Reduce time for validating log file(#1726)
- Add
impl std::error::Error for ErrorCodefor better error reporting (#1693) - Add ability to create a consumer that can read from multiple partitions concurrently. (#1568)
- Expose partition for
fluvio consume --format. (#1701) - Fix consumer stream hanging after rollver (#1700)
- Added deployment controller for managed connectors (#1499).
- Add progress indicator to
fluvio cluster start(#1627) - Added
fluvio cluster diagnosticsto help debugging with support (#1671) - Fix installation of sys charts when running
fluvio cluster start --local --develop(#1647)
- Improve progress message in
fluvio cluster start --local(#1586) - Fix handling large stream fetch (#1630)
- Create error variant and propagate that in case of attempt of creation of a topic with an invalid name. (#1464)
- Improve display representation for some variants in FluvioError type (#1581)
- Add spinner to
fluvio cluster --local --setupcommand (#1574) - Add
--formatstring for custom Consumer printouts (#1593)
- Update
Debugprintout forSmartStreamWasmto reduce noise (#1524) - Increase platform stability (#1497)
- Spawn a thread to handle stream fetch requests (#1522)
- Publish docker image for aarch64 #1389 (#1389)
- Do not panic when trying to create topic with space in the name. (#1448)
- Deprecate consumer fetch API (#957)
- Gracefully handle error when trying to install plugins or update. (#1434)
- Fix timing issue in Multiplexor Socket (#1484)
- Compress WASM binaries. (#1468)
- Fix Replication timing. (#1439)
- Fix release workflow to include Helm charts (#1361)
- Implement SmartStream Aggregates (
#[smartstream(aggregate)]) API (#1173) - Fix bounds when resolving relative Offsets (#1210)
- Add
--tailCLI option for reading recent records from a stream (#1216) - Fix consumer stream API that waited for records before initializing (#986)
- Fixed
fluvio installfor windows CLI (#1461)
- Make Cluster installation more reliable. (#1395)
- Reliabiility improvement in SC's SPU controller. (#1413)
- Add Apple M1 as Tier2 platform for
fluvio-run(#1382)
- Add k8s feature flag to cli. (#1257)
- Add windows build of cli and client. (#1218)
- Improve
#[derive(Encoder, Decoder)]to work with data enums. (#1232) - Fix Replication bug in K8 (#1290)
- Add apply method to
StoreContext. (#1289) - Build M1 mac CLI (#132)
- Use inline helm chart (#1292)
- Update
ConsumerConfigwith more idiomatic builder (#1271) - Improve
install.shto run on more targets (#1269) - Make
fluvio-cloudan optional part of installation based on target support (#1317) - Remove
#[deprecated]items from crates (#1299) - Bump
MINIMUM_PLATFORM_VERSIONto0.9.0(#1310) - Fix owner reference type to work delete in K 1.20.0 (#1342)
- Fix Upgrading K8 Cluster (#1347)
- Add Error Handling to SmartStreams (#1198)
- Finish SmartStream Map (
#[smartstream(map)]) API (#1174, #1198)
- Add unstable Admin Watch API for topics, partitions, and SPUs (#1136)
- Make recipes for smoke tests no longer build by default, helps caching. (#1165)
- Relax requirement of
FluvioAdminmethods from&mut selfto&self. (#1178) - Sort output of
fluvio partition listby Topic then Partition. (#1181) - Add SmartStream Map (
#[smartstream(map)]) API for transforming records. (#1174) - Change C compiler to
zigand linker tolld. Resolves segfaults when cross compiling to musl. (#464) - Consumer CLI prints a status when consuming from the end of a partition. (#1171)
- Upgrade wasmtime to thread-safe API. (#1200)
- Update fluvio-package to support arbitrary Targets. (#1234)
- Future-proof PackageKind by deserializing all Strings. (#1249)
- Don't hang when check for non exist topic. (#697)
fluvio cluster startuses Kubernetes NodePort by default (#1083)- Use OpenSSL for Client (#1150)
- Add
--rawflag tofluvio producefor sending whole file input (#1149)
- Added builder for fluvio_storage::config::ConfigOption. (#1076)
- Use batch record sending in CLI producer (#915)
- Now ResponseApi and RequestApi encoder-decoders are symmetric (#1075)
FluvioCodecencoder now supportsFluvioEncodertypes. Implementation with bytes::Bytes now is deprecated. (#1076)- Added implementations of FluvioEncoder for &T: FluvioEncoder. (#1081)
- Updated RecordAPI with RecordKey and RecordData (#1088)
- Support WASM for client (#1101)
spu_poolto support wasm runtime. (#1106)- Remove async trait for more wasm support to client (#1108)
- Better logging for SPU health check (#1109)
- fluvio-socket build for wasm32 (#1111)
- Add Fluvio::connect_with_connector to support custom connectors. (#1120)
- Fix Replication fail over with duplication (#1052)
- Relax platform version requirement for upgrade check (#1055)
- Update logic for finding latest package release (#1061)
- Use file name for the external commands (fixes #889) (#1008)
- Fix Fluvio log directory on K8 (#1043)
- Add RecordKey API for sending records without keys (#985)
- Make Fluvio Client compatitble with WASM (#1042)
- Update Replication logic for SPU (#1011)
- Added Partitioner trait for assigning partitions based on record keys (#965)
- Deprecated the
TopicProducer::send_recordmethod (#965) - Decoupled Fluvio CLI from Fluvio server components (#928)
- Added batching for producing records with
send_allAPI (#896). - WASM based Smart Stream Filter MVP (#901).
- Fix topic not being deleted when SPU goes offline (#914)
fluvio updateupdates plugins as well as CLI (#865).- SPU controller uses SVC ingress annotation (#888).
- Client Key/Value support for producers and consumers (#828).
- CLI Key/Value interface (#830)
- CI Reliability updates (#842), (#832)
fluvio cluster upgrade(#709)install.shscript works withVERSION=latestfor prereleases(#812)- Fix stream fetch (#769)
- Limit for batchsize (#787)
- Protocol updates (#752)
- Socket close events propagate to client (infinyon/fluvio-socket#22)
- Fix sha256 has in
fluvio version(#740) - Implement flush policy to flush on a delay time after writes (#694)
- Create basedir during
fluvio installif missing (#739)
- Protocol changes to encode vector lengths in
DefaultAsyncBufferandRecordSets(#752).
- Added
bytesandbytes_refforRecordand removingtry_into_bytes(#706)
- Restore Ok (#675)
- Expose Consumer Record (#687)
- Stand alone Installer
- Support for Writing Extension
- Self Update Capability
- Profile rename
- Show Platform versions
- API Docs
- Stream based Fetch
- Cluster Installer with API and CLI support
- Support for Installing in Minikube without workaround
- Delete Topic
- Pluggable Authorization Framework with simple RBAC
- TLS endpoint for SC and SPU
- Connection multiplexing
- Support Raspberry Pi
- Use tracing instead of logger
- Github Action to test Platform
- K8: Enforce resource limit on Kubernetes
- Consolidate Custom SPU and SPU
- Better error messages
- Move TLS as global option
- Fully multi-threaded consumer and producer
- Better stability
- K8: Fix storage location