Skip to content

Commit

Permalink
Added proper readme
Browse files Browse the repository at this point in the history
  • Loading branch information
Nawy committed Mar 7, 2024
1 parent ffe32f1 commit bcd5dd3
Show file tree
Hide file tree
Showing 2 changed files with 180 additions and 2 deletions.
91 changes: 90 additions & 1 deletion serde_flow/README.md
@@ -1 +1,90 @@
../README.md
Serde Flow - Migration Framework
==================================

[<img alt="build status" src="https://img.shields.io/github/actions/workflow/status/versolid/serde-flow/ci.yml?branch=main&style=for-the-badge" height="20">](https://github.com/versolid/serde-flow/actions?query=branch%3Amain)

`serde_flow` is a Rust library that simplifies managing changes in *serialized* data formats during software development, enabling seamless file migration and maintaining version compatibility.

## Features
1. **Serialize migration** with `#[variants(UserV1, UserV2)]`
2. **Serialize to file** with `#[flow(variant = 1, file)]`
3. **Async** with `#[flow(variant = 1, file(nonbloking))]`
4. **Zerocopy** with `#[flow(variant = 1, file, zerocopy)]`

## Basics
Serde Flow primarily consists of three major components:
1. `#[derive(Flow)]`: To utilize Serde Flow, you must annotate your class with `serde_flow::Flow`. This annotation serves as a signal to the library that the class is eligible for data migration.
2. `#[flow(variant = N)]`: Utilize this annotation to specify the version of the entity. Simply replace N with a `u16` number that represents the version. This helps in managing different versions of your data structures efficiently.
3. `#[variants(StructA, StructB, ...)]` (*Optional*): This annotation is optional but highly recommended for comprehensive data migration management. Here, you list the structs that are essential for migrating into the struct highlighted with this annotation. *To ensure, you need to implement `From<VariantStruct>` for all structs listed in `#[variants(..)]`*.

## 🛠️ Getting Started
```toml
[dependencies]
serde_flow = "1.0.0"
```
Imagine you have a `User` struct that has evolved over time through versions `UserV1` -> `UserV2` -> `User` (current), while the previous versions `UserV1` and `UserV2` still exist elsewhere. To manage this scenario effectively, follow these steps:
1. **Versioning:** Start by setting proper versioning from the beginning. The initial creation of the user should be annotated with `#[flow(variant = 1)]`.
2. **Incremental Versioning:** As you iterate and create subsequent versions, ensure to increment the version in the annotations, such as `#[flow(variant = 2)]` for the next version.
3. **Migration Preparation:** When you're ready to migrate to a new version, add the `#[variants(UserV1, UserV2)]` annotation to the main User struct. It's essential to include all previous variants that you intend to migrate from.
4. **Implementation Scope:** Variants must be implemented in the same file as the main variant to ensure proper management and accessibility during migration processes.

By adhering to these guidelines, you can effectively manage the evolution of your data structures while ensuring seamless migration across versions.
```rust

// the main file
#[derive(Serialize, Deserialize, Flow)]
#[flow(variant = 3, file)]
#[variants(UserV1, UserV2)]
pub struct User {
pub first_name: String,
pub middle_name: String,
pub last_name: String,
}

// previous variant
#[derive(Serialize, Deserialize, Flow)]
#[flow(variant = 2)]
pub struct UserV2 {
pub first_name: String,
pub last_name: String,
}

// the first version of the User entity
#[derive(Serialize, Deserialize, Flow)]
#[flow(variant = 1)]
pub struct UserV1 {
pub name: String,
}

// provide a proper mappings from old file to the new one
impl From<UserV1> for User {
fn from(value: UserV1) -> Self {
//... migration
}
}

impl From<UserV2> for User {
fn from(value: UserV2) -> Self {
//... migration
}
}
```

## Basic Serialization & Deserialization
```rust
// create an old struct
let user_v2 = UserV2 {
name: "John Adam Doe".to_string(),
};

// store on the disk
user_v2
.save_to_path::<bincode::Encoder>(&Path::new("/path/to/user"))
.unwrap();

// Now, you can load User struct, because you have a proper variant to transform
let user = User::load_from_path::<bincode::Encoder>(path.as_path()).unwrap();
```

## 📜 License
Bitwark is open-source software, freely available under the MIT License.
91 changes: 90 additions & 1 deletion serde_flow_derive/README.md
@@ -1 +1,90 @@
../README.md
Serde Flow - Migration Framework
==================================

[<img alt="build status" src="https://img.shields.io/github/actions/workflow/status/versolid/serde-flow/ci.yml?branch=main&style=for-the-badge" height="20">](https://github.com/versolid/serde-flow/actions?query=branch%3Amain)

`serde_flow` is a Rust library that simplifies managing changes in *serialized* data formats during software development, enabling seamless file migration and maintaining version compatibility.

## Features
1. **Serialize migration** with `#[variants(UserV1, UserV2)]`
2. **Serialize to file** with `#[flow(variant = 1, file)]`
3. **Async** with `#[flow(variant = 1, file(nonbloking))]`
4. **Zerocopy** with `#[flow(variant = 1, file, zerocopy)]`

## Basics
Serde Flow primarily consists of three major components:
1. `#[derive(Flow)]`: To utilize Serde Flow, you must annotate your class with `serde_flow::Flow`. This annotation serves as a signal to the library that the class is eligible for data migration.
2. `#[flow(variant = N)]`: Utilize this annotation to specify the version of the entity. Simply replace N with a `u16` number that represents the version. This helps in managing different versions of your data structures efficiently.
3. `#[variants(StructA, StructB, ...)]` (*Optional*): This annotation is optional but highly recommended for comprehensive data migration management. Here, you list the structs that are essential for migrating into the struct highlighted with this annotation. *To ensure, you need to implement `From<VariantStruct>` for all structs listed in `#[variants(..)]`*.

## 🛠️ Getting Started
```toml
[dependencies]
serde_flow = "1.0.0"
```
Imagine you have a `User` struct that has evolved over time through versions `UserV1` -> `UserV2` -> `User` (current), while the previous versions `UserV1` and `UserV2` still exist elsewhere. To manage this scenario effectively, follow these steps:
1. **Versioning:** Start by setting proper versioning from the beginning. The initial creation of the user should be annotated with `#[flow(variant = 1)]`.
2. **Incremental Versioning:** As you iterate and create subsequent versions, ensure to increment the version in the annotations, such as `#[flow(variant = 2)]` for the next version.
3. **Migration Preparation:** When you're ready to migrate to a new version, add the `#[variants(UserV1, UserV2)]` annotation to the main User struct. It's essential to include all previous variants that you intend to migrate from.
4. **Implementation Scope:** Variants must be implemented in the same file as the main variant to ensure proper management and accessibility during migration processes.

By adhering to these guidelines, you can effectively manage the evolution of your data structures while ensuring seamless migration across versions.
```rust

// the main file
#[derive(Serialize, Deserialize, Flow)]
#[flow(variant = 3, file)]
#[variants(UserV1, UserV2)]
pub struct User {
pub first_name: String,
pub middle_name: String,
pub last_name: String,
}

// previous variant
#[derive(Serialize, Deserialize, Flow)]
#[flow(variant = 2)]
pub struct UserV2 {
pub first_name: String,
pub last_name: String,
}

// the first version of the User entity
#[derive(Serialize, Deserialize, Flow)]
#[flow(variant = 1)]
pub struct UserV1 {
pub name: String,
}

// provide a proper mappings from old file to the new one
impl From<UserV1> for User {
fn from(value: UserV1) -> Self {
//... migration
}
}

impl From<UserV2> for User {
fn from(value: UserV2) -> Self {
//... migration
}
}
```

## Basic Serialization & Deserialization
```rust
// create an old struct
let user_v2 = UserV2 {
name: "John Adam Doe".to_string(),
};

// store on the disk
user_v2
.save_to_path::<bincode::Encoder>(&Path::new("/path/to/user"))
.unwrap();

// Now, you can load User struct, because you have a proper variant to transform
let user = User::load_from_path::<bincode::Encoder>(path.as_path()).unwrap();
```

## 📜 License
Bitwark is open-source software, freely available under the MIT License.

0 comments on commit bcd5dd3

Please sign in to comment.