0.3.0

ScaleDP 0.30

What's Changed

🚀 Features

• Added TextEmbeddings transformer, for compute embedding using SentenceTransformers
• Added BaseTextSplitter and TextSplitter for semantic splitting text
• Added support pandas udf for TextSplitter
• Added support TextChunks as input to TextEmbeddings

📚 Documentation

• Added TextEmbedding and TextSplitter docs

📘 Jupyter Notebooks

• TextSplitterAndEmbeddings.ipynb - Read pdf documents, split text into chunks and compute embeddings in scale