Skip to content
This repository has been archived by the owner on Nov 16, 2023. It is now read-only.

Azure-Samples/data-lake-s3-and-powerbi-demo-pipeline

Repository files navigation

Project Name

Move data from an AWS S3 bucket to Azure Data Lake Store via Azure Data Factory, transform the data with Azure Data Lake Analytics, and then output the data to PowerBI.

Features

This project framework provides the following features:

  • Data Factory JSON definition files to build the pipeline
  • Powershell scripts to use in Azure
  • U-SQL script to transform the data
  • Sample data for use in the demo

Getting Started

Prerequisites

  • Azure Powershell
  • Visual Studios (optional)
  • PowerBI

Quickstart

(Add steps to get up and running quickly)

  1. git clone https://github.com/Azure-Samples/data-lake-s3-and-powerbi-demo-pipeline.git
  2. cd C:
  3. mkdir ADFv2QuickStartPSH

Resources

  • Azure Data Lake
  • Azure Data Factory
  • Azure Portal

About

End to End pipeline showing how to move unstructured data from S3 and analyze it using U-SQL and then viewing the results in PowerBI

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published