Feature/generate sh files #6
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
deepakmca05
added a commit
that referenced
this pull request
Dec 29, 2021
* Scala Code for data algorithms with spark-ch01 * Refactored the package name * With spark contextclose * Feature/scala code/ch01 biman (#3) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * dataframe join right * dataframe sql * rdd map transformations * rdd filter transformations * rdd flatMap transformations * rdd transformations groupByKey * rdd transformations Join * rdd transformations Cartesian * rdd transformations Combine By Key * rdd transformations MapPartitions * rdd transformations Sort By * rdd action take ordered * Feature/scala code/ch01 deepak (#4) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * Refactroed code + RDD Transformation * INDENTATION CORRECT * ReduceByKey * ReduceByKey1 Co-authored-by: bimanmandal <biman29@gmail.com> * added gradle shorthands * Feature/generate sh files (#6) * added gradle shorthands * added the shell script * added the shell script * updated the shell commands Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: bimanmandal <biman29@gmail.com>
bimanmandal
added a commit
that referenced
this pull request
Jan 7, 2022
* added kmers for FASTA and FASTQ formats * DNA Based count in scala * Indentation fix * improved documentation * ch02 * Feature/scala code/ch01 (#5) * Scala Code for data algorithms with spark-ch01 * Refactored the package name * With spark contextclose * Feature/scala code/ch01 biman (#3) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * dataframe join right * dataframe sql * rdd map transformations * rdd filter transformations * rdd flatMap transformations * rdd transformations groupByKey * rdd transformations Join * rdd transformations Cartesian * rdd transformations Combine By Key * rdd transformations MapPartitions * rdd transformations Sort By * rdd action take ordered * Feature/scala code/ch01 deepak (#4) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * Refactroed code + RDD Transformation * INDENTATION CORRECT * ReduceByKey * ReduceByKey1 Co-authored-by: bimanmandal <biman29@gmail.com> * added gradle shorthands * Feature/generate sh files (#6) * added gradle shorthands * added the shell script * added the shell script * updated the shell commands Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: bimanmandal <biman29@gmail.com> * updated README.md * updated README.md * ch02-changes * ch02-changes * Feature/scala code/ch01 missing class gradle (#7) * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * added bonus chapter correlation * added bonus chapter correlation * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * DNABaseCountFastq * added the code changes for chapter 2 * added the run_spark_applications_scripts * added the conditions for 1GB data * added the readme file Co-authored-by: Mahmoud Parsian <mahmoud.parsian@yahoo.com> Co-authored-by: deepakmca05 <deepakmca05@gmail.com>
deepakmca05
added a commit
that referenced
this pull request
Jan 7, 2022
* added kmers for FASTA and FASTQ formats * DNA Based count in scala * Indentation fix * improved documentation * ch02 * Feature/scala code/ch01 (#5) * Scala Code for data algorithms with spark-ch01 * Refactored the package name * With spark contextclose * Feature/scala code/ch01 biman (#3) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * dataframe join right * dataframe sql * rdd map transformations * rdd filter transformations * rdd flatMap transformations * rdd transformations groupByKey * rdd transformations Join * rdd transformations Cartesian * rdd transformations Combine By Key * rdd transformations MapPartitions * rdd transformations Sort By * rdd action take ordered * Feature/scala code/ch01 deepak (#4) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * Refactroed code + RDD Transformation * INDENTATION CORRECT * ReduceByKey * ReduceByKey1 Co-authored-by: bimanmandal <biman29@gmail.com> * added gradle shorthands * Feature/generate sh files (#6) * added gradle shorthands * added the shell script * added the shell script * updated the shell commands Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: bimanmandal <biman29@gmail.com> * updated README.md * updated README.md * ch02-changes * ch02-changes * Feature/scala code/ch01 missing class gradle (#7) * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * added bonus chapter correlation * added bonus chapter correlation * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * DNABaseCountFastq * added the code changes for chapter 2 * added the run_spark_applications_scripts * added the conditions for 1GB data * added the readme file Co-authored-by: Mahmoud Parsian <mahmoud.parsian@yahoo.com> Co-authored-by: deepakmca05 <deepakmca05@gmail.com> Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: Mahmoud Parsian <mahmoud.parsian@yahoo.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.