Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-5155] [PySpark] [Streaming] Mqtt streaming support in Python #7833

Closed
wants to merge 26 commits into from
Closed

[SPARK-5155] [PySpark] [Streaming] Mqtt streaming support in Python #7833

wants to merge 26 commits into from

Commits on Jul 4, 2015

  1. Mqtt streaming support in Python

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    b7d42ff View commit details
    Browse the repository at this point in the history

  2. Added Python streaming mqtt word count example

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    3aa7fff View commit details
    Browse the repository at this point in the history

  3. adress comments

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    b34c3c1 View commit details
    Browse the repository at this point in the history

  4. updated version

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    3f4df12 View commit details
    Browse the repository at this point in the history

  5. Fix assembly jar location of mqtt-assembly

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    ee387ae View commit details
    Browse the repository at this point in the history

  6. address comments

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    795ec27 View commit details
    Browse the repository at this point in the history

  7. fixed python style

    @prabeesh
    prabeesh committed Jul 4, 2015
    Configuration menu
    Copy the full SHA
    a11968b View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2015

  1. implemented Python-friendly class

    @prabeesh
    prabeesh committed Jul 7, 2015
    Configuration menu
    Copy the full SHA
    9767d82 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2015

  1. added Python test

    @prabeesh
    prabeesh committed Jul 11, 2015
    Configuration menu
    Copy the full SHA
    a5a8f9f View commit details
    Browse the repository at this point in the history

  2. scala style fix

    @prabeesh
    prabeesh committed Jul 11, 2015
    Configuration menu
    Copy the full SHA
    e1ee016 View commit details
    Browse the repository at this point in the history

  3. python style fix

    @prabeesh
    prabeesh committed Jul 11, 2015
    Configuration menu
    Copy the full SHA
    1f0cfe9 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2015

  1. fix

    @prabeesh
    prabeesh committed Jul 12, 2015
    Configuration menu
    Copy the full SHA
    80474d1 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2015

  1. Make sbt build the assembly test jar for streaming mqtt

    @zsxwing
    zsxwing committed Jul 22, 2015
    Configuration menu
    Copy the full SHA
    97244ec View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2015

  1. address the comments: 

    	keep the whole MQTTTestUtils in test and then link to test jar from python
	fix issue under Maven build
	return JavaDStream[String] directly.
    Prabeesh K committed Jul 23, 2015
    Configuration menu
    Copy the full SHA
    87fc677 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2015

  1. wait for starting the receiver before publishing data

    @prabeesh
    prabeesh committed Jul 24, 2015
    Configuration menu
    Copy the full SHA
    a6747cb View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2015

  1. Register StreamingListerner before starting StreamingContext; Revert … 

    …unncessary changes; fix the python unit test
    @zsxwing
    zsxwing committed Jul 26, 2015
    Configuration menu
    Copy the full SHA
    d07f454 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1 from zsxwing/pr4229 

    Register StreamingListerner before starting StreamingContext; Revert …
    @prabeesh
    prabeesh committed Jul 26, 2015
    Configuration menu
    Copy the full SHA
    b90b709 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2015

  1. address the comments

    Prabeesh K committed Jul 30, 2015
    Configuration menu
    Copy the full SHA
    126608a View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2015

  1. Merge branch 'master' into pr4229

    @zsxwing
    zsxwing committed Jul 31, 2015
    Configuration menu
    Copy the full SHA
    734db99 View commit details
    Browse the repository at this point in the history

  2. Make the maven build generate the test jar for Python MQTT tests

    @zsxwing
    zsxwing committed Jul 31, 2015
    Configuration menu
    Copy the full SHA
    5f8a1d4 View commit details
    Browse the repository at this point in the history

  3. Add unpack

    @zsxwing
    zsxwing committed Jul 31, 2015
    Configuration menu
    Copy the full SHA
    478f844 View commit details
    Browse the repository at this point in the history

  4. Include the project class files

    @zsxwing
    zsxwing committed Jul 31, 2015
    Configuration menu
    Copy the full SHA
    47278c5 View commit details
    Browse the repository at this point in the history

  5. Fix the flaky MQTT tests

    @zsxwing
    zsxwing committed Jul 31, 2015
    Configuration menu
    Copy the full SHA
    935615c View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2015

  1. Merge branch 'master' into pr4229

    @zsxwing
    zsxwing committed Aug 1, 2015
    Configuration menu
    Copy the full SHA
    abf5f18 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2015

  1. Fix pom.xml indentation

    @zsxwing
    zsxwing committed Aug 4, 2015
    Configuration menu
    Copy the full SHA
    4a9c79e View commit details
    Browse the repository at this point in the history

  2. Fix the variable name and check null in finally

    @zsxwing
    zsxwing committed Aug 4, 2015
    Configuration menu
    Copy the full SHA
    9570bec View commit details
    Browse the repository at this point in the history