Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Maven Dependency #85

Closed
KlausSchaefersAtWork opened this issue Jul 25, 2017 · 15 comments
Closed

Maven Dependency #85

KlausSchaefersAtWork opened this issue Jul 25, 2017 · 15 comments

Comments

@KlausSchaefersAtWork
Copy link

I added the following dep to my poml.xml

com.microsoft.ml.spark mmlspark 0.6 test

and also added the repo

azureedge.net MS Azure Maven Repo https://mmlspark.azureedge.net/maven

Still maven cannot find the artifact...
@KlausSchaefersAtWork KlausSchaefersAtWork changed the title Maven Depedency Maven Dependency Jul 25, 2017
@drdarshan
Copy link
Contributor

Dear @KlausSchaefersAtWork, thanks for reporting this - I'll take a look right away.

@drdarshan
Copy link
Contributor

Dear @KlausSchaefersAtWork, it is possibly an issue with the CDN on our side.

Could you please try the instructions to get it working via SBT here? I just tried a simple program and it worked for me.

Also, if you are able to attach your POM file, we can look into it more.

Sorry for the inconvenience and thanks for your patience while we figure this out!

@elibarzilay
Copy link
Contributor

@KlausSchaefersAtWork -- have you tried the above?

@KlausSchaefersAtWork
Copy link
Author

Hi,

I took the latest dependency from maven central...


4.0.0

<groupId>com.quant-ux</groupId>
<artifactId>spark-example</artifactId>
<version>1.0-SNAPSHOT</version>
<properties>
    <maven.compiler.source>1.8</maven.compiler.source>
    <maven.compiler.target>1.8</maven.compiler.target>
</properties>

<dependencies>
    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.11</artifactId>
        <version>2.1.1</version>
        <scope>provided</scope>
    </dependency>


    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-sql_2.11</artifactId>
        <version>2.1.1</version>
        <scope>provided</scope>
    </dependency>

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-mllib_2.11</artifactId>
        <version>2.1.1</version>
        <scope>provided</scope>
    </dependency>

    <dependency>
        <groupId>org.testng</groupId>
        <artifactId>testng</artifactId>
        <version>6.11</version>
        <scope>test</scope>
    </dependency>

    <dependency>
        <groupId>Azure</groupId>
        <artifactId>mmlspark</artifactId>
        <version>0.6</version>
    </dependency>


</dependencies>

<build>
    <plugins>
        <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-shade-plugin</artifactId>
            <version>3.0.0</version>
            <executions>
                <execution>
                    <phase>package</phase>
                    <goals>
                        <goal>shade</goal>
                    </goals>
                </execution>
            </executions>
        </plugin>
    </plugins>
</build>


<repositories>
    <repository>
        <id>azureedge.net</id>
        <name>MS Azure Maven Repo</name>
        <url>https://mmlspark.azureedge.net/maven</url>
    </repository>
</repositories>

@imatiach-msft
Copy link
Contributor

imatiach-msft commented Oct 24, 2017 •
edited
Loading

I don't believe 0.6 version exists, see here:
https://mvnrepository.com/artifact/Azure/mmlspark
The latest version is 0.9, so I would recommend using that:
https://mvnrepository.com/artifact/Azure/mmlspark/0.9

I see you are using 0.6 based on this:

<dependency>
    <groupId>Azure</groupId>
    <artifactId>mmlspark</artifactId>
    <version>0.6</version>
</dependency>

@imatiach-msft
Copy link
Contributor

@KlausSchaefersAtWork can you try my suggestion and let us know if the newer version in maven central works for you?

@elibarzilay
Copy link
Contributor

I'm not sure what's wrong exactly, but in general, we have no early packages (definitely not 0.6) on maven central itself, I think that it went on there later as part of the spark package uploads. But if you're specifying our maven url as a repository, then it should exist there.

@elibarzilay
Copy link
Contributor

Something that came up now when @mhamilton723 was entering the coordinates of a build: the artifact id for the maven coordinates should be mmlspark_2.11.

@mhamilton723
Copy link
Collaborator

@elibarzilay can this be closed?

@elibarzilay
Copy link
Contributor

Likely stale.

@bigdataexplorer
Copy link

bigdataexplorer commented Jun 1, 2018 •
edited
Loading

It works for me with the following

<repository>
      <id>azureedge.net</id>
      <name>MS Azure Maven Repo</name>
      <url>https://mmlspark.azureedge.net/maven</url>
</repository>
<dependency>
      <groupId>com.microsoft.ml.spark</groupId>
      <artifactId>mmlspark_2.11</artifactId>
      <version>0.12</version>
</dependency>

@imatiach-msft
Copy link
Contributor

imatiach-msft commented Aug 22, 2018 via email

@imatiach-msft
Copy link
Contributor

imatiach-msft commented Aug 27, 2018 via email

@friyal
Copy link

friyal commented Aug 27, 2018 •
edited
Loading

Hello, I've solved the problem by using something like:
<repository> <id>Maven</id> <url>https://dl.bintray.com/spark-packages/maven/</url> </repository> <dependency> <groupId>Azure</groupId> <artifactId>mmlspark</artifactId> <version>0.13</version> </dependency>
I think I just took a wrong repository before.
Thank you very much!

@imatiach-msft
Copy link
Contributor

imatiach-msft commented Aug 27, 2018 •
edited
Loading

@friyal Yes, that looks better, glad you were able to find it. The package is on maven central as well so you don't even need to specify the repository, you only need to specify the dependency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@elibarzilay @drdarshan @bigdataexplorer @friyal @mhamilton723 @KlausSchaefersAtWork @imatiach-msft