[WIP] publishing to scaladex using sbt publish #176

Scyks · 2016-07-09T14:51:22Z

implementing receiving data from bt publish task
verify credentials to github
only accept pom file
write pom file
update index

Todos:

verify write access to this repo
check for ovverrides
cleanup
documentation
rebase to elastic restructuring
scripted test
publish plugin to sbt community
complete documentation after decision of don't trust scmInfo (Forked repositories) #178

Sbt config

scaladexKeywords in Scaladex := Seq("foo", "bar", "acl")
scaladexDownloadContributors in Scaladex := false
scaladexDownloadInfo in Scaladex := false
scaladexDownloadReadme in Scaladex := false
Credentials in Scaladex := Credentials(Path.userHome / ".ivy2" / ".scaladex.credentials")

Scyks · 2016-07-09T14:52:29Z

server/src/main/scala/ch.epfl.scala.index.server/ApiImplementation.scala

@@ -74,7 +74,8 @@ class ApiImplementation(github: Github, userState: Option[UserState])(implicit v
          )
        )
      ).limit(1)
-    }.map(r => r.as[Project].headOption.map(hideId))
+//    }.map(r => r.as[Project].headOption.map(hideId))
+    }.map ( r => r.as[Project].headOption)


@MasseGuillaume Maybe this will lead to some problems. I guess indexing all data

what about it ?

I guess it was there for a reason.

yep the id was for updating (ProjectDelta)

Ok, then i'll fix that :)

MasseGuillaume · 2016-07-09T17:04:17Z

really cool!

If I understand well, it's to receive pom from sbt via http and fetch all info to index.

On this branch I remove the link between projects and release:
https://github.com/scalacenter/scaladex/tree/feature/no-artifacts

Therefore adding a new release will be pretty easy :-)

Scyks · 2016-07-09T18:29:22Z

Can i already rebase to no-artifactsbranch?

MasseGuillaume · 2016-07-09T22:23:59Z

@Scyks almost, if it's too much work I can do it for you.

MasseGuillaume · 2016-07-10T16:50:29Z

sbtScaladex/src/main/scala/ScaladexPlugin.scala

+
+  object autoImport {
+
+    lazy val scaladex = TaskKey[Unit]("scaladex-publish", "Publishes to scaladex")


you should create a scaladex scope and reuse the publish task

- implementing receiving data from bt publish task - verify credentials to github - only accept pom file - write pom file - update index Todos: - [ ] verify write access to this repo - [ ] check for ovverrides - [ ] cleanup - [ ] rebase to elastic restructuring

The url schema is changed to provide some settings for scaldex - download readme - download info - download contributors - keywords Lookup a release by mavenReference

- refactoring of `PublishProcess` to ensure the user have write access to the repo. - Check the write access - check for publish settings - update project keywords

Thanks @MasseGauillaume :)

… into publish-to-scaladex

I created a bintray user called scaladex and published a package under https://bintray.com/scaladex/sbt-plugins/sbt-scaladex a request was sent to be included to https://bintray.com/sbt/sbt-plugin-releases

Scyks · 2016-07-12T05:19:53Z

sbtScaladex/src/main/scala/org.scala_lang.index.sbt/ScaladexPlugin.scala

@@ -22,13 +22,15 @@ object ScaladexPlugin extends AutoPlugin {
    lazy val scaladexDownloadReadme = settingKey[Boolean]("defines if scaladex should download the readme file from the defined scm tag")
    lazy val scaladexDownloadInfo = settingKey[Boolean]("defines if scaladex should download the project info from the defined scm tag")
    lazy val scaladexDownloadContributors = settingKey[Boolean]("defines if scaladex should download the contributors from the defined scm tag")
+    lazy val scaladexBaseUrl = settingKey[String]("scaladex server location and path")


Nice, i wanted to add that also 👍

Scyks · 2016-07-12T06:09:08Z

README.MD


-## How to run:
+## Hot to publish on scaladex


@heathermiller @MasseGuillaume Could one of you maybe check the description of errors / miss understanding / mistakes.

MasseGuillaume · 2016-07-13T19:01:02Z

data/src/main/scala/ch.epfl.scala.index.data/github/GithubDownload.scala

 import play.api.libs.ws.ahc.AhcWSClient

 import scala.util._
 import java.nio.charset.StandardCharsets
 import java.nio.file.{Files, Path}

-class GithubDownload(implicit val system: ActorSystem, implicit val materializer: ActorMaterializer) extends PlayWsDownloader {
+class GithubDownload(privateCredentials: Option[GithubCredentials], implicit val system: ActorSystem, implicit val materializer: ActorMaterializer) extends PlayWsDownloader {


split in two

class GithubDownload(privateCredentials: Option[GithubCredentials])(implicit val system: ActorSystem, implicit val materializer: ActorMaterializer) extends PlayWsDownloader {

MasseGuillaume added the in progress label Jul 9, 2016

Scyks reviewed Jul 9, 2016
View reviewed changes

Scyks mentioned this pull request Jul 9, 2016

Index private repositories #15

Closed

Scyks force-pushed the publish-to-scaladex branch from 0f81816 to 43a2a1d Compare July 10, 2016 07:37

MasseGuillaume reviewed Jul 10, 2016
View reviewed changes

MasseGuillaume and others added 11 commits July 11, 2016 20:59

front page

57b82cf

be consistent with github width for readme

b277ac8

rebased to no-artifacts

db44225

Change publish url schema, lookup release

6d1b4f4

The url schema is changed to provide some settings for scaldex - download readme - download info - download contributors - keywords Lookup a release by mavenReference

restructure process, verify write access

c15ea7d

- refactoring of `PublishProcess` to ensure the user have write access to the repo. - Check the write access - check for publish settings - update project keywords

Fix write access, put indexing into a future

9dc513e

implement command based scaladex plugin

5cd7e18

fix build

9793c3c

try to solve that with scopes

cb3bb67

optimization after rebase

12b56e9

Scyks force-pushed the publish-to-scaladex branch from f630514 to 12b56e9 Compare July 11, 2016 19:23

MasseGuillaume and others added 3 commits July 11, 2016 15:30

removing artifact html

ca91e29

solved SBT plugin - it works :)

4ab5bcf

Thanks @MasseGauillaume :)

Merge branch 'publish-to-scaladex' of github.com:scalacenter/scaladex…

8b0e111

… into publish-to-scaladex

Scyks mentioned this pull request Jul 11, 2016

don't trust scmInfo (Forked repositories) #178

Open

Scyks added 3 commits July 12, 2016 00:06

write a bit of documentation for the plugin

0714d00

simply use the first repository found in scm tag

18e7ca5

adding documentation to the classes

331e351

MasseGuillaume added 3 commits July 11, 2016 23:15

scripted sbt plugin test setup

7e37ebf

note to turn on plugin testing in travis eventually

744cd6b

sbt-bintray and notes how to publish sbt plugins

cbec70d

I created a bintray user called scaladex and published a package under https://bintray.com/scaladex/sbt-plugins/sbt-scaladex a request was sent to be included to https://bintray.com/sbt/sbt-plugin-releases

Scyks reviewed Jul 12, 2016
View reviewed changes

added description for publishing using the Plugin

c746c31

Scyks reviewed Jul 12, 2016
View reviewed changes

Scyks added 3 commits July 12, 2016 08:16

optimizing the README

dcc3f47

fix typos and referencing

13a86e1

added section for private repositories

005a720

Scyks changed the title ~~[WIP] test for publishing to scaladex using sbt publish~~ [WIP] publishing to scaladex using sbt publish Jul 12, 2016

update readme, some comments

ffd8eb2

MasseGuillaume reviewed Jul 13, 2016
View reviewed changes

Scyks added 2 commits July 13, 2016 21:05

simplify GithubDownload creation

22e0378

iuse java temp file creation

09d0e76

MasseGuillaume merged commit 04df102 into master Jul 13, 2016

MasseGuillaume removed the in progress label Jul 13, 2016

Scyks deleted the publish-to-scaladex branch July 13, 2016 19:44

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[WIP] publishing to scaladex using sbt publish #176

[WIP] publishing to scaladex using sbt publish #176

Scyks commented Jul 9, 2016 •

edited by MasseGuillaume

Scyks Jul 9, 2016

MasseGuillaume Jul 9, 2016

Scyks Jul 9, 2016

MasseGuillaume Jul 9, 2016

Scyks Jul 9, 2016

MasseGuillaume commented Jul 9, 2016

Scyks commented Jul 9, 2016

MasseGuillaume commented Jul 9, 2016

MasseGuillaume Jul 10, 2016 •

edited

Scyks Jul 12, 2016

Scyks Jul 12, 2016

MasseGuillaume Jul 13, 2016


		object autoImport {

		lazy val scaladex = TaskKey[Unit]("scaladex-publish", "Publishes to scaladex")

[WIP] publishing to scaladex using sbt publish #176

[WIP] publishing to scaladex using sbt publish #176

Conversation

Scyks commented Jul 9, 2016 • edited by MasseGuillaume

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

MasseGuillaume commented Jul 9, 2016

Scyks commented Jul 9, 2016

MasseGuillaume commented Jul 9, 2016

MasseGuillaume Jul 10, 2016 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Scyks commented Jul 9, 2016 •

edited by MasseGuillaume

MasseGuillaume Jul 10, 2016 •

edited