Kotlin2Js Gradle plugin #524

abesto · 2014-11-06T20:47:05Z

No description provided.

bashor · 2014-11-11T13:49:35Z

Sorry for delay!
I'll see it today.

bashor · 2014-11-11T16:52:48Z

Looks like all commits should be merged in one. Thoughts?

abesto · 2014-11-11T16:55:10Z

Can do. ETA 1 hour.
On Nov 11, 2014 5:52 PM, "Zalim Bashorov" notifications@github.com wrote:

Looks like all commits should be merged in one. Thoughts?

—
Reply to this email directly or view it on GitHub
#524 (comment).

bashor · 2014-11-11T16:58:29Z

or maybe two -- impl and tests

bashor · 2014-11-11T17:05:49Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+    abstract protected fun createBlankArgs(): T
+    public var kotlinOptions: T = createBlankArgs()
+
+    public var kotlinDestinationDir : File? = getDestinationDir()


Unnecessary space before colon(:)

bashor · 2014-11-11T17:14:33Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+
+    protected fun isJava(it: File): Boolean = FilenameUtils.getExtension(it.getName()).equalsIgnoreCase("java")
+
+    private fun getKotlinSources(): ArrayList<File> = getSource()


The call chain may be written in one line

Why just not List?

Good point :)

abesto · 2014-11-11T17:37:05Z

Fixed the two code style comments, squash coming up soon.

bashor · 2014-11-11T17:41:41Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt


-        args.freeArgs = sources.map { it.getAbsolutePath() }
+    abstract protected fun populateTargetSpecificArgs(args: T, sources: ArrayList<File>)


looks like we don't need sources in populateTargetSpecificArgs

I think will be better if move up populateTargetSpecificArgs and afterCompileHook declarations, because it's part of API of this class

Absolutely.

bashor · 2014-11-11T17:48:45Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+            .filterNot { isJava(it) }
+            .toArrayList()
+
+    protected fun populateCommonArgs(args: T, sources: ArrayList<File>) {


should be it private?

In an ideal world, yes. I don't know enough to confidently say no-one will ever need to override it. If you say go, I'll change it.

let's do it :)

bashor · 2014-11-11T17:59:07Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+    protected fun isJava(it: File): Boolean = FilenameUtils.getExtension(it.getName()).equalsIgnoreCase("java")
+
+    private fun getKotlinSources(): ArrayList<File> = getSource()
+            .filterNot { isJava(it) }


I think more properly to check that it's kotlin file.

P.S. I see that it's legacy code

You can get file extension by file.extension.
And You can use JetFileType.EXTENSION instead of magic string.

FYI, I'll rebase to the latest master to get JetFileType.EXTENSION. Would have to do it anyway. I'll squash the commits again once we're done with the review.

JavaFileType has slightly different constants, so I used the common interface to make the symmetry obvious.

bashor · 2014-11-11T18:07:54Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+    private fun getJavaSourceRoots(): HashSet<File> = getSource()
+            .filter { isJava(it) }
+            .map { findSrcDirRoot(it) }
+            .filter { it != null }


May be replaced with filterNotNull

Great! I spent a minute or so looking for this method but couldn't find it for some reason.

bashor · 2014-11-11T18:08:20Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

-            ExitCode.INTERNAL_ERROR -> throw GradleException("Internal compiler error. See log for more details")
-            else -> {}
-        }
+    private fun getJavaSourceRoots(): HashSet<File> = getSource()


May be List?

It needs to be a set because generally there will be several files in each source root, leading to multiple entries for each source root. But I've generalized it from HashSet to just Set.

bashor · 2014-11-11T18:19:53Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+
+    fun outputFile(): String {
+        return if (StringUtils.isEmpty(kotlinOptions.outputFile)) {
+            "${kotlinDestinationDir}/app.js"


I think outputFile can not be omitted and if it omitted compilation should be failed.

Isn't this the same case as destination for the JVM task? There the plugin defaults to kotlinDestinationDir. This is basically the same logic. Of course we don't need to keep symmetry between the plugins.

I don't have a strong preference, it's up to you :)

They are similar but not the same.
In k2js compiler right now file name will be used as module name, so I think this parameter should be provided explicitly. (Probably in the future it will be replaced with moduleName)

As far as i understand JVM task, by default, use project's build dir.

Ok, that makes sense. I'm convinced.

bashor · 2014-11-11T18:26:21Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+
+    [TaskAction] fun rewrite() {
+        val file = File(sourceMapPath())
+        val text = file.readText("UTF-8")


charset parameter may be omitted -- UTF-8 will by use by default

abesto · 2014-11-11T19:48:18Z

Sorry for the delay, I shot myself in the foot by upgrading my default java to 8, causing strange gradle internal errors. Almost done with "fail if outputFile not set".

abesto · 2014-11-11T20:50:07Z

... and then proceeded to shoot myself in the foot repeatedly with various tools. Anyway, that's it for me today. Next time I'll have more than 10 minutes to hack on this will probably be Thursday. Thanks for the review so far!

bashor · 2014-11-11T20:52:06Z

Thanks for your efforts!

bashor · 2014-11-12T11:52:19Z

...kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/plugin/KotlinPlugin.kt

+        compilerClass = javaClass<Kotlin2JsCompile>()) {
+    val copyKotlinJsTaskName = sourceSet.getTaskName("copy", "kotlinJs")
+    val clean = project.getTasks().findByName("clean")
+    val compileJava = project.getTasks().findByName(sourceSet.getCompileJavaTaskName()) as AbstractCompile?


Why we need javaTask?

Because a bunch of tasks are added to its dependencies, so that they run on gradle build.

Could we avoid to use it?

Sure: abesto@3e1461c

bashor · 2014-11-12T13:18:02Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+    }
+}
+
+public open class RewritePathsInSourceMap() : DefaultTask() {


Ideally it should be fixed in compiler as part of KT-4078. You can just add TODO comment that this hack should be dropped after KT-4078 will be fixed or fix it :)

Ah, nice to know this is something you've already thought about. I'd prefer not to attack 4078, added TODOs in abesto@c50a32e

bashor · 2014-11-12T13:22:09Z

...s/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt

+
+    override fun createBlankArgs(): K2JSCompilerArguments = K2JSCompilerArguments()
+
+    public fun addLibraryFiles(vararg fs: String) {


I think we should extract all libraries from dependencies instead.

Agree, thanks for pointing it out. Done in abesto@99df661 and abesto@fe3060d

bashor · 2014-11-13T17:05:10Z

...kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/plugin/KotlinPlugin.kt

+        clean?.dependsOn("clean" + kotlinTaskName.capitalize())
+
+        createCopyKotlinJsTask(jsLibraryJar)
+        createCopyKotlinSourcesForSourceMapTask()


I think we should not be able to copy source files.

I'm not exactly sure what you mean. Let me explain the use-case I tried to solve here, maybe that's an answer; if not, please clarify.

There are two things you may want to do with source maps. One, use them locally. In this case it doesn't matter where the Kotlin sources are, the browser will find them over the file:// protocol. Two, distribute the source-map and Kotlin sources with the project; either as a debug build of the application, or as an example of kotlin2js. In this case the Kotlin sources need to be copied to a place the sourcemap can reference; also it needs to be edited to point to paths relative to the sourcemap (that's what createRewritePathsInSourceMapTask does).

I think that this gradle task should not be able to copy source files because user can do it in plain gradle if need, and how he want. And maybe it can lead to accidental leakage of sources.
But we should provide better way to setup source map generation(KT-4078).

Fair enough. Removed them in abesto@dbeacf0

bashor · 2014-11-15T13:27:49Z

You can find some my minor changes in https://github.com/JetBrains/kotlin/commits/rr/z/pr/524__4.
It includes:

fixes of windows specific issues;
temporary disable assert for source map which fails on windows(build log;
temporary drop copying source files(AFAIR something fails on windows).

You can see build results for this branch here

abesto · 2014-11-15T14:40:35Z

Thanks for linking your changes, they look good to me. Should I merge / cherry-pick them into this branch, or will you take care of that after the next squash?

bashor · 2014-11-15T19:59:04Z

Would be nice if You cherry-pick my changes.

abesto · 2014-11-15T20:23:25Z

Done. Also: does adab044 mean that I shouldn't add kotlin-js-library as a dependency (and thus add the jar to libraryFiles) anymore? Edit: atm I can't try it out because my build against master fails with [error] /Users/abesto/playground/kotlin/libraries/stdlib/src/kotlin/io/ReadWrite.kt: (156, 37) Type mismatch: inferred type is java.util.stream.Stream<kotlin.String!>! but kotlin.Stream<kotlin.String> was expected, not yet sure if I messed up my local env or there's really a bug.

bashor · 2014-11-15T21:15:31Z

does adab044 mean that I shouldn't add kotlin-js-library as a dependency (and thus add the jar to libraryFiles) anymore?

I think in maven and in gradle user should declare kotlin-js-library as dependency explicitly.
Probably You already saw that I added args.noStdlib = true in your code

abesto · 2014-11-15T21:17:41Z

Ok, I'll make it so. I'm curious: is there a reason besides "let's not surprise the developer by adding dependencies"?

bashor · 2014-11-15T21:18:20Z

What version of the compiler you?
Did you rebase on current master?

bashor · 2014-11-15T21:21:00Z

They(maven, gradle) have own dependency manager and probably will be proper to use it.

abesto · 2014-11-15T21:24:03Z

Agree with using Gradle to define the dependency, that's how it's implemented currently. The plugin uses the Gradle dependency manager to set kotlin-js-library as a compile dependency. I take it you don't think we should do this, the user should specify it explicitly; I'll remove the code from the plugin that adds the dependency.

bashor · 2014-11-15T21:25:11Z

For developing Kotlin we use plugin from https://teamcity.jetbrains.com/guestAuth/repository/download/bt345/bootstrap.tcbuildtag/updatePlugins.xml

You can find more information here

abesto · 2014-11-15T21:27:42Z

Wrt/ the build error: rebased on latest master (321e758). I'm using CLI tools to build. Did ant -f update_dependencies.xml, then ant -f build.xml dies with the above error. AFAICT I don't even have a working Kotlin compiler since I can't build the stdlib.

abesto · 2014-11-15T21:29:53Z

./dependencies/bootstrap-compiler/Kotlin/kotlinc/bin/kotlinc-jvm -version                                                                                                                                                           22:29:22
INFO: Kotlin Compiler version 0.9.686

bashor · 2014-11-15T21:38:40Z

0.9.686 is OK, it's latest bootstrap compiler. So, I'll try build your branch locally.

bashor · 2014-11-15T21:56:38Z

I got it -- it's conflict between kotlin's Stream and java's Stream, try to run build on older runtime.

abesto · 2014-11-15T22:05:52Z

Bah. This again.

Nice, thanks for figuring it out, build works with Java 7. Will now fix if any tests are broken and squash the commits.

bashor · 2014-11-15T22:15:03Z

I take it you don't think we should do this, the user should specify it explicitly; I'll remove the code from the plugin that adds the dependency.

Yes, for maven and gradle we prefer this way.

Anyway we should provide a way to build with and without stdlib.

Conflicts: libraries/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/plugin/KotlinPlugin.kt

abesto · 2014-11-19T20:36:59Z

Quick check, are you waiting for some changes, or just didn't get around to moving on with this?

bashor · 2014-11-19T21:18:19Z

Hi, Zoltán!

Sorry for delay!

Right now I waiting some changes in master, I hope it'll happen in some days.
This changes allow to avoid your "hack" in kotlin-javascript-library and allow to use kotlin2js gradle project from IDEA.

Additionally we don't sure that our buildtools(ant, maven, gradle) should copy js files from libraries to out dir. Maybe user should do it himself(by own tools)?
Feel free to share your thoughts.

Thanks!

abesto · 2014-11-19T21:33:20Z

No problem at all, thanks for the prompt response.

Avoiding hacks is great, I'm fine with waiting for it.

About not copying the library to the out dir: as a user of the plugins, I have no idea where to find the kotlin.js for the version of Kotlin I'm using in my project. OTOH, I can see how automatically copying the file is not clean. How about providing a task type, but not creating a task by default? That way the user can manage what happens explicitly, without having to think about Kotlin internals.

bashor · 2014-11-21T13:48:26Z

Good points, thanks! Let's continue discussion here.

bashor · 2014-12-24T09:42:27Z

Hi, @abesto!

I pushed PR commits manually with minor fixes.

bashor · 2014-12-24T09:44:11Z

Thanks a lot for your contributions!

bashor · 2014-12-24T09:47:15Z

Additionally I turn off now copy js kotlin.js from jar, it's current common behavior of all our build tools. we'll continue to think how simplify build process.

abesto · 2014-12-24T10:18:16Z

\o/ best 🎄 🎁 :)

yanex · 2014-12-24T13:37:27Z

Files with ".kts" extension are Kotlin source files as well.

bashor self-assigned this Nov 6, 2014

bashor reviewed Nov 11, 2014
View changes

abesto force-pushed the abesto:gradle-js branch from e554509 to 73794d1 Nov 11, 2014

bashor reviewed Nov 11, 2014
View changes

abesto force-pushed the abesto:gradle-js branch from a364d64 to faa76ba Nov 11, 2014

bashor reviewed Nov 11, 2014
View changes

abesto force-pushed the abesto:gradle-js branch from 6462fba to 158e73e Nov 12, 2014

bashor reviewed Nov 12, 2014
View changes

bashor reviewed Nov 13, 2014
View changes

abesto force-pushed the abesto:gradle-js branch from 3e1461c to 5c5519d Nov 15, 2014

abesto and others added 3 commits Nov 15, 2014

Kotlin2Js Gradle plugin implementation

0435c90

Kotlin2Js Gradle plugin tests

c811232

Code quality, bugfixes

55cce01

Conflicts: libraries/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/plugin/KotlinPlugin.kt

abesto force-pushed the abesto:gradle-js branch from a326c3d to 55cce01 Nov 15, 2014

lptr referenced this pull request Dec 11, 2014

Added wrapper module for gradle plugin

7e36547

goodwinnk force-pushed the JetBrains:master branch from f0cbb00 to 8de11e4 Dec 15, 2014

bashor closed this Dec 24, 2014


		protected fun isJava(it: File): Boolean = FilenameUtils.getExtension(it.getName()).equalsIgnoreCase("java")

		private fun getKotlinSources(): ArrayList<File> = getSource()


		args.freeArgs = sources.map { it.getAbsolutePath() }
		abstract protected fun populateTargetSpecificArgs(args: T, sources: ArrayList<File>)


		override fun createBlankArgs(): K2JSCompilerArguments = K2JSCompilerArguments()

		public fun addLibraryFiles(vararg fs: String) {

JetBrains / kotlin

Kotlin2Js Gradle plugin #524

Kotlin2Js Gradle plugin #524

Conversation

abesto commented Nov 6, 2014

bashor commented Nov 11, 2014

bashor commented Nov 11, 2014

abesto commented Nov 11, 2014

bashor commented Nov 11, 2014

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

abesto commented Nov 11, 2014

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014 Member

This comment has been minimized.

abesto Nov 11, 2014 Author Contributor

This comment has been minimized.

bashor Nov 11, 2014 Member

abesto commented Nov 11, 2014

abesto commented Nov 11, 2014

bashor commented Nov 11, 2014

This comment has been minimized.

bashor Nov 12, 2014 Member

This comment has been minimized.

abesto Nov 15, 2014 Author Contributor

This comment has been minimized.

bashor Nov 15, 2014 Member

This comment has been minimized.

abesto Nov 15, 2014 Author Contributor

This comment has been minimized.

bashor Nov 12, 2014 Member

This comment has been minimized.

abesto Nov 15, 2014 Author Contributor

This comment has been minimized.

bashor Nov 12, 2014 Member

This comment has been minimized.

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

bashor Nov 11, 2014
Member

abesto Nov 11, 2014
Author Contributor

bashor Nov 11, 2014
Member

bashor Nov 12, 2014
Member

abesto Nov 15, 2014
Author Contributor

bashor Nov 15, 2014
Member

abesto Nov 15, 2014
Author Contributor

bashor Nov 12, 2014
Member

abesto Nov 15, 2014
Author Contributor

bashor Nov 12, 2014
Member

abesto Nov 15, 2014
Author Contributor

bashor Nov 13, 2014
Member

abesto Nov 15, 2014
Author Contributor

bashor Nov 15, 2014
Member

abesto Nov 15, 2014
Author Contributor

yanex commented on `libraries/tools/kotlin-gradle-plugin-core/src/main/kotlin/org/jetbrains/kotlin/gradle/tasks/Tasks.kt` in `0435c90` Dec 24, 2014