For those of you new to the JVM who have never touched Ant or Maven in anger: don't panic. Leiningen is designed with you in mind. This tutorial will help you get started and explain Leiningen's take on project building and JVM-land dependency management.
We'll assume you've got Leiningen installed as per the README. Generating a new project is easy:
$ lein new myproject
Created new project in: myproject
$ cd myproject
$ tree
.
|-- project.clj
|-- README
|-- src
| `-- myproject
| `-- core.clj
`-- test
`-- myproject
`-- core_test.clj
Here we've got your project's README, a src/ directory containing the code, a test/ directory, and a project.clj file which describes your project to Leiningen. The src/myproject/core.clj file corresponds to the myproject.core namespace.
Note that we use myproject.core instead of just myproject since single-segment namespaces are discouraged in Clojure. Also the file test/myproject/core_test.clj corresponds with the myproject.core-test namespace--you need to remember to replace dashes in namespace names with underscores in file names on disk since the JVM has trouble loading files with dashes in the name.
You can package your project up now, even though at this stage it's fairly useless:
$ lein jar
Created ~/src/myproject/myproject-1.0.0-SNAPSHOT.jar
Libraries for the JVM are packaged up as .jar files, which are basically just .zip files with a little extra JVM-specific metadata. They usually contain .class files (JVM bytecode) and .clj source files, but they can also contain other things like config files. Leiningen downloads jar files of dependencies from remote Maven repositories for you.
$ cat project.clj
(defproject myproject "1.0.0-SNAPSHOT"
:description "FIXME: write description"
:dependencies [[org.clojure/clojure "1.2.0"]])
Fill in the :description with a short paragraph so that your project will show up in search results once you upload to Clojars as described below. At some point you'll need to flesh out the README too, but for now let's skip ahead to setting :dependencies. Note that Clojure is just another dependency here. Unlike most languages, it's easy to swap out any version of Clojure.
If you've got a simple pure-clojure project, you will be fine with the default of depending only on Clojure, but otherwise you'll need to list other dependencies.
Clojars is the Clojure community's centralized jar repository, and it's where you'll find Clojure dependencies for your project. Each dependency even lists out the snippet you'll need to put in your project.clj to use it. Let's take a look at what it would take to add a library named Lancet:
It's available on Clojars with the Leiningen dependency notation shown as below:
[lancet "1.0.0"]
The "artifact id" here is "lancet", and "1.0.0" is the version you require. Every library also has a "group id", though for Clojure libraries it is often the same as the artifact-id, in which case you may leave it out of the Leiningen dependency notation. For Java libraries often a domain name is used as the group id.
Many Java libraries can be found by searching Jarvana, though you'll need to translate the Maven XML notation into Leiningen's. Lucene is a typical example:
<dependency>
<groupId>org.apache.lucene</groupId>
<artifactId>lucene-core</artifactId>
<version>3.0.2</version>
</dependency>
This becomes:
[org.apache.lucene/lucene-core "3.0.2"]
Sometimes versions will end in "-SNAPSHOT". This means that it is not an official release but a development build. Relying on snapshot dependencies is discouraged but is sometimes necessary if you need bug fixes, etc. that have not made their way into a release yet. However, snapshot versions are not guaranteed to stick around, so it's important that released code never depends upon snapshot versions that you don't control. Adding a snapshot dependency to your project will cause Leiningen to actively go seek out the latest version of the dependency once a day when you run lein deps, (whereas normal release versions are cached in the local repository) so if you have a lot of snapshots it will slow things down.
Speaking of the local repository, all the dependencies you pull in using Leiningen or Maven get cached in $HOME/.m2/repository since Leiningen uses the Maven API under the covers. You can install the current project in the local repository with this command:
$ lein install
Wrote pom.xml
[INFO] Installing myproject-1.0.0-SNAPSHOT.jar to ~/.m2/repository/myproject/myproject/1.0.0-SNAPSHOT/myproject-1.0.0-SNAPSHOT.jar
Generally Leiningen will fetch your dependencies when they're needed, but if you have just added a new dependency and you want to force it to fetch it, you can do that too:
$ lein deps
Copying 3 files to ~/src/myproject/lib
Copied :dependencies into ~/src/myproject/lib.
Dependencies are downloaded from Clojars, the central Maven (Java) repository, the official Clojure build server, and any other repositories that you add to your project.clj file. See :repositories in sample.project.clj.
If you've confirmed that your project will work with a number of different versions of a given dependency, you can provide a range instead of a single version:
[org.clojure/clojure "[1.1,1.2]"] ; <= will match 1.1.0 through 1.2.0.
See Maven's version range specification for details. Don't do this unless you have manually confirming that it works with each of those versions though. You can't assume that your dependencies will use semantic versions; some projects even introduce backwards-incompatible changes in bugfix point releases.
Sometimes you want to pull in dependencies that are really only for your convenience while developing; they aren't strictly required for the project to function. Leiningen calls these :dev-dependencies. They're listed in project.clj alongside regular dependencies and downloaded when you run lein deps, but they are not brought along when another project depends on your project. Using swank-clojure for Emacs support would be a typical example; you may not want it included at runtime, but it's useful while you're hacking on the project.
This is the part Leiningen can't really help you with; you're on your own here. Well--not quite. Leiningen can help you with running your tests.
$ lein test
Testing myproject.core-test
FAIL in (replace-me) (core_test.clj:6)
No tests have been written.
expected: false
actual: false
Ran 1 tests containing 1 assertions.
1 failures, 0 errors.
Of course, we haven't written any tests yet, so we've just got the skeleton failing tests that Leiningen gave us with lein new. But once we fill it in the test suite will become more useful. Sometimes if you've got a large test suite you'll want to run just one or two namespaces at a time:
$ lein test myproject.parser-test
Testing myproject.parser-test
Ran 2 tests containing 10 assertions.
0 failures, 0 errors.
Rather than running your whole suite or just a few namespaces at a time, you can run a subset of your tests using test selectors. To do this, you attach metadata to various deftests.
(deftest ^{:integration true} network-heavy-test
(is (= [1 2 3] (:numbers (network-operation)))))
Then add a :test-selectors map to project.clj:
:test-selectors {:default (fn [v] (not (:integration v)))
:integration :integration
:all (fn [_] true)}
Now if you run "lein test" it will only run deftests that don't have :integration metadata, while "lein test :integration" will only run the integration tests and "lein test :all" will run everything. You can include test selectors and listing test namespaces in the same run.
Running "lein test" from the command-line is not a good solution for test-driven development due to the slow startup time of the JVM. For quick feedback, try starting an interactive session with "lein int" and running tests from in there. Other options include editor integration (see clojure-test-mode for Emacs) or keep a repl open and call run-tests from there as you work.
Keep in mind that while keeping a single process around is convenient, it's easy for that process to get into a state that doesn't reflect the files on disk--functions that are loaded and then deleted from the file will remain in memory, making it easy to miss problems arising from missing functions (referred to as "getting slimed"). Because of this it's advised to do a "lein test" run with a fresh instance periodically, perhaps before you commit.
If you're lucky you'll be able to get away without doing any AOT (ahead-of-time) compilation. But there are some Java interop features that require it, so if you need to use them you should add an :aot option into your project.clj file. It should be a seq of namespaces you want AOT-compiled. Again, the sample.project.clj has example usage.
Like dependencies, this should happen for you automatically when needed, but if you need to force it you can:
$ lein compile
Compiling myproject.core
For your code to compile, it must be run. This means that you shouldn't have any code with side-effects in the top-level. Anything that doesn't start with def outside a function definition is suspect. If you have code that should run on startup, place it in a -main function as explained below under "Uberjar".
For projects that include some Java code, you can set the :java-source-path key in project.clj to a directory containing Java files. Then the javac compiler will run before your Clojure code is AOT-compiled, or you can run it manually with the javac task.
There's a problem in Clojure where AOT-compiling a namespace will also AOT compile all the namespaces it depends upon. This often causes unrelated compilation artifacts to be included in the jars, but you can set :class-file-whitelist to a regex which will be matched against .class file names you want to keep in order to remove the unwanted file.
Generally speaking, there are three different goals that are typical of Leiningen projects:
- An application you can distribute to end-users
- A server-side application
- A library
For the first, you typically either build an uberjar or use a shell-wrapper. For libraries, you will want to have them published to a repository like Clojars or a private repository. For server-side applications it varies as described below.
The simplest thing to do is to distribute an uberjar. This is a single standalone executable jar file most suitable for giving to nontechnical users. For this to work you'll need to specify a namespace as your :main in project.clj. By this point our project.clj file should look like this:
(defproject myproject "1.0.0-SNAPSHOT"
:description "This project is MINE."
:dependencies [[org.clojure/clojure "1.2.0"]
[org.apache.lucene/lucene-core "3.0.2"]
[lancet "1.0.0"]]
:main myproject.core)
The namespace you specify will need to contain a -main function that will get called when your standalone jar is run. This namespace should have a (:gen-class) declaration in the ns form at the top. The -main function will get passed the command-line arguments. Let's try something simple in src/myproject/core.clj:
(ns myproject.core
(:gen-class))
(defn -main [& args]
(println "Welcome to my project! These are your args:" args))
Now we're ready to generate your uberjar:
$ lein uberjar
Cleaning up
Copying 3 files to /home/phil/src/leiningen/myproject/lib
Created ~/src/myproject/myproject-1.0.0.jar
Including myproject-1.0.0-SNAPSHOT.jar
Including lancet-1.0.0.jar
Including clojure-1.2.0.jar
Including lucene-core-3.0.2.jar
Created myproject-1.0.0-standalone.jar
This creates a single jar file that contains the contents of all your dependencies. Users can run it with a simple java invocation, or on some systems just by double-clicking the jar file.
$ java -jar myproject-1.0.0-standalone.jar Hello world.
Welcome to my project! These are your args: (Hello world.)
You can run a regular (non-uber) jar with the java command-line tool, but that requires constructing the classpath yourself, so it's not a good solution for end-users.
Invoking "lein run" will launch your project's -main function as if from an uberjar, but without going through the packaging process. You can also specify an alternate namespace in which to look for -main with "lein run -m my.alternate.namespace ARG1 ARG2".
There are a few downsides to uberjars. It's relatively awkward to invoke them compared to other command-line tools. You also can't control how the JVM is launched. To solve this, you can include a shell script in your jar file that can be used to launch the project. Leiningen places this shell script into the ~/.lein/bin directory at install time. Of course, this is only suitable if your users already use Leiningen.
If you simply include :shell-wrapper true in your project.clj, Leiningen automatically generates a simple shell script wrapper when you create your jar file. However, if you need more control you can provide a map instead:
:shell-wrapper {:main myproject.core
:bin "bin/myproject"}
Normally the shell wrapper will invoke the -main function in your project's :main namespace, but specifying this option triggers AOT for uberjars, so if you wish to avoid this or use a different :main for the shell wrapper vs uberjar you can specify a :main ns inside the :shell-wrapper map. You may also specify a :bin key, which should point to a file relative to the project's root to use as a shell wrapper template instead of the default. The format function is called with the contents of this file along with the necessary classpath and the main namespace, so put %s in the right place. See the default wrapper for an example.
There are many ways to get your project deployed as a server-side application. Simple programs can be packaged up as tarballs with accompanied shell scripts using the lein-tar plugin and then deployed using pallet, chef, or other mechanisms. Debian packages can be created with lein-deb. Web applications may be deployed using the lein-ring plugin. You can even create Hadoop projects. These kinds of deployments are so varied that they are better-handled using plugins rather than tasks that are built-in to Leiningen itself.
If your project is a library and you would like others to be able to use it as a dependency in their projects, you will need to get it into a public repository. While it's possible to maintain your own repository or get it into Maven central, the easiest way is to publish it at Clojars. Once you have created an account there, publishing is easy:
$ lein jar, pom
$ scp pom.xml myproject-1.0.0.jar clojars@clojars.org:
Once that succeeds it will be available as a package on which other projects may depend. You will need to have permission to publish to the project's group-id under Clojars, though if that group-id doesn't exist yet then Clojars will automatically create it and give you permissions.
For further details about publishing including setting up private repositories, see the deploy guide
Now go start coding your next project!