Implemented the Adaptive Epsilon Sampling EA #7

FedorSmirnov89 · 2018-03-09T16:51:27Z

Implemented the Adaptive Epsilon Sampling EA proposed in the paper:

Aguirre, Hernán, Akira Oyama, and Kiyoshi Tanaka. "Adaptive ε-sampling and ε-hood for evolutionary many-objective optimization." International Conference on Evolutionary Multi-Criterion Optimization. Springer, Berlin, Heidelberg, 2013.

In its current state, it should perform well on problems with a high number (4 +) of objectives (experiments running). There is also an extension to improve the performance in cases with fewer objectives. I would like to integrate it into OPT4J even if it should be outperformed by NSGA2 because it has a more sophisticated algorithm for the survivor and parent selection and is, in my opinion, more suitable to try out new exploration approaches.

…tion

…ards different parent and offspring numbers

…ull values

coveralls · 2018-03-09T16:55:07Z

Coverage increased (+3.05%) to 20.402% when pulling ef6eb5e on FedorSmirnov89:master into 5a72265 on felixreimann:master.

…rdingly

felixreimann

Perhaps, we should also move the huge number of specific AeSeH classes to another subpackage ea.aeseh

felixreimann · 2018-03-12T22:32:48Z

build.gradle

@@ -1,5 +1,6 @@
 plugins {
 	id 'com.github.kt3k.coveralls' version '2.6.3'
+ id "org.sonarqube" version "2.5"


Is this working? Should be another feature.

It works for the sonarqube I am running on my local machine. I oversaw that it was still in the build.gradle when merging the branches. I normally to not commit this change because I only use it locally.

felixreimann · 2018-03-12T22:33:16Z

build.gradle

@@ -21,6 +22,7 @@ allprojects {
    group = 'org.opt4j'

    repositories {
+	jcenter() 


Because of Mockito. It is really cool for mocking up stuff. And it enable actual test-driven development where you can test the high-level classes without touching or even having an implementation of the low-level modules

Ok. Then leave it in. Is mockito not available on maven central?

I'll check. To be honest I just used the gradle dependency that was in the Mockito tutorial

felixreimann · 2018-03-12T22:35:04Z

opt4j-optimizers/build.gradle

@@ -1,4 +1,7 @@
 dependencies {
 	compile project(':opt4j-core')
 	compile project(':opt4j-operators')
+
+	testCompile	group: 'junit',							name: 'junit',					version: '[4.0,)'
+	testCompile "org.mockito:mockito-core:2.+"


please also use scheme: group: '', name: '', version ''
do use a specific version of mockito (gradle eclipse often has some problems otherwise)

felixreimann · 2018-03-12T22:39:20Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/AeSeHCoupler.java

+ * Heidelberg, 2013.
+ * 
+ * Please consider citing the paper if you use this class for a scientific
+ * publication.


we propably should use this sentence either everywhere or nowhere.
~~You could also additionally use @Info annotation~~
Maybe (as another feature), we could create an @citation annotation to a) hold such information and b) print all citations which are used during an optimizuation.

felixreimann · 2018-03-12T22:40:43Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/AeSeHModule.java

+ * @author Fedor Smirnov
+ *
+ */
+


remove empty line

felixreimann · 2018-03-12T22:55:29Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/EpsilonAdaption.java

+	 * value where the number of neighborhoods is near a user-defined value.
+	 * 
+	 * @param tooManyNeighborhoods
+	 *            : TRUE => too many neighborhoods created; FALSE => not enough


and what, if the correct number of neighborhoods have been created?

use just

@param tooManyNeighborhoods {@code true} if too many neighborhoods have been created

felixreimann · 2018-03-12T22:59:50Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/EvolutionaryAlgorithmModule.java

@@ -47,19 +46,19 @@
 	protected int generations = 1000;

 	@Constant(value = "alpha", namespace = EvolutionaryAlgorithm.class)
-	@Info("The size of the population.")
+	@Info("Alpha - The size of the population.")


Would

@Info("The size of the population α.")
@Info("The number of parents per generation μ.")
@Info("The number of offsprings per generation λ.")

work?

felixreimann · 2018-03-12T23:10:24Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedSorting.java

+import org.opt4j.core.Objectives;
+
+/**
+ * Class used for the non-dominated sorting. During non-dominated sorting, the


Style: do not use "Class" but "The NonDominatedSorting sorts individuals into fronts." or similar.

felixreimann · 2018-03-12T23:10:50Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedSorting.java

+ */
+public class NonDominatedSorting {
+
+	private NonDominatedSorting() {


delete unused constructor

This is a thing I got from SonarQube. It says that it is good practice to have a private constructor in classes that only offer static methods, so that no instance of the class can be created.

felixreimann · 2018-03-12T23:15:59Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedSorting.java

+ * @author Fedor Smirnov
+ *
+ */
+public class NonDominatedSorting {


what about

public class NonDominatedSorting extends ArrayList<List>
instead of all static methods, directly holding the front.

I have to think about that

FedorSmirnov89 · 2018-03-15T19:44:06Z

I totally agree with everything I did not reply to. Will implement the adjustments in the near future

felixreimann

some minor code style stuff.

felixreimann · 2018-03-21T21:05:13Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedFronts.java

+	}
+
+	/**
+	 * sort the given individuals into non-dominated fronts


Comment should start with upper case

Use third person

Missing "." at the end of the sentence

{@link Individual}s

See http://www.oracle.com/technetwork/articles/java/index-137868.html

--> Sorts the given {@link Individual}s into non-dominated fronts.

felixreimann · 2018-03-21T21:06:55Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedFronts.java

+	/**
+	 * sort the given individuals into non-dominated fronts
+	 * 
+	 * @param individuals


add basic description http://www.oracle.com/technetwork/java/javase/documentation/index-137868.html#@param

felixreimann · 2018-03-21T21:11:35Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedFronts.java

+	 */
+	public void generateFronts(Collection<Individual> individuals) {
+		// assign an id to each individual that corresponds to its index in an
+		// array


Start also code comments with upper case in case they are full sentences, end with "."

felixreimann · 2018-03-21T21:16:14Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedFronts.java

+		// Initialize a map where an individual is assigned to the individuals
+		// that it dominates
+		Map<Individual, List<Individual>> dominatedIndividualsMap = new HashMap<Individual, List<Individual>>();
+		// n is an array where for each individual, the number of individuals


felixreimann · 2018-03-21T21:24:01Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedFronts.java

+import org.opt4j.core.Objectives;
+
+/**
+ * The NonDominatedFronts sorts each evaluated individual into fronts based on


Please link used classes in javadoc:
The {@link NonDominatedFronts} sorts each evaluated {@link Individual}...

felixreimann · 2018-03-21T21:42:12Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AdditiveEpsilonMapping.java

+public class AdditiveEpsilonMapping implements EpsilonMapping {
+
+	@Override
+	public Objectives mapObjectives(Objectives original, double epsilon, Map<Objective, Double> objectiveAmplitudes) {


Javadoc comment

felixreimann · 2018-03-21T21:42:18Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AdditiveEpsilonMapping.java

+	}
+
+	@Override
+	public Map<Objective, Double> findObjectiveAmplitudes(Set<Individual> individuals) {


Javadoc comment

At this point I think that the javadocs generated for the interface of the class do provide an exact description of what the method does so that no additional comments are necessary.

Correct, sorry.

felixreimann · 2018-03-21T21:42:27Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHCoupler.java

+	protected final int plannedNeighborhoodNumber;
+
+	@Inject
+	public AeSeHCoupler(EpsilonMapping epsilonMapping, EpsilonAdaption epsilonAdaption, Random random,


Javadoc comment

felixreimann · 2018-03-21T21:42:32Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHCoupler.java

+	}
+
+	@Override
+	public Collection<Pair<Individual>> getCouples(int size, List<Individual> parents) {


Javadoc comment

felixreimann · 2018-03-21T21:43:16Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHSelector.java

+	protected final ESamplingSurvivorGeneration survivorGeneration;
+
+	@Inject
+	public AeSeHSelector(ESamplingSurvivorGeneration survivorGeneration) {


Javadoc comment

FedorSmirnov89 · 2018-03-22T17:28:49Z

Okay, I made the javadoc comment adjustments.

felixreimann

Last remarks, I hope. Ideally, this process should not take so long...

felixreimann · 2018-03-28T19:13:41Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/package-info.java

+/**
+ * Package for the classes of the Adaptive ε-Sampling ε-Hood MOEA.
+ */
+/**


*/ /**
should just be one comment.

See for example org.opt4j.core.package-info.java. Some general information, how all the different classes/interfaces in this package interact would be great to easier get an overview.

felixreimann · 2018-03-28T19:31:38Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHModule.java

+	@Override
+	protected void config() {
+		bindIterativeOptimizer(EvolutionaryAlgorithm.class);
+		bind(CrossoverRate.class).to(ConstantCrossoverRate.class).in(SINGLETON);


If we would remove line 256 and 257 we would have only one module for the general EA and this one for the aeseh selector and coupler.

Pro:

This one module is a lot simpler without alpha, mu, and lambda.

It would resemble the way we do it with Couplers in BasicMating and the Selectors NSGA, SMS, and SPEA

You can freely combine selectors and couplers
Contra:

You would need to select two modules, the standard EA and the AeSeh. We could, however, document this.

felixreimann · 2018-03-28T19:36:55Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/ESamplingSurvivorGeneration.java

+ *
+ */
+@ImplementedBy(DefaultSurvivorGeneration.class)
+public interface ESamplingSurvivorGeneration {


Is it probably that we get another Survivor Generation? Otherwise, we could remove the interface in favor for just a single class.

If not, I would nonetheless vote for renaming this interface to SurvivorGeneration and the DefaultSurvivorGeneration to EpsilonSamplingSurvivorGeneration.

See https://en.wikipedia.org/wiki/You_aren%27t_gonna_need_it

felixreimann · 2018-03-28T19:39:01Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/EpsilonMapping.java

+ *
+ */
+@ImplementedBy(AdditiveEpsilonMapping.class)
+public interface EpsilonMapping {


Is it likely that we get another EpsilonMapping? To me, this also looks extremely AeSeH specific. If not, we could remove the interface in favor for just a single class.

felixreimann · 2018-03-28T19:40:21Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AdditiveEpsilonMapping.java

+	}
+
+	@Override
+	public Map<Objective, Double> findObjectiveAmplitudes(Set<Individual> individuals) {


Correct, sorry.

felixreimann · 2018-03-28T19:41:16Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/EpsilonAdaption.java

+ *
+ */
+@ImplementedBy(DefaultEpsilonAdaptation.class)
+public interface EpsilonAdaption {


Is it likely that we get another EpsilonAdaption? To me, this also looks extremely AeSeH specific. If not, we could remove the interface in favor for just a single class.

felixreimann · 2018-04-17T18:41:08Z

@FedorSmirnov89 could you check and resolve the minor comments I added and also resolve the codacy problem? Then, we can merge this one.

FedorSmirnov89 · 2018-04-18T07:29:53Z

@felixreimann Okay, I will take care of it before the end of this week.

FedorSmirnov89 · 2018-04-19T15:02:13Z

Summary of the changes to the pull request:

I did not remove any interfaces, but I applied the naming changes we talked about. I think the relationship between the classes and the interfaces is now much clearer, so that we can keep the interfaces
Improved the documentation of the AeSeH package
Removed the duplications between the EvolutionaryAlgorithm- and the AeSeH-Module.

felixreimann

We should think about even more restructure this:

Rename the Selector to EpsilonSamplingSelector and create a specific SelectorModule for it, according the other selectors: Elitism, Nsga2, Spea2, SMS
Rename the Coupler to EpsilonNeighborhoodCoupler and add it to the BasicMatingModule (and perhaps rename it), according the other couplers: Random, unique, default

Then, the user could freely mix all the couplers and selectors.

Additionally, the AeSeHModule would just statically configure the eamodule, the EpsilonSamplingSelector, and the EpsilonNeighborhoodCoupler with exactly the values proposed in the paper such that the user could just select it if the exact aeseh implementation is required.

felixreimann · 2018-04-24T20:25:24Z

build.gradle

@@ -1,5 +1,6 @@
 plugins {
 	id 'com.github.kt3k.coveralls' version '2.6.3'
+


remove empty line

felixreimann · 2018-04-24T20:26:06Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/package-info.java

+ *         {@link org.opt4j.optimizers.ea.aeseh.AeSeHModule} and the
+ *         {@link org.opt4j.optimizers.ea.EvolutionaryAlgorithmModule}.
+ */
+package org.opt4j.optimizers.ea.aeseh;


felixreimann · 2018-04-24T20:26:55Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/package-info.java

+ *         In the Opt4J GUI, the AeSeH is configured using the
+ *         {@link org.opt4j.optimizers.ea.aeseh.AeSeHModule} and the
+ *         {@link org.opt4j.optimizers.ea.EvolutionaryAlgorithmModule}.
+ */


this is just an extremly long and awkward author name. Test javadoc generation.

Add <p> as paragraph separator. See other javadocs.

felixreimann · 2018-04-24T20:41:52Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHModule.java

+ */
+@Info("Multi-objective evolutionary algorithm where the survival selection and the creation of neighborhoods is based on epsilon-dominance. The selection of parents is done within the created neighborhoods.")
+@Citation(authors = "Hernán Aguirre, Akira Oyama, and Kiyoshi Tanaka", title = "Adaptive ε-sampling and ε-hood for evolutionary many-objective optimization.", journal = "Evolutionary Multi-Criterion Optimization (EMO)", pageFirst = 322, pageLast = 336, year = 2013, month = UNKNOWN)
+public class AeSeHModule extends OptimizerModule {


I would suggest that AeSeH should be an EA submodule as it is mainly an EA with a specific selector and coupler. Please add:

@Parent(EvolutionaryAlgorithmModule.class)

…ividually

FedorSmirnov89 · 2018-05-11T20:00:27Z

I agree that having the selectors and couplers as modules that can be implemented individually is a good idea. I have made changes to the coupler and selector of the AeSeH accordingly. However, for the other selectors and couplers, the treatment was somewhat inconsistent. While each selector can be added as a single module, the couplers are configured in the GUI using the BasicMatingModule. I would prefer a solution where each coupler is added as a module as well. I have implemented the modules and would propose to delete the BasicMatingModule.

felixreimann · 2018-05-14T21:04:00Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/EpsilonAdaptation.java

+	 *            the {@link AdaptiveEpsilon} contains the ε-value and the
+	 *            information about its adaptation
+	 * @param epsilonTooBig
+	 *            {@code} if the current epsilon is too big


{@code what?} fix javadoc

felixreimann · 2018-05-14T21:04:41Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/EpsilonAdaptation.java

+	 * @param tooManyEpsilonDominantIndividuals
+	 *            {@code true} if too many individuals have been created
+	 */
+	//public void adaptSamplingEpsilon(boolean tooManyEpsilonDominantIndividuals);


Delete if unnecessary.

felixreimann · 2018-05-14T21:04:46Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/EpsilonAdaptation.java

+	 * @param tooManyNeighborhoods
+	 *            {@code true} if too many individuals have been created
+	 */
+	//public void adaptNeighborhoodEpsilon(boolean tooManyNeighborhoods);


Delete if unnecessary.

felixreimann · 2018-05-14T21:06:42Z

build.gradle

@@ -1,5 +1,5 @@
 plugins {
-	id 'com.github.kt3k.coveralls' version '2.6.3'
+	id 'com.github.kt3k.coveralls' version '2.6.3' 


Please let files unchanged if the changes have nothing to do with the main scope of the pull request.

felixreimann · 2018-05-14T21:18:45Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/NonDominatedFronts.java

+ * @author Fedor Smirnov
+ *
+ */
+public class NonDominatedFronts extends ArrayList<List<Individual>> {


I do not think, this class should expose that it technically uses an arraylist<list> to the outside. Aren't there a lot of arraylist functions (or even all of them?), which make no sense on an object called "NonDominatedFronts"? Isn't this class more an algorithm instead of a data structure?

As I do not have good proposal how to restructure this one, this is not a blocker for merging. Just something I would ask you to rethink.

I agree. The user should not be able to manipulate the list. I changed the class accordingly

felixreimann · 2018-05-14T21:33:54Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHModule.java

+import org.opt4j.optimizers.ea.Selector;
+
+/**
+ * Module to bind the AeSeH evolutionary algorithm as optimizer.


Add to docu: This module sets the parameters of {@link AeSehCoupler} and {@link AeSehSelector} as given in the paper. The corresponding {@link AeSehCouplerModule} and {@link AeSehSelectorModule} are then not required to be selected. or something similar.

felixreimann · 2018-05-14T21:34:42Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHSelectorModule.java

+ *
+ */
+@Name("Epsilon Sampling")
+public class AeSeHSelectorModule extends SelectorModule {


Add @citation

felixreimann · 2018-05-14T21:35:46Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/AeSeHSelectorModule.java

+ *
+ */
+@Name("Epsilon Sampling")
+public class AeSeHSelectorModule extends SelectorModule {


Rename to EpsilonSamplingSelectorModule and EpsilonSamplingSelector, resp.

felixreimann · 2018-05-14T21:39:56Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/EpsilonAdaptationDefault.java

+ * @author Fedor Smirnov
+ *
+ */
+public class EpsilonAdaptationDefault implements EpsilonAdaptation {


Isn`t this one such specific that the separation of class and interface is superfluous? If you can think about an alternative implementation, what is then specific about this one? -> If you have an answer, use it in the class name instead of "Default" and also in the documentation.

This class handles the adaptation of the epsilon throughout the exploration. At least for me, the exact way to adapt the epsilon would be one of the first things to play around with in an exploration. The implementation here realizes the adaptation presented in the paper. However, the authors do not provide any argument as to why this adaptation makes sense, so I definitely foresee different adaptation mechanisms in the future.

As for the name: What they are doing is adding/substracting a delta value which itself is then doubled/divided by 2. I find it hard to find a descriptive title here. For now, I went with EpsilonAdaptationDelta to signify that the adapted part is the delta value and not the epsilon. Not super happy with this name though. Any suggestions?

felixreimann · 2018-05-14T21:41:13Z

opt4j-optimizers/src/main/java/org/opt4j/optimizers/ea/aeseh/package-info.java

+ * {@link org.opt4j.optimizers.ea.EvolutionaryAlgorithmModule}.
+ * </p>
+ */
+package org.opt4j.optimizers.ea.aeseh;


add newline

Could you tell me which newline you are referring to? The generated Javadoc seems fine to me.

seems to be nothing more to say about it

FedorSmirnov89 and others added 10 commits March 2, 2018 19:53

Implemented the basic structure of the survivor- and the mating-selec…

5c2fd7c

…tion

implemented tests for the adaptive epsilon sampling EA

6e114f7

Integrated the AeSeH into the EA Gui

4f14f94

separated the modules of NSGA and AeSeH; made AeSeH more flexible tow…

5500531

…ards different parent and offspring numbers

fixed module bug

069159a

tests for AeSeH; addressed code smells of AeSeH

9820bea

changed the way the sampling accesses objective values to cope with n…

24345a4

…ull values

fixed the value access for the epsilon mapping function

519c44d

refactored the non-dominated sorting

4608ebc

Merge branch 'eps_sampling_ea'

5e5e392

FedorSmirnov89 added 2 commits March 11, 2018 15:16

fixed typos

a17788f

added a check for infeasible objectives; adjusted the test cases acco…

0551a69

…rdingly

felixreimann requested changes Mar 12, 2018

View reviewed changes

BossSeminarFAU added 10 commits March 16, 2018 12:44

created an extra package for the classes of the AeSeH MOEA

03e83db

moved the tests to the new package as well

051805b

restored the build.gradle file

c5a6b87

Implemented non dominated sorting in a non-static way

35e74a6

forgot to add stuff before committing

fb152ff

changed the build to get mockito from maven

8291485

cleaned up the comments

9297324

fixed infeasible objectives bug

dabe519

Merge https://github.com/felixreimann/opt4j

7b31949

used the citation-annotation and removed the comments

4c52546

FedorSmirnov89 assigned felixreimann Mar 21, 2018

felixreimann requested changes Mar 21, 2018

View reviewed changes

improved javadoc comments

ae3866f

felixreimann approved these changes Mar 28, 2018

View reviewed changes

Merge https://github.com/felixreimann/opt4j

e22b575

BossSeminarFAU added 2 commits April 19, 2018 16:41

updated class names and package description

3c9b0a1

changed the module structure

1bf72d1

SDARG deleted a comment Apr 19, 2018

felixreimann requested changes Apr 24, 2018

View reviewed changes

FedorSmirnov89 added 4 commits May 5, 2018 15:36

minor corrections + implemented a coupler module for the gui

9a47452

refactored code so that the coupler and the selecotor can be used ind…

3084c0f

…ividually

restructured the coupler- and selector modules

16432a8

merge with the main repository version

dbbbae7

SDARG deleted a comment May 14, 2018

felixreimann requested changes May 14, 2018

View reviewed changes

implemented the changes requested in the review

61a914d

SDARG deleted a comment Jun 4, 2018

BossSeminarFAU added 2 commits June 11, 2018 09:11

added new lines at the end of files

e9e6d7b

Merge branch 'master' of https://github.com/FedorSmirnovUdacity/opt4j

7dc0c88

SDARG deleted a comment Jun 12, 2018

felixreimann added 4 commits June 12, 2018 23:06

typo

48a85e5

Update EpsilonSamplingSelectorModule.java

5750f19

see comment

3396503

phrase removed

ef6eb5e

seems to be nothing more to say about it

felixreimann approved these changes Jun 12, 2018

View reviewed changes

felixreimann merged commit 28b44c3 into SDARG:master Jun 12, 2018

		@@ -1,5 +1,6 @@
		plugins {
		id 'com.github.kt3k.coveralls' version '2.6.3'

Implemented the Adaptive Epsilon Sampling EA #7

Implemented the Adaptive Epsilon Sampling EA #7

Conversation

FedorSmirnov89 commented Mar 9, 2018

coveralls commented Mar 9, 2018 • edited

felixreimann left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

FedorSmirnov89 commented Mar 15, 2018

felixreimann left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

FedorSmirnov89 commented Mar 22, 2018

felixreimann left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

felixreimann commented Apr 17, 2018

FedorSmirnov89 commented Apr 18, 2018

FedorSmirnov89 commented Apr 19, 2018

felixreimann left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

FedorSmirnov89 commented May 11, 2018

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

FedorSmirnov89 Jun 3, 2018 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

coveralls commented Mar 9, 2018 •

edited

FedorSmirnov89 Jun 3, 2018 •

edited