java.lang.NullPointerException

[chaojiang06]

Hi, thanks for your useful tool!

However, when I run the tool, I meet a bug which error log is:

Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58)
Caused by: java.lang.NullPointerException
at simplifiedTextAlignment.DatasetAlignment.AlignNewselaDataset.main(AlignNewselaDataset.java:94)
... 5 more

My java version is 8, would you please take a look at this issue?

Thanks in advance!

[neosyon]

Thank you for using our tool. Can you please share more details? I don't think it's a Java 8 issue. I would like to see the full execution command line. Did you include the -i "decompressed newsela folder path" argument?

[neosyon]

Thank you for your comments and analysis. I found a bug in the code related to how to deal with English abbreviations when they were correctly processed by the sentence splitter and it is the last sentence of the text. I just uploaded the fix. I hope it works! Best, Marc From: Chao6 <notifications@github.com> Sent: viernes, 28 de septiembre de 2018 23:37 To: neosyon/SimpTextAlign <SimpTextAlign@noreply.github.com> Cc: Marc F. S. <neosyon@gmail.com>; Comment <comment@noreply.github.com> Subject: Re: [neosyon/SimpTextAlign] java.lang.NullPointerException (#2) Hi, thanks for reply! Would you please try to use the latest version of ComputeSimilarityBetweenTexts class to compute the similarity of this line regardless of which similarity measure? A1_Grand_Prix Nelson Piquet , Jr. won the inaugural race of the series for A1 Team Brazil . The Curitiba , Brazil in January 2006 was canceled . 0 This line follows the same format as Hwang's Standard Wikipedia to Simple Wikipedia alignments dataset, each element is separated by '\t' like this: A1_Grand_Prix\tNelson Piquet , Jr. won the inaugural race of the series for A1 Team Brazil .\tThe Curitiba , Brazil in January 2006 was canceled .\t0 The code will report a NullPointerException. The problem stems from the sentence splitter in getSubtexts function in TextProcessingUtils. I understand that by adjusting the pointer, we could avoid wrong sentences splitting like (Dr./Prof.) suggest by this article <https://stackoverflow.com/questions/17159513/split-paragraph-into-sentences-with-titles-and-numbers?answertab=oldest#tab-top> . But in this case, if the only sentence contains abbreviation, this only sentence will be filtered out. An empty list will be returned by the getSubtexts and getCleanText functions in TextProcessingUtils class. In getAlignmentsUsingClosestCosSim function in VectorUtils class, closestIndex = -1, cleanSubtexts1.get(closestIndex).getText() and sims[closestIndex][i] will induce a NullPointerException. Since when calculating sentences pair similarity, the input is splitted sentence. Thus to ensure the running, can I just replace if (! hasAbbreviation(sentence)) with if (true) in the getSubtexts function? I think this operation will not affect the correctness of the similarity score, is this correct? Thanks! BTW, the second to the last main version (commit: <38ab50d> 38ab50d) which uses Stanford nlp DocumentPreprocessor doesn't have this problem. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2 (comment)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/AS63i8Cd7KleeeeH8-2e40ghHX5mTMvUks5ufpaCgaJpZM4V9JdV> .

[sabdul111]

Hi,

Thanks for your useful tool, however I get the same error.

Calculating IDF...
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58)
Caused by: java.lang.IllegalStateException: basedir ../../data/Newsela/articles is not a directory
at org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:797)
at simplifiedTextAlignment.Representations.NgramModel.buildNewselaNgramModel(NgramModel.java:42)
at simplifiedTextAlignment.DatasetAlignment.AlignNewselaDataset.main(AlignNewselaDataset.java:107)
... 5 more

My java version is
openjdk version "1.8.0_191"
OpenJDK Runtime Environment (build 1.8.0_191-8u191-b12-2ubuntu0.16.04.1-b12)
OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode)

Can you please guide how to resolve this,

Thank you in adavance.