it is critical to select the right paper kind to be able to assist get top quality reviews for the work. Remember that all paper kinds utilize the exact same template; download your message and LaTeX templates right here: coling2018.zip
Computationally-aided linguistic analysis
The main focus for this paper kind is new linguistic insight. It could take the type of an empirical research of some linguistic trend, or of the theoretical outcome in regards to a linguistically-relevant system that is formal.
- Relevance: Is this paper highly relevant to COLING?
- Readability/clarity: Through the means the paper is written, is it possible to tell just what research concern ended up being addressed, the thing that was done and exactly why, and just how the outcomes connect with the study question?
- Originality: How initial and revolutionary may be the extensive research described? Originality could possibly be within the linguistic concern being addressed, when you look at the methodology put on the linguistic concern, or perhaps in the blend associated with two.
- Technical correctness/soundness: could be the research described in the paper theoretically sound and proper? Is one to trust the claims of this paper—are they sustained by the analysis or experiments and they are the results precisely interpreted?
- Reproducibility: can there be detail that is sufficient some body in identical industry to reproduce/replicate the outcome? n/a for many forms of theoretical results
- Data/code access: may be the data/code (as appropriate) open to the investigation community or perhaps is here a compelling explanation provided why this is simply not feasible?
- Generalizability: Does the paper show exactly exactly exactly how the outcomes generalize, either by deepening our comprehension of some linguistic system in basic or by demonstrating methodology which can be placed on other issues also? n/a for several kinds of theoretical results
- Significant contrast: Does the paper clearly put the described make use of respect to literature that is existing? Could it be clear both what exactly is novel within the extensive research presented and how it develops on earlier in the day work?
- Substance: performs this paper have sufficient substance for the paper that is full-length or wouldn’t it take advantage of further development?
- General recommendation: there are lots of good submissions contending for slots at COLING 2018; essential can it be to feature that one? Will people learn lot by scanning this paper or seeing it presented? Please be decisive—it is way better to vary from other reviewers than to grade every thing at the center.
NLP engineering test paper
This paper kind fits the majority of submissions at present CL and NLP seminars.
- Relevance: Is it paper highly relevant to COLING?
- Readability/clarity: Through the means the paper is created, is it possible to inform exactly what research concern had been addressed, that which was done and just why, and exactly how the outcome relate solely to the investigation concern?
- Will it be clear what the authors’ hypothesis is? What exactly is it? A text input reponse
- Could it be clear the way the authors have actually tested their hypothesis? y/n
- Originality: How initial and innovative may be the research described? Remember that originality could include a unique strategy or a brand new task, or it might lie within the careful analysis of what the results are whenever a understood strategy is placed on a known task (in which the pairing is novel) or perhaps within the careful analysis of what goes on each time a understood strategy is put on a known task in a language that is new.
- Technical correctness/soundness: may be the research described in the paper theoretically sound and correct? Is one able to trust the claims associated with paper—are they supported by the analysis or experiments and are usually the total results precisely interpreted?
- Will it be clear the way the outcomes confirm/refute the theory, or will be the outcomes inconclusive?
- Perform some writers explain the way the outcomes follow from their theory (rather than state, other feasible confounding element)?
- Would be the datasets utilized plainly described and therefore are they right for testing the hypothesis as previously mentioned?
- Reproducibility: will there be detail that is sufficient some body in identical industry to reproduce/replicate the outcomes?
- Data/code supply: could be the data/code custom writing (as appropriate) open to the investigation community or perhaps is here a compelling explanation offered why it is not possible?
- Error analysis: Does the paper provide a thoughtful mistake analysis, which actively seeks linguistic patterns into the forms of mistakes created by the system(s) examined and sheds light on either avenues for future work or the way to obtain the strengths/weaknesses associated with the systems?
- Significant contrast: Does the paper clearly spot the described make use of respect to current literary works? Can it be clear both what’s novel into the extensive research presented and just how it builds on earlier in the day work?
- Substance: Does this paper have sufficient substance for a full-length paper, or would it not reap the benefits of further work?
- General recommendation: there are numerous good submissions contending for slots at COLING 2018; essential could it be to feature this 1? Will people discover great deal by looking over this paper or seeing it presented? Please be decisive—it is much better to vary from other reviewers rather than grade every thing at the center.