Class SynthDictionaryBuilder

java.lang.Object

org.languagetool.tools.DictionaryBuilder

org.languagetool.tools.SynthDictionaryBuilder

final class SynthDictionaryBuilder
extends DictionaryBuilder

Create a Morfologik binary synthesizer dictionary from plain text data.

Field Summary

Fields

Modifier and Type	Field	Description
private static final String	POLISH_IGNORE_REGEX	It makes sense to remove all forms from the synthesizer dict where POS tags indicate "unknown form", "foreign word" etc., as they only take space.

Constructor Summary

Constructors

Constructor	Description
SynthDictionaryBuilder(File infoFile)

Method Summary

Modifier and Type	Method	Description
(package private) File	build(File plainTextDictFile, File infoFile)
private Set<String>	collectTags(File plainTextDictFile)
private Set<String>	getIgnoreItems(File file)
private @Nullable Pattern	getPosTagIgnoreRegex(File infoFile)
private File	getTagFile(File tempFile)
static void	main(String[] args)
private File	reverseLineContent(File plainTextDictFile, Set<String> itemsToBeIgnored, Pattern ignorePosRegex)
private void	writePosTagsToFile(File plainTextDictFile, File tagFile)

Methods inherited from class DictionaryBuilder

addFreqData, buildDict, buildFSA, convertTabToSeparator, getOption, getOutputFilename, hasOption, isOptionTrue, readFreqList, setOutputFilename

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

POLISH_IGNORE_REGEX

private static final String POLISH_IGNORE_REGEX

It makes sense to remove all forms from the synthesizer dict where POS tags indicate "unknown form", "foreign word" etc., as they only take space. Probably nobody will ever use them:

See Also:

• Constant Field Values

Constructor Details

SynthDictionaryBuilder

SynthDictionaryBuilder(File infoFile)
                throws IOException

Throws:

IOException

Method Details

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

build

File build(File plainTextDictFile,
 File infoFile)
    throws Exception

Throws:

Exception

getIgnoreItems

private Set<String> getIgnoreItems(File file)
                            throws FileNotFoundException

Throws:

FileNotFoundException

getPosTagIgnoreRegex

@Nullable
private @Nullable Pattern getPosTagIgnoreRegex(File infoFile)

reverseLineContent

private File reverseLineContent(File plainTextDictFile,
 Set<String> itemsToBeIgnored,
 Pattern ignorePosRegex)
                         throws IOException

Throws:

IOException

getTagFile

private File getTagFile(File tempFile)

writePosTagsToFile

private void writePosTagsToFile(File plainTextDictFile,
 File tagFile)
                         throws IOException

Throws:

IOException

collectTags

private Set<String> collectTags(File plainTextDictFile)
                         throws IOException

Throws:

IOException