Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

place-name recognition #14

Open
alabrashJr opened this issue Jan 28, 2020 · 1 comment
Open

place-name recognition #14

alabrashJr opened this issue Jan 28, 2020 · 1 comment
Labels
enhancement New feature or request

Comments

@alabrashJr
Copy link
Collaborator

alabrashJr commented Jan 28, 2020

Placename recognition is an essential technique that pipeline should master.
Social scientists see placename as a piece of important information in commenting about the events.
the model we are using is not doing very well so I tried using NLTK, Standford and Spacy NER.
the results as follows,

  % of 1-gram matching match token number
gold_tokens 1.000.000 177
used_classifier (BERT) 0.610169 108
nltk 0.723164 128
spacy 0.000000 0
standford 0.423729 75
NeuroNER 0.203390 36
@alabrashJr alabrashJr assigned alabrashJr and unassigned alabrashJr Jan 28, 2020
@alabrashJr alabrashJr added the enhancement New feature or request label Jan 28, 2020
@OsmanMutlu
Copy link
Member

We are now using SoTA Flair's place name model (en-ner-conll03-v0.4) as an extra place name extractor.
This model has a recall of 97% in our test data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants