$ cd ../
Advanced NLP: NER + Extractive QA — bash

user@devops:~$ cat README.md

Advanced NLP: NER + Extractive QA

# Description

Advanced Natural Language Processing (NLP) covering two fundamental tasks: (1) Named Entity Recognition (NER) — detecting persons, organizations, locations and miscellaneous entities using dslim/bert-base-NER (fine-tuned CoNLL2003) for English and Davlan/bert-base-multilingual-cased-ner-hrl for Spanish. The model detects entities across 5 example sentences per language with high confidence (mean >0.95). Quantitative evaluation on 10 manually annotated sentences with seqeval: Accuracy 93.39%, Micro F1 81.36%, ORG F1 94.12%, LOC F1 92.31%, PER F1 75%. (2) Extractive Question Answering — literal answer extraction from context using distilbert-base-cased-distilled-squad with raw model inference (softmax over start/end logits, transformers v5). 2 real contexts (Turing Award, Deep Learning Revolution) with 8 questions: mean score 83%. 6 visualizations: entity distribution, token confidence, per-entity metrics, QA score histogram, per-question confidence, EN/ES comparison heatmap.

# Key features

$ Multilingual NER: English (dslim/bert-base-NER) and Spanish (Davlan/multilingual-ner-hrl)

$ Quantitative seqeval evaluation: Accuracy 93.39%, F1 ORG 94.12%, LOC 92.31%, PER 75%

$ Extractive QA with DistilBERT-SQuAD: 8 questions over 2 real contexts, mean score 83%

$ Raw model inference for transformers v5: softmax over start/end logits for QA

$ 10 manually annotated IOB2 test sentences for NER evaluation

$ 6 visualizations: bar charts, histograms, heatmap EN/ES comparison

$ Pretrained models: 3 ready pipelines without GPU fine-tuning

# Gallery

Project terminal
Advanced NLP: NER + Extractive QA - Project terminal
Entity distribution EN vs ES
Advanced NLP: NER + Extractive QA - Entity distribution EN vs ES
Confidence per detected entity
Advanced NLP: NER + Extractive QA - Confidence per detected entity
Seqeval metrics by entity type
Advanced NLP: NER + Extractive QA - Seqeval metrics by entity type
QA confidence distribution
Advanced NLP: NER + Extractive QA - QA confidence distribution
Confidence per QA question
Advanced NLP: NER + Extractive QA - Confidence per QA question
EN/ES comparison heatmap
Advanced NLP: NER + Extractive QA - EN/ES comparison heatmap

# Technologies used

Hugging Face Transformers PyTorch Python NumPy Pandas Matplotlib scikit-learn