Topological emergence of skills and competency graphs
Home/Research/Skills Intelligence
SOTA-WP-2026-02·Data Topologies · 2026

Skills Intelligence

Understanding what people can do from unstructured evidence.

Daniel Mahandana · Systems Lab Group · The Sota Lab
Abstract

Free-form CVs and vocational certificates contain rich latent signals that conventional keyword matching routinely fails to capture. We develop an entity-extraction and graph-alignment architecture that maps natural language experience to standardized international taxonomies (ESCO/OFO) with calibrated confidence, separating job-title marketing from genuine operational mastery.

01 / The Core Question

Can structural competency graphs recover genuine practitioner capabilities without succumbing to job-title ambiguity?

In our parsing experiments over 4,800 vocational CVs, words like "managed" or "engineered" appeared in over 60% of entries with near-zero correlation to domain competency. By anchoring textual tokens to formal ontology graphs (ESCO and South African OFO codes), our pipeline recovers true operational capacity.

02 / Live Transformation Pipeline

Unstructured Text → Competency Projection

Transformation PipelineUnstructured Experience → Competency Projection
Sample:
01 / Raw Unstructured Text Input

"I worked as a production supervisor for three years coordinating factory shifts, scheduling preventative machinery maintenance, enforcing ISO-9001 compliance, and training junior operators on PLC safety protocols."

02 / Contextual Entity Extraction
production supervisor (OCCUPATION)factory shifts (ORGANIZATION)machinery maintenance (TECHNICAL_TASK)ISO-9001 compliance (STANDARD)PLC safety protocols (HARD_SKILL)training junior operators (LEADERSHIP)
03 / Alignment with Standardized Competencies (ESCO · OFO)
ESCO-3122.1Supervise manufacturing production
94%
ESCO-3115.4Industrial maintenance scheduling
88%
ESCO-2422.3Quality management systems (ISO)
82%
OFO-312201Manufacturing operations management
91%
04 / Latent Occupational Inference
Manufacturing Production Supervisor (OFO 312201)92%

High correlation on shift management & safety compliance

Industrial Operations Coordinator84%

Substantial overlap in maintenance scheduling

Quality Assurance Specialist76%

Partial qualification via ISO-9001 standards

03 / Empirical Failure Analysis

Where Lexical Ambiguity Challenges the Model

Empirical Boundary Analysis

Documented Failure Modes

Genuine research maturity requires documenting failure modes with the same empirical scrutiny as benchmark successes:

Ambiguity in Managerial ScopeFailure Mode
Observed Input

"I managed several teams across production cycles ensuring daily targets were hit."

Model Prediction
General Leadership, Project Management, Corporate Oversight
Ground Truth
Manufacturing Shift Operations Management (OFO 312201)

Diagnosis: The token classifier interprets 'managed' as executive administrative leadership rather than grounding the verb in factory shift operational constraints.

Mitigation: Conditioning entity weights on domain co-occurrence embeddings (e.g. 'production cycles' attenuates corporate leadership classification).

TVET Dual-Trade Qualification ConflationFailure Mode
Observed Input

"NC(V) in Electrical Infrastructure Construction with mechanical fitting apprentice modules."

Model Prediction
Mechanical Fitter (OFO 653306), Construction Foreman
Ground Truth
Industrial Electrician (OFO 671101)

Diagnosis: Vocational programs integrate cross-disciplinary foundational modules. The classifier over-indexed on secondary mechanical tokens, downgrading the primary trade accreditation.

Mitigation: Enforcing strict National Qualification Framework (NQF) regulatory gazette hierarchies during graph projection.

Sample Starvation in Bayesian PriorFailure Mode
Observed Input

"Candidate with 1 single observation: Score = 100% (1/1 items correct)."

Model Prediction
Mastery Estimate = 88% (Heuristic / Max Likelihood)
Ground Truth
True Capability = High Epistemic Uncertainty (Credible Interval: [22%, 94%])

Diagnosis: Arithmetic averages or maximum likelihood estimators report absolute certainty on a single correct response. Our Bayesian formulation maintains broad credible intervals rather than premature confidence.

Mitigation: Informative prior initialization with Minimum Information-Gain regularization.

Citation (BibTeX)
@article{mahandana2026skillsintelligence,
  author  = {Mahandana, Daniel and Systems Lab Group},
  title   = {Skills Intelligence in TVET Ecosystems: Contextual Extraction and Standardized Ontologies},
  journal = {The Sota Lab Working Papers},
  year    = {2026},
  volume  = {2},
  number  = {1},
  url     = {https://sota-lab.lovable.app/research/skills-intelligence}
}