Why Polygraf AI?

At Polygraf, we envision a future where AI augments human capabilities without compromising safety, privacy, or ethical standards. Trust in our commitment to building this future with you.

About Polygraf AI

Polygraf AI redefines AI security for critical operations. Our proprietary Small Language Model (SLM) technology enables organizations to detect, explain, and mitigate AI risks – from data leakage and compliance violations to deepfakes and synthetic content – using local, explainable, and auditable AI solutions.

We’re award-winning and investor-backed: named ‘Best in Show’ at SXSW 2025 (winning in Enterprise, Smart Data, FinTech & Future of Work), recognized as Top AI & Data Product (2025), Top AI Governance Product and Top AI Content Detection Product (2024) by Products That Count, and ranked a Top Analytics Startup to Watch Globally by Dealroom.

About the Role

You will build and improve applied machine learning systems, from dataset preparation and model training to retrieval, agentic workflows, and knowledge graphs. The role combines practical engineering, careful data work, and experimentation across a range of ML and NLP tasks.

What You'll Do

Model development & training: Develop, train, fine-tune, and iterate on ML and NLP models; choose appropriate architectures, prepare training data, run controlled experiments, and improve models based on measured results.
RAG & retrieval systems: Build retrieval-augmented generation pipelines, including document ingestion, chunking, embeddings, indexing, retrieval, and reranking; evaluate retrieval quality and how well generated answers are supported by retrieved evidence.

Agentic pipeline development: Design and implement workflows that combine models, tools, retrieval, and validation for annotation, information extraction, document processing, and other tasks; build reliable orchestration, failure handling, and human-review mechanisms.

Knowledge graph construction: Build pipelines that extract entities and relationships from text, resolve duplicate or ambiguous entities, and organize information into knowledge graphs; maintain source provenance and evaluate extraction and linking quality.

NER & structured extraction: Develop and improve named entity recognition and token-classification systems; define entity schemas and span-boundary rules, review annotations, and investigate contextual label decisions and extraction errors.

Model QA & benchmarking: Systematically evaluate predictions, identify recurring error patterns, and distinguish model failures from annotation or data issues; maintain benchmarks, compare model versions, track relevant metrics, and communicate gains and regressions.

Dataset selection, curation & labeling: Process, filter, audit, and analyze large text corpora and labeled datasets; evaluate candidate sources and select diverse, representative, entity-rich samples; create, review, and correct annotations with careful judgment on ambiguous cases.

Annotation policies & data readiness: Define and refine entity definitions, span boundaries, precedence rules, and edge-case policies; keep labeling rules consistent, and clean, normalize, validate, and convert outputs into training-ready datasets.

Deployment & automation: Integrate ML models and LLMs into services and automated pipelines; implement batching, retries, logging, result collection, and quality checks, and manage trade-offs between accuracy, latency, throughput, and cost.

AI security & guardrails: Build guardrails for LLM and agentic systems, including input and output validation, defenses against prompt injection and jailbreaks, limits on tool access and permissions, and filtering of harmful or policy-violating content; red-team models and pipelines, and measure how well safeguards hold without blocking legitimate use.

Must-have

Strong applied ML fundamentals: Practical understanding of supervised learning, generalization, overfitting, data leakage, class imbalance, and evaluation; hands-on experience training or fine-tuning models and making evidence-based improvements.

Solid Python and engineering skills: Ability to build, debug, and extend data-processing and ML code, integrate APIs, and produce reproducible experiments and maintainable pipelines.

Strong NLP background: Experience with NER, sequence labeling, or other token-level tasks, including contextual label decisions, token-to-span alignment, boundary errors, and precision/recall trade-offs.

Excellent English and annotation judgment: IELTS 7.5+ or equivalent, with hands-on dataset labeling and annotation quality control. Sample labeling requires deep contextual understanding of subtle meaning, boundaries, and edge cases, plus clear writing of labeling policies and QA notes.

Dataset selection and curation experience: Comfort with large text datasets, sampling, filtering, aggregation, deduplication, source assessment, and scalable human-review workflows; ability to select high-value samples under coverage and diversity constraints.

Data validation and policy consistency: Experience validating, cleaning, and converting selected or automatically labeled data; ability to define and revise enforceable annotation rules without introducing contradictions.

Practical LLM deployment & system building: Hands-on experience deploying, serving, and using open-source LLMs locally, integrating them into retrieval or agentic pipelines, and prompting them for structured extraction and annotation; practical understanding of efficient inference, including quantization, KV caching, batching, GPU memory management, and trade-offs between context length, throughput, and latency.

Benchmarking and error analysis: Ability to compare checkpoints or systems fairly, analyze performance by label and data slice, separate data problems from model problems, and report both improvements and regressions.

Careful, independent judgment: High attention to detail, strong reasoning under ambiguity, and clear written communication of decisions, evidence, and trade-offs.

Nice to Have

Knowledge graph experience: Entity and relationship extraction, entity resolution, ontology or schema design, graph databases, and graph-based retrieval.

Multilingual and large-corpus NLP: Experience with language-specific preprocessing and normalization, embeddings, similarity search, clustering, and retrieval for exploring and selecting data.

Dataset and experiment lifecycle management: Versioned annotation schemas, datasets, experiment tracking, model artifacts, and reproducible release workflows.

AI security & guardrails: Familiarity with LLM threat models (prompt injection, jailbreaks, data exfiltration, unsafe tool use), guardrail frameworks and safety classifiers, adversarial testing and red-teaming, and evaluating model robustness and safety.

Who thrives in this role

Someone who enjoys building useful ML systems and investigating why they succeed or fail: choosing the right data, defining precise labels, training models, building retrieval and agentic pipelines, connecting information through knowledge graphs, and improving quality through careful experimentation.

As an equal opportunity employer, we highly value diversity and inclusion. We recognize that a diverse team brings unique perspectives, fosters ongoing innovation, and deepens our connection to the global community we serve. If you’re enthusiastic about spearheading the next era of generative AI and leaving a profound impact on how individuals and brands create, we’re eager to have you join our team.

Application form

Products

thank you

Your download will start now.

Thank you!

Please provide information below and
we will send you a link to download the white paper.