Job Opportunities API

The Public Ledger of Openings

← Back to the ledger

GenAI Tuning Analyst

usan
Companyusan
CategoryUncategorised
LocationNorcross
RemoteOn-site (inferred)
EmploymentNot stated
LevelNot stated
SalaryNot stated by the employer
First seen30 Jul 2026 (the employer did not state a posting date)
Last verified6 Aug 2026
SourceEmployer ATS (bamboohr)
Applications are handled by the employer, not by us.Apply on the employer's site →
Description
Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time. No agencies please. Role Overview As a  GenAI Tuning Analyst , you will  be responsible for  the continuous improvement, accuracy, and "brand voice" of our Generative AI deployments within the Contact Center ecosystem , including agentic bots . You will work at the intersection of data science, linguistics, and customer operations to ensure our AI agents and agent-assist tools provide precise, empathetic, and compliant resolutions. This role requires a  professional learner ; a  high-signal individual who pairs raw brainpower and adaptability with the hunger to master the evolving science of AI performance. Your goal is to transform generic LLM  output  into specialized,  contact  ce n ter  domain -aware intelligence . Key Responsibilities • RLHF & Quality Calibration:  Lead  Reinforcement Learning from Human Feedback (RLHF)  cycles. You will review AI-generated outputs and "grade" them based on accuracy, empathy, and adherence to compliance protocols. • Participate in  Customer  Tuning   monthly  meetings   pertaining to   a complete suite  of USAN   AI Product  Specific  deployments. • Performance Monitoring:  Define and track AI-specific KPIs, such as  Hallucination Rate ,  Refusal Rate , and  Intent Accuracy , alongside traditional metrics like  First Contact Resolution (FCR) . • Bias & Safety Guardrails:  Implement and monitor safety filters to ensure the AI  remains  neutral,  avoids  prohibited topics, and protects PII (Personally Identifiable Information). • Cross-Functional Collaboration:  Partner with Subject Matter Experts (SMEs) in Legal, Compliance, and Operations to translate business policy into technical model constraints. • Prompt Engineering & Optimization:  Iterate on complex system prompts to guide LLM behavior for specific contact center use cases (e.g., automated summaries, live chat responses, and knowledge base retrieval). • Data Curation:   Identify  and curate high-quality "golden datasets" from historical call transcripts and chat logs to  be used  for fine-tuning and few-shot prompting. Ideal Candidate  Skills Analytical Pattern Recognition:  Naturally  identifies  patterns in data and customer language, using strong data and business analytics skills to interpret trends and organize information effectively. Customer-facing   skills for both the supervisory and executive sponsors of AI deployed in USAN’s cloud contact center offerings. Comfort with Ambiguity:  Able to make thoughtful decisions in gray areas, applying sound judgment to  determine  how conversational intents should  be categorized , merged, or preserved. Curiosity About Customer Communication:  Interested in how customers naturally express their needs  and  are  able to  translate that language into meaningful insights for AI optimization. Process Improvement Mindset:  Enjoys working with data repeatedly while finding smarter ways  process  and  analyzing   it,   such as building Excel formulas, spotting systematic issues, and improving workflows. Trust-Based Collaboration:  Builds credibility and trust with clients and internal teams while working collaboratively to improve AI performance and data quality. Functional Requirements Writing:   Translate customer feedback into actionable product improvements by gathering input, researching root causes, writing clear technical requirements for developers, and analyzing post-update results (e.g., for agent scorecards/GenAI tools) before returning changes to the customer. Required Qualifications Experience • 1-2 years in AI/NLP, Data Analysis, high-level Contact Center Operations . • Analyzing Intent Accuracy to  identify  gaps in the AI’s natural language understanding (NLU/NLP). • UAT Support: Experience assisting in User Acceptance Testing for new AI features or tool rollouts. • Secondary experience in Quality Assurance is a plus. Technical Skills • Proficiency  in prompt engineering techniques (Chain-of-Thought, Few-Shot, Zero Shot). • Basic understanding of LLM architectures (GPT-4, Claude, Llama). • Skilled at identifying  trends in customer interaction data to suggest process improvements. Communication • Exceptional written and verbal communication skills with an obsession over tone, grammar, and brand consistency. • Ability to act as a bridge between technical teams and frontline operations. • Moderate customer meetings to align with company direction on our AI tools . Preferred "Bonus" Skills • Experience with  RAG (Retrieval-Augmented Generation)  frameworks. • Background in Linguistics or Cognitive Science. • Experience with data visualization  tools (Tableau/ PowerBI )  and basic SQL to pull interaction data. • Familiarity with Contact Center platforms (e.g.,  Amazon Connect  Workspaces,  Salesforce Service Cloud, Genesys, Nice, or HubSpot). Why This Role Matters In the modern contact center, the AI is  the  first impression. The Tuning Analyst ensures that impression is not just intelligent, but human-centric and helpful. Job Benefits: •Healthcare benefits •401K plan •Paid company holidays •Paid vacation •Business casual work environment •Annual performance based bonus program Company Description United States Advanced Network, In. (USAN) is a privately held corporation based out of Norcross, GA (a suburb of Atlanta, GA).  USAN is an AWS Advanced Tier Partner specializing in Amazon Connect, helping organizations design and deploy scalable, AI-driven customer interactions that accelerate time to value and maximize ROI. With over 35 years of deep contact center expertise, USAN delivers modern agentic CX solutions and a white-glove approach to optimizing and managing cloud contact center environments through its managed services. For more information, please visit us at www.usan.com