AI Functional Tester - Flexon Technologies Inc.

Remote, USA Full-time
Job Description:As a Functional Tester specializing in AI Agents, you will be responsible for designing, executing, and maintaining test cases that validate the functionality, reliability, and performance of AI-driven agent systems. You will work closely with development teams, AI specialists, and product owners to ensure that AI agents perform accurately and efficiently in real-world scenarios. Key ResponsibilitiesAILLM-Specific QA Designing test frameworks for LLM outputs (hallucination checks, factuality tests, toxicitybias detection). Automation Frameworks PyTest, Robot Framework, Playwright, Cypress, or custom LLM test harnesses. Evaluation Metrics BLEU, ROUGE, BERTScore, GPT-based evaluators, human-in-the-loop validation. Data QA Ensuring high-quality trainingevaluation datasets, data validation (Great Expectations, Deequ). Python Automation Scripting test cases, API test automation. CICD Integration Automated test pipelines in JenkinsGitHub ActionsGitLab CI. Performance Testing Latency, throughput, stress testing of LLM-powered services. Leadership (Manager level) Define QA strategies for AI systems, lead test automation teams, enforce quality gates. Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity. Apply to this job

Apply Now

Similar Jobs

Enrollment Technician II - Remote Healthcare Operations Specialist for Member Enrollment and Benefits Administration

Remote, USA Full-time

Enterprise Account Executive, Major Accounts - Transforming Businesses with Innovative Apple Solutions

Remote, USA Full-time

Enterprise Account Executive - Remote - Pennsylvania State - TeamViewer - Cloud and Enterprise IT Solutions Sales

Remote, USA Full-time

Enterprise Account Executive – Remote, US - Strategic Sales Leadership for AI-Powered Customer Experience Solutions

Remote, USA Full-time

Enterprise Account Executive, Work Management, Trello (SSE) - Leading Global Sales for Top Fortune 500 Companies

Remote, USA Full-time

Enterprise Application Engineer – Google Workspace Platform Optimization & Collaboration

Remote, USA Full-time

Enterprise Customer Success Manager - Strategic Customer Engagement and Success at Atlan

Remote, USA Full-time

Enterprise Data Architect - Master Data Management, Cloud Computing, and Data Governance with Active Secret or Top Secret Clearance

Remote, USA Full-time

Enterprise Data Quality Senior Analyst – Technical Deployment & Innovation at Toyota Financial Services

Remote, USA Full-time

Enterprise Data Strategist - Remote Work Opportunity with PRIMUS Global Services - Data Governance and Management

Remote, USA Full-time

Sales & Customer Service Representative - Texas Based, Full-Time

Remote, USA Full-time

Game Night Staff: Mascot Assistant (Part-Time/Seasonal)

Remote, USA Full-time

Getting A Job At Yelp $25/Hour

Remote, USA Full-time

Delta Airlines Remote Customer Service Jobs At Home - Apply Now

Remote, USA Full-time

Cost Engineer – Data Center Construction

Remote, USA Full-time

Project-Based Customer Service - FEMA Support Specialist $20.50/hr (New Mexico Remote)

Remote, USA Full-time

Online Apple Jobs $30/Hour – mysmartpros

Remote, USA Full-time

Remote Account Support Specialist

Remote, USA Full-time

Unit Secretary, Special Care Nursery, Full Time, Night Shift, Mt. Holly

Remote, USA Full-time

Registered Nurse - Adult Joint and Reconstruction Orthopedics Stepdown – Amazon Store

Remote, USA Full-time
Back to Home