QA Engineer

Arabic Contractual QA – Role Guideline & Responsibilities
(Skillset Equivalent to L3 Data Associate / QAT- I Level)
The purpose of this document is to capture the criteria, skill-set requirements and key
responsibilities of contractual hire in MENA region to support ar-SA related testing activities for
Alexa.
We are seeking a contractual QA Engineer to support the Arabic Alexa. This role requires
expertise in testing voice-enabled AI systems with a focus on Arabic language quality.
1. Role Overview
Title: Arabic Quality Assurance Associate (Contractual)
Level Equivalent: L3 (Device Associate/QAT)
Employment Type: Contractual / Temporary
Purpose: Execute manual/automated tests for Arabic (ar-SA) Alexa features, focusing on
linguistic accuracy, dialectal validation, and functional testing across Alexa endpoints.
2. Role Definition (L3 DA/QAT Equivalent)
The Arabic Contractual QA operates with minimal direction on defined tasks, following
established SOPs and test procedures. This role is execution-focused with the ability to identify
issues, report bugs, and provide linguistic/cultural feedback on Arabic language experiences.
Dimension
Expectation
1 Ambiguity Low – works within well-defined SOPs and test plans
2 Scope
Component/Feature level – validates specific Arabic language features
3 Execution Executes test cases; may become execution SME in Arabic locale testing
4 Impact
Direct impact on Arabic locale quality; contributes to launch readiness
activities
5 Autonomy Operates independently on assigned tasks; escalates blockers to
QAE/Manager
1
3. Key Responsibilities
3.1 Core Testing Responsibilities
• Execute manual/automated test cases for Arabic (ar-SA) Alexa features across P0
endpoints (EFD Headless, Multimodal, Mobile)
• Validate Arabic ASR (Automatic Speech Recognition) accuracy across dialects like Najdi,
Hijazi, Emarati
• Validate Arabic TTS (Text-to-Speech) output for naturalness, dialect consistency, and
pronunciation accuracy
• Test code-switching scenarios (Arabic-English mixed utterances)
• Validate entity resolution for Arabic names, places, numbers, and phone numbers
• Test gender-appropriate responses (masculine/feminine agreement)
• Validate diacritical accuracy and context-dependent pronunciation
• Execute regression testing for Arabic locale features
3.2 Bug Reporting & Documentation
• Report bugs with clear reproduction steps, expected vs. actual behavior, and severity
classification
• Document test results in designated tools (TestRail, SIM)
• Provide linguistic/cultural feedback on Arabic responses
• Flag culturally sensitive content or Responsible AI concerns
• Maintain test execution logs and daily status reports
3.3 Localization & Cultural Validation
• Validate Najdi dialect consistency in TTS responses
• Verify MSA (Modern Standard Arabic) usage for religious/spiritual content
• Assess cultural appropriateness of responses for Saudi/UAE market
• Validate Arabic UI elements (RTL layout, font rendering, text truncation)
3.4 Data & Metrics
• Track and report individual KPIs (test cases executed, bugs reported, quality scores)
• Contribute to weekly engagement metrics and traffic data collection
• Support data annotation tasks for Arabic utterance validation when required
3.5 Collaboration
• Participate in daily stand-ups and weekly sync meetings
• Collaborate with PM/QAM/QAE on test strategy execution
• Support beta tester feedback triaging for Arabic locale
2
4. Required Skillset (Must Have)
4.1 Language Skills
• Native Saudi Arabic proficiency – spoken and written
• Najdi dialect expertise (primary), ability to evaluate naturalness and accuracy
• Understanding of MSA (Modern Standard Arabic) grammar and diacritics
• Familiarity with at least 2 additional Arabic dialects (Hijazi, Emirati, Egyptian, or
Levantine)
• English proficiency – professional working level (written and verbal)
• Understanding of Arabic-English code-switching patterns
4.2 Technical Skills
• Experience with manual software testing (1+ years preferred)
• Understanding of test case creation, execution and bug reporting
• Basic knowledge of test management tools (TestRail or equivalent)
• Proficiency in bug tracking systems (JIRA/SIM or equivalent)
• Basic understanding of QA methodologies (functional, regression, exploratory testing)
• Familiarity with voice assistant/smart speaker technology
4.3 Domain Knowledge
• Understanding of ASR/TTS concepts (awareness level)(not mandatory)
• Familiarity with localization testing principles
• Awareness of RTL (Right-to-Left) UI testing
• Basic understanding of i18n testing categories: Regional, Contextual, Language, Cultural
4.4 Soft Skills
• Strong attention to detail
• Ability to write structured and coherent bug reports backed by evidence
• Ability to work independently with minimal supervision
• Effective time management and ability to meet deadlines
• Active listening and clear communication during team meetings
5. Preferred Qualifications (Good to Have)
• Experience testing voice-based or conversational AI products
• Familiarity with Alexa ecosystem or similar voice assistants
• Awareness of Responsible AI principles
• Experience in agile/scrum environments
• Bachelor’s degree in Linguistics, Computer Science, IT, or related field
3
4
6
5 Learn and Be Curious Stays updated on Arabic dialect nuances and Alexa feature
4 Deliver Results
3 Insist on Highest
Standards
2 Dive Deep
1 Bias for Action
Leadership Principle
changes
Meets daily/weekly test execution targets consistently
Maintains high quality bar for Arabic linguistic accuracy
Investigates root causes of Arabic language defects thoroughly
Proactively identifies and reports issues without waiting for