Project: Complete QA Automation Pipeline

Overview

Build a production-ready testing pipeline for a real-world application with comprehensive test coverage, CI/CD integration, and quality gates.

Project Requirements

CI/CD quality pipeline: commit passes pre-commit hooks and CI checks, a coverage gate allows build and staging deploy, visual tests gate production; failures fail the build

Phase 1: Test Suite (60 points)

Unit Tests (20 points)

✅ 90%+ code coverage
✅ All edge cases covered
✅ Fast execution (< 5 seconds)
✅ No flaky tests

Integration Tests (20 points)

✅ API endpoint testing
✅ Database integration
✅ External service mocking
✅ Error handling verification

E2E Tests (20 points)

✅ Critical user journeys
✅ Cross-browser testing
✅ Mobile responsive tests
✅ Accessibility checks

Phase 2: CI/CD Pipeline (25 points)

GitHub Actions Workflow

name: Production CI/CD

on:
  push:
    branches: [main]
  pull_request:
    branches: [main]

jobs:
  quality-gates:
    name: Quality Gates
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: actions/setup-node@v4
        with:
          node-version: '20.x'
          cache: 'npm'

      - name: Install dependencies
        run: npm ci

      - name: Type check
        run: npm run typecheck

      - name: Lint
        run: npm run lint

      - name: Security audit
        run: npm audit --audit-level=moderate

      - name: Unit tests with coverage
        run: npm run test:coverage

      - name: Upload coverage
        uses: codecov/codecov-action@v3
        with:
          files: ./coverage/lcov.info

      - name: Integration tests
        run: npm run test:integration

      - name: E2E tests
        run: |
          npx playwright install --with-deps
          npm run test:e2e

      - name: Mutation testing
        run: npx stryker run

      - name: Performance tests
        run: npm run test:performance

  build:
    needs: quality-gates
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: actions/setup-node@v4
      - run: npm ci
      - run: npm run build

      - name: Upload artifacts
        uses: actions/upload-artifact@v3
        with:
          name: dist
          path: dist/

Quality Gates Checklist

Phase 3: Quality Tools (15 points)

Coverage Reporting

// vitest.config.js
export default {
  test: {
    coverage: {
      provider: 'v8',
      reporter: ['text', 'json-summary', 'html', 'lcov'],
      statements: 90,
      branches: 85,
      functions: 90,
      lines: 90,
      exclude: [
        '**/*.config.{js,ts}',
        '**/dist/**',
        '**/node_modules/**',
        '**/*.test.{js,ts}'
      ]
    }
  }
};

Mutation Testing

Verify tests catch real bugs
Fix surviving mutants
Achieve 80%+ mutation score

Performance Monitoring

// tests/performance/lighthouse.test.js
import { playAudit } from 'playwright-lighthouse';
import { test } from '@playwright/test';

test('Lighthouse performance audit', async ({ page, context }) => {
  await page.goto('http://localhost:3000');

  await playAudit({
    page,
    port: 9222,
    thresholds: {
      performance: 90,
      accessibility: 100,
      'best-practices': 90,
      seo: 90
    }
  });
});

Deliverables

1. Complete Test Suite

task-manager/
├── tests/
│   ├── unit/
│   │   ├── validators.test.js
│   │   ├── Task.test.js
│   │   └── helpers.test.js
│   ├── integration/
│   │   ├── api.test.js
│   │   └── database.test.js
│   ├── e2e/
│   │   ├── tasks.spec.js
│   │   ├── auth.spec.js
│   │   └── search.spec.js
│   └── performance/
│       └── lighthouse.test.js

2. CI/CD Configuration

.github/workflows/ci.yml
.github/workflows/deploy.yml
Quality gate checks
Automated deployments

3. Documentation

Create docs/testing.md:

# Testing Strategy

## Test Coverage Goals
- Unit: 95%+
- Integration: 90%+
- E2E: Critical paths only
- Mutation: 80%+

## Running Tests Locally
\`\`\`bash
npm test              # All tests
npm run test:unit     # Unit only
npm run test:int      # Integration only
npm run test:e2e      # E2E only
npm run test:mutation # Mutation testing
\`\`\`

## CI/CD Pipeline
All PRs must pass:
1. Linting
2. Type checking
3. Security audit
4. All test suites
5. Coverage thresholds
6. Mutation testing

## Adding New Tests
[Instructions for team...]

Grading Rubric

Category	Points	Criteria
Unit Tests	20	90%+ coverage, all edge cases, fast
Integration Tests	20	API, database, error handling
E2E Tests	20	Critical flows, cross-browser
CI/CD Pipeline	25	Complete automation, quality gates
Quality Tools	15	Coverage, mutation, performance
Total	100

Bonus Points (10)

Visual regression testing (+3)
Accessibility testing (+3)
Performance budgets (+2)
Comprehensive documentation (+2)

Success Criteria

Your project is complete when:

✅ All tests pass locally
✅ CI/CD pipeline is green
✅ Coverage meets thresholds
✅ No critical security issues
✅ Mutation score ≥ 80%
✅ Documentation is complete
✅ Team can run tests easily

Submission

Submit via GitHub:

Create a repository: qa-automation-project
Implement all requirements
Ensure CI/CD passes
Add screenshot of green pipeline
Submit repository URL

Real-World Application

This project simulates a production environment where:

Every commit triggers automated tests
Code reviews include test coverage
Deployments require all tests to pass
Quality gates prevent bad code from shipping
Team confidence in releases is high

Quality Assurance & Automation