Join Comet — your AI browser comes with Perplexity Pro free ›

QA Automation Engineer

Remote from
Poland flag
Poland
Annual salary
Undisclosed
Salary information is not provided for this position. Check our Salary Directory to estimate the average compensation for similar roles.
Employment type
Full Time,
Job posted
Apply before
22 Nov 2025
Experience level
Senior
Views / Applies
61 / 3

About Altoros

Helping organizations adopt software innovations and market-leading solutions through expert software development services.

Verified job posting
This job post has been manually reviewed for authenticity and compliance.

Altoros – an established provider of software development services, is looking for a QA Automation Engineer.

Requirements

Responsibilities & Responsibilities:

It’s a part-time position.

  • Own the test strategy across FE, BE, and LLM/agent workflows; define the test pyramid and coverage goals.
  • Build and maintain automation for:
    • UI/E2E flows (critical paths, multi‑step agentic scenarios).
    • API/contract testing (REST/GraphQL), schema/compatibility checks.
    • Data & integration tests across services and external partners.
  • LLM Quality & Evals
    • Design golden datasets and rubrics for LLM output evaluation (pass/fail thresholds, human‑in‑the‑loop review).
    • Set up regression/eval harnesses for prompts, tools, and agents; track drift and hallucination rates.
    • Implement guardrails and adversarial/red‑team tests for safety, privacy, bias, and toxicity.
  • Non‑functional testing: baseline and monitor performance, reliability, and resilience for key user journeys.
  • CI/CD ownership: integrate tests into pipelines, gate releases, reduce flakiness, and surface quality KPIs (e.g., failure rate, MTTR, coverage).
  • Test data & environments: manage fixtures, synthetic data, and stable seeds for deterministic runs.
  • Quality operations: triage defects, drive root‑cause analysis, and keep crisp, proactive communication with PM, Design, and Engineering.
  • Documentation: maintain clear test plans, playbooks, and release criteria.

Nice to have:

    • Experience with agent frameworks, tool calling, retrieval/RAG, or tracing.
    • Familiarity with evaluation/observability tools for LLM apps (e.g., prompt testing frameworks, tracing dashboards).
    • Performance testing (e.g., k6/JMeter) and basic security/safety testing practices.

Join Altoros Team!

Apply now >

Logo
Upgrade your job search with Comet
Ad Instantly find insights, write better applications, and explore new opportunities — all within your browser. Try Perplexity Pro free for 1 month.
Activate
Annual salary information is not provided for this position. Explore salary ranges for similar roles in our Salary Directory ›

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

How to apply

Did you apply? Let us know, and we’ll help you track your application.

See a few more

Similar Software Engineering remote jobs

Job Search Safety Tips

Here are some tips to help you search and apply for jobs safely:
Watch out for suspicious jobs Don't apply for jobs that offer high pay for little work or offer to hire you without an interview. Read more ›
Check the employer's profile Make sure you're applying for a trustworthy job by visiting the employer's profile and learning more about them. Read more ›
Protect your information Don't share personal details like your bank account or government-issued ID on suspicious websites or messengers. Read more ›
Report jobs that feel unsafe If you see a job that seems misleading, inappropriate or discriminatory, report it for going against our policies and we'll review it.

Share this job

Jobicy+ Subscription

Jobicy

578 professionals pay to access exclusive and experimental features on Jobicy

Free

USD $0/month

For people just getting started

  • • Unlimited applies and searches
  • • Access on web and mobile apps
  • • Weekly job alerts
  • • Access to additional tools like Bookmarks, Applications, and more

Plus

USD $8/month

Everything in Free, and:

  • • Ad-free experience
  • • Daily job alerts
  • • Personal career consultant
  • • AI-powered job advice
  • • Featured & Pinned Resume
  • • Custom Resume URL
Go to account ›