Senior Data Engineer

Remote from: Costa Rica
Annual salary: Undisclosed
Salary information is not provided for this position. Check our Salary Directory to estimate the average compensation for similar roles.
Department: Data Science & Analytics
Employment type: Full Time,
Job posted: 22 May 2026
Apply before: 22 Jun 2026
Experience level: Senior
Views / Applies: 86 / 31

Experian unlocks the power of data to create opportunities for consumers, businesses and society.

Actively Hiring

AI Summary

Experian is seeking a Senior Data Engineer to join their global team, focusing on building automated frameworks for data ingestion, transformation, orchestration, and deployment. The role involves integrating AI/ML capabilities into data pipelines, such as anomaly detection and pattern recognition. Candidates need expertise in PySpark, Python, SQL, and AWS services, with at least 3+ years of data engineering experience. This is a fully remote position offering competitive benefits and a people-first culture.

Job Complexity

Easy Hard

AI Insight The role requires advanced technical skills in PySpark, Python, SQL, and AWS, along with experience in CI/CD and AI/ML integration, making it challenging but not the most senior level.

Salary Analysis

AI Insight The salary for this role is not specified, but based on market data for Senior Data Engineers with cloud and AI/ML skills, the estimated median is $130,000. This is competitive for the US market, where similar roles range from $110,000 to $160,000.

Key Skills

Data Engineering PySpark Python SQL AWS CI/CD Machine Learning AI ETL Data Pipelines

Cover Letter Sample

I am writing to express my interest in the Senior Data Engineer position at Experian. With over 3 years of experience in data engineering and a strong background in PySpark, Python, and SQL, I am confident in my ability to contribute to your team.

I have extensive experience building automated data pipelines and integrating AI/ML capabilities, including anomaly detection and pattern recognition, which aligns with the role's requirements.

My expertise in AWS services such as Lambda, EC2, and Redshift, combined with proficiency in CI/CD tools like Github, enables me to deliver scalable and efficient solutions.

I am excited about the opportunity to work in a fully remote environment and contribute to Experian's innovative projects. Thank you for considering my application.

Possible Interview Questions

Describe your experience with building automated data ingestion and transformation pipelines.

I have built pipelines using PySpark and Python to ingest data from various sources, transform it using Spark SQL, and orchestrate with Airflow. I also implemented automated testing and monitoring.

How have you integrated AI/ML capabilities into data pipelines?

I integrated anomaly detection by using a pre-trained model to score data quality metrics and trigger alerts. I also used metadata enrichment with NLP to tag incoming data.

Can you explain your experience with AWS services in a data engineering context?

I have used AWS Lambda for serverless data processing, S3 for storage, Redshift for warehousing, and DynamoDB for metadata. I also set up CI/CD with CodePipeline and GitHub.

How do you handle schema drift in data pipelines?

I implement schema-on-read with Spark and use schema registries to track changes. I also set up alerts for drift detection using AWS Glue Data Catalog.

Describe a challenging data engineering problem you solved.

I optimized a slow batch pipeline by switching to streaming with Kinesis and using Spark Structured Streaming, reducing latency from hours to minutes.

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries

Job Description

Reporting to Software Engineering Manager, you will focus on:

You will build automated frameworks for data ingestion, transformation, orchestration, and deployment.
You will integrate AI/ML capabilities into pipelines, including anomaly detection, metadata enrichment, and pattern recognition.
Involved in the implementation of AI and LLM‑based tooling to automate data engineering workflows (e.g., code generation, data quality monitoring, schema drift detection) nice to have.

Qualifications

Bachelor’s degree in Computer Science or equivalent experience.
3+ years of experience in data engineering.
PySpark, Python, SQL (expert‑level)
Cloud experience with AWS, including services such as API Gateway, Lambda, EC2, ECS, SQS, SNS, DynamoDB, Redshift, and Aurora.
Proficiency in CI/CD tools (Github)

Additional Information

Our uniqueness is that we celebrate yours. Experian’s people first, inclusive and purpose-driven culture is multi award-winning; World’s Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why.Experian is proud to be an Equal Opportunity Employer for all groups protected under applicable federal, state and local law, including protected veterans and individuals with disabilities. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Our benefits include: Medical, life and dental insurance, Asociacion Solidarista, International Share Save Plan, Flex Work/Work from home, Paid time off, Annual Performance Bonus, Education Reimbursement, Family Bonding, Bereavement Leave, Referral Program, and more.

This is a fully remote job opportunity. #LI-Remote

Apply now >