Data Engineer - Ab Initio to GCP Migration Job at Monster, Dallas, TX

YzJFa0E1dHYxL1NHOUhWUG1CRUd3ZXJz
  • Monster
  • Dallas, TX

Job Description

Job Title: Data Engineer – Ab Initio to GCP Migration Location: Dallas, TX We are seeking a highly skilled Data Engineer to support a large-scale Ab Initio to Google Cloud Platform (GCP) migration initiative. The ideal candidate will have strong hands-on experience in ETL development, data pipeline design, and cloud migration, with deep expertise in Ab Initio and modern GCP data services. This role will focus on re-engineering legacy Ab Initio processes, designing scalable cloud-native solutions, and ensuring a smooth migration with minimal disruption. Key Responsibilities: Collaborate with architects and business stakeholders to gather migration requirements from Ab Initio to GCP. Re-engineer and optimize ETL pipelines built in Ab Initio to leverage GCP-native tools such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, and Dataproc. Develop, test, and deploy data ingestion, transformation, and integration workflows on GCP. Ensure data quality, governance, lineage, and compliance throughout the migration process. Optimize the performance and scalability of cloud-based data pipelines. Partner with DevOps teams to implement CI/CD pipelines and automation for data workflows. Provide technical expertise in Ab Initio to GCP mapping, workload analysis, and re-platforming strategies. Support troubleshooting, validation, and performance tuning of migrated workloads. Document migration steps, architecture, and best practices for ongoing knowledge sharing. Required Skills & Experience 5–8+ years of experience in Data Engineering with expertise in ETL and data pipeline development. Strong hands-on expertise with Ab Initio (plans, graphs, PDL, EME, etc.). Proven track record of migrating data pipelines from Ab Initio to GCP or similar modernization initiatives. Proficiency with GCP services: BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Composer (Airflow). Strong programming skills in SQL, Python, and Shell scripting. Experience in data modeling, performance tuning, and large-scale data processing. Good knowledge of data governance, security, and compliance in cloud environments. Familiarity with CI/CD, Git, and DevOps practices for data engineering. Nice to Have Experience with other ETL migration tools/accelerators. Knowledge of healthcare or retail domain data systems. Exposure to Agile methodologies and collaborative delivery models.

Job Tags

Similar Jobs

League School for Autism

Autism Education Strategy Director (Boston) Job at League School for Autism

 ...An educational institution for special needs in Walpole is seeking a Senior Director of Educational Strategy to lead educational programs and ensure compliance with regulatory standards. Candidates should have at least ten years of special education experience, strong... 

Maxion Research

Remote Research Participant & Survey Reviewer (Hiring Immediately) Job at Maxion Research

 ...for motivated individuals to participate in paid research studies including focus groups, clinical trials, online surveys, secret shopping, and product reviews. If you enjoy sharing your opinion and making an impact, this opportunity is for you. Why Choose Us? You... 

OneTech

Environmental Scientist Assistant Job at OneTech

 ...Job Description One Tech Engineering is searching for an Environmental Scientist Assistant for a position located in either Wallingford,...  ...environmental field studies. Provide assistance in utilizing GIS data for map production in accordance with standards and industry... 

Plus 57

Account Representative Job at Plus 57

 ...Capable of assembly of marketing presentations Comfortable operating computers and mobile devices No experience necessary, entry level candidates welcome Core Responsibilities: Review on-ground marketing campaigns, determine additional needs. Collaborate... 

ACTS-Aviation Security Inc

Aviation Public Safety Liaison - Denver Job at ACTS-Aviation Security Inc

 ...Join a forward-thinking company in aviation security as a Public Safety Officer at a major airport. This role involves engaging with the public, ensuring compliance with airport regulations, and addressing incidents effectively. You'll work alongside law enforcement and...