Lead Data Engineer Job at Egen, Naperville, IL

ZkdZa0JKaG8wZlNEK1hCTm5Ca0V3ZXZ0WEE9PQ==
  • Egen
  • Naperville, IL

Job Description

\n

Job Description:
  • Responsible for designing and building data pipelines.
  • Designing and implementing solutions and developing applications utilizing airflow, dataflow, Apache beam, snowflake or GCP components.
  • Reading, extracting, transforming, staging, and loading data to multiple targets, using Hadoop, Hive, Snowflake, BigQuery, and Cloud Storage.
  • Migrating existing data processing from standalone or legacy technology scripts to distributed framework processing.
  • Working with gigabytes/terabytes of data and dealing with the challenges of transforming and enriching such large datasets.
  • Utilizing Google Cloud Platform and strong big data technology foundation 
  • Designing and Architecting data model to modernize legacy data warehouses.
  • Writing ELT jobs using DBT to maintain data lineage and data auditability.
  • Designing architecture of CI/CD pipelines to perform continuous build and isolate multiple environments.

Experience/Qualifications
  • Master’s or foreign academic equivalent in Business Analytics, Computer Science, Statistics, Data Science or any related field plus one (1) year of experience. Location: Northridge, CA, telecommuting permitted, HQ in Naperville, IL. Approx. 25% domestic travel required. Travel Expenses to be paid by employer. One year of experience with Hadoop, Spark, Pig, Hive, Snowflake, BigQuery, Kubernetes, and Dataflow required.

\n

SALARY: $116,334 per year

BENEFITS: Medical Insurance, Dental, Life Insurance, Paid Time Off, 401(k)

WHERE TO APPLY: SpringML, Inc. dba Egen Solutions, 40 Shuman Blvd, Suite 204, Naperville, IL;

Email:  hr@egen.ai

EEO and Accommodations:

Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.

Job Tags

Full time, Local area, Remote work,

Similar Jobs

SEIU

Organizer Union Representative - SEIU Local 1199 Job at SEIU

POSITION TITLE: Organizer Union RepresentativeASSIGNMENT: Florida - Miramar AREA VariousREPORTS TO: EVP/VPCLASSIFICATION: PermanentSALARY: $77,549.09NO. OF POSITIONS: 1About 1199SEIU UHWEWith over 450,000 members throughout Massachusetts, New York, New Jersey, Maryland... 

St. Charles Community College

Theatre Production Assistant - Back House Job at St. Charles Community College

 ...Qualified candidates will have demonstrated success in serving diverse student populations. SCC seeks a Part-time t emporary Theatre Production Assistant (Back of House) to perform various duties associated with the scheduled operation of the theatre and... 

Indy Fiber and Surface Cleaning LLC

Industrial Cleaner Job at Indy Fiber and Surface Cleaning LLC

 ...development This is a Part-time evening position at least 3-4 days per week, minimum 10-18 hours per week Looking for someone to clean the warehouse area of an industrial location. All supplies will be provided for you. Must be ok with working in an industrial... 

CHS Inc

Propane Truck Driver Job at CHS Inc

 ...overtime during the winter months. The ideal candidate for this role would have their Class A or B CDL wtih hazmat/tanker endorsements or willing to obtain. No previous CDL experience is required- apply today! Responsibilities Ensure accurate and on time deliveries to... 

University of Oklahoma

Video %26 Photography Production Manager Job at University of Oklahoma

 ...responsible for leading all aspects of visual media creation, including overseeing concept development, production, and delivery of high-quality video and photography content. This role combines creative vision with strong project management and technical expertise to...