Data Engineer - #196100

Intellibee Inc


Date: 3 weeks ago
City: Great Malvern
Contract type: Full time
Data Engineer, Malvern, PA, US

Data Engineer

Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture).

Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.

Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.

Qualifications: Bachelor’s degree in Computer Science or related field.

  • Strong hands-on experience with Apache Spark and Glue.
  • Proven ability to work with Python-based data pipelines.
  • Experience with Git and GitHub Actions is mandatory.

Required Qualifications Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.

  • 7+ years of enterprise Data Engineering experience.
  • Strong Python development experience.
  • Advanced SQL programming skills. Extensive experience with Apache Spark and PySpark.
  • Hands-on experience with AWS data services including: S3 AWS Glue Athena Lambda Step Functions EventBridge Experience building enterprise ETL and ELT pipelines.
  • Strong understanding of distributed data processing.
  • Experience working with large-scale cloud data platforms.
  • Strong knowledge of dimensional data modeling.
  • Experience implementing CI/CD pipelines.
  • Familiarity with Agile/Scrum methodologies.
  • Excellent communication and stakeholder management skills.

Preferred Qualifications

  • Financial Services or Asset Management industry experience.
  • Experience with Snowflake or Databricks.
  • Knowledge of Apache Iceberg, Delta Lake, or Hudi.
  • Experience with Airflow.
  • Knowledge of Kafka or Kinesis streaming.
  • Experience supporting AI/ML and advanced analytics platforms.
  • AWS Professional or Specialty Certifications.

Job Responsibilities

  • We are seeking high-caliber Data Engineers to drive the B2B Service Experience and Financials initiatives.
  • In this pivotal role, you will architect, implement, and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering our core financial engines and reporting ecosystems

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Salaried GP

Menlo Park International GPs, Great Malvern
2 weeks ago
Background – This is a unique opportunity to work in a forward-thinking, supportive, GP Training practice in the idyllic backdrop of the Malvern Hills. The clinical workload is exceptionally light as BMA safe-working guidance is followed, meaning you’ll never see more than 25 patient contacts in a regular day (15-minute appointments). The Practice is light on regular home visits, averaging...

DV Cleared Principal Engineer

Experis UK, Great Malvern
2 weeks ago
Job Title: DV Cleared Principal Engineer Location: Malvern 5 days due to system security purposes Duration: 6 months with possible extension Rate: Market rates Must be willing and eligible to go through the DV Clearance process Our Client is hiring for a reputed client where you'll help deliver complex IT infrastructure activities end-to-end-building, configuring, testing and supporting changes that keep...

Full Stack Developer -Angular, Typescript, Bedrock

Intellibee Inc, Great Malvern
3 weeks ago
Full Stack Developer -Angular, Typescript, Bedrock, Malvern, PA, US Full Stack Developer – Angular, Typescript, Bedrock Position Overview We are seeking a Software Engineer who specializes in modern frontend architectures and cloud-native AI integration. In this role, your primary focus will be designing and building robust user interfaces using Angular (latest versions) while leveraging AWS and AWS Bedrock to integrate...