AWS Data Pipeline Engineer

Job OverviewWe are seeking a seasoned data engineer to lead our data pipeline development efforts, focusing on scalability and efficiency.The ideal candidate will design, develop, and optimize ETL/ELT pipelines using Apache Spark, AWS Glue, and Azure Data Factory for seamless data integration.Collaboration with cross-functional teams is essential in building...

Big Data EngineerWe are seeking a skilled professional to join our team as a Big Data Engineer. In this role, you will be responsible for designing and building robust data pipelines that handle high-volume financial data.Key Responsibilities:Design end-to-end data pipelines for stocks, crypto, and other financial datasets.Integrate third-party APIs and data...

Job Title: Data Pipeline ArchitectAbout the Role:We are looking for a seasoned professional to design and develop efficient data pipelines using AWS Glue and DBT.The ideal candidate will have experience with serverless and AWS ecosystem services for data ingestion and transformation, aligning with Gartner's approach on data transformation.This role involves...

Job OverviewWe're seeking a skilled Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark, AWS, and Databricks.Key Responsibilities:Perform data profiling, validation, and transformation using Python and SQL.Optimize and monitor workflows for performance, scalability, and cost efficiency.Collaborate with analytics teams to...

Senior Data ArchitectWe are seeking an experienced data architect to lead the design and implementation of our data pipelines using Snowflake, AWS Lambda, Glue, and SQL.Key Responsibilities:Design and implement scalable data pipelines that integrate with multiple internal and external sources.Develop ETL/ELT pipelines using AWS Glue, Lambda, and DBT for...

Job Title: Data Pipeline DeveloperWe are seeking an experienced Data Engineer to design, build, and maintain robust data pipelines using cloud services such as Google Cloud Platform (GCP), Amazon Web Services (AWS), or Microsoft Azure. The ideal candidate will have deep expertise in cloud-based data processing technologies.About the Role:Design and develop...

Job Description:We are seeking a candidate who is comfortable working on non-standard shifts.Develop and maintain data pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client onboardingOptimize cloud-based queries, compute usage,...

**Job Summary**We are seeking a highly skilled ETL Developer to join our team. As an ETL Developer, you will be responsible for designing, developing, and maintaining ETL pipelines using IBM DataStage and AWS Glue/Lambda.**Key Responsibilities:**Design and develop ETL pipelines for ingestion from varied sources using IBM DataStage and AWS Glue/Lambda.Build...

We are seeking a Freelance Data Engineer with expertise in designing, developing, and optimizing data pipelines.Develop scalable Python code for data engineering workflowsImplement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sourcesManage storage solutions using Amazon S3Write unit tests to ensure data quality and...

We are looking for a highly skilled Data Engineer with strong expertise in PostgreSQL and hands-on experience in building data warehouses and data lakes. In this role, you will design and implement a scalable PostgreSQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...