Optimizing Data Pipeline Architecture

2 days ago


India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 21,60,000
Remote Data Engineer

We are seeking a highly skilled Data Engineer to join our team in a 6-month remote contract based in India. As a key member of our data architecture team, you will play a critical part in designing, maintaining, and optimizing our data pipeline architecture.

You will be responsible for managing ELT processes using Stitch, including configuration, monitoring, and troubleshooting. Additionally, you will maintain and update AWS Data Migration Service (DMS) tasks for data replication from PostgreSQL to Redshift, with an emphasis on Change Data Capture (CDC) implementations.

The ideal candidate will have experience in designing, implementing, and optimizing data models within our Redshift data warehouse following best practices. You will develop and maintain data transformation pipelines using Python, dbt, AWS Lambda, and Dagster.

Responsibilities include creating and maintaining data marts for various business domains, supporting containerized applications running on AWS EKS, and collaborating with the engineering team to ensure data quality and accessibility.

Requirements:
  • 3+ years of experience as a Data Engineer
  • Expertise in AWS services, particularly DMS and Lambda
  • Proficiency in Python and database design
  • Strong understanding of data warehousing and ETL concepts
  • Experience with data visualization tools such as Tableau or Power BI
What We Offer:
  • A competitive salary and benefits package
  • Opportunities for professional growth and development
  • A dynamic and collaborative work environment


  • India beBeeDeveloper Full time US$ 1,04,000 - US$ 1,30,878

    ETL Data Engineer - Scalable Pipeline DeveloperWe are seeking an experienced ETL data engineer to build and maintain scalable data pipelines using IBM DataStage and AWS Glue. As a key member of our data engineering team, you will work collaboratively with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data...


  • India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Big Data Engineer - BrightEdge is seeking a skilled professional to lead the design, build and maintenance of high-performance data pipelines. The ideal candidate will have extensive experience in big data technologies, Python programming skills and a strong understanding of performance optimization techniques.Job OverviewThis role is critical in ensuring...


  • India beBeeDataProfessional Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled data professional with expertise in Talend Open Studio to join our organization. The ideal candidate will have experience with BigQuery, PostgreSQL, Python, and GCP.Position DetailsRole: Talend ETL DeveloperExperience: 8-10 yearsThe successful candidate will be responsible for designing and optimizing complex data pipelines using...


  • India beBeeAzure Full time US$ 1,04,000 - US$ 1,30,878

    Azure Data Factory Specialist We are seeking an experienced Azure Data Factory specialist to join our team. The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines using Azure ADF. Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes. Integrate data...


  • India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Cloud Data EngineerAbout the JobOur company is seeking a highly skilled Cloud Data Engineer with deep expertise in designing, building, and optimizing scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower...


  • India Weekday AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    This role is for one of Weekday's clientsMin Experience: 6 yearsLocation: IndiaJobType: full-timeWe are looking for an experienced and motivated Senior Pipeline Engineer to join our engineering team and take ownership of designing, building, and managing high-performance data pipelines. This role demands strong expertise in orchestration frameworks such as...

  • Senior Data Engineer

    3 weeks ago


    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...


  • India beBeeDatabricks Full time ₹ 12,00,000 - ₹ 18,00,000

    Azure Databricks Engineer PositionWe are seeking a seasoned data engineer to lead our Databricks team. The ideal candidate will have extensive experience with data ingestion processes and expertise in CI/CD and Kubernetes.This role offers an opportunity to design, develop, and optimize data ingestion pipelines for integrating multiple sources into...


  • India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,75,000

    Job SummaryWe are seeking an experienced senior Data Engineer to design, build and maintain robust data pipelines for processing channel activity data from multiple sources.Utilize AWS cloud infrastructure services like Pyspark, Glue, EMR, Lambda, Redshift, Athena and other services like Iceberg to implement scalable data solutions.Collaborate with...


  • India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering PositionWe are seeking an experienced Data Engineer to design and build scalable data pipelines, manage large datasets using Spark and SQL, and deploy real-time streaming applications.Key Responsibilities:Design and optimize data pipelines and ETL workflows.Manage and process large datasets using Spark, PySpark, and SQL.Build and maintain...