Lead Data Pipeline Developer

6 days ago

Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000
Data Engineering Expert

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines, as well as expertise in working with cloud-based services.

Key Responsibilities:

  • Develop and maintain ETL/ELT data pipelines to ingest data from various sources into our data warehouse using AWS Lambda, DMS, and Glue.
  • Craft Snowflake stored procedures to implement complex business logic and data transformations.
  • Manage and monitor scheduled data workflows using Apache Airflow.
  • Work closely with stakeholders to understand project requirements and translate them into technical solutions.
  • Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.
  • Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals.

Required Skills and Qualifications:

  • Proven experience as a Data Engineer or in a similar role.
  • Strong proficiency in SQL scripting.
  • Proficiency in Python for data manipulation and automation.
  • Experience with Apache Airflow for workflow orchestration.
  • Hands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.
  • Solid understanding of data warehousing concepts, with practical experience using Snowflake.
  • Excellent problem-solving skills and the ability to design and implement solutions based on business requirements.

About This Role:

This is a cutting-edge opportunity for a skilled Data Engineer to contribute to the development of innovative data-driven solutions.

What We Offer:

  • A collaborative and dynamic work environment.
  • Opportunities for professional growth and development.
  • A competitive compensation package.

Why Choose Us?

We are passionate about delivering exceptional results and pushing the boundaries of what is possible.

  • Data Pipelines Specialist

    1 day ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Senior Data Engineering SpecialistWe are seeking an experienced Senior Data Engineer to join our team.This is a critical role in designing, developing, and maintaining data pipelines and infrastructure.Your Key Responsibilities:Designing and implementing scalable data pipelines using Azure Data Factory and Databricks for efficient data ingestion,...

  • Senior Data Pipelining Specialist

    7 days ago

    Solapur, Maharashtra, India beBeeTalendDateveloper Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled professional to fill the role of a Talend ETL Developer with expertise in BigQuery, PostgreSQL, and Python for an immediate contract position.Job Summary:Talend ETL Developers design, optimize, and deploy complex data pipelines using Talend Open Studio. The ideal candidate will have experience with partitioning, clustering, federated...

  • Azure Data Pipeline Specialist

    5 days ago

    Solapur, Maharashtra, India beBeeData Full time US$ 9,00,000 - US$ 12,00,000

    Job Description:We are seeking a skilled Azure Data Engineer to design, build, and maintain robust data pipelines that efficiently curate and ingest data. This role involves working with cross-functional teams to ensure data integrity, security, and accessibility.Key Responsibilities:Design, build, and maintain data pipelines for efficient data curation and...

  • Senior Data Pipeline Specialist

    5 days ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,20,000

    Key Responsibilities:Design and maintain complex data pipelines utilizing Python, AWS (S3, Redshift, Lambda, Glue), and other relevant technologies.Implement and optimize Extract, Transform, Load (ETL) processes for large-scale datasets to ensure efficient data processing.Guarantee the integrity, security, and accessibility of data assets while adhering to...

  • Data Pipeline Quality Assurance Specialist

    5 days ago

    Solapur, Maharashtra, India beBeeTest Full time ₹ 80,00,000 - ₹ 1,50,00,000

    About this opportunity :We are seeking an experienced professional to join our team as a Test Engineer, specializing in ETL and Power BI.This role will involve ensuring the accuracy, integrity, and performance of ETL Pipelines deployed into Azure cloud environments.The ideal candidate will have experience with Python scripting and Pytest framework,...

  • High-Performance Data Pipelines Specialist

    7 days ago

    Solapur, Maharashtra, India beBeeData Full time US$ 1,80,000 - US$ 2,40,000

    Big Data Engineer Job DescriptionWe're seeking a skilled Big Data Engineer to help us scale and optimize our data processing capabilities. Our platform processes massive amounts of data to provide actionable insights to clients.The ideal candidate will design, build, and maintain high-performance data pipelines that process terabytes of data. This includes...

  • Lead Data Engineer

    4 weeks ago

    Solapur, Maharashtra, India CoffeeBeans Full time

    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The company uses...

  • Lead Data Innovator

    7 days ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the Role:We are seeking a skilled Data Engineer to build scalable data pipelines, work with streaming data and collaborate with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL workflows;Manage large datasets using Spark, PySpark and SQL;Build real-time streaming...

  • Lead Data Operations Specialist

    3 days ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to spearhead our data operations.About the RoleThis is a highly skilled position that involves designing, implementing and managing ETL pipelines using Azure Data Factory and Fabric toolbox. The ideal candidate will have expertise in building and delivering high-quality datasets to...

  • Pipeline Growth Manager

    19 hours ago

    Solapur, Maharashtra, India beBeeDemand Full time ₹ 12,00,000 - ₹ 30,00,000

    Job Title:Demand Generation SpecialistA results-driven professional is sought after to spearhead demand generation efforts across both outbound and inbound channels. This role will be responsible for developing and executing end-to-end demand generation plans, driving pipeline growth, and campaigns.Responsibilities:Execute the demand generation plans for...