Data Pipeline Specialist

2 days ago


Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Overview

We are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines using PySpark and Python in AWS.

About the Role

The successful candidate will have 6+ years of ETL experience and strong knowledge of SQL fundamentals and snowflake experience. You will be expected to develop new ETL/data transformation jobs, enhance and support existing ETL/data transformation jobs, communicate technical solutions and resolutions to internal customers, and provide high-level technical support and perform root cause analysis for problems experienced within the area of functional responsibility.

Requirements
  • A minimum of 6+ years of ETL experience.
  • Strong knowledge of SQL fundamentals and snowflake experience.
  • Intermediate-level Python and PySpark skills.
  • Able to write SQL code sufficient for most business requirements.
  • Proven track record in troubleshooting ETL jobs and addressing production issues.
  • Proficient in developing optimization strategies for ETL processes.
Preferred Qualifications
  • Bachelor's degree in computer science or equivalent.
  • 7+ years of ETL and SQL experience.
  • 3+ years of Python and PySpark experience.
  • 3+ Snowflake experience.
  • 3+ years of AWS and UNIX experience.
Certifications
  • AWS Certified Cloud Practitioner.
  • Python and PySpark certifications.


  • Pune, Maharashtra, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 12,00,000

    We are seeking a skilled Data Pipeline Automation Specialist to join our team. The ideal candidate will have extensive experience in designing, developing and maintaining automated testing frameworks for large-scale data pipelines.The successful candidate will be responsible for ensuring the stability and quality of our data pipeline solutions.This is an...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data Architect SpecialistDescription:We are looking for a skilled Data Architect Specialist to craft and maintain robust data pipelines, utilizing Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data. This role involves building and optimizing data pipelines to facilitate seamless data flow across systems and...


  • Pune, Maharashtra, India beBeePipeline Full time ₹ 19,99,999 - ₹ 24,99,999

    Pipeline SpecialistAs a key member of our Pipelines team, you will be responsible for delivering pipeline engineering expertise to support the safe and reliable operation of our pipelines globally.Key Responsibilities:Regional Pipeline Support: Provide execution and assessment of subsea inspection campaigns and define repair requirements.Subsea and Pipeline...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...


  • Pune, Maharashtra, India beBeeCommercial Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:The Senior Specialist, Global Commercial Pharma Pipeline Analytics role is a pivotal position within the organization. The successful candidate will be responsible for developing and delivering data and analytics solutions to support strategic business decisions.This critical role requires a strong analytical mindset, excellent communication...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a seasoned Data Engineer to join our team. This role involves crafting and maintaining robust data pipelines using Python and SQL to ensure efficient extraction, transformation, and loading (ETL) of data.The ideal candidate will have expertise in building and optimizing data pipelines to facilitate seamless data flow across systems...


  • Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data Engineering SpecialistThis is an exciting opportunity to join a team of talented professionals in designing and implementing data pipelines and workflows using Snowflake and Matillion.The successful candidate will be responsible for collaborating with cross-functional teams to gather requirements, define data models, and develop solutions...


  • Pune, Maharashtra, India beBeeOncology Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Specialist Oncology Global Commercial Pipeline AnalyticsAs a Senior Specialist in Oncology Global Commercial Pipeline Analytics, you will partner closely with cross-functional teams to drive innovation and excellence in the oncology pipeline.Key Responsibilities:Develop analytics capabilities to support strategic decision-making for the Global...


  • Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    The Role of a Data Pipeline Developer.We are seeking an experienced Data Pipeline Developer to join our team. The ideal candidate will have a strong background in designing, developing and maintaining data pipelines using IBM DataStage (on Cloud Pak for Data) and AWS Glue/Lambda.Key ResponsibilitiesDesign, develop and maintain ETL pipelines using IBM...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...