Leading Data Engineering Professional

5 days ago

Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
About the Job

We are looking for a skilled Data Engineer to create efficient data pipelines and ETL processes, with expertise in Python and proficiency in SQL, Snowflake, and Spark.

The role involves developing scalable pipelines to efficiently process and transform data using Spark, designing and developing a robust framework for generating PDF reports using Python and Spark, and leveraging Azure Databricks and Datalake for data processing and storage.

Collaboration with Architects and Business stakeholders is essential to understand reporting requirements and maintain existing reporting pipelines and infrastructure.

Key Responsibilities:

  • Design and develop scalable pipelines to efficiently process and transform data using Spark
  • Develop a robust framework for generating PDF reports using Python and Spark
  • Leverage Azure Databricks and Datalake for data processing and storage
  • Develop APIs using Python's Flask framework to support front-end applications
  • Maintain and improve existing reporting pipelines and infrastructure

Qualifications:

  • Proven experience as a Data Engineer with a strong understanding of data pipelines and ETL processes
  • Proficiency in Python with experience in data manipulation libraries such as Pandas and Numpy
  • Experience with SQL, Snowflake, and Spark for data querying and aggregations
  • Familiarity with Azure cloud services such as Data Factory, Databricks, and Datalake
  • Experience developing APIs using frameworks like Flask is a plus

Why Work With Us?

  • Accelerated career growth and global exposure
  • Collaborative, inclusive work environment rooted in innovation
  • Exposure to best-in-class automation framework
  • Innovation-first culture: We embrace automation, AI insights, and clean data

  • Data Engineering Professional

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalAbout the Role:We are seeking a skilled data engineer to build scalable and reliable data pipelines using modern cloud and big data platforms.

  • Data Engineering Lead

    4 days ago

    Ellore, Andhra Pradesh, India beBeeEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    We are seeking an experienced data engineering professional to lead our team's development and implementation of large-scale data integration projects using various ETL tools.Job OverviewThe ideal candidate will have over 14 years of experience in leading data engineering teams, with expertise in ETL, SQL, Oracle, and cloud-based technologies.Key...

  • Lead Data Engineering Specialist

    5 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 20,00,000

    Data Engineering ExpertMResult is a leading provider of digital solutions and data-driven insights, empowering clients worldwide.We deliver cutting-edge solutions for Fortune 500 companies.Our expertise spans data engineering, machine learning, AI, automation, and more.You will collaborate with top professionals to design and develop scalable data pipelines...

  • Senior Data Engineering Team Lead

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Leader OpportunityWe are seeking an experienced Data Engineering Scrum Master to lead our team in Chennai. The ideal candidate will have a strong background in data processing, documentation, and SQL expertise.Must have 6 years of experience in Data Engineering with excellent leadership skillsFundamental understanding of Scrum methodology is...

  • Azure Data Engineer Lead

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Data Engineer PositionJob Overview:Azure Data Engineers are responsible for developing data load processes using Azure Data Factory, Databricks, Delta Lake, and Python/PySpark.Core Responsibilities:Develop and implement data load processes with expertise in Azure Data Factory, Azure Databricks, Delta Lake, and Python/PySpark.Work closely with senior...

  • Transformative Data Engineer

    22 hours ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: Data Engineering LeadershipAbout the Role:Lead and mentor a team of experienced data engineers in designing, developing, and implementing large-scale data warehouse systems.Develop and drive the strategic vision for our enterprise data warehousing initiatives, focusing on data architecture, delivery, and modern analytics platforms.Collaborate with...

  • Senior Data Engineering Professional

    3 days ago

    Ellore, Andhra Pradesh, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Pipeline Engineer PositionWe are seeking a skilled and motivated Data Pipeline Engineer to design, develop, and maintain scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.

  • Data Engineering Leader

    5 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data Engineer Position OverviewWe are seeking an experienced data engineer to lead our team in designing and optimizing modern data platforms.Drive the development of scalable data solutions using Databricks architecture.Build efficient ETL/ELT pipelines with Python (PySpark).Establish and maintain CI/CD pipelines with Git/DevOps tools.Design data...

  • Big Data Engineering Expert

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Big Data Engineer to lead our data engineering teams and manage cross-team collaboration.The ideal candidate will have a strong background in big data engineering, with experience in designing and developing large-scale data processing pipelines using Apache Spark and Scala/Python.Responsibilities include...

  • Leading Data Engineering Expert

    3 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 14,00,000

    Data Engineer PositionWe are seeking a skilled Data Engineer with expertise in designing, developing, and maintaining large-scale data systems.The ideal candidate will have experience in designing and developing scalable data pipelines using AWS services, collaborating with cross-functional teams to implement data-driven solutions, analyzing and optimizing...