Senior Data Engineer

5 days ago

Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000
Job Description:

We are seeking a highly skilled Senior Data Engineer to lead our cloud architecture team. As a key member of our organization, you will design and develop scalable data pipelines using AWS services.

You will have a strong understanding of AWS services like EC2, S3, EMR, Glue, and Redshift, with hands-on experience in developing applications using Python and PySpark for data manipulation, transformation, and analysis.

  • Develop and maintain robust ETL pipelines using PySpark, focusing on performance, scalability, and data quality.
  • Collaborate with cross-functional teams to translate business requirements into technical solutions using AWS cloud services and Python/PySpark.
  • Lead and manage projects from planning to delivery, ensuring timely completion and high-quality results.

A minimum of 5 years of experience in data integration and pipeline development is required. Prior experience with AWS Cloud, Apache Spark, Glue, Kafka, Kinesis, and Lambda in S3 Redshift, RDS, MongoDB/DynamoDB ecosystems is a major plus.

Key Responsibilities:
  • Design and develop data pipelines using AWS services
  • Maintain and support existing data pipelines
  • Collaborate with cross-functional teams to translate business requirements into technical solutions
  • Lead and manage projects from planning to delivery
Requirements:
  • 5+ years of experience in data integration and pipeline development
  • Experience with AWS Cloud, Apache Spark, Glue, Kafka, Kinesis, and Lambda
  • Strong understanding of Python and its data science libraries, along with PySpark for distributed data processing
  • Proficiency in PL/SQL, T-SQL for data querying, manipulation, and database interactions
About Our Company:

We provide innovative technology solutions to help clients achieve their business goals.

  • Senior Data Engineer

    7 days ago

    Ellore, Andhra Pradesh, India beBeeMachineLearningEngineer Full time ₹ 1,92,00,000 - ₹ 2,56,00,000

    As a Senior Data Engineer, you will play a crucial role in enhancing our machine learning capabilities and credit risk management processes.Key Responsibilities:Design and implement end-to-end data engineering architecture, including model deployment and production maintenance.Develop and maintain scalable data models using Python, PySpark, NumPy, Pandas,...

  • Senior Data Engineer

    3 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a highly skilled data engineer to join our team for an exciting in-house project. The ideal candidate will have extensive experience in ETL development and a strong background in Python, SQL, and automation.Key Responsibilities:Design and implement complex data pipelines using Python and SQL.Develop...

  • Senior Data Engineer

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,34,40,000 - ₹ 2,01,20,000

    Job Summary: We are seeking an experienced Senior Software Engineer to join our team. As a key member of the technical staff, you will be responsible for designing and implementing scalable data architectures, developing and optimizing ETL/ELT pipelines, and collaborating with stakeholders to ensure data availability.Key Responsibilities:Design and implement...

  • Senior Data Engineer

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 19,00,000

    About this Role:A senior data engineer is responsible for designing, developing and maintaining large-scale data processing systems. They use their expertise in Airflow and Python to drive business growth.Collaborating with cross-functional teams ensures timely and accurate data delivery.Developing, implementing and monitoring data workflows helps leverage...

  • Key Senior Data Engineering Position

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer RoleWe're looking for a skilled data engineer to join our team. As a senior data engineer, you'll be responsible for designing, developing, and operating data warehouses and data platforms.A bachelor's degree in computer science, computer engineering, or electrical engineering or equivalent technical background and experience5+ years of...

  • Senior Data Engineering Specialist Wanted

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior ConsultantSenior Data Engineering Specialist WantedWe are seeking a highly skilled data engineer to design, develop, and maintain enterprise data pipelines using Informatica Intelligent Cloud Services.Key Responsibilities:Design, develop, and implement scalable ETL/ELT workflows using Informatica IICS.Integrate cloud-based data platforms...

  • Cloud Data Engineer

    5 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer OpportunityGreeting!We are seeking a Senior Data Engineer with experience in GCP and ETL to join our team.The successful candidate will have a strong background in data engineering, with expertise in designing, building, and maintaining large-scale data pipelines using GCP services such as BigQuery, Cloud Storage, Pub/Sub, and...

  • Senior Data Engineer

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to join our team.As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data pipelines using PySpark.Key Responsibilities:Design and implement scalable data pipelines using PySparkDevelop strong technical skills with proficiency in programming...

  • Data Engineering Leader

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineering ProfessionalWe are seeking a seasoned Senior Data Engineering professional to join our team.Key Responsibilities:Pipeline Development:Design and implement robust ML pipelines using Azure Machine Learning services.Collaborate with data scientists to transition models from development to production.Strong knowledge of Azure...

  • Senior Software Engineer

    5 days ago

    Ellore, Andhra Pradesh, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,10,00,000

    About the Role:The Senior Software Engineer will be a key contributor in building and scaling modern financial data platform.This role focuses on Snowflake, dbt, and financial systems integration, helping Accounting and Finance teams gain trusted insights and ensure accurate financial reporting.As a Senior Software Engineer, you will work closely with other...