Leading Cloud-Based Data Engineer

3 days ago


Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

Job Opportunity

We are seeking a Senior Data Engineer to lead our data pipeline development team.

The ideal candidate will have 4-8 years of experience in designing, building, and optimizing scalable data pipelines on cloud-based platforms.

The successful candidate will possess strong programming skills in Python and/or Scala, with hands-on experience in Apache Spark for big data processing on AWS cloud.

They will also be proficient in AWS services such as S3, Glue, Redshift, EMR, Lambda, and have strong SQL skills for data transformation and analytics.

In addition, the candidate should have experience in Infrastructure as Code (IaC) using Terraform and expertise in setting up and managing CI/CD pipelines with Jenkins.

Responsibilities:
  • Data Pipeline Development: Design, build, and optimize scalable data pipelines on AWS.
  • Data Ingestion, Transformation, and Integration: Implement data ingestion, transformation, and integration solutions using Spark, Glue, and SQL.
  • Cloud Environment Management: Manage and optimize cloud storage and compute environments.
  • Deployment and Automation: Ensure robust, automated deployments with Terraform and Jenkins.
  • Collaboration and Delivery: Collaborate with cross-functional teams to deliver high-quality data products.
Requirements:
  • Programming Skills: Strong programming skills in Python and/or Scala.
  • Spark Experience: Hands-on experience in Apache Spark for big data processing on AWS cloud.
  • AWS Services: Proficiency in AWS services such as S3, Glue, Redshift, EMR, Lambda.
  • SQL Skills: Strong SQL skills for data transformation and analytics.
  • IaC Experience: Experience in Infrastructure as Code (IaC) using Terraform.
  • CICD Expertise: Expertise in setting up and managing CI/CD pipelines with Jenkins.
Nice to Have:
  • Domain Expertise: Prior experience in the Healthcare / Life Sciences domain.
  • Data Architecture: Familiarity with modern data lake and data mesh architectures.

  • Cloud Data Engineer

    2 days ago


    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Migration LeadWe are seeking an accomplished Cloud Architect with a strong background in Java and Apache Spark to lead the development and deployment of cloud-based data solutions.This role involves overseeing the technical direction of projects, mentoring team members, and delivering scalable and efficient systems using cloud and big data...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,20,000 - ₹ 20,36,520

    About UsWe are a leading provider of cloud data engineering solutions.Experience: 4-8 years in Cloud data engineering solutionsLocation: Bangalore, IndiaThe successful candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and be responsible for end-to-end implementation of cloud data engineering solutions like...

  • Cloud Data Engineer

    1 week ago


    Dindigul, Tamil Nadu, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 30,00,000

    As a seasoned data professional, we are seeking a highly skilled Senior Informatica Intelligent Cloud Services (IICS) Developer to lead our Data Engineering team.Key Responsibilities:Design, develop, and maintain enterprise-scale ETL/ELT workflows using Informatica IICS.Integrate IICS solutions with cloud-based data platforms such as Google Cloud Platform...

  • Cloud Data Engineer

    3 days ago


    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data EngineerWe are seeking an experienced cloud data engineer to lead the development and maintenance of data pipelines and applications using AWS services.Main Responsibilities:Design and Implement ETL Pipelines: Create efficient and scalable ETL pipelines using PySpark, focusing on performance, scalability, and data quality.Develop...

  • Cloud Data Engineer

    1 week ago


    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineer RoleWe seek a skilled Cloud Data Engineer to develop and maintain large-scale data processing systems.Design, implement, and manage scalable data pipelines on cloud platforms.Collaborate with cross-functional teams to identify business needs and provide innovative solutions.Develop ETL processes using Python and other tools to ensure...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Seeking seasoned data engineer with expertise in cloud infrastructure and analytics platforms to lead full lifecycle implementations.This role is ideal for individuals who thrive at the intersection of data engineering, infrastructure, and DevOps.Lead setup and maintenance of scalable cloud infrastructure using Terraform or Pulumi (AWS, Azure, or...


  • Dindigul, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Executive Data Engineering PositionWe are seeking a visionary and highly experienced executive-level data engineer to lead our team of experts in designing, developing, and managing scalable data infrastructure and pipelines. This role requires an individual with a strong focus on Databricks and cloud-based data engineering.Key Responsibilities:Lead and...


  • Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled professional to lead our data engineering initiatives.As a seasoned data engineer, you will drive the development and continuous improvement of our Data/AI Practice.Design and implement scalable data projects using modern unified data platforms (e.g., Databricks, Snowflake)Implement ETL/ELT processes using SQL and...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Our company is seeking a seasoned data engineer to join our team. This individual will be responsible for designing, implementing, and optimizing data pipelines.Key Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable and efficient data pipelines using Python and cloud-based technologies.ETL Process Implementation: Implement...


  • Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionAs a senior data engineer, you will play a pivotal role in building scalable and reliable systems to deliver actionable insights that drive business growth.Key Responsibilities:Collaborate closely with cross-functional teams to design and develop large-scale data processing systems.Design, build, and deploy real-time stream and batch data...