Leading Cloud Data Engineer

3 days ago

Aurangabad, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000
Job Summary

We are seeking a seasoned Cloud Data Engineer to join our team. This is a challenging role that requires expertise in designing and building scalable, secure, and high-performance cloud-based data systems.

About the Role

This position involves working with cutting-edge technologies such as AWS, Apache Spark, Scala, and NoSQL databases. As a Cloud Data Engineer, you will be responsible for architecting, implementing, and maintaining large-scale data pipelines, data warehouses, and data lakes. You will work closely with cross-functional teams to ensure seamless integration of data systems with business applications.

Key Responsibilities

* Design and develop scalable, secure, and high-performance cloud-based data systems using AWS services such as S3, DynamoDB, EMR, and Glue.
* Collaborate with data scientists and analysts to design and implement data pipelines, data warehouses, and data lakes using Apache Spark, Scala, and NoSQL databases.
* Develop and maintain complex data processing workflows using Apache Airflow, Apache NiFi, and other workflow management tools.
* Work closely with development teams to integrate data systems with business applications and ensure seamless data flow.
* Participate in code reviews, contribute to architectural decisions, and mentor junior engineers.

Requirements

* 5+ years of experience in cloud data engineering, preferably with AWS.
* Strong proficiency in programming languages such as Java, Python, or Scala.
* Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
* Knowledge of data warehousing and ETL concepts, including data modeling and data governance.
* Excellent problem-solving skills, attention to detail, and ability to work under pressure.

Preferred Qualifications

* Experience with DevOps practices such as continuous integration and delivery.
* Familiarity with containerization using Docker and Kubernetes.
* Knowledge of machine learning and artificial intelligence concepts and their application in data science.
* Certification in AWS, Apache Spark, or other relevant technologies.

Bonus Points

* Experience with data engineering analytics platforms such as Hortonworks Cloudera MapR AWS.
* Knowledge of data ingestion technologies such as Apache Nifi Apache Airflow Sqoop Oozie.
* Hands-on experience with streaming data technologies such as Kafka Flink Spark Streaming.

  • Data Engineer Lead

    6 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Lead Data Engineering PositionAs a senior data engineer, you will be responsible for designing and developing scalable ETL/ELT pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Main Responsibilities:Designing ingestion and transformation workflows across cloud platforms.Building data lake and warehouse solutions using AWS S3 and Azure Data...

  • Cloud Data Engineer

    3 days ago

    Aurangabad, Maharashtra, India beBeeCloudDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Cloud Data Engineer">As a skilled cloud data engineer, you will be responsible for developing and maintaining large-scale data pipelines on Google Cloud. Your expertise in GCP tools such as Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage will enable the efficient processing and storage of structured and...

  • Cloud Data Engineering Specialist

    1 week ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data Engineering Specialist">We are seeking a Cloud Data Engineering Specialist with expertise in designing, developing, and optimizing scalable data pipelines using cloud-native technologies.Develop robust and secure data pipelines using Azure Data Factory, Databricks, Synapse Analytics, Event Hub, Azure Functions, AWS Glue, S3, Redshift,...

  • Cloud Data Engineer

    7 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 18,00,000

    Cloud Data Engineering PositionAs a cloud data engineer, you will play a pivotal role in designing and implementing scalable data pipelines using Python and AWS services.Data Pipelines Development: Collaborate with cross-functional teams to design and implement data pipelines that ensure seamless data flow.ETL Process Optimization: Develop and optimize...

  • Leading Data Engineer

    1 day ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 16,66,707 - ₹ 24,39,935

    Job Title: Senior Data EngineerOverview:The Senior Data Engineer will be responsible for designing and implementing large-scale data processing systems, leveraging expertise in data warehousing concepts, strategies, and tools. The successful candidate will collaborate with business users and other stakeholders to understand business processes and develop...

  • Cloud Native Data Engineer Manager

    13 hours ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Cloud Data Engineering Manager">We are seeking a highly skilled Cloud Data Engineering Manager to lead our technical direction on a scalable data platform in clinical oncology or healthcare domain. The tech stack includes AWS, Python, Terraform, and AI.As a Cloud Data Engineering Manager, you will oversee the design and implementation of modular,...

  • Senior Cloud Data Engineering Specialist

    13 hours ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 14,01,600 - ₹ 20,16,000

    Job DescriptionWe are seeking a highly skilled Senior Cloud Data Engineering Specialist to design and develop scalable data pipelines using Python and PySpark. This role involves translating business requirements into technical solutions using AWS cloud services and programming languages.Key ResponsibilitiesDesign, develop, and maintain large-scale data...

  • Cloud Data Engineer Position

    7 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000

    Job DescriptionWe are seeking an experienced and skilled Data Engineer to join our team. As a pivotal member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines, ensuring seamless integration with cloud platforms.The ideal candidate will possess a strong command of Python, data engineering...

  • Senior Cloud Data Engineer

    56 minutes ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Cloud Data EngineerWe are seeking a seasoned Senior Cloud Data Engineer to join our team. The ideal candidate will have extensive experience designing, developing, and maintaining scalable data pipelines using Google Cloud Platform tools.Main Responsibilities:Design and develop robust data pipelines for batch and real-time processing using GCP...

  • Leading Data Engineer

    15 hours ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a visionary leader in data engineering, you will be responsible for designing and implementing scalable high-performance data solutions across the organization. A technical leader and mentor, you will drive best practices in data engineering, architecture, and governance.About the RoleYou will architect, design, and optimize complex data pipelines using...