Cloud Data Engineer

1 day ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,50,00,000
Cloud Data Engineer Opportunity

We are seeking an experienced Cloud Data Engineer to design, develop, and maintain scalable, secure, and high-performance data solutions on Databricks. The ideal candidate will lead the architecture and implementation of cloud-based data pipelines and ETL processes, collaborating with business stakeholders, data scientists, and analysts to deliver actionable data insights.

The successful candidate will have a strong background in big data ecosystems, including Hadoop and Kafka, and experience with PySpark, Spark SQL, and Scala. They will also have hands-on expertise with cloud platforms, preferably Azure, and a solid understanding of data modeling, ETL development, and data warehousing concepts.

In addition, the candidate will be proficient in implementing CI/CD pipelines for data solutions, have a strong understanding of data governance, security, and quality management, and be able to troubleshoot and resolve issues in data pipelines. A mentorship role is also expected, providing technical leadership and guidance to junior engineers.

Key Responsibilities:
  • Design and develop cloud-based data pipelines and ETL processes on Databricks.
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data insights.
  • Optimize data workflows for performance, cost-efficiency, and reliability.
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
Required Skills & Qualifications:
  • 7+ years of experience in Cloud Data Engineering.
  • Proven subject matter expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark, Spark SQL, and Scala.
  • Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).
  • Proficiency in data modeling, ETL development, and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning.
  • Experience in implementing CI/CD pipelines for data solutions.

  • Career Opportunity

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...

  • Cloud Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    As a cloud data engineer, you will be responsible for designing and implementing scalable data processing systems on Google Cloud Platform.Key Responsibilities:Design and implement efficient data pipelines using BigQuery, DataProc, and Cloud DataflowMaintain data consistency and integrity across multiple sources and platformsDevelop and maintain effective...

  • Cloud Data Engineering Leader

    1 day ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Cloud Data EngineerDescriptionWe are seeking a highly skilled Senior Cloud Data Engineer to join our team. As a Senior Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data engineering solutions on Google Cloud Platform.Your primary focus will be on creating custom data products, enhancing...

  • Cloud Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India Giggso Full time

    Key Responsibilities:• Design, develop, and maintain cloud-based solutions on Azure or AWS.• Implement and manage real-time data streaming and messaging systems using Kafka.• Develop scalable applications and services using Java and Python.• Deploy, manage, and monitor containerized applications using Kubernetes.• Build and optimize big data...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Cloud and Data Engineering RoleThis is a challenging position that involves the design, implementation, and management of data engineering solutions. The ideal candidate will have experience in cloud services and data integration tools.The successful applicant will possess strong technical skills in areas such as AWS data services, database management, OT...

  • Senior Cloud Data Engineer

    12 hours ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewIn this role, you will be a key developer in a global team building complex data warehouses on the Google Cloud Platform (GCP).This position involves designing, implementing, and optimizing data pipelines to ensure data integrity during migration and leveraging GCP services for enhanced data transformation processes.Main Responsibilities:Design...

  • Cloud Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Giggso Full time

    Key Responsibilities:• Design, develop, and maintain cloud-based solutions on Azure or AWS.• Implement and manage real-time data streaming and messaging systems using Kafka.• Develop scalable applications and services using Java and Python.• Deploy, manage, and monitor containerized applications using Kubernetes.• Build and optimize big data...

  • Cloud Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Giggso Full time

    Key Responsibilities :- Design, develop, and maintain cloud-based solutions on Azure or AWS.- Implement and manage real-time data streaming and messaging systems using Kafka.- Develop scalable applications and services using Java and Python.- Deploy, manage, and monitor containerized applications using Kubernetes.- Build and optimize big data processing...

  • Cloud Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India Giggso Full time

    Key Responsibilities: • Design, develop, and maintain cloud-based solutions on Azure or AWS. • Implement and manage real-time data streaming and messaging systems using Kafka. • Develop scalable applications and services using Java and Python. • Deploy, manage, and monitor containerized applications using Kubernetes. • Build and optimize big data...

  • Cloud-First Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India beBeeGcPDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Job Title: GCP Data EngineerWe are seeking a seasoned data engineer to contribute to our organization's success.As a GCP Data Engineer, you will be responsible for designing and implementing scalable data processing pipelines using Apache Beam (Data Flow) and GCP tools such as Big Query, Dataflow, Cloud Composer, and Cloud Spanner.Key...