Cloud Data Engineer

3 weeks ago

Delhi, Delhi, India SourceBae Full time

Job Title: Cloud Data Engineer

Job Overview

SourceBae is a leading provider of cloud-based services for data science and big data analytics. We are seeking an experienced Cloud Data Engineer to join our team and lead the delivery of successful projects in customer environments.

Key Responsibilities

  • Architecture and Design: Establish architecture and target design for data engineering and machine learning projects.
  • Requirement Analysis and Planning: Current inventory analysis, review and formalize requirements, project planning and execution plan.
  • Advisory Services and Best Practices: Troubleshooting, performance tuning, cost optimization, operational runbooks and mentoring.
  • Large Migrations: Assist customers with large migrations to Databricks from Hadoop ecosystems, data warehouses, ETL engines, and cloud-based data platforms.
  • Design, Build, and Optimize Data Pipelines: The Databricks implementation will be best in class, with flexibility for future iterations.
  • Production Readiness: Assisting with production readiness for customers, including exception handling, production cutover, capture analysis, alert scheduling, and monitoring.
  • Machine Learning (ML) – Model Review, Tuning, ML Operations, and Optimization: Build and review ML models, ML best practices, model lifecycle, ML frameworks, and deploying of models in production.

Requirements:

  • Hands-on experience with distributed computing framework like DataBricks, Spark ecosystem.
  • Willingness to work with product teams to best optimize product features/functions.
  • Experience on batch workloads and real-time streaming with high volume data frequency.
  • Performance optimization on Spark workloads.
  • Environment setup, user management, authentication, and cluster management on Databricks.
  • Professional curiosity and the ability to enable yourself in new technologies and tasks.
  • Good understanding of SQL and a good grasp of relational and analytical database management theory and practice.

Key Skills:

  • Python, SQL, and PySpark.
  • Big Data Ecosystem (Hadoop, Hive, Sqoop, HDFS, HBase).
  • Spark Ecosystem (Spark Core, Spark Streaming, Spark SQL) / Databricks.
  • Azure (ADF, ADB, Logic Apps, Azure SQL Database, Azure Key Vaults, ADLS, Synapse).
  • AWS (Lambda, AWS Glue, S3, Redshift).
  • Data modeling, ETL methodology.

About Us:

SourceBae is a leading provider of cloud-based services for data science and big data analytics. We are committed to staying ahead in the industry by leveraging cutting-edge technologies to drive innovation and enhance our business processes.

How to Apply:

Please submit your CV to SourceBae's HR department or share it via our website.

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Syren Cloud Inc Full time

    About the RoleWe are seeking a highly skilled Data Engineer - Cloud Computing Expert to join our team at Syren Cloud Inc. In this role, you will be responsible for designing, developing, and implementing distributed applications and systems on the Azure Cloud platform.Key ResponsibilitiesDevelop and implement databases, data collection systems, data...

  • Data Engineering Manager

    2 days ago

    Delhi, Delhi, India Cloud Destinations Full time

    Data Engineer Role at Cloud DestinationsWe are seeking a highly skilled Senior Data Engineer to play a critical role in designing, developing, and maintaining robust data pipelines and data warehouses at Cloud Destinations.Key Responsibilities:Data Engineering:Design, develop, and maintain efficient and scalable data pipelines using SQL, Python, and other...

  • Senior Data Engineer

    2 weeks ago

    Delhi, Delhi, India Cloud Destinations Full time

    Job Summary:Cloud Destinations is seeking a highly skilled Data Architect Leader to design, develop, and maintain robust data pipelines and data warehouses. As a Senior Data Engineer, you will play a critical role in extracting, transforming, and loading (ETL) large datasets, analyzing data to uncover insights, and building data products that drive business...

  • Cloud Data Engineering Manager

    4 weeks ago

    Delhi, Delhi, India Retail Kloud9 Technologies India Private Limited Full time

    Job Title : Data Engineering Manager (Remote)Location : RemotePosition Type : Full-time / ConsultantExperience : 10-12 yrsJob Description :We are seeking an experienced Data Engineering Manager who is hands-on in managing and delivering complex cloud-based data engineering projects, including data lake implementations.The ideal candidate will lead...

  • Cloud Destinations DevOps Engineering Lead

    2 days ago

    Delhi, Delhi, India Cloud Destinations Full time

    Lead DevOps EngineerAbout the Role : We are seeking a highly skilled and experienced Lead DevOps Engineer to join our dynamic team at Cloud Destinations.Job OverviewIn this role, you will be responsible for leading and driving our DevOps initiatives, automating infrastructure, and ensuring the reliability and scalability of our applications. Our ideal...

  • Cloud Data Engineer

    3 weeks ago

    Delhi, Delhi, India Techolution Full time

    Job OverviewWe are seeking a highly skilled Cloud Data Engineer to join our team at Techolution. As a Cloud Data Engineer, you will play a crucial role in building a scalable and reliable platform to support our business growth.About the RoleWe are looking for a talented individual who can design, develop, and maintain scalable data pipelines on Google Cloud...

  • Azure Cloud Data Engineer

    2 weeks ago

    Delhi, Delhi, India Intuitive Full time

    About Us:Intuitive is a leading cloud and SDx solution provider, supporting enterprise customers globally. As an engineering company, we deliver measurable value and key business outcomes. Our superpowers include DataOps, AI/ML, Cloud Native, AppSecOps, DevSecOps, Cloud Migration, Cloud FinOps, Cybersecurity, and SDx.Our team has achieved significant...

  • Cloud Data Engineer

    3 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Greetings from TCSUnlock Your PotentialTata Consultancy Services is proud to offer an exceptional opportunity for leaders like you to drive change and foster innovation in the business market.About the RoleAs a Technical Professional, you will provide expertise in specific technology/methodology/business/application/product in terms of technical/solution...

  • Data Engineer

    2 days ago

    Delhi, Delhi, India Straive Full time

    Job Title: Data Engineer - Cloud ArchitectAbout Straive:Straive is a leading provider of data services, technology solutions, and subject matter expertise to various domains. Our company's long-term vision is built around three core pillars: Data Analytics & AI Solutions, Data AI Powered Operations, and Education & Learning. We specialize in offering...

  • Cloud Data Engineering Specialist

    2 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Data Engineering ExpertiseWe are seeking a highly skilled Data Engineer with expertise in cloud-based data engineering solutions. As an Azure Data Engineer Developer, you will be responsible for designing, developing, and maintaining large-scale data warehouses and ETL processes.Key Responsibilities:Design and implement data warehouse solutions on Azure Data...

  • Azure Cloud Data Engineer

    2 weeks ago

    Delhi, Delhi, India Hexaware Technologies Full time

    Job Details:We are seeking a highly skilled Azure Data Engineer to join our team at Hexaware Technologies. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and Azure...

  • AWS Cloud Data Engineer

    4 weeks ago

    Delhi, Delhi, India Creative Technostructure Full time

    Job Title: AWS Cloud Data EngineerJob Summary:We are seeking an experienced AWS Cloud Data Engineer to join our team at Creative Technostructure. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines and ETL processes using AWS services.Key Responsibilities:Develop and maintain...

  • Data Engineer

    4 weeks ago

    Delhi, Delhi, India Amtech Analytics LLC Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team at Amtech Analytics LLC. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines using Python, Airflow, and SQL.Key Responsibilities:Design and develop data pipelines using Python, Airflow, and SQL.Work closely with data analysts and...

  • Data Engineer

    1 week ago

    Delhi, Delhi, India ThinkMove Solutions Full time

    Data Engineer Role Overview :We are seeking a skilled and experienced Data Engineer to join our ThinkMove Solutions' dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing and analytics.Key Responsibilities :1....

  • Senior Cloud Data Engineer

    2 weeks ago

    Delhi, Delhi, India StarTree Full time

    About StarTreeStarTree is a cloud-based software company that enables business customers to gain real-time insights from their data.We were founded by the core software engineering team and inventors of Apache Pinot, a fast and scalable analytics engine used by hundreds of applications at leading companies.Our mission is to help businesses make data-driven...

  • Data Engineer

    4 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Job DescriptionAs a Data Engineer at Tata Consultancy Services, you will play a key role in designing, building, and optimizing systems for data collection, storage, access, and analytics at scale.Key Responsibilities:Design and develop data pipelines that convert raw data into formats usable by data scientists, data-centric applications, and other data...

  • AWS Cloud Data Engineer

    2 weeks ago

    Delhi, Delhi, India Adastra Full time

    Job DescriptionAdastra India is a part of Adastra Group, a global delivery company. The company focuses on local talent for projects delivered in Europe and North America. As an AWS Data Engineer, you will be responsible for creating data pipelines, implementing data integration, and developing best practices for AWS applications.Key ResponsibilitiesCreate...

  • Data Engineering Manager

    2 weeks ago

    Delhi, Delhi, India Retail Kloud9 Technologies India Private Limited Full time

    Job Title : Data Engineering Manager - Cloud Platform ExpertLocation : RemotePosition Type : Full-time / ConsultantExperience : 10-12 yrsJob Description :We are seeking an experienced Data Engineering Manager who is hands-on in managing and delivering complex cloud-based data engineering projects, including data lake implementations. The ideal candidate will...

  • GCP Data Engineer

    4 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Job Title: GCP Data EngineerAbout the Role:We are seeking a highly skilled GCP Data Engineer to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will be responsible for designing and implementing data pipelines in an end-to-end manner using GCP technologies such as Big Query, Cloud Storage, and PySpark.Key Responsibilities:Design and...

  • Cloud Data Architect

    2 weeks ago

    Delhi, Delhi, India SourceBae Full time

    About the Role:We are looking for a highly skilled Data Engineer to join our team at SourceBae. As a Data Engineer, you will play a crucial role in developing and maintaining our data pipelines, ensuring the smooth operation of our AI and machine learning workflows.Key Responsibilities:Configure and manage Vertex AI Search for efficient indexing and...