Cloud Data Engineer

7 days ago

Chennai, Tamil Nadu, India Covenant Consultants Full time

We are seeking a talented Azure Databricks Developer to lead our data engineering projects. As a key member of our team, you will design, implement, and optimize large-scale data processing pipelines using Azure Databricks, Azure Data Factory, and other related services.

Key Responsibilities:

Data Engineering:

  • Design, develop, and optimize complex data processing workflows using Azure Databricks, PySpark, and other relevant tools.
  • Implement scalable data architecture and pipelines to support various data projects and ensure data consistency and integrity.

Azure Cloud Services:

  • Utilize Azure services such as Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics to build end-to-end data solutions.
  • Monitor, troubleshoot, and optimize Azure cloud resources and Databricks clusters for performance and cost-efficiency.

Data Integration:

  • Integrate data from multiple sources and develop data validation and quality checks.
  • Ensure seamless data flow and minimize data latency.

Collaboration:

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Participate in agile development processes and contribute to continuous improvement practices.

Documentation and Reporting:

  • Document data workflows, architecture, and processes for knowledge sharing and maintenance.
  • Generate reports and visualizations to communicate insights and progress to stakeholders.

Required Skills and Experience:

Technical Skills:

  • Strong experience with Azure Databricks, Azure Data Factory, and PySpark.
  • Proficiency in Python programming, with a focus on data processing and manipulation.
  • Experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics.
  • Solid understanding of data warehousing concepts and ETL processes.
  • Familiarity with CI/CD practices and tools for data pipelines.

Professional Experience:

  • At least 5 years of hands-on experience in data engineering and cloud-based data processing.
  • Proven track record of working with large-scale data systems and distributed computing.
  • Experience in performance tuning and optimization of data processing jobs.

Soft Skills:

  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills to collaborate effectively with cross-functional teams.
  • Ability to work independently and manage multiple tasks in a dynamic environment.

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Role SummaryWe are seeking a highly skilled Cloud Data Management Engineer to join our team at NTT DATA Services. This role will focus on designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms. The ideal candidate will have extensive experience in AWS DevOps Engineering, including EC2, S3, ECS, Lambda, and...

  • Cloud Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Destinations Full time

    Job Title: Lead DevOps EngineerWe are seeking a highly skilled Lead DevOps Engineer to join our team at Cloud Destinations. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining our cloud-based infrastructure and applications.Key Responsibilities:Design and implement scalable, secure, and highly...

  • Cloud Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Cloud Destinations Full time

    Job Title: Lead DevOps EngineerWe are seeking a highly skilled Lead DevOps Engineer to join our team at Cloud Destinations. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining our cloud-based infrastructure and applications.Key Responsibilities:Design and implement scalable, secure, and highly...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Strategic Data Leader

    2 weeks ago

    Chennai, Tamil Nadu, India Cloud Destinations Full time

    About Cloud DestinationsCloud Destinations is a leading provider of digital transformation and cloud solutions, serving various sectors including healthcare, retail, and technology. Our strong focus lies in large-scale cloud migrations and multi-cloud operations, driving business growth through innovative solutions.Role OverviewAs the Head of Data at Cloud...

  • Cloud Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Aditi Consulting Full time

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Aditi Consulting. The ideal candidate will have a strong background in cloud computing, big data, and data engineering.Key Responsibilities:Design and implement scalable cloud-based data architectures using Big Data and application cloud environments.Develop and...

  • AWS Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to lead our data infrastructure team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure....

  • Cloud DevOps Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Job SummaryWe are seeking an experienced technical professional to support our Cloud Data Management and Advanced Analytics platforms.Key ResponsibilitiesDesign, implement, and support Cloud Data Management and Advanced Analytics platforms.Provide technological guidance on Data Lake and Enterprise Data Warehouse design, development, implementation, and...

  • Data Engineering Leader

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Data Engineering Director

    4 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Cloud Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    We are seeking a skilled Data Engineer to join our team at Colan Infotech Private Limited. The ideal candidate will have experience working with GCP data engineering tools, including BigQuery, Cloud Storage, and Dataform.Key Responsibilities:Design and implement data pipelines using GCP data engineering toolsDevelop and maintain data warehouses and data...

  • Data Engineering Leader

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...

  • Cloud Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    We are seeking a skilled Cloud Data Engineer to join Colan Infotech Private Limited.Key Responsibilities:• Design and implement scalable data architectures on GCP.• Develop and maintain data pipelines using BigQuery, Cloud Storage, and Dataform.• Ensure data quality and integrity through thorough testing and validation.Requirements:• Proven...

  • Cloud Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Raah Techservices Full time

    We are seeking a skilled Cloud Data Engineer to join our team at Raah Techservices. This is a full-time, remote position based in Chennai. The ideal candidate will have between 4 to 6 years of professional experience, with a strong focus on GCP data engineering.Key Responsibilities:Design, develop, and maintain robust data pipelines and ETL processes on the...

  • Cloud Data Engineering Lead

    7 days ago

    Chennai, Tamil Nadu, India NR Consulting - India Full time

    About the Role:As a Senior Data Engineer - Cloud Solutions, you will be responsible for leading our cloud data engineering efforts, leveraging Google Cloud Platform (GCP) technologies to drive data-driven decision making across the organization. With 7-10 years of experience in cloud data engineering, you will have a proven track record of delivering...

  • Cloud Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Technogen India Pvt. Ltd. Full time

    **Job Title:** Cloud Data Engineer**Job Summary:** We are seeking a skilled Cloud Data Engineer to join our team at Technogen India Pvt. Ltd.**Key Responsibilities:**Design and implement data pipelines using GCP technologies.Develop and maintain big data technologies, including BigQuery, Composer, and DataFlow.Collaborate with cross-functional teams to...

  • Senior Cloud Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India GBIT (Global Bridge InfoTech Inc) Full time

    Job Title: Senior Cloud Data EngineerJob Summary:We are seeking a highly skilled Senior Cloud Data Engineer to join our team at GBIT (Global Bridge InfoTech Inc). As a Senior Cloud Data Engineer, you will be responsible for designing, developing, and implementing cloud-based data analytics solutions using Big Query SQL, Python, Alteryx, and GCP services.Key...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India xanika infotech Full time

    Job Title: Data Engineer - Cloud Data ArchitectJob Summary:Xanika Infotech is seeking a skilled Data Engineer - Cloud Data Architect to design, develop, and maintain scalable data models and transformations using DBT alongside Snowflake.Key Responsibilities:Implement and oversee data models in DBT to ensure precise data transformation aligned with business...

  • Cloud Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India HCLTech Full time

    About the Role:We are seeking a skilled Cloud Data Engineer with expertise in Google BigQuery to empower our organization with data-driven insights.The successful candidate will be responsible for designing, implementing, and maintaining near real-time data pipelines and solutions that drive business growth.Key Responsibilities:Design, build, and maintain...

  • Cloud Data Management Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Rigel networks Full time

    Job Title: Cloud Data Management EngineerWe are seeking a highly skilled Cloud Data Management Engineer to join our team at Rigel Networks. As a key member of our Cloud Data Management team, you will be responsible for designing, implementing, and supporting cloud-based data management platforms.Key Responsibilities:Design and implement cloud data management...