Data Engineer with Databricks Expertise

4 weeks ago

Madurai, India Hello World Tech Consulting Full time

Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment, programming, data modeling, and governance.Key Responsibilities• Design and implement data pipelines using AWS and Databricks.• Manage and orchestrate data workflows, ensuring eEicient data ingestionprocesses.• Utilize Delta Lake for data storage and management, ensuring secure datasharing across platforms with Delta Sharing.• Implement data governance and access control using Unity Catalog.• Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.• Develop and manage ETL pipelines using AWS Glue.• Leverage Amazon S3 for data storage and management.• Utilize AWS Lambda and Step Functions for serverless computing in dataprocessing.• Apply data warehousing solutions and best practices in data transformation.• Monitor and implement data quality checks and governance practices.• Collaborate with data scientists, analysts, and other stakeholders in an Agileenvironment.• Deliver large-scale data processing and analytics projects within cloudenvironments.Required Skills and Qualifications• Databricks certifications with practical experience in the Databricks Lakehouseplatform.• Proficient in AWS services: Glue, S3, Lambda, Step Functions, and datawarehousing solutions.• Strong programming skills in Python, Scala, or Java.• Proficient in SQL for querying and manipulating data.• Experience in data modeling for Lakehouse architecture.• Knowledge of ETL best practices and data transformation techniques.• Understanding of data governance frameworks and practices.• Proven track record of delivering data engineering projects, particularly in cloudenvironments.• Experience with large-scale data processing and analytics projects.• Ability to work in Agile teams and collaborate eEectively with variousstakeholders.Preferred Qualifications• Advanced AWS certifications.• Experience with additional cloud platforms (e.g., Azure).• Familiarity with other data engineering tools and frameworks.

  • Data Engineer With Databricks Expertise

    4 weeks ago

    Madurai, India Whatjobs IN C2 Full time

    Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline...

  • Databricks Data Engineer – Carbon Footprint Analyst

    1 week ago

    madurai, India beBeeData Full time

    Role OverviewWe are seeking a Databricks Data Engineer to support our enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level carbon footprint analysis.This role involves integrating structured engineering, manufacturing, and supplier data into a unified model using Databricks...

  • Databricks Cloud Support Specialist

    1 week ago

    madurai, India beBeeData Full time

    Enterprise Data Platform AdministratorWe are seeking an experienced professional to implement and maintain our Databricks platform on a cloud-based infrastructure. The ideal candidate will have a passion for working in agile environments and possess expertise in supporting Databricks platforms.Key Responsibilities:Implement and maintain the Databricks...

  • Data Engineer

    2 weeks ago

    Madurai, India Whatjobs IN C2 Full time

    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice. You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Microsoft Fabric, Azure Synapse Analytics, Databricks, and Power BI. Your work will involve implementing contemporary data architecture patterns (e.G., medallion,...

  • Aws data engineer

    3 weeks ago

    Madurai, India COVET IT INC Full time

    Hi, Please go through the below requirements and let me know your interest and forward your resume along with your contact information to Role : AWS Data Engineer Location : 100% Remote. Job Description: We are seeking a highly skilled AWS Data Engineer to design, build, and optimize scalable data pipelines and analytical solutions. The ideal candidate will...

  • Databricks Gen AI Engineer

    3 weeks ago

    Madurai, India Syren Full time

    Experience with Databricks GenAI , including Model Serving, Vector Search, and embedding workflows.Strong command of Databricks Lakehouse (Clustering, Unity Catalog, Delta Lake).Knowledge of LLMs , embeddings (OpenAI/Azure OpenAI), and GenAI app patterns (RAG / Agents).4–5 years of hands-on experience in Python , PySpark , and Data Engineering .Proficiency...

  • Mastering Large-Scale Data Movement

    1 week ago

    madurai, India beBeeDataEngineer Full time

    Senior Data EngineerAs a Senior Data Engineer, you will be responsible for leading data migration initiatives from on-premises environments to cloud platforms.This includes designing and implementing data migration strategies, building and managing ETL/ELT pipelines, and optimizing workflows for large-scale data movement.You will work closely with internal...

  • Cloud Data Engineer

    6 days ago

    madurai, India beBeeDatabricks Full time

    Azure Databricks is a cloud-based big data analytics platform that helps businesses gain valuable insights from their data.Job Description:This role involves managing data ingestion pipelines, handling ETL/ELT processes, and ensuring effective incident management, service monitoring, and alert resolution.The ideal candidate will have expertise in Microsoft...

  • Enterprise Cloud Data Architect

    4 days ago

    madurai, India beBeeCloud Full time

    Job Title: Enterprise Data Platform Administrator About This Role: We are seeking a skilled Enterprise Data Platform Administrator to join our team. This is an exciting opportunity for a talented professional who wants to work with cutting-edge technology and make a real impact in the field of data management. As a key member of our team, you will be...

  • Expert Cloud Data Engineer

    7 days ago

    madurai, India beBeeData Full time

    Job OpportunityWe are seeking a skilled Freelance Azure Data Engineer with expertise in Vectr and Cribl to design ETL/ELT pipelines, optimize data workflows, and ensure robust data observability and streaming.Key ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).Design and implement API...