Data Engineer With Databricks Expertise

6 days ago

Madurai, India Whatjobs IN C2 Full time

Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline development, programming, data modeling, and governance. Key Responsibilities - Design and implement data pipelines using AWS and Databricks. - Manage and orchestrate data workflows, ensuring eEicient data ingestion processes. - Utilize Delta Lake for data storage and management, ensuring secure data sharing across platforms with Delta Sharing. - Implement data governance and access control using Unity Catalog. - Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects. - Develop and manage ETL pipelines using AWS Glue. - Leverage Amazon S3 for data storage and management. - Utilize AWS Lambda and Step Functions for serverless computing in data processing. - Apply data warehousing solutions and best practices in data transformation. - Monitor and implement data quality checks and governance practices. - Collaborate with data scientists, analysts, and other stakeholders in an Agile environment. - Deliver large-scale data processing and analytics projects within cloud environments. Required Skills and Qualifications - Databricks certifications with practical experience in the Databricks Lakehouse platform. - Proficient in AWS services: Glue, S3, Lambda, Step Functions, and data warehousing solutions. - Strong programming skills in Python, Scala, or Java. - Proficient in SQL for querying and manipulating data. - Experience in data modeling for Lakehouse architecture. - Knowledge of ETL best practices and data transformation techniques. - Understanding of data governance frameworks and practices. - Proven track record of delivering data engineering projects, particularly in cloud environments. - Experience with large-scale data processing and analytics projects. - Ability to work in Agile teams and collaborate eEectively with various stakeholders. Preferred Qualifications - Advanced AWS certifications. - Experience with additional cloud platforms (e.G., Azure). - Familiarity with other data engineering tools and frameworks.

  • Data Engineer with Databricks Expertise

    1 week ago

    Madurai, India Hello World Tech Consulting Full time

    Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment,...

  • Databricks Gen AI Engineer

    8 hours ago

    Madurai, India Syren Full time

    Experience with Databricks GenAI , including Model Serving, Vector Search, and embedding workflows.Strong command of Databricks Lakehouse (Clustering, Unity Catalog, Delta Lake).Knowledge of LLMs , embeddings (OpenAI/Azure OpenAI), and GenAI app patterns (RAG / Agents).4–5 years of hands-on experience in Python , PySpark , and Data Engineering .Proficiency...

  • AWS Data Engineer

    4 weeks ago

    Madurai, India TerraGiG Full time

    Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable)Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark – especially with AWS...

  • Data Specialist

    3 days ago

    Madurai, India Revature Full time

    About the Role:The Data Specialist evaluates learners’ technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner development. . The specialist...

  • Data Specialist

    3 days ago

    Madurai, India Revature Full time

    About the Role:The Data Specialist evaluates learners’ technical proficiency in data engineering, analytics, and cloud data platforms. This role involves comprehensive assessment across SQL, data pipeline development, data modeling, and visualization capabilities, while providing actionable feedback to accelerate learner development. . The specialist...

  • Senior Data Scientist

    3 days ago

    Madurai, India Recro Full time

    About the job Role : Senior Data Scientist (AI & Data) Location: Remote (Work from Home) We’re hiring a Senior Data Scientist to build the next generation of intelligent decision systems that power pricing, supply optimization, ranking, and personalization in our global B2B hotel marketplace. This is a high-impact role at the intersection of machine...

  • Data Engineer

    2 weeks ago

    Madurai, India IntraEdge Full time

    Websitehttp://www.intraedge.comJob Title: Data EngineerExperience: 5–9 yearsLocation: [Remote]Job Summary:We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda), and Snowflake. The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable...

  • Delivery Head – Data Engineering

    2 weeks ago

    Madurai, Tamil Nadu, India Techmango Technology Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: MaduraiJob Experience: 12-20 YearsModel of Work: HybridTechnologies: AWSFunctional Area: Software DevelopmentJob Summary:Job Title: Delivery Head – Data Engineering & Full Stack ServicesJob Location: Madurai (Hybrid)Experience: 12+ YearsCompany: Tech Mango Technology ServicesAbout Tech Mango Tech Mango is a rapidly growing IT services...

  • Scrum Master

    2 weeks ago

    Madurai, India Qode Full time

    Scrum Master - Data Engineering Location Chennai India Workplace Type Onsite About the Role Incedo is seeking a highly motivated and experienced Scrum Master to join our Data Engineering team focusing on Wealth Management projects In this role you will be responsible for facilitating Scrum ceremonies removing impediments and ensuring the team adheres to...

  • Pinnacle Infotech

    3 days ago

    Madurai, India PINNACLE INFOTECH SOLUTIONS Full time

    Job Summary :We are seeking a highly proficient Data Engineer with 46+ years of specialized experience in designing, building, and maintaining robust, scalable, and secure data infrastructure. This role is pivotal in enabling advanced analytics, reporting, and machine learning use cases by focusing on data integration, transformation (ETL/ELT), and optimal...