Data Engineer with Databricks Expertise

2 days ago

Madurai, India Hello World Tech Consulting Full time

Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment, programming, data modeling, and governance.Key Responsibilities• Design and implement data pipelines using AWS and Databricks.• Manage and orchestrate data workflows, ensuring eEicient data ingestionprocesses.• Utilize Delta Lake for data storage and management, ensuring secure datasharing across platforms with Delta Sharing.• Implement data governance and access control using Unity Catalog.• Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.• Develop and manage ETL pipelines using AWS Glue.• Leverage Amazon S3 for data storage and management.• Utilize AWS Lambda and Step Functions for serverless computing in dataprocessing.• Apply data warehousing solutions and best practices in data transformation.• Monitor and implement data quality checks and governance practices.• Collaborate with data scientists, analysts, and other stakeholders in an Agileenvironment.• Deliver large-scale data processing and analytics projects within cloudenvironments.Required Skills and Qualifications• Databricks certifications with practical experience in the Databricks Lakehouseplatform.• Proficient in AWS services: Glue, S3, Lambda, Step Functions, and datawarehousing solutions.• Strong programming skills in Python, Scala, or Java.• Proficient in SQL for querying and manipulating data.• Experience in data modeling for Lakehouse architecture.• Knowledge of ETL best practices and data transformation techniques.• Understanding of data governance frameworks and practices.• Proven track record of delivering data engineering projects, particularly in cloudenvironments.• Experience with large-scale data processing and analytics projects.• Ability to work in Agile teams and collaborate eEectively with variousstakeholders.Preferred Qualifications• Advanced AWS certifications.• Experience with additional cloud platforms (e.g., Azure).• Familiarity with other data engineering tools and frameworks.

  • Azure Data Engineer-Technical Lead

    2 weeks ago

    Madurai, Tamil Nadu, India HCLTech Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,SQL,Oracle PL/SQL,PythonJob SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet...

  • AWS Data Engineer

    3 weeks ago

    Madurai, India TerraGiG Full time

    Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable)Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark – especially with AWS...

  • Data Engineer

    6 days ago

    Madurai, India IntraEdge Full time

    Websitehttp://www.intraedge.comJob Title: Data EngineerExperience: 5–9 yearsLocation: [Remote]Job Summary:We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda), and Snowflake. The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable...

  • Delivery Head – Data Engineering

    5 days ago

    Madurai, Tamil Nadu, India Techmango Technology Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Location: MaduraiJob Experience: 12-20 YearsModel of Work: HybridTechnologies: AWSFunctional Area: Software DevelopmentJob Summary:Job Title: Delivery Head – Data Engineering & Full Stack ServicesJob Location: Madurai (Hybrid)Experience: 12+ YearsCompany: Tech Mango Technology ServicesAbout Tech Mango Tech Mango is a rapidly growing IT services...

  • Scrum Master

    6 days ago

    Madurai, India Qode Full time

    Scrum Master - Data Engineering Location Chennai India Workplace Type Onsite About the Role Incedo is seeking a highly motivated and experienced Scrum Master to join our Data Engineering team focusing on Wealth Management projects In this role you will be responsible for facilitating Scrum ceremonies removing impediments and ensuring the team adheres to...

  • Data Governance Functional Lead

    2 days ago

    Madurai, India Delphi Consulting Middle East Full time

    Join Delphi - Where Innovation meets transformation At Delphi, we believe in creating an environment where our people thrive. Our hybrid work model empowers you to choose where you work—whether it's from the office, your home, or a mix of both—so you can prioritize what matters most. We are committed to supporting your personal goals, family, and overall...

  • GCP Data Engineer

    2 days ago

    Madurai, India TechMango Full time

    We are seeking a hands-on GCP Data Engineer/Lead/Architect with deep expertise in real-time streaming data architectures to help design, build, and optimize data pipelines in our Google Cloud Platform (GCP) environment. The ideal candidate will have strong architectural vision and be comfortable rolling up their sleeves to build scalable, low-latency...

  • Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India Techmango Technology Services Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Hi, Dear candidateGreetings of the dayI am Amutha and I'm reaching out to you regarding an exciting opportunity with TechMango. You can connect with me on LinkedInOr Email:Techmango Technology Servicesis a full-scale software development services company founded in 2014 with a strong focus on emerging technologies. It holds a primary objective of delivering...

  • Senior LLM Engineers

    1 week ago

    Madurai, India MillionLogics Full time

    Company Description MillionLogics, a trusted Oracle Partner, is an IT solutions provider with a global presence, blending innovation and strategic vision. With offices in London, UK, and a development hub in Hyderabad, India, we offer a diverse range of services, including Data & AI, Cloud Solutions, and IT Consulting. Our mission is to transform enterprises...

  • GCP Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India Techmango Technology Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About TechMango:Founded in 2014, TechMango Technology Services is a leading software development company with a strong focus on emerging technologies. Our primary goal is to deliver strategic solutions that align with our business partners' technological needs.We specialize in providing custom software solutions using the best available technologies,...