Data Engineer with Databricks Expertise

13 hours ago

India Hello World Tech Consulting Full time

Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment, programming, data modeling, and governance.Key Responsibilities• Design and implement data pipelines using AWS and Databricks.• Manage and orchestrate data workflows, ensuring eEicient data ingestionprocesses.• Utilize Delta Lake for data storage and management, ensuring secure datasharing across platforms with Delta Sharing.• Implement data governance and access control using Unity Catalog.• Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.• Develop and manage ETL pipelines using AWS Glue.• Leverage Amazon S3 for data storage and management.• Utilize AWS Lambda and Step Functions for serverless computing in dataprocessing.• Apply data warehousing solutions and best practices in data transformation.• Monitor and implement data quality checks and governance practices.• Collaborate with data scientists, analysts, and other stakeholders in an Agileenvironment.• Deliver large-scale data processing and analytics projects within cloudenvironments.Required Skills and Qualifications• Databricks certifications with practical experience in the Databricks Lakehouseplatform.• Proficient in AWS services: Glue, S3, Lambda, Step Functions, and datawarehousing solutions.• Strong programming skills in Python, Scala, or Java.• Proficient in SQL for querying and manipulating data.• Experience in data modeling for Lakehouse architecture.• Knowledge of ETL best practices and data transformation techniques.• Understanding of data governance frameworks and practices.• Proven track record of delivering data engineering projects, particularly in cloudenvironments.• Experience with large-scale data processing and analytics projects.• Ability to work in Agile teams and collaborate eEectively with variousstakeholders.Preferred Qualifications• Advanced AWS certifications.• Experience with additional cloud platforms (e.g., Azure).• Familiarity with other data engineering tools and frameworks.

  • Sr. Big Data Engineer

    5 days ago

    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R34As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical...

  • Data Engineer with Databricks

    4 weeks ago

    India KPG99 INC Full time

    Job Title: Databricks Engineer Location: Remote Duration : 12 months Contract with extensions Job Description: REQUIRED SKILLS AND EXPERIENCE - 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and...

  • Data Engineer with Databricks

    4 weeks ago

    india, IN KPG99 INC Full time

    Job Title: Databricks Engineer Location: RemoteDuration: 12 months Contract with extensions Job Description: REQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and troubleshooting....

  • Databricks Data Engineer

    4 weeks ago

    India Insight Global Full time

    ** Immediate Joiner **Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...

  • Databricks Data Engineer

    4 weeks ago

    India Insight Global Full time

    ** Immediate Joiner ** Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...

  • Databricks Data Engineer

    4 weeks ago

    india, IN Insight Global Full time

    Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and optimizing data...

  • Databricks Data Engineer

    4 weeks ago

    india, IN Insight Global Full time

    ** Immediate Joiner **Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...

  • Big Data Manager, Professional Services

    7 days ago

    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ426R227As a Big Data Manager in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks...

  • Databricks Engineer

    4 weeks ago

    India KPG99 INC Full time

    Databricks Engineer Location: REMOTE Duration: 12 months with extensions Openings: 3 REQUIRED SKILLS AND EXPERIENCE - 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and troubleshooting. - Solid programming...

  • Databricks Engineer

    4 weeks ago

    India KPG99 INC Full time

    Databricks EngineerLocation: REMOTEDuration: 12 months with extensionsOpenings: 3REQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles- Strong hands-on experience with Databricks for data processing and pipeline development.- Proficiency in SQL for data querying, transformation, and troubleshooting.- Solid programming skills in...