Data Engineer with Databricks Expertise

6 days ago

India Hello World Tech Consulting Full time

Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline development, programming, data modeling, and governance. Key Responsibilities • Design and implement data pipelines using AWS and Databricks. • Manage and orchestrate data workflows, ensuring eEicient data ingestion processes. • Utilize Delta Lake for data storage and management, ensuring secure data sharing across platforms with Delta Sharing. • Implement data governance and access control using Unity Catalog. • Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects. • Develop and manage ETL pipelines using AWS Glue. • Leverage Amazon S3 for data storage and management. • Utilize AWS Lambda and Step Functions for serverless computing in data processing. • Apply data warehousing solutions and best practices in data transformation. • Monitor and implement data quality checks and governance practices. • Collaborate with data scientists, analysts, and other stakeholders in an Agile environment. • Deliver large-scale data processing and analytics projects within cloud environments. Required Skills and Qualifications • Databricks certifications with practical experience in the Databricks Lakehouse platform. • Proficient in AWS services: Glue, S3, Lambda, Step Functions, and data warehousing solutions. • Strong programming skills in Python, Scala, or Java. • Proficient in SQL for querying and manipulating data. • Experience in data modeling for Lakehouse architecture. • Knowledge of ETL best practices and data transformation techniques. • Understanding of data governance frameworks and practices. • Proven track record of delivering data engineering projects, particularly in cloud environments. • Experience with large-scale data processing and analytics projects. • Ability to work in Agile teams and collaborate eEectively with various stakeholders. Preferred Qualifications • Advanced AWS certifications. • Experience with additional cloud platforms (e.g., Azure). • Familiarity with other data engineering tools and frameworks.

  • Data Engineer with Databricks Expertise

    1 week ago

    India Hello World Tech Consulting Full time

    Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment,...

  • Data Engineer with Databricks Expertise

    7 days ago

    India Hello World Tech Consulting Full time

    Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline...

  • Sr. Big Data Engineer

    2 weeks ago

    Remote - India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    CSQ326R34As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical...

  • Databricks Engineer

    6 days ago

    India Cozzera Full time

    Databricks Engineer Experience: 7–12 years Location-Remote Overview We are looking for an experienced Databricks Engineer with deep expertise in designing, building, and optimizing modern data platforms on Azure and Databricks . The ideal candidate will serve as the go-to expert for Databricks platform architecture, Unity Catalog, and emerging Databricks...

  • Senior Software Engineer

    5 days ago

    Bengaluru, India Databricks Full time

    Job Description P- 1430 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Data Engineer with Databricks

    1 day ago

    India iitjobs, Inc. Full time € 50,000

    Greetings!!! Role:- Data Engineer with Databricks & GCP Location- 100 % Remote Duration: 6 Months Contract Immediate Joiner Experience Level: 10+ yrs Must-Have Skills: - Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark. - Expertise in SQL and advanced query optimization. - Proficiency in Python for data engineering...

  • Sr Incident Manager

    6 days ago

    Bengaluru, India Databricks Full time

    Job Description P-1485 At Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems from bringing the next mode of transportation to reality to accelerating the development of medical breakthroughs. We achieve this by building and operating the world's best data and AI infrastructure platform, enabling our...

  • DE&A - Core - Data Engineer – Databricks

    2 weeks ago

    India Zensar Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Offshore Data Engineer – DatabricksExperience: 6+ YearsLocation: IndiaEmployment Type: Full-TimeAbout the Role:We are seeking an experienced Data Engineer (Databricks) to join our offshore data engineering team. The ideal candidate will have strong expertise in Azure Databricks , data lake architecture , and ETL/ELT pipeline development . This...

  • DE&A - Core - Data Engineer – Databricks

    1 week ago

    India Zensar Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    DescriptionJob Title: Offshore Data Engineer – DatabricksExperience: 6+ Years Location: India  Employment Type: Full-Time About the Role:We are seeking an experienced Data Engineer (Databricks) to join our offshore data engineering team. The ideal candidate will have strong expertise in Azure Databricks, data lake architecture, and ETL/ELT pipeline...

  • Databricks Sme

    4 days ago

    India Zensar Technologies Full time

    **Databricks Expert will be required to set up the Databricks Platform on AWS, so he or she needs to be proficient with infrastructure as code technology such as CloudFormation and Terraform to work together with the Platform Engineering team.** **Must have knowledge in Networking and Security Architecture for a successful implementation.** - **Design &...