Data Engineer with Databricks Expertise

4 weeks ago

Kolhapur, India Hello World Tech Consulting Full time

Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment, programming, data modeling, and governance.Key Responsibilities• Design and implement data pipelines using AWS and Databricks.• Manage and orchestrate data workflows, ensuring eEicient data ingestionprocesses.• Utilize Delta Lake for data storage and management, ensuring secure datasharing across platforms with Delta Sharing.• Implement data governance and access control using Unity Catalog.• Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.• Develop and manage ETL pipelines using AWS Glue.• Leverage Amazon S3 for data storage and management.• Utilize AWS Lambda and Step Functions for serverless computing in dataprocessing.• Apply data warehousing solutions and best practices in data transformation.• Monitor and implement data quality checks and governance practices.• Collaborate with data scientists, analysts, and other stakeholders in an Agileenvironment.• Deliver large-scale data processing and analytics projects within cloudenvironments.Required Skills and Qualifications• Databricks certifications with practical experience in the Databricks Lakehouseplatform.• Proficient in AWS services: Glue, S3, Lambda, Step Functions, and datawarehousing solutions.• Strong programming skills in Python, Scala, or Java.• Proficient in SQL for querying and manipulating data.• Experience in data modeling for Lakehouse architecture.• Knowledge of ETL best practices and data transformation techniques.• Understanding of data governance frameworks and practices.• Proven track record of delivering data engineering projects, particularly in cloudenvironments.• Experience with large-scale data processing and analytics projects.• Ability to work in Agile teams and collaborate eEectively with variousstakeholders.Preferred Qualifications• Advanced AWS certifications.• Experience with additional cloud platforms (e.g., Azure).• Familiarity with other data engineering tools and frameworks.

  • Data Engineering Expertise Validator

    5 days ago

    Kolhapur, India beBeeEvaluator Full time

    Job Title: Technical Proficiency EvaluatorAt Revature, we are seeking a skilled Technical Proficiency Evaluator to join our team. This role involves assessing learners' technical proficiency in data engineering, analytics, and cloud data platforms. The successful candidate will design and execute comprehensive assessments, including quizzes, coding...

  • Databricks Cloud Data Platform Professional

    5 days ago

    Kolhapur, India beBeeDatabricks Full time

    Job Title: Databricks Platform ExpertWe seek a highly skilled data platform professional to implement and maintain the Databricks platform on AWS, Azure, or GCP.The ideal candidate will have experience working in agile environments and strong technical expertise in supporting Databricks platforms on cloud infrastructure.Implement and maintain Databricks...

  • Databricks Specialist

    7 days ago

    Kolhapur, India beBeeDataEngineer Full time

    Job DescriptionGreetings, we are seeking an experienced Data Engineer with Databricks Specialization to manage our data ingestion pipelines and optimize our Azure services.Required Skills and QualificationsMicrosoft Azure Services: Data Factory, Storage, Synapse, Key Vault; Databricks: cluster management, job execution, troubleshooting;Data Ingestion: batch...

  • Data Engineer

    1 week ago

    kolhapur district, India Fulcrum Digital Inc Full time

    We are looking for a skilled Data Engineer with hands-on experience in Databricks to build and manage scalable, high-performance data pipelines. The ideal candidate will have strong expertise in big data technologies, cloud platforms, and workflow orchestration to support data science and analytics initiatives. Responsibilities Design, develop, and optimize...

  • Data Engineering Specialist

    5 days ago

    Kolhapur, India beBeeDataEngineer Full time

    About UsWe're a fast-growing distributed workforce enabler, helping businesses scale with top global talent. We empower enterprises by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Snowflake & Databricks Data Engineer / Data Science SpecialistExperience: 9+ YearsLocation...

  • Data Engineering Expert

    7 days ago

    Kolhapur, India beBeeDataEngineeringExpert Full time

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team. The ideal candidate will have a strong background in data engineering, including design, development, testing, and operational stability.The successful candidate will have advanced proficiency in data processing frameworks and tools, such as Parquet,...

  • Azure Data Migration Specialist

    5 days ago

    Kolhapur, India beBeeData Full time

    Azure Data Engineer RoleJob Overview:We are seeking a skilled Azure Data Engineer to lead the migration of large-scale SQL workloads from on-premise environments to Azure.Key Responsibilities:Design, develop, and manage end-to-end data pipelines using Azure Data Factory or Synapse Data Factory.Build and administer scalable, secure Azure Data Lakes to store...

  • Sustainability Data Engineering Lead

    7 days ago

    Kolhapur, India beBeeDataEngineering Full time

    Lead Sustainability Data EngineerThe role involves spearheading data pipeline and model development to drive sustainability initiatives through analytics.Data engineering expertise: Develop, optimize, and maintain scalable ETL/ELT pipelines using Databricks on AWS to support carbon footprint analysis.Data modeling skills: Build unified models integrating...

  • Chief Data Engineering Specialist

    7 days ago

    Kolhapur, India beBeeAzure Full time

    Lead Data ArchitectAbout the Role:Design and implement enterprise-level data pipelines using Azure Data Factory (ADDF) and Databricks.Review business requirements and develop scalable data architectures that integrate with Azure Data Lakes or Azure Data warehouses, Azure Synapse, Azure Databricks, or cloud services.Develop expertise in advanced data modeling...

  • Data Engineering Specialist

    7 days ago

    Kolhapur, India beBeeData Full time

    Job Title: Data Support EngineerWe are seeking a highly skilled and experienced professional to serve as the escalation point for data ingestion, pipeline, and consumption issues. The ideal candidate will ensure high system stability through proactive monitoring and root-cause analysis.You will be responsible for supporting data quality checks,...