Data Engineer with Databricks Expertise

1 day ago

Kolhapur, India Hello World Tech Consulting Full time

Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment, programming, data modeling, and governance.Key Responsibilities• Design and implement data pipelines using AWS and Databricks.• Manage and orchestrate data workflows, ensuring eEicient data ingestionprocesses.• Utilize Delta Lake for data storage and management, ensuring secure datasharing across platforms with Delta Sharing.• Implement data governance and access control using Unity Catalog.• Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.• Develop and manage ETL pipelines using AWS Glue.• Leverage Amazon S3 for data storage and management.• Utilize AWS Lambda and Step Functions for serverless computing in dataprocessing.• Apply data warehousing solutions and best practices in data transformation.• Monitor and implement data quality checks and governance practices.• Collaborate with data scientists, analysts, and other stakeholders in an Agileenvironment.• Deliver large-scale data processing and analytics projects within cloudenvironments.Required Skills and Qualifications• Databricks certifications with practical experience in the Databricks Lakehouseplatform.• Proficient in AWS services: Glue, S3, Lambda, Step Functions, and datawarehousing solutions.• Strong programming skills in Python, Scala, or Java.• Proficient in SQL for querying and manipulating data.• Experience in data modeling for Lakehouse architecture.• Knowledge of ETL best practices and data transformation techniques.• Understanding of data governance frameworks and practices.• Proven track record of delivering data engineering projects, particularly in cloudenvironments.• Experience with large-scale data processing and analytics projects.• Ability to work in Agile teams and collaborate eEectively with variousstakeholders.Preferred Qualifications• Advanced AWS certifications.• Experience with additional cloud platforms (e.g., Azure).• Familiarity with other data engineering tools and frameworks.

  • Databricks Data Engineer

    3 weeks ago

    Kolhapur, India Pradeepit Consulting Services Full time

    Job Description Responsibilities: - Requirements Elucidation: Liaise effectively with coworkers and clients to clearly understand the requirements for each data engineering task. - Infrastructure Design & Generation: Conceptualize and generate robust infrastructure that facilitates the access and analysis of big data, primarily utilizing the Databricks...

  • Sr Data Bricks Data Engineer

    3 weeks ago

    Kolhapur, Hyderabad, India Pradeepit Consulting Services Full time

    Job Description Responsibilities: - Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines using Databricks for data ingestion, transformation, and processing. - Programming & Scripting: Develop robust data solutions and automation scripts primarily using Python. - Cloud Data Warehousing: Work with and optimize data...

  • Lead Data Architect

    19 hours ago

    Kolhapur, India NexGen Tech Solutions Full time

    Job Title: Data Lead / Data Architect – Wealth ManagementLocation: [Noida/Gurgaon/Remote]Experience: 10+ yearsMust Have: Wealth Management DomainJob Summary:We are seeking a highly skilled Data Lead / Data Architect with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions.Experience in building end-to-end...

  • Machine Learning Engineer

    5 days ago

    Kolhapur, India People Prime Worldwide Full time

    About the Client:Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018. It helps companies connect with remote software developers using AI-powered vetting and matching technology. Originally branded as the “Intelligent Talent Cloud,” it enabled companies to “spin up their engineering dream team in the cloud” by...

  • Data Engineer

    5 days ago

    Kolhapur, India IntraEdge Full time

    Websitehttp://www.intraedge.comJob Title: Data EngineerExperience: 5–9 yearsLocation: [Remote]Job Summary:We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda), and Snowflake. The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable...

  • Business Intelligence Engineer

    19 hours ago

    Kolhapur, India Tata Consultancy Services Full time

    Role**: Business Intelligence EngineerRequired Technical Skill Set: Business Intelligence EngineerDesired Experience Range: 7 - 10 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skill:Proficient in SQL and Python.Proficient in snowflake and Databricks....

  • Data engineer

    4 hours ago

    Kolhapur, India Tata Consultancy Services Full time

    Greetings from TCS!!! TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before the interview. To create an...

  • Electric Wiring Harness

    4 weeks ago

    Kolhapur, India Cableteque Full time

    Cableteque comprises an international team with extraordinary wire interconnects, CAD deployments, data exchange protocols, and AI expertise. Our team is located worldwide, including the US, India, & Europe. This allows us to assemble diverse perspectives, comprehensive knowledge, and specialized know-how to deliver the best software product/service to our...

  • Senior Snowflake Data Engineer

    3 weeks ago

    Kolhapur, India Pradeepit Consulting Services Full time

    Job Description Roles and Responsibilities: - Requirements Elucidation: Liaise effectively with coworkers and clients to clearly understand the requirements for each data engineering task. - Infrastructure Design & Generation: Conceptualize and generate robust infrastructure that facilitates the access and analysis of big data, primarily utilizing Snowflake....

  • Data Scientist

    2 weeks ago

    Kolhapur, India v4c.ai Full time

    Overview: The Data Scientist supports the development and implementation of data models, focusing on Machine Learning, under the supervision of more experienced scientists, contributing to the team’s innovative projects.Job Description:Assist in the development of Machine Learning models and algorithms, contributing to the design and implementation of...