Lead Data Engineer

5 days ago


Anywhere in IndiaMultiple Locations Zenfinet Full time

Job Overview

Zenfinet is seeking a skilled Databricks Developer to join our team. As a key member, you will be responsible for designing and implementing cutting-edge data engineering solutions using Databricks.

About the Role

This is an exciting opportunity for a motivated professional with experience in data engineering, cloud computing, and big data processing. You will work closely with our architects and engineers to develop innovative solutions that meet both functional and non-functional requirements.

Responsibilities

  • Maintain close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
  • Demonstrate knowledge of relevant industry trends and standards.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in Data Engineering domain.
  • Must have implemented at least 2 project end-to-end in Databricks.

Requirements

  • Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
  • Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
  • Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
  • Demonstrated knowledge of relevant industry trends and standards.
  • Demonstrate strong analytical and technical problem-solving skills.
  • Must have excellent coding skills either Python or Scala, preferably Python.
  • Must have experience in Data Engineering domain.
  • Must have implemented at least 2 project end-to-end in Databricks.
  • Must have extensive knowledge of Spark and Hive data processing framework.
  • Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.

Preferred Qualifications

  • Unity catalog and basic governance knowledge.
  • Good to have Databricks SQL Endpoint understanding.
  • Good To have CI/CD experience to build the pipeline for Databricks jobs.
  • Good to have if worked on migration project to build Unified data platform.
  • Good to have knowledge of DBT.
  • Good to have knowledge of docker and Kubernetes.

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Sureminds Full time

    As a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...

  • Data Architect Lead

    5 days ago


    Anywhere in India/Multiple Locations Zenfinet Full time

    About ZenfinetZenfinet is a leading provider of data engineering services, helping businesses unlock the full potential of their data. As a Senior Databricks Specialist, you will play a key role in delivering high-quality solutions to our clients and driving business growth.


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    About the RoleWe are looking for a highly skilled Senior Data Engineering Manager to lead our data engineering team. The successful candidate will have extensive experience in designing and implementing large-scale data ingestion processes, as well as expertise in ETL tools such as SSIS and Azure Data Factory.Key Responsibilities:Manage and lead a team of...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/India Techiebutler Full time

    Job Title : Senior Data Engineer. Employment Type : Full-Time. Experience Required : 5+ Years. About Us : At Techiebutler, we pride ourselves on creating impactful data solutions that power innovative businesses. We are searching for a highly-skilled Senior Data Engineer who thrives in a collaborative environment and brings expertise from working in...


  • Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full time

    Company Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...


  • Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    Job Title: Senior Data EngineerAbout Cybyrotek Solutions: We are a leading technology company that provides innovative data engineering solutions to its clients.The Job: We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and maintaining large-scale data pipelines and...

  • Data Engineer

    7 days ago


    Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    Responsibilities :- Design, develop, and maintain efficient and reliable data pipelines using PySpark.- Implement ETL processes to ingest, transform, and load data from various sources.- Optimize PySpark code for performance and scalability.- Work with large datasets and distributed computing frameworks.- Develop and maintain data quality checks and...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Overview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...


  • Anywhere in India/Multiple Locations Zenfinet Full time

    Job DescriptionLead the design and implementation of cloud-based data architectures for clients across various industries.Collaborate with cross-functional teams to develop innovative data engineering solutions that meet client needs.Mentor junior team members and provide technical guidance on best practices in data engineering.Stay up-to-date with emerging...


  • Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    About MWIDM Staffing ServicesWe are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.Job Description:The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing...

  • Lead Engineer

    1 week ago


    Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    Job Role : GenAI Lead Engineer Job Location : PAN India Job type : Contract to hire Job Overview : GenAI Lead engineer designs and implements GenAI and artificial intelligence pilots/pocs/products. Responsibilities include selecting appropriate technologies (hybrid/multi-cloud) and collaborating with cross-functional teams to integrate AI into existing...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Insight Global Full time

    Position : Data Engineer. Location : 100% Remote in India.Shift : Must be able to overlap with US team working 8 : 00am-5 : 00pm EST (Eastern Standard Time). Required Skills & Qualifications : .- 5-7+ years of experience as a Data Engineer.- Proficient in Apache Airflow and Google Cloud Platform (GCP).- Experience creating DAGs and workflows, monitoring...

  • Data Engineer

    7 days ago


    Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full time

    Job Title : Data EngineerExperience : 5 to 8 YearsLocation : RemoteContract : 6 months to 1 yearJob Description :We are seeking a skilled Data Engineer to assist in designing and implementing Snowflake-based analytics solutions on AWS. The ideal candidate will have experience in data lake and data warehouse architecture, data integration, and pipeline...


  • Anywhere in India/Multiple Locations Zenfinet Full time

    Why Join Us?Zenfinet offers a dynamic and collaborative work environment that fosters innovation and growth. As a Databricks Developer, you will have the opportunity to work on cutting-edge projects and contribute to the development of our data engineering solutions.About the RoleThis is an exciting opportunity for a motivated professional with experience in...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Patch Infotech Private Limited Full time

    Key Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...

  • Senior Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Lead and drive discovery sessions with external clients and build state-of-the-art data architectures. - Work with stakeholders to understand their problem statements, data requirements and implement solutions that meet their needs.- Design, implement, and develop data pipelines to collect and process large amounts of data from...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.- Develop and implement data validation and testing processes to ensure that data is processed accurately and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations CA-One Tech Cloud Full time

    Job Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...

  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations Mentorpal Full time

    Minimum Qualifications : Minimum 5 years exp. is required- Hands on experience in working with Marketing Domain datasets.- 2+ years of applicable work experience in ML,3+ years in python- 4+ years of hands-on experience in Snowflake.- 2+ years of experience on Generative AI projects.- Proficiency with the Python Machine Learning stack, e.g. Pandas, etc.-...

  • AWS Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...