Data Engineer

5 days ago


Anywhere in IndiaMultiple Locations MWIDM Staffing Services Full time

Responsibilities :

- Design, develop, and maintain efficient and reliable data pipelines using PySpark.

- Implement ETL processes to ingest, transform, and load data from various sources.

- Optimize PySpark code for performance and scalability.

- Work with large datasets and distributed computing frameworks.

- Develop and maintain data quality checks and monitoring processes.

- Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver data solutions.

- Build and deploy data pipelines to production environments.

- Troubleshoot and debug data pipeline issues.

- Stay up-to-date with the latest data engineering technologies and trends, particularly within the PySpark ecosystem.

- Contribute to the development and maintenance of data engineering best practices.

- Participate in code reviews and provide constructive feedback.

- Work in an Agile/Scrum environment.

- Mentor junior data engineers.

Required Skills :

- 5+ years of experience in data engineering.

- Strong proficiency in Python and PySpark.

- Deep understanding of Spark architecture and its core components.

- Experience with data warehousing concepts and dimensional modeling.

- Proficiency in SQL and experience writing complex queries.

- Experience with data ingestion tools and techniques.

- Experience with data transformation and cleansing.

- Experience with data quality monitoring and validation.

- Experience with workflow management tools (Airflow, Luigi).

- Experience with version control systems (Git)

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Risk Resources LLP Full time

    Overview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Sureminds Full time

    As a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Insight Global Full time

    Position : Data Engineer. Location : 100% Remote in India.Shift : Must be able to overlap with US team working 8 : 00am-5 : 00pm EST (Eastern Standard Time). Required Skills & Qualifications : .- 5-7+ years of experience as a Data Engineer.- Proficient in Apache Airflow and Google Cloud Platform (GCP).- Experience creating DAGs and workflows, monitoring...

  • Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations Screatives Software Services Pvt Ltd Full time

    Job Title : Data EngineerExperience : 5 to 8 YearsLocation : RemoteContract : 6 months to 1 yearJob Description :We are seeking a skilled Data Engineer to assist in designing and implementing Snowflake-based analytics solutions on AWS. The ideal candidate will have experience in data lake and data warehouse architecture, data integration, and pipeline...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Patch Infotech Private Limited Full time

    Key Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.- Develop and implement data validation and testing processes to ensure that data is processed accurately and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations CA-One Tech Cloud Full time

    Job Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...

  • Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Title : Data Engineer - DBTExperience : 5 - 8 YearsLocation : GurgaonNotice period : 15 DaysJob Type : FTE/C2HWork Mode : RemoteJob Responsibilities : - Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS- Requirements definition, source data analysis and profiling, the logical...


  • Anywhere in India/Multiple Locations Appizion Consulting And Solutions Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines to support critical business decisions. You will work closely with data scientists, analysts, and engineers to build and...


  • Anywhere in India/Multiple Locations RESURGENT ENTERPRISE SOLUTIONS PRIVATE LIMITED Full time

    Company Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...


  • Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    Job Title: Senior Data EngineerCompany Overview: Cybyrotek Solutions is a leading technology company that specializes in providing innovative data engineering solutions to its clients.Job Description: We are seeking an experienced Senior Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining...

  • Lead Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations Zenfinet Full time

    Job OverviewZenfinet is seeking a skilled Databricks Developer to join our team. As a key member, you will be responsible for designing and implementing cutting-edge data engineering solutions using Databricks.About the RoleThis is an exciting opportunity for a motivated professional with experience in data engineering, cloud computing, and big data...


  • Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    About MWIDM Staffing ServicesWe are a leading provider of staffing services, specializing in placing talented professionals in top data engineering roles.Job Description:The ideal candidate will have 5+ years of experience in designing, developing, and maintaining efficient and reliable data pipelines using PySpark. They will be responsible for implementing...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations/India Techiebutler Full time

    Job Title : Senior Data Engineer. Employment Type : Full-Time. Experience Required : 5+ Years. About Us : At Techiebutler, we pride ourselves on creating impactful data solutions that power innovative businesses. We are searching for a highly-skilled Senior Data Engineer who thrives in a collaborative environment and brings expertise from working in...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Coders Brain Technology & Private Limited Full time

    About the role :- As a Data Engineer Specialist, you will be a subject matter expert responsible for developing and maintaining data pipelines to assist us aggregate number of client data sources into a single view for our teams to utilize. The data is often incomplete, inconsistent and stored in silos with access primarily through APIs and FTPs. We are...

  • Senior Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations Uncap Research Labs Full time

    Key Responsibilities :- Lead and drive discovery sessions with external clients and build state-of-the-art data architectures. - Work with stakeholders to understand their problem statements, data requirements and implement solutions that meet their needs.- Design, implement, and develop data pipelines to collect and process large amounts of data from...


  • Anywhere in India/Multiple Locations Aventior Digital Private Limited Full time

    About the RoleWe are looking for a highly skilled Senior Data Engineering Manager to lead our data engineering team. The successful candidate will have extensive experience in designing and implementing large-scale data ingestion processes, as well as expertise in ETL tools such as SSIS and Azure Data Factory.Key Responsibilities:Manage and lead a team of...


  • Anywhere in India/Multiple Locations Zenfinet Full time

    Job DescriptionLead the design and implementation of cloud-based data architectures for clients across various industries.Collaborate with cross-functional teams to develop innovative data engineering solutions that meet client needs.Mentor junior team members and provide technical guidance on best practices in data engineering.Stay up-to-date with emerging...

  • Big Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...

  • AWS Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we...