Data Engineer

1 week ago


gurgaon, India True Tech Professionals Full time
Lead Data Engineer (Multiple Positions)
Location: Remote - Gurgaon (Office visit - once in a while - as and when required)
Experience:
4 to 6 years
Key Responsibilities:
Data Pipeline Development: Design, implement, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or other storage solutions.
PySpark Expertise: Utilize PySpark to process large datasets and perform complex transformations. Optimize Spark jobs for performance and resource efficiency.
ETL Processes: Develop and manage ETL processes to ensure data integrity and quality. Monitor ETL jobs and troubleshoot issues as they arise.
Data Modeling: Create and maintain data models that support business requirements and analytics needs.
Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide timely, accurate data solutions.
Documentation: Document data pipeline architectures, ETL processes, and data models. Ensure documentation is up-to-date and accessible.
Performance Tuning: Continuously monitor and optimize the performance of data pipelines and ETL processes.
Data Quality: Implement and enforce data quality checks to ensure data accuracy and consistency.
Best Practices: Stay current with industry best practices and emerging technologies in data engineering and apply them to improve existing processes.
Technical Skills:
Proficiency in PySpark and Spark SQL.
Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect).
Strong knowledge of SQL and experience with relational databases.
Familiarity with data warehousing solutions (e.g., AWS Redshift, Google BigQuery, Snowflake).
Understanding of cloud platforms (e.g., AWS, Azure, GCP).
  • Data Engineer

    7 days ago


    Gurgaon, India Persistent Systems Full time

    About Position:We are seeking a talented Data Engineer to join our team. The ideal candidate will have strong expertise in Python, Apache Spark, and Databricks.Role: Data EngineerLocation: GurgaonExperience: 4-6 YearsJob Type: Full Time EmploymentWhat You'll Do:Develop and maintain scalable data pipelines using Python and Apache Spark.Collaborate with...

  • Data Engineer

    2 months ago


    Gurgaon, India Corning Full time

    Requisition Number: 63042   Corning is vital to progress – in the industries we help shape and in the world we share. We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts,...

  • Data Engineer

    3 months ago


    gurgaon, India Impetus Full time

    About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...

  • Data Engineer

    3 weeks ago


    Gurgaon, India Awign Expert Full time

    Job DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...

  • Data Engineer

    4 weeks ago


    Gurgaon, India Awign Expert Full time

    Job DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...

  • Data Engineer

    3 weeks ago


    Gurgaon, India Awign Expert Full time

    Job DescriptionAbout Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing...


  • gurgaon, India True Tech Professionals Full time

    Job Summary:We are seeking a meticulous and proactive Data Quality Engineer to join our dynamic DataEngineering team. The ideal candidate will possess a deep understanding of data quality,validation, and data reconciliation concepts. They will collaborate closely with our dataengineers to ensure the integrity and accuracy of our data. This role requires...

  • Data Engineer

    1 week ago


    Gurgaon, India RSA India (An Intact Company) Full time

    Data Engineering Opportunity with RSA Insurance GroupThe purpose of the Data Engineer is to build and unit test code for Projects and Programmes on Azure Cloud Data and Analytics Platform.About the roleAnalyse business requirements and support\create design for requirementsBuild and deploy new/changes to technology applications developed on Azure Cloud...

  • Data Engineer

    3 weeks ago


    Gurgaon, India Awign Expert Full time

    About Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing administrative tasks,...

  • Data Engineer

    4 weeks ago


    Gurgaon, India Awign Expert Full time

    About Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing administrative tasks,...

  • Data Engineer

    3 weeks ago


    Gurgaon, India Awign Expert Full time

    About Awign Expert: Awign Expert, a division of Awign - India's largest work-as-a-service platform. We connect skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll. Our mission is to empower professionals to focus on their work by managing administrative tasks,...

  • Data Engineer

    1 week ago


    gurgaon, India RSA India (An Intact Company) Full time

    Data Engineering Opportunity with RSA Insurance GroupThe purpose of the Data Engineer is to build and unit test code for Projects and Programmes on Azure Cloud Data and Analytics Platform.About the roleAnalyse business requirements and support\create design for requirementsBuild and deploy new/changes to technology applications developed on Azure Cloud...


  • gurgaon, India True Tech Professionals Full time

    Job Title: Senior Data EngineerLocation: Gurgaon (Hybrid)Experience Required: 6 to 9 yearsJob Summary:We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will be...


  • Gurgaon, India Deutsche Telekom Digital Labs Full time

    The RoleAs an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...


  • Gurgaon, India Mrikal Full time

    We are looking for a talented Data Engineer to join our team and play a pivotal role in designing, building, and maintaining the cloud-based data infrastructure for our clients. In this role, you will collaborate closely with data architects, analysts, and cross-functional teams to develop robust and scalable data pipelines, ensuring the seamless flow of...

  • Data Engineer

    3 months ago


    Gurgaon, India Siemens Energy Full time

    Data Engineer About the Role Location India Haryana Gurgaon Remote vs. Office Hybrid (Remote/Office) Company Siemens Energy Industrial Turbomachinery India Private Limited Organization EVP Global Functions Business Unit Digital Products and Solutions Full / Part time Full-time Experience Level Experienced Professional LET’S TALK ABOUT YOU...

  • Data Engineer

    2 months ago


    Gurgaon, India BayOne Solutions Full time

    Work from office - 3 days/WeekLocation:Bangalore/GurgaonJob Description:Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc.Azure experience is preferred over other cloud platforms.5 years of proven experience with SQL, schema design and dimensional data...


  • gurgaon, India Deutsche Telekom Digital Labs Full time

    The RoleAs an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled. You will also act as an Architect for this team and will be responsible for design and long-term roadmap. You will analyse other employees’ tasks and carry on...


  • gurgaon, India Zupee Full time

    Manager Data EngineeringZupee is India’s fastest growing Technology backed Behavioural Science company. We are innovating Skill-Based Gaming with a mission to become the most trusted and responsible entertainment company in the world. We have been constantly focussing on innovation of indigenous games to entertain the mass.Our strategy is to invest in our...

  • Data Engineer

    1 week ago


    gurgaon, India ClearPier Inc Full time

    "Established in 2012 in Canada, ClearPier is a global tech-enabled performance marketing company and Canada’s largest performance ad-tech company, boasting over 180 employees worldwide.ClearPier excels in driving mobile app installs and user re-engagement for mobile-first brands using proprietary tools, custom algorithms, audience data, and multiple...