Senior Data Pipeline Specialist

1 day ago


Gurgaon, Haryana, India MINFY TECHNOLOGIES PRIVATE LIMITED, Full time
Senior Data Engineer Position

We are looking for a skilled Senior Data Engineer to join our team at Minfy Technologies. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support data-driven initiatives.

About the Role:
  • Lead the design and implementation of robust data pipelines and ETL processes using Python, PySpark, and AWS Glue.
  • Develop and maintain data lake solutions, ensuring scalability, security, and performance.
  • Implement and manage data lineage and metadata management processes.
  • Collaborate with cross-functional teams to ensure data quality, availability, and accessibility for various analytics and business intelligence needs.
Responsibilities:
  1. Team Leadership: Lead a team of data engineers to design and implement data pipelines.
  2. Data Pipeline Design: Develop efficient data pipelines that handle large volumes of data.
  3. ETL Process Implementation: Implement and maintain ETL processes using Python and PySpark.
  4. Data Lake Management: Ensure data lakes are scalable, secure, and performant.
Requirements:
  • Proven work experience as a Senior Data Engineer or similar role.
  • Strong leadership skills and experience managing a team of data engineers.
  • Strong proficiency in Python programming and experience with PySpark for big data processing.
  • Hands-on experience with AWS Redshift and SQL query writing.
  • Familiarity with Snowflake or similar cloud data warehouse platforms.
  • Proficiency in SQL and database technologies (relational and non-relational databases).
Estimated Salary:

$150,000 - $220,000 per year

About Us:

We are MINFY TECHNOLOGIES PRIVATE LIMITED, a leading organization in the field of data engineering and analytics. We are committed to delivering high-quality solutions that meet the needs of our clients.



  • Gurgaon, Haryana, India WEN Full time

    At WEN, we are looking for a seasoned Senior Data Pipeline Specialist to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and implementing robust data pipelines that drive business growth and inform strategic decision-making.The ideal candidate will have extensive experience in data warehousing, cloud...

  • Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India MINFY TECHNOLOGIES PRIVATE LIMITED, Full time

    Job Title : Data Engineer - Cloud Data Pipeline SpecialistWe are seeking an experienced Data Engineer to join our team at Minfy Technologies Private Limited. The estimated salary for this role is ₹1,500,000 - ₹2,500,000 per annum, depending on experience. Company OverviewMinfy Technologies Private Limited is a leading technology company that specializes...


  • Gurgaon, Haryana, India AXA Group Full time

    Experience the excitement of transforming data into actionable insights as a Senior Data Pipeline Engineer at AXA XL.About UsAXA XL is a leading provider of specialty risk solutions, serving mid-sized companies and multinationals with innovative and flexible approaches to risk management. We're known for combining a comprehensive capital platform,...


  • Gurgaon, Haryana, India Deqode Full time

    Job Title: Data Pipeline Specialist with Lakehouse ArchitectureAbout Deqode:We are a cutting-edge technology company that values innovation and collaboration. Our team is dedicated to delivering exceptional solutions that transform the way businesses operate.Estimated Salary: $140,000 - $170,000 per yearJob Description:Data Engineering Role: As a key member...


  • Gurgaon, Haryana, India First Call HReSource Full time

    About the RoleA Senior Cloud Data Infrastructure Specialist is needed at First Call HReSource to develop and maintain scalable data pipelines across Azure systems. The ideal candidate will have 8-12 years of experience in a related field, with expertise in Databricks, SQL, SAS, and PySpark. This role requires strong analytical skills, proficiency in data...


  • Gurgaon, Haryana, India IGT Solutions Full time

    Job Title: Senior Big Data SpecialistWe are seeking a seasoned Senior Big Data Specialist with 6 years of experience in designing and implementing scalable data pipelines. The ideal candidate will have expertise in AWS Cloud services, including IAM, EC2, S3, Glue, Athena, Redshift, and CloudWatch.About the Role:The role involves working with programming...


  • Gurgaon, Haryana, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description:We are seeking an experienced Senior Data Integration Specialist to join our team at IFlowTech Solutions Private Limited. The successful candidate will play a key role in designing, developing, and implementing data integration solutions using Python, PySpark, SQL, and other relevant technologies.About the Role:This is a challenging...


  • Gurgaon, Haryana, India WEN Full time

    OverviewAt WEN, we are seeking a highly skilled Senior Data Infrastructure Specialist to join our team. This role requires expertise in designing and implementing robust data pipelines for analytics and reporting.The ideal candidate will possess strong experience in data warehousing, cloud platforms, and ETL/ELT processes, coupled with the ability to handle...


  • Gurgaon, Haryana, India IGT Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineering Specialist to join our team at IGT. As a key member of our data engineering team, you will play a vital role in designing, developing, and maintaining scalable data pipelines using Python and PySpark.In this role, you will work closely with cross-functional teams to gather and understand...

  • Senior Data Engineer

    24 hours ago


    Gurgaon, Haryana, India Innova ESI Full time

    About the RoleAre you a highly skilled and experienced Senior Data Engineer looking to take your career to the next level? We are seeking an exceptional individual to join our team at Innova ESI as a Senior Data Engineer - ETL Process Specialist.In this role, you will be responsible for designing, developing, and maintaining robust data pipelines and data...


  • Gurgaon, Haryana, India NTT DATA Full time

    About NTT DATANTT DATA is a leading IT services provider. We help clients to transform their businesses through digital innovation, and this role will play an important part in that journey.Salary InformationThe estimated annual salary for this position is around $95,000 - $125,000 based on location and industry standards.Job DescriptionThis Senior Financial...


  • Gurgaon, Haryana, India IT Source Global Full time

    Job Description:We are seeking a skilled Senior Data Infrastructure Specialist to join our team at IT Source Global. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Google Cloud Platform (GCP) services.About the Role:The ideal candidate will have a...

  • AWS Data Engineer

    2 months ago


    Gurgaon, Haryana, India Randstad Digital Full time

    Data Engineer Role OverviewWe are seeking a skilled Backend Data Engineer to join our dynamic team at Randstad Digital. The ideal candidate will have expertise in Databricks, AWS, SQL, Python, and PySpark, with a proven ability to design and implement efficient data pipelines. Additionally, a foundational knowledge of API development is required. If you are...

  • AWS Data Engineer

    2 months ago


    Gurgaon, Haryana, India Randstad Digital Full time

    Role : AWS Data : 5+ YearsLocation : Gurgaon (WFO)Must have : Databricks, AWS, SQL, Python, PySpark.We are seeking a skilled Backend Data Engineer to join our dynamic team. The ideal candidate will have expertise in Databricks, AWS, SQL, Python, and PySpark, with a proven ability to design and implement efficient data pipelines. Additionally, a foundational...

  • Data Pipeline Analyst

    4 weeks ago


    Gurgaon, Haryana, India American Express Full time

    **Job Overview**At American Express, we are seeking a highly skilled Data Pipeline Analyst to join our team. As a key member of our data analytics team, you will be responsible for designing, building, and maintaining complex data pipelines to support our business operations.**Key Responsibilities**Participate in the full lifecycle of data pipeline...


  • Gurgaon, Haryana, India TalentXO Full time

    About the RoleTalentXO is looking for an experienced Senior Big Data Specialist to join our team. As a Cloud Data Engineer, you will play a key role in designing and developing cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.You will be responsible for working with Spark, Hive, HDFS, MR, Apache Kafka/AWS...


  • Gurgaon, Haryana, India TalentXO Full time

    Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our client's team, who offers online cohort-based courses for architects, engineers, and designers in the AEC industry.The ideal candidate will have experience in designing, implementing, and optimizing scalable and efficient data architectures and pipelines to...


  • Gurgaon, Haryana, India exl Full time

    Job OverviewWe are seeking an experienced Senior AWS Data Engineering Specialist to join our team at EXL. This is a challenging and rewarding opportunity for the right candidate.About UsEXL is a leading business process management company that helps clients achieve high-quality, cost-effective results across various sectors.Key ResponsibilitiesDesign and...


  • Gurgaon, Haryana, India ACS Consultants Full time

    Job SummaryACS Consultants is seeking a highly skilled Senior Data Science Specialist to lead complex data science projects, drive innovation with a strategic mindset, and deliver impactful solutions. This role requires a strong background in computer science, statistics, or mathematics, with at least 4 years of experience in data science, statistical...


  • Gurgaon, Haryana, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Processing Specialist to join our team at NTT DATA. As a key member of our operations team, you will be responsible for reviewing and processing basic customer transactions, investigating and resolving data or account discrepancies, and providing excellent customer service.About the RoleThis is a 24 x 7...