Big Data Processing Expert

4 weeks ago


Delhi, Delhi, India ASCHPRO IT SOLUTIONS PRIVATE LIMITED Full time

Job Overview

We are seeking a highly skilled Data Engineer to lead our team in Gurgaon. The ideal candidate will have 5+ years of experience in big data processing using PySpark, AWS expertise, and hands-on experience with AWS Redshift and SQL query writing.

Key Responsibilities:

  • Design and implement data architecture and data lake solutions using AWS services including Glue, S3, EMR, and Lambda.
  • Develop and maintain data management tools and data lineage tools for metadata management.
  • Collaborate with cross-functional teams to design and implement cloud data warehouses using Snowflake or similar platforms.

Requirements:

  • 5+ years of experience in big data processing using PySpark.
  • Expertise in AWS services including Glue, S3, EMR, and Lambda.
  • Hands-on experience with AWS Redshift and SQL query writing (mandatory).
  • Proficiency in SQL and database technologies (both relational and non-relational databases) is mandatory.

What We Offer:

Competitive salary: ₹1200000 - ₹2000000 per annum.

Opportunity to work with a leading company in the industry.

Collaborative and dynamic work environment.



  • Delhi, Delhi, India Tata Consultancy Services Full time

    Tata Consultancy Services is a leading global IT services company seeking an experienced Big Data Expert to join our team in Chennai. We are committed to delivering innovative solutions that drive business growth and excellence.We offer a competitive salary of ₹20,00,000 per annum, commensurate with experience and qualifications.Job DescriptionAs a Big...

  • Cloud Data Engineer

    1 month ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    About the RoleWe are seeking an experienced Cloud Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will play a vital role in designing, building, and deploying big data pipelines in Google Cloud Platform (GCP).Key ResponsibilitiesDesign and develop scalable big data architectures on GCP using...

  • Big Data Engineer

    4 weeks ago


    Delhi, Delhi, India Max life insurance co ltd Full time

    Job Description: Max Life Insurance Co Ltd is seeking a highly skilled Big Data Engineer to join our dynamic team. As a Big Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on AWS cloud platform.Required Skills and Qualifications:Hands-on experience with AWS services such as S3,...


  • Delhi, Delhi, India Nityo Infotech Full time

    Company OverviewNityo Infotech is a leading provider of innovative data engineering solutions. We empower our clients to harness the power of cloud and big data technologies, driving business growth and success.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be...


  • Delhi, Delhi, India Talent Pro Full time

    Job OverviewTalent Pro is seeking a Big Data Solutions Specialist to join our team. In this role, you will be responsible for designing, developing, testing, deploying, and maintaining large-scale big data processing pipelines using Hadoop ecosystem (HDFS, MapReduce) and Spark.The ideal candidate will have experience working with various technologies such as...


  • Delhi, Delhi, India Kloud9 Full time

    Technical Requirements:The ideal candidate should possess expert-level programming proficiency in Python, Java, and Scala, as well as extensive hands-on experience with big data technologies, including Spark, Hadoop, Hive, Yarn, MapReduce, Pig, Kafka, and PySpark. Additionally, they should be proficient in Google Cloud Platform services, such as BigQuery,...


  • Delhi, Delhi, India Sourcebae Full time

    About the RoleAs a Data Engineer at Sourcebae, you will play a crucial role in designing, building, and maintaining large-scale data processing systems. This position requires expertise in developing ETL pipelines involving big data and experience in working with cloud-based services like AWS.Key Responsibilities:Developing data processing and analytics...


  • Delhi, Delhi, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    About the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics.The ideal candidate will have extensive...

  • Big Data Architect

    4 weeks ago


    Delhi, Delhi, India QAAgility Technologies Full time

    We are seeking a highly skilled Big Data Architect to join our team at QAAgility Technologies. As a key member of our big data team, you will be responsible for designing, building, and maintaining large-scale big data architectures on AWS.The ideal candidate will have 6+ years of experience in AWS, Big Data, and Python, with a strong background in data...


  • Delhi, Delhi, India Kloud9 Full time

    About the JobKloud9 is seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design and implementation of large-scale data engineering projects on the Google Cloud Platform (GCP).The ideal candidate will have extensive experience in building data ingestion...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    About NucleusTeq Consulting Pvt. Ltd.NucleusTeq Consulting Pvt. Ltd. is a technology consulting firm that helps businesses leverage big data and analytics to drive business outcomes.Salary and Benefits:The estimated salary for this position is around $120,000 - $180,000 per annum, depending on experience. We also offer a comprehensive benefits package,...


  • Delhi, Delhi, India PubMatic Full time

    Job DescriptionWe are seeking a highly skilled Big Data Automation Engineer to join our team at PubMatic. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining automation frameworks for big data workflows.Responsibilities:Designing and implementing automation frameworks using Python to automate big data...


  • Delhi, Delhi, India Talent Pro Full time

    About the RoleWe are seeking a highly skilled Data Processing Engineer to join our team at Talent Pro. This role is responsible for designing, developing, testing, deploying, and maintaining large-scale big data processing pipelines using Hadoop ecosystem (HDFS, MapReduce) and Spark.The ideal candidate will have expertise in working with various technologies...


  • Delhi, Delhi, India LTIMindtree Full time

    We are seeking an experienced Data Engineer to join our team at LTIMindtree. As a key member of our big data solutions group, you will be responsible for designing and developing scalable data platforms using modern technologies like Spark, HBase, Hive, and other Hadoop ecosystem tools.About the RoleIn this role, you will work closely with cross-functional...


  • Delhi, Delhi, India HCLTech Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at HCLTech. As a key member of our engineering team, you will be responsible for designing and developing scalable data pipelines using Google Cloud Platform (GCP) technologies.Key ResponsibilitiesDesign and implement data pipelines using GCP services such as BigQuery,...


  • Delhi, Delhi, India LTIMindtree Full time

    Job SummaryWe are seeking an experienced Big Data Architect to lead the design and development of scalable big data platforms using Scala and Spark. The ideal candidate will have a deep understanding of modern data processing technology stacks, including Spark, HBase, Hive, and other Hadoop ecosystem technologies.About the RoleThis is an exciting opportunity...


  • Delhi, Delhi, India Strategic HR Solutions Full time

    Job SummaryWe are looking for an experienced Data Engineer to join our team in Dubai. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Informatica Big Data Management.ResponsibilitiesDesign and build data pipelines using HQL, Hive, and HDFSMaintain and optimize existing systems to...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking a highly skilled Data Engineer to join our team in building enterprise big data solutions. With over 10 years of experience, you will play a critical role in designing and implementing large-scale data processing systems using Apache Hadoop components and Spark.As a Data Engineer at TCS, you will be responsible for...


  • Delhi, Delhi, India ASCHPRO IT SOLUTIONS PRIVATE LIMITED Full time

    About the Role:We are seeking a highly skilled Data Engineer to join ASCHPRO IT SOLUTIONS PRIVATE LIMITED in Gurgaon. The ideal candidate will have 5+ years of experience in big data processing using PySpark, AWS expertise, and hands-on experience with AWS Redshift and SQL query writing.

  • Big Data Architect

    4 weeks ago


    Delhi, Delhi, India Aptino, Inc. Full time

    We are searching for a Big Data Architect to join our team at Aptino, Inc. and develop scalable ETL (Extract, Transform, Load) pipelines.The ideal candidate will have a strong understanding of data governance, security, and compliance standards, such as GDPR and HIPAA.The estimated salary for this position is around $180,000 per year.