Senior Big Data Specialist

14 hours ago


Gurgaon, Haryana, India IGT Full time
About the Role

Exciting opportunity for a seasoned data engineer to join IGT Solutions as a Senior Big Data Specialist. This role requires 3+ years of experience in designing, developing, and maintaining scalable data pipelines using Python and PySpark.

Key Responsibilities:

  • Design and develop efficient data pipelines using Python and PySpark.
  • Work with SQL and MongoDB to manage and query large datasets, ensuring data quality and integrity across various data sources.
  • Develop and implement solutions using Snowflake for data warehousing, leveraging AWS services such as S3, Glue, Lambda, and Athena to process and analyze data.
  • Collaborate with cross-functional teams to gather and understand requirements, implementing CI/CD pipelines to streamline the deployment of data solutions.
  • Monitor, troubleshoot, and optimize the performance of data systems, ensuring seamless data flow and minimal downtime.

Required Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 3+ years of experience in data engineering or a similar role, with strong proficiency in Python and PySpark.
  • Experience with SQL and NoSQL databases, particularly MongoDB, and familiarity with Snowflake and its ecosystem.
  • Hands-on experience with AWS services, including S3, Glue, Lambda, and Athena, and understanding of CI/CD processes and tools.
  • Excellent problem-solving skills and attention to detail, with strong communication and collaboration skills.

Salary: $120,000 - $150,000 per year, depending on experience.

About IGT Solutions

IGT Solutions is an equal opportunities employer, committed to providing a non-discriminatory environment free from intimidation, harassment, or bias. We strive to create a workplace where everyone feels valued, respected, and empowered to succeed. If you're passionate about big data and want to be part of a dynamic team, apply now



  • Gurgaon, Haryana, India IGT Solutions Full time

    Job Title: Senior Big Data SpecialistWe are seeking a seasoned Senior Big Data Specialist with 6 years of experience in designing and implementing scalable data pipelines. The ideal candidate will have expertise in AWS Cloud services, including IAM, EC2, S3, Glue, Athena, Redshift, and CloudWatch.About the Role:The role involves working with programming...


  • Gurgaon, Haryana, India TalentXO Full time

    About the RoleTalentXO is looking for an experienced Senior Big Data Specialist to join our team. As a Cloud Data Engineer, you will play a key role in designing and developing cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.You will be responsible for working with Spark, Hive, HDFS, MR, Apache Kafka/AWS...


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...

  • Big Data Specialist

    6 days ago


    Gurgaon, Haryana, India Aptita Consulting Partners Full time

    About Aptita Consulting PartnersWe are a leading consulting firm that specializes in delivering high-quality data engineering and analytics solutions to our clients. Our team of experts has a deep understanding of the latest technologies and trends in the field.Job DescriptionWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer,...


  • Gurgaon, Haryana, India Max life insurance co ltd Full time

    Job DescriptionThis is an exciting opportunity to work as a Cloud Big Data Architecture Specialist, designing and implementing scalable data pipelines and infrastructure on the AWS cloud platform.


  • Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    About our Ideal Candidate:">We are looking for a motivated and experienced data engineer who can lead our team in delivering high-quality big data solutions. The ideal candidate should have a strong background in big data engineering, excellent problem-solving skills, and the ability to work effectively in a collaborative environment.


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...


  • Gurgaon, Haryana, India HUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED Full time

    Job Description: Senior Big Data Engineer LeadHUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED is a cutting-edge technology company that values innovation, collaboration, and excellence. Our team is passionate about leveraging data science to drive business growth and transform industries.About the Role:We are looking for a seasoned Senior Big Data Engineer...

  • Big Data Architect

    5 days ago


    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at Deutsche Telekom Digital Labs Private Limited. As a Senior Hadoop Engineer, you will design and implement scalable big data solutions using Hadoop-based technologies along with AWS. Your primary responsibilities include designing and implementing various big...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...

  • Big Data Developer

    1 day ago


    Gurgaon, Haryana, India Material Full time

    Job Description: We are looking for a highly skilled Big Data Developer to join our team at Material. The ideal candidate will have extensive experience with big data technologies such as Hadoop, Spark, and Hive, as well as programming languages like Java, Python, and Scala.As a Big Data Developer, you will be responsible for designing and developing big...


  • Gurgaon, Haryana, India Max life insurance co ltd Full time

    Job Description: Max Life Insurance Co Ltd is seeking an experienced Senior Big Data Engineer to lead the development and maintenance of our big data infrastructure on the AWS cloud platform. In this role, you will be responsible for architecting, designing, and implementing scalable data pipelines and infrastructure that support data-driven decision-making...


  • Gurgaon, Haryana, India Aays Full time

    About UsAays is a cutting-edge company at the forefront of innovation, dedicated to harnessing the power of data to drive business growth.Salary and BenefitsWe offer an attractive salary range of $120,000 - $180,000 per annum, along with a comprehensive benefits package that includes health insurance, retirement plans, and generous paid time off.Job...


  • Gurgaon, Haryana, India Steerlean Consulting Services Pvt Ltd. Full time

    Job Description: Steerlean Consulting Services Pvt Ltd. is seeking an experienced Sr. Big Data Developer to join our team. The successful candidate will design, build, and maintain scalable data pipelines and systems to support analytics and business intelligence.In this role, you will work closely with data scientists, analysts, and other engineers to...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    About the RoleWe are seeking an experienced Senior Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets in our Bangalore, Chennai, Kolkata, Gurugram, Pune office.The ideal candidate will have a strong understanding of data warehousing and data modeling techniques, proficient knowledge of distributed computing...


  • Gurgaon, Haryana, India dunnhumby Full time

    Company Overview:dunnhumby is a market-leading business that explores new opportunities for global retailers. We're looking for a Big Data Engineer who expects more from their career.


  • Gurgaon, Haryana, India Rapture Staffing Full time

    Data Engineering PositionAbout the Role:We are seeking an experienced data engineer to develop and implement efficient data architectures and pipelines. The ideal candidate will have a strong background in ETL tools, big data technologies, and cloud platforms.Responsibilities:Design and implement data architectures and pipelines that meet business...


  • Gurgaon, Haryana, India The Nielsen Company Full time

    Senior/Lead Software Engineer Position OverviewWe are seeking an experienced Senior/Lead Software Engineer to join our DevOps team at The Nielsen Company. In this role, you will be responsible for analyzing, developing, testing, and supporting Big Data applications.


  • Gurgaon, Haryana, India Rapture Staffing Full time

    About the RoleWe're looking for a skilled Senior Data Engineer to join our team at Rapture Staffing. The ideal candidate will have a strong background in designing, implementing, and optimizing scalable and efficient data architectures and pipelines.Key Responsibilities:Create and maintain data pipelines that ingest, transform, and store data from various...