Senior Big Data ETL Specialist

6 days ago


Gurgaon, Haryana, India IGT Solutions Full time
Job Overview

We are seeking a highly skilled Senior Big Data ETL Specialist to join our team at IGT Solutions.

About the Role

This is a permanent, full-time position offering an estimated salary of $120,000 - $180,000 per year, depending on experience.

The ideal candidate will have a strong background in AWS and PySpark, with experience in designing and implementing end-to-end ETL solutions that align with business requirements. They will also have excellent problem-solving skills, attention to detail, and the ability to work closely with data engineers, data scientists, and other stakeholders.

Key Responsibilities
  • Architect ETL solutions: Design scalable, reliable, and performant ETL solutions that meet business needs.
  • Data Modeling: Define and implement data models, schemas, and structures for efficient data processing and storage.
  • ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines using PySpark, leveraging AWS Glue or other relevant AWS services.
  • AWS Integration: Integrate ETL processes with various AWS services, such as S3, Redshift, Athena, and EMR.
  • Performance Optimization: Identify and resolve performance bottlenecks in ETL processes for efficiency.
  • Data Quality and Governance: Implement data quality checks and governance policies to ensure data accuracy and compliance.
  • Monitoring and Troubleshooting: Set up monitoring and alerting systems to proactively identify and address issues within ETL pipelines.
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as an ETL Technical Architect with a strong focus on AWS and PySpark.
  • In-depth knowledge of AWS services, including but not limited to S3, Redshift, Athena, EMR, and Glue.
  • Proficiency in PySpark and related Big Data technologies for ETL processing.
  • Strong SQL skills for data manipulation and querying.
  • Familiarity with data warehousing concepts and dimensional modeling.
  • Experience with data governance, data quality, and data security practices.
  • Excellent problem-solving skills and attention to detail.
About Us

IGT Solutions is a next-gen customer experience (CX) company, defining and delivering transformative experiences for global brands using digital technologies. With a global delivery footprint across 30 locations and 25,000+ CX and Technology experts from 35+ nationalities, we provide industry solutions and Digital services to leading enterprise customers.



  • Gurgaon, Haryana, India MINDTEL GLOBAL PRIVATE LIMITED Full time

    Job Description: As a Senior ETL Data Testing Specialist at MINDTEL GLOBAL PRIVATE LIMITED, you will be responsible for conducting and overseeing ETL data testing processes to ensure data quality and integrity.


  • Gurgaon, Haryana, India IGT Solutions Full time

    Job Title: Senior Big Data SpecialistWe are seeking a seasoned Senior Big Data Specialist with 6 years of experience in designing and implementing scalable data pipelines. The ideal candidate will have expertise in AWS Cloud services, including IAM, EC2, S3, Glue, Athena, Redshift, and CloudWatch.About the Role:The role involves working with programming...


  • Gurgaon, Haryana, India TalentXO Full time

    About the RoleTalentXO is looking for an experienced Senior Big Data Specialist to join our team. As a Cloud Data Engineer, you will play a key role in designing and developing cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.You will be responsible for working with Spark, Hive, HDFS, MR, Apache Kafka/AWS...

  • ETL Data Specialist

    2 weeks ago


    Gurgaon, Haryana, India MINDTEL GLOBAL PRIVATE LIMITED Full time

    About the RoleMINDTEL GLOBAL PRIVATE LIMITED is seeking a highly skilled ETL Data Specialist to join our team. As an ETL Data Specialist, you will be responsible for conducting and overseeing ETL data testing processes to ensure data quality and integrity.The ideal candidate will have proficiency in ETL processes, data testing methodologies, and tools such...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...

  • Big Data Specialist

    2 weeks ago


    Gurgaon, Haryana, India Aptita Consulting Partners Full time

    About Aptita Consulting PartnersWe are a leading consulting firm that specializes in delivering high-quality data engineering and analytics solutions to our clients. Our team of experts has a deep understanding of the latest technologies and trends in the field.Job DescriptionWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer,...

  • ETL Data Specialist

    2 weeks ago


    Gurgaon, Haryana, India Douxware Technologies Full time

    Douxware Technologies seeks an experienced ETL Data Specialist to design, develop, and maintain Extract, Transform, Load processes using SSIS or other ETL tools.The ideal candidate will have a solid understanding of data management principles and experience in managing data warehouses.Design, develop, and maintain ETL processes using SSIS or any other ETL...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Innova ESI Full time

    About the RoleAre you a highly skilled and experienced Senior Data Engineer looking to take your career to the next level? We are seeking an exceptional individual to join our team at Innova ESI as a Senior Data Engineer - ETL Process Specialist.In this role, you will be responsible for designing, developing, and maintaining robust data pipelines and data...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Douxware Technologies Full time

    About Douxware TechnologiesAt Douxware Technologies, we are seeking a highly skilled Senior Data Engineer - ETL Specialist to join our team. As a key member of our data management department, you will be responsible for designing, developing, and maintaining ETL processes using SSIS or other ETL tools.Job Description:Key Responsibilities:Design, develop, and...


  • Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...


  • Gurgaon, Haryana, India HUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED Full time

    Job Description: Senior Big Data Engineer LeadHUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED is a cutting-edge technology company that values innovation, collaboration, and excellence. Our team is passionate about leveraging data science to drive business growth and transform industries.About the Role:We are looking for a seasoned Senior Big Data Engineer...


  • Gurgaon, Haryana, India IGT Full time

    About the RoleExciting opportunity for a seasoned data engineer to join IGT Solutions as a Senior Big Data Specialist. This role requires 3+ years of experience in designing, developing, and maintaining scalable data pipelines using Python and PySpark.Key Responsibilities:Design and develop efficient data pipelines using Python and PySpark.Work with SQL and...


  • Gurgaon, Haryana, India IGT Solutions Full time

    About the Role:We are seeking a highly skilled Senior Data Integration Specialist to join our team at IGT Solutions. As an experienced professional in data integration, you will be responsible for designing and implementing end-to-end ETL solutions that align with business requirements.Key Responsibilities:Design and develop scalable and reliable ETL...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....


  • Gurgaon, Haryana, India Rapture Staffing Full time

    Data Engineering PositionAbout the Role:We are seeking an experienced data engineer to develop and implement efficient data architectures and pipelines. The ideal candidate will have a strong background in ETL tools, big data technologies, and cloud platforms.Responsibilities:Design and implement data architectures and pipelines that meet business...


  • Gurgaon, Haryana, India NITS Solutions Full time

    Position Overview :We are seeking an Associate Big Data Engineer to join our team at NITS Solutions. The ideal candidate will have hands-on experience with Python, SQL, and POSTGRESQL, as well as a basic understanding of Pandas, Pyspark, and ETL processes.Key Responsibilities :Understand business needs and apply analytical concepts to generate actionable...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    About the RoleWe are seeking an experienced Senior Big Data Engineer to work on collecting, storing, processing, and analyzing large data sets in our Bangalore, Chennai, Kolkata, Gurugram, Pune office.The ideal candidate will have a strong understanding of data warehousing and data modeling techniques, proficient knowledge of distributed computing...

  • Big Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India IGT Solutions Full time

    Data Engineer Position:We're seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and implementing robust ETL pipelines using technologies such as Python, PySpark, PLSQL, Snowflake, and AWS.Main Responsibilities:Design and develop...


  • Gurgaon, Haryana, India SysTechCorp Inc Full time

    About the Job: SysTechCorp Inc is a leading technology company looking for a skilled ETL Developer to join our team. In this role, you will be responsible for designing and developing efficient data integration solutions using Workday Adaptive tools and technologies.Main Responsibilities:Design and implement data integration solutions using Workday Adaptive...