Big Data SDET

3 weeks ago


Pune, Maharashtra, India PubMatic Full time
About the Role

We are seeking a highly skilled Big Data Software Development Engineer in Test to join our team at PubMatic.

Job Description

This is a critical role that involves testing and ensuring the quality of our big data platform. The successful candidate will have experience working with big data technologies like Hadoop and Spark, and will be responsible for developing automation frameworks using Python.

The ideal candidate will have strong programming skills, particularly in Python, and good debugging skills. They will also have experience working in Linux/Unix environments and knowledge of relational databases and SQL.

Some of the key responsibilities of this role include testing big data ingestion and aggregation flows, developing automation frameworks, debugging and troubleshooting issues, and setting up the big data platform and Hadoop ecosystem for testing.

As a member of our team, you will work closely with our NOC team to implement operating procedures, service monitors, and alerts. You will also be responsible for system and performance testing of the data platform and applications.

Requirements
  • 1-3 years of experience working as an SDET and doing meaningful automation
  • Good programming skills, particularly in Python
  • Hands-on experience in automating backend applications (e.g., database, REST API's)
  • Knowledge of relational databases and SQL
  • Good debugging skills
  • Working experience working in Linux/Unix environment
  • Good understanding of testing methodologies
Qualifications
  • Good hands-on experience with Unix/Linux
  • Good hands-on experience in writing Python codes
  • QA Methodologies understanding
Salary Information

The estimated salary range for this role is $120,000 - $180,000 per year, depending on experience.


  • Big Data Architect

    4 weeks ago


    Pune, Maharashtra, India Fincrif Full time

    FinCrif's Big Data Architect Position:We are seeking a highly skilled Big Data Architect to join our Research & Insights team. As a key member of our team, you will design and implement big data solutions to drive business growth.Key Responsibilities:Design and implement big data solutions using industry-standard toolsCollaborate with cross-functional teams...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    LTIMindtree is a leading global technology consulting and services company. We are seeking an experienced Big Data Developer to join our team.We offer a competitive salary of $120,000 per annum, commensurate with experience.About the RoleThis role involves designing and developing big data platforms using Scala and Spark technologies. The ideal candidate...

  • Big Data Professional

    4 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Professional to join our team at LTIMindtree. As a key member of our analytics group, you will be responsible for designing and implementing data-driven solutions using big data technologies.The ideal candidate will have a strong background in big data processing with Spark, including experience with PySpark and EMR...

  • Big Data Architect

    1 month ago


    Pune, Maharashtra, India HiLabs Full time

    About the Job: We are seeking a highly experienced Big Data Architect to join our team at HiLabs. The successful candidate will design and implement scalable big data solutions to support our business growth.">Responsibilities:">">Design and implement big data architectures using tools like Apache Hadoop, Spark, or NoSQL databases.">Collaborate with...

  • Big Data Developer

    4 weeks ago


    Pune, Maharashtra, India Corner Tree Consulting P Ltd Full time

    Job Title: Big Data DeveloperAbout Us: Corner Tree Consulting P Ltd is a leading consulting firm that provides innovative solutions to businesses.Job Description:We are seeking a skilled Big Data Developer to join our team. The ideal candidate will have 4-10 years of experience in big data technologies, including pySpark, Hadoop, and Hive.The successful...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Where U Elevate Full time

    Senior Big Data Engineer JobWe are seeking a seasoned Senior Big Data Engineer to join our team at Where U Elevate. This role requires someone who can design and implement robust data architecture, work with cross-functional teams, and ensure high-quality data products.Your Responsibilities:Design and implement scalable data architectureCollaborate with...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job Summary:We are looking for a highly skilled Big Data Engineer to join our team at LTIMindtree. The successful candidate will have extensive experience in designing and implementing large-scale data processing systems using Spark.Key Responsibilities:Design and implement data processing pipelines using SparkOptimize system performance and...


  • Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full time

    Big Data Technology Expert Job SummaryWe are seeking an experienced Big Data Technology Expert to join our team at Nagarro Software Pvt. Ltd. This role involves designing and developing big data solutions using various technologies.About the Role:Design and develop big data solutions using technologies like Apache Spark, Python, and PL/SQL/NoSQL/SQL.Work...


  • Pune, Maharashtra, India Digital Group Infotech Pvt Ltd Full time

    Job Overview: We are looking for a Senior Big Data Developer to work on designing and developing big data solutions using various technologies such as Spark, Hive, HDFS, and NoSQL databases. The ideal candidate should have 5-10 years of experience in solution design, development, and deployment of big data projects.Responsibilities include designing and...


  • Pune, Maharashtra, India Mig Staffing Full time

    About Mig StaffingWe are a leading staffing agency specializing in the placement of highly skilled professionals in various industries. Our team of experts works closely with clients to understand their unique needs and requirements.Job Title: Big Data Solutions ArchitectJob Summary:We are seeking an experienced Big Data Solutions Architect to join our team....

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India LTIMindtree Full time

    At LTIMindtree, we are looking for a skilled Big Data Engineer to join our team. This role involves designing and developing scalable data processing systems using Spark.The ideal candidate should have experience working with EMR EKS AWS and be familiar with OSS Delta Lake and Open Source Storage.A Strong understanding of Java Scala Python programming...


  • Pune, Maharashtra, India Synechron Full time

    Job Title: Senior Big Data EngineerEstimated Salary: ₹1,500,000 - ₹2,000,000 per annumAt Synechron, we are looking for a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of big data technologies and be able to design and implement scalable data solutions using AWS services.About the Role:We are...


  • Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full time

    Job Title: Senior Big Data EngineerWe are seeking an experienced Senior Big Data Engineer to join our team at Nagarro Software Pvt. Ltd. This role involves working with large datasets and designing scalable data architectures.About the Role:Design and develop big data solutions using technologies like Apache Spark, Python, and PL/SQL/NoSQL/SQL.Work with...


  • Pune, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to work on cutting-edge projects at Aexonic Technologies Pvt. Ltd.This individual will design and optimize Big Data pipelines with Hadoop, Hive, PySpark, and Google BigQuery, and architect scalable data solutions on Google Cloud Platform (GCP).Responsibilities:Design and...

  • Big Data Engineer

    2 days ago


    Pune, Maharashtra, India Wipro Full time

    Company OverviewWipro is a leading global information technology, consulting and business process services company.We help our clients adapt to the speed of change by providing insights that spark new ways of thinking and operating. Our collective expertise includes digital strategy consulting, customer centric design, data engineering, application...


  • Pune, Maharashtra, India Corner Tree Consulting P Ltd Full time

    Job Overview:We are seeking an experienced Senior ETL Developer to join our team at Corner Tree Consulting P Ltd. The successful candidate will have a strong background in Big Data technologies, including pySpark, Hadoop, and Hive.About the Role:The Senior ETL Developer will be responsible for designing and implementing data warehousing solutions using Big...

  • Big Data Engineer

    2 days ago


    Pune, Maharashtra, India Wipro Full time

    We are urgently looking for a skilled Big Data Engineer to join our team at Wipro in Pune and Gurgaon locations.Job DescriptionCreate efficient ETL jobs, data pipelines, and data quality pipelines that meet the required standards.Set up alerts for failures, errors, and warnings to ensure timely issue resolution.Maintain logging and management systems to...


  • Pune, Maharashtra, India Birlasoft Full time

    About Birlasoft: A Partner in Digital TransformationBirlasoft is a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and...


  • Pune, Maharashtra, India Recro Full time

    About the RoleAs a Senior Big Data Engineer at Recro, you will be responsible for designing and implementing large-scale data pipelines using distributed processing tools like Akka and Spark. Your expertise in Big Data ecosystems, including processing frameworks like Hadoop, Storm, and Spark, will enable you to drive technical excellence and ownership of...


  • Pune, Maharashtra, India PubMatic Full time

    About the Role:We are looking for a highly skilled Data Engineering Lead to lead our big data ecosystem efforts at PubMatic. As a key member of our engineering team, you will be responsible for designing, developing, and testing complex data systems and applications.Duties and Responsibilities:Big Data Ingestion and Processing: You will work on testing and...