Senior Software Development Engineer for Big Data

2 days ago


Pune, Maharashtra, India PubMatic Full time

About the Role

We are seeking an experienced Senior Software Development Engineer to join our team in designing, developing, and testing complex engineering projects. The ideal candidate will have a strong background in software development, testing methodologies, and big data technologies.

Key Responsibilities

  • Develop automation frameworks using Python to automate big data workflows such as ingestion, aggregation, ETL processing, etc.
  • Test and debug issues within the big data ecosystem
  • Set up the Big Data platform and Hadoop ecosystem for testing
  • Define test strategies and write test plans for data platform enhancements and new features/services built on it
  • Work with the NOC team to implement operating procedures, service monitors, and alerts
  • Responsible for system & performance testing of the data platform and applications
  • Solve problems, establish plans, and provide technical consultation in the design, development, and test effort of complex engineering projects
  • Review product specifications and write test cases, develop test plans for assigned areas
  • Identify issues and technical interdependencies and suggest possible solutions

Qualifications and Skills

The successful candidate will possess:

  • Good hands-on experience with Unix/Linux
  • Good hands-on experience in writing Python codes
  • Understanding of QA methodologies

Preferred Qualifications and Skills

The ideal candidate will also have:

  • Experience in big data platform & data analytics testing
  • Knowledge on distributed systems and technologies like Hadoop and Spark

What We Offer

At PubMatic, we offer a competitive salary range of $140,000 - $170,000 per annum, commensurate with experience, plus additional benefits including health insurance, retirement plan, and generous paid time off.



  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...

  • Senior Data Engineer

    3 weeks ago


    Pune, Maharashtra, India TapTalent Full time

    TapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...


  • Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full time

    We are Nagarro, a Digital Product Engineering company that is scaling rapidly. We build products, services, and experiences that inspire and delight. Our dynamic work culture is non-hierarchical and global.As an Associate Principal Engineer, you will play a key role in our team's success. Your expertise in Snowflake, data science, and machine learning will...


  • Pune, Maharashtra, India Mig Staffing Full time

    We are seeking a highly skilled Senior Big Data Developer to design and implement robust Big Data solutions using Hadoop technologies. As a key member of our team, you will be responsible for developing and managing large-scale data processing systems, collaborating with cross-functional teams, and ensuring data quality and integrity.Key...


  • Pune, Maharashtra, India 12542 Citicorp Services India Private Limited Full time

    Key Responsibilities:As a Senior Big Data Developer at 12542 Citicorp Services India Private Limited, you will be responsible for developing and implementing large-scale data processing systems, ensuring high performance, scalability, and reliability.Requirements:6+ years of experience in programming with SQL, Java, Python, J2EE, Unix/Linux shell, and...


  • Pune, Maharashtra, India MSA Software Full time

    About MSA SoftwareMSA Software is a leading provider of innovative software solutions, delivering high-quality products to meet the evolving needs of our clients.Salary and BenefitsWe offer an attractive salary package that reflects your experience and skills. Based on industry standards and the requirements outlined below, we estimate an annual salary of...


  • Pune, Maharashtra, India Mig Staffing Full time

    Job Title: Big Data Solutions DeveloperJob Description:Mig Staffing is seeking a Big Data Solutions Developer to design, implement, and manage our company's big data solutions. Key responsibilities include developing Hadoop systems, loading disparate data sets, conducting pre-processing services, and collaborating with software research and development...


  • Pune, Maharashtra, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture.As a Senior Big Data Solutions Architect, you will play a crucial role in designing and implementing Big Data solutions for our...

  • Data Engineer Leader

    1 month ago


    Pune, Maharashtra, India DATAECONOMY Full time

    About the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...


  • Pune, Maharashtra, India Capgemini Full time

    Job SummaryWe are seeking a Senior Big Data Developer Lead to join our team at Capgemini.About the RoleThe ideal candidate will have hands-on experience with Scala and object-oriented programming concepts, as well as distributed frameworks like Spark. They should be proficient in Spark RDD, Spark Dataframe, Spark Core, and Spark Streaming.A strong...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    We are seeking an experienced Senior Data Engineer to work on our Big Data projects. The ideal candidate will have good work experience on platforms like Hadoop, Spark, Scala, Hive, Impala, and SQL.A successful candidate will have hands-on experience working on Data Engineering projects and a good understanding of SQL concepts.The role requires strong...


  • Pune, Maharashtra, India DATAECONOMY Full time

    Job OverviewWe are seeking a highly skilled Senior Python & PySpark Developer to join our team. The ideal candidate will have extensive experience with Python development, PySpark, and working with large datasets in distributed computing environments.Key Responsibilities:Develop, maintain, and optimize scalable data processing pipelines using Python and...


  • Pune, Maharashtra, India Absolutdata Full time

    About the RoleWe are looking for a talented Senior Big Data Architect to join our team at Absolutdata. In this role, you will be responsible for designing and implementing big data infrastructure, working closely with the operations and analytics teams to understand data landscaping requirements and build the systems, processes, and teams required.Key...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Senior Data Pipeline Engineer to join our team in Pune, Hyderabad, Bangalore, Chennai, Noida or Nagpur. The ideal candidate will have 5-10 years of experience in designing and building production data pipelines using Cloud Native GCP, Python, SQL and other relevant technologies.Key ResponsibilitiesDesign and...


  • Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...


  • Pune, Maharashtra, India Synechron Full time

    Job Overview Synechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. We are seeking an experienced Senior Big Data Developer to join our team in Pune, India.About the Role As a Senior Big Data Developer, you will be responsible for designing and developing data-driven solutions...


  • Pune, Maharashtra, India Atyeti Inc Full time

    About Atyeti Inc">Ayetti Inc is a leading company in the field of big data and cloud migration, with a strong focus on innovation and excellence.">Job Overview">We are currently seeking a highly skilled Senior Java Developer to join our team in Pune/Hyderabad/Chennai/Bangalore/ Trivandrum. The successful candidate will be responsible for leading the...


  • Pune, Maharashtra, India Talentmatics Full time

    Company Overview:Talentmatics is a leading provider of innovative solutions for the digital age. We are committed to delivering exceptional services and fostering a culture of excellence.Job Summary:We are seeking an experienced Senior Big Data Administrator to join our team in Pune or Hyderabad. This role will be responsible for administering our Big Data...


  • Pune, Maharashtra, India Consulting Pandits Full time

    About Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...