Senior Software Development Engineer for Big Data
2 days ago
About the Role
We are seeking an experienced Senior Software Development Engineer to join our team in designing, developing, and testing complex engineering projects. The ideal candidate will have a strong background in software development, testing methodologies, and big data technologies.
Key Responsibilities
- Develop automation frameworks using Python to automate big data workflows such as ingestion, aggregation, ETL processing, etc.
- Test and debug issues within the big data ecosystem
- Set up the Big Data platform and Hadoop ecosystem for testing
- Define test strategies and write test plans for data platform enhancements and new features/services built on it
- Work with the NOC team to implement operating procedures, service monitors, and alerts
- Responsible for system & performance testing of the data platform and applications
- Solve problems, establish plans, and provide technical consultation in the design, development, and test effort of complex engineering projects
- Review product specifications and write test cases, develop test plans for assigned areas
- Identify issues and technical interdependencies and suggest possible solutions
Qualifications and Skills
The successful candidate will possess:
- Good hands-on experience with Unix/Linux
- Good hands-on experience in writing Python codes
- Understanding of QA methodologies
Preferred Qualifications and Skills
The ideal candidate will also have:
- Experience in big data platform & data analytics testing
- Knowledge on distributed systems and technologies like Hadoop and Spark
What We Offer
At PubMatic, we offer a competitive salary range of $140,000 - $170,000 per annum, commensurate with experience, plus additional benefits including health insurance, retirement plan, and generous paid time off.
-
Senior Big Data Developer
3 weeks ago
Pune, Maharashtra, India NTT DATA Full timeCompany OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...
-
Senior Data Engineer
3 weeks ago
Pune, Maharashtra, India TapTalent Full timeTapTalent is a leading player in the job market, and we're looking for a seasoned Data Engineer to join our team. As a senior member of our engineering team, you will play a crucial role in designing and developing our big data platform.We're looking for someone with at least 4 years of experience in working with Scala Spark. If you have expertise in data...
-
Nagarro Software Engineer
3 weeks ago
Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full timeWe are Nagarro, a Digital Product Engineering company that is scaling rapidly. We build products, services, and experiences that inspire and delight. Our dynamic work culture is non-hierarchical and global.As an Associate Principal Engineer, you will play a key role in our team's success. Your expertise in Snowflake, data science, and machine learning will...
-
Senior Big Data Developer
4 weeks ago
Pune, Maharashtra, India Mig Staffing Full timeWe are seeking a highly skilled Senior Big Data Developer to design and implement robust Big Data solutions using Hadoop technologies. As a key member of our team, you will be responsible for developing and managing large-scale data processing systems, collaborating with cross-functional teams, and ensuring data quality and integrity.Key...
-
Senior Big Data Developer
4 weeks ago
Pune, Maharashtra, India 12542 Citicorp Services India Private Limited Full timeKey Responsibilities:As a Senior Big Data Developer at 12542 Citicorp Services India Private Limited, you will be responsible for developing and implementing large-scale data processing systems, ensuring high performance, scalability, and reliability.Requirements:6+ years of experience in programming with SQL, Java, Python, J2EE, Unix/Linux shell, and...
-
Data Engineering Specialist
1 week ago
Pune, Maharashtra, India MSA Software Full timeAbout MSA SoftwareMSA Software is a leading provider of innovative software solutions, delivering high-quality products to meet the evolving needs of our clients.Salary and BenefitsWe offer an attractive salary package that reflects your experience and skills. Based on industry standards and the requirements outlined below, we estimate an annual salary of...
-
Big Data Solutions Developer
2 weeks ago
Pune, Maharashtra, India Mig Staffing Full timeJob Title: Big Data Solutions DeveloperJob Description:Mig Staffing is seeking a Big Data Solutions Developer to design, implement, and manage our company's big data solutions. Key responsibilities include developing Hadoop systems, loading disparate data sets, conducting pre-processing services, and collaborating with software research and development...
-
Senior Big Data Solutions Architect
4 weeks ago
Pune, Maharashtra, India Epam Full timeEPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture.As a Senior Big Data Solutions Architect, you will play a crucial role in designing and implementing Big Data solutions for our...
-
Data Engineer Leader
1 month ago
Pune, Maharashtra, India DATAECONOMY Full timeAbout the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...
-
Senior Big Data Developer Lead
3 weeks ago
Pune, Maharashtra, India Capgemini Full timeJob SummaryWe are seeking a Senior Big Data Developer Lead to join our team at Capgemini.About the RoleThe ideal candidate will have hands-on experience with Scala and object-oriented programming concepts, as well as distributed frameworks like Spark. They should be proficient in Spark RDD, Spark Dataframe, Spark Core, and Spark Streaming.A strong...
-
Senior Data Engineer for Big Data Platforms
3 weeks ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWe are seeking an experienced Senior Data Engineer to work on our Big Data projects. The ideal candidate will have good work experience on platforms like Hadoop, Spark, Scala, Hive, Impala, and SQL.A successful candidate will have hands-on experience working on Data Engineering projects and a good understanding of SQL concepts.The role requires strong...
-
Senior Big Data Developer
3 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob OverviewWe are seeking a highly skilled Senior Python & PySpark Developer to join our team. The ideal candidate will have extensive experience with Python development, PySpark, and working with large datasets in distributed computing environments.Key Responsibilities:Develop, maintain, and optimize scalable data processing pipelines using Python and...
-
Senior Big Data Architect
1 month ago
Pune, Maharashtra, India Absolutdata Full timeAbout the RoleWe are looking for a talented Senior Big Data Architect to join our team at Absolutdata. In this role, you will be responsible for designing and implementing big data infrastructure, working closely with the operations and analytics teams to understand data landscaping requirements and build the systems, processes, and teams required.Key...
-
Senior Data Pipeline Engineer
2 days ago
Pune, Maharashtra, India Tata Consultancy Services Full timeAbout the RoleWe are seeking a highly skilled Senior Data Pipeline Engineer to join our team in Pune, Hyderabad, Bangalore, Chennai, Noida or Nagpur. The ideal candidate will have 5-10 years of experience in designing and building production data pipelines using Cloud Native GCP, Python, SQL and other relevant technologies.Key ResponsibilitiesDesign and...
-
Big Data Engineering Specialist
2 days ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...
-
Senior Big Data Developer
4 weeks ago
Pune, Maharashtra, India Synechron Full timeJob Overview Synechron is a global consulting firm that combines creativity and innovative technology to deliver industry-leading digital solutions. We are seeking an experienced Senior Big Data Developer to join our team in Pune, India.About the Role As a Senior Big Data Developer, you will be responsible for designing and developing data-driven solutions...
-
Senior Java Developer for Big Data Project
1 week ago
Pune, Maharashtra, India Atyeti Inc Full timeAbout Atyeti Inc">Ayetti Inc is a leading company in the field of big data and cloud migration, with a strong focus on innovation and excellence.">Job Overview">We are currently seeking a highly skilled Senior Java Developer to join our team in Pune/Hyderabad/Chennai/Bangalore/ Trivandrum. The successful candidate will be responsible for leading the...
-
Senior Big Data Administrator
1 week ago
Pune, Maharashtra, India Talentmatics Full timeCompany Overview:Talentmatics is a leading provider of innovative solutions for the digital age. We are committed to delivering exceptional services and fostering a culture of excellence.Job Summary:We are seeking an experienced Senior Big Data Administrator to join our team in Pune or Hyderabad. This role will be responsible for administering our Big Data...
-
Big Data Engineer Specialist
1 week ago
Pune, Maharashtra, India Consulting Pandits Full timeAbout Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...
-
Principal Data Architect
3 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...