Big Data SDET
3 weeks ago
We are seeking a highly skilled Big Data Software Development Engineer in Test to join our team at PubMatic.
Job DescriptionThis is a critical role that involves testing and ensuring the quality of our big data platform. The successful candidate will have experience working with big data technologies like Hadoop and Spark, and will be responsible for developing automation frameworks using Python.
The ideal candidate will have strong programming skills, particularly in Python, and good debugging skills. They will also have experience working in Linux/Unix environments and knowledge of relational databases and SQL.
Some of the key responsibilities of this role include testing big data ingestion and aggregation flows, developing automation frameworks, debugging and troubleshooting issues, and setting up the big data platform and Hadoop ecosystem for testing.
As a member of our team, you will work closely with our NOC team to implement operating procedures, service monitors, and alerts. You will also be responsible for system and performance testing of the data platform and applications.
Requirements- 1-3 years of experience working as an SDET and doing meaningful automation
- Good programming skills, particularly in Python
- Hands-on experience in automating backend applications (e.g., database, REST API's)
- Knowledge of relational databases and SQL
- Good debugging skills
- Working experience working in Linux/Unix environment
- Good understanding of testing methodologies
- Good hands-on experience with Unix/Linux
- Good hands-on experience in writing Python codes
- QA Methodologies understanding
The estimated salary range for this role is $120,000 - $180,000 per year, depending on experience.
-
Big Data Architect
4 weeks ago
Pune, Maharashtra, India Fincrif Full timeFinCrif's Big Data Architect Position:We are seeking a highly skilled Big Data Architect to join our Research & Insights team. As a key member of our team, you will design and implement big data solutions to drive business growth.Key Responsibilities:Design and implement big data solutions using industry-standard toolsCollaborate with cross-functional teams...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeLTIMindtree is a leading global technology consulting and services company. We are seeking an experienced Big Data Developer to join our team.We offer a competitive salary of $120,000 per annum, commensurate with experience.About the RoleThis role involves designing and developing big data platforms using Scala and Spark technologies. The ideal candidate...
-
Big Data Professional
4 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Professional to join our team at LTIMindtree. As a key member of our analytics group, you will be responsible for designing and implementing data-driven solutions using big data technologies.The ideal candidate will have a strong background in big data processing with Spark, including experience with PySpark and EMR...
-
Big Data Architect
1 month ago
Pune, Maharashtra, India HiLabs Full timeAbout the Job: We are seeking a highly experienced Big Data Architect to join our team at HiLabs. The successful candidate will design and implement scalable big data solutions to support our business growth.">Responsibilities:">">Design and implement big data architectures using tools like Apache Hadoop, Spark, or NoSQL databases.">Collaborate with...
-
Big Data Developer
4 weeks ago
Pune, Maharashtra, India Corner Tree Consulting P Ltd Full timeJob Title: Big Data DeveloperAbout Us: Corner Tree Consulting P Ltd is a leading consulting firm that provides innovative solutions to businesses.Job Description:We are seeking a skilled Big Data Developer to join our team. The ideal candidate will have 4-10 years of experience in big data technologies, including pySpark, Hadoop, and Hive.The successful...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Where U Elevate Full timeSenior Big Data Engineer JobWe are seeking a seasoned Senior Big Data Engineer to join our team at Where U Elevate. This role requires someone who can design and implement robust data architecture, work with cross-functional teams, and ensure high-quality data products.Your Responsibilities:Design and implement scalable data architectureCollaborate with...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeJob Summary:We are looking for a highly skilled Big Data Engineer to join our team at LTIMindtree. The successful candidate will have extensive experience in designing and implementing large-scale data processing systems using Spark.Key Responsibilities:Design and implement data processing pipelines using SparkOptimize system performance and...
-
Big Data Technology Expert
4 weeks ago
Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full timeBig Data Technology Expert Job SummaryWe are seeking an experienced Big Data Technology Expert to join our team at Nagarro Software Pvt. Ltd. This role involves designing and developing big data solutions using various technologies.About the Role:Design and develop big data solutions using technologies like Apache Spark, Python, and PL/SQL/NoSQL/SQL.Work...
-
Senior Big Data Developer
1 month ago
Pune, Maharashtra, India Digital Group Infotech Pvt Ltd Full timeJob Overview: We are looking for a Senior Big Data Developer to work on designing and developing big data solutions using various technologies such as Spark, Hive, HDFS, and NoSQL databases. The ideal candidate should have 5-10 years of experience in solution design, development, and deployment of big data projects.Responsibilities include designing and...
-
Big Data Solutions Architect
1 month ago
Pune, Maharashtra, India Mig Staffing Full timeAbout Mig StaffingWe are a leading staffing agency specializing in the placement of highly skilled professionals in various industries. Our team of experts works closely with clients to understand their unique needs and requirements.Job Title: Big Data Solutions ArchitectJob Summary:We are seeking an experienced Big Data Solutions Architect to join our team....
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeAt LTIMindtree, we are looking for a skilled Big Data Engineer to join our team. This role involves designing and developing scalable data processing systems using Spark.The ideal candidate should have experience working with EMR EKS AWS and be familiar with OSS Delta Lake and Open Source Storage.A Strong understanding of Java Scala Python programming...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Synechron Full timeJob Title: Senior Big Data EngineerEstimated Salary: ₹1,500,000 - ₹2,000,000 per annumAt Synechron, we are looking for a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of big data technologies and be able to design and implement scalable data solutions using AWS services.About the Role:We are...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Nagarro Software Pvt. Ltd Full timeJob Title: Senior Big Data EngineerWe are seeking an experienced Senior Big Data Engineer to join our team at Nagarro Software Pvt. Ltd. This role involves working with large datasets and designing scalable data architectures.About the Role:Design and develop big data solutions using technologies like Apache Spark, Python, and PL/SQL/NoSQL/SQL.Work with...
-
Big Data Engineering Lead
4 weeks ago
Pune, Maharashtra, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timeSenior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to work on cutting-edge projects at Aexonic Technologies Pvt. Ltd.This individual will design and optimize Big Data pipelines with Hadoop, Hive, PySpark, and Google BigQuery, and architect scalable data solutions on Google Cloud Platform (GCP).Responsibilities:Design and...
-
Big Data Engineer
2 days ago
Pune, Maharashtra, India Wipro Full timeCompany OverviewWipro is a leading global information technology, consulting and business process services company.We help our clients adapt to the speed of change by providing insights that spark new ways of thinking and operating. Our collective expertise includes digital strategy consulting, customer centric design, data engineering, application...
-
Big Data Solutions Architect
4 weeks ago
Pune, Maharashtra, India Corner Tree Consulting P Ltd Full timeJob Overview:We are seeking an experienced Senior ETL Developer to join our team at Corner Tree Consulting P Ltd. The successful candidate will have a strong background in Big Data technologies, including pySpark, Hadoop, and Hive.About the Role:The Senior ETL Developer will be responsible for designing and implementing data warehousing solutions using Big...
-
Big Data Engineer
2 days ago
Pune, Maharashtra, India Wipro Full timeWe are urgently looking for a skilled Big Data Engineer to join our team at Wipro in Pune and Gurgaon locations.Job DescriptionCreate efficient ETL jobs, data pipelines, and data quality pipelines that meet the required standards.Set up alerts for failures, errors, and warnings to ensure timely issue resolution.Maintain logging and management systems to...
-
Data Engineer for Big Data Solutions
2 weeks ago
Pune, Maharashtra, India Birlasoft Full timeAbout Birlasoft: A Partner in Digital TransformationBirlasoft is a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and...
-
Senior Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Recro Full timeAbout the RoleAs a Senior Big Data Engineer at Recro, you will be responsible for designing and implementing large-scale data pipelines using distributed processing tools like Akka and Spark. Your expertise in Big Data ecosystems, including processing frameworks like Hadoop, Storm, and Spark, will enable you to drive technical excellence and ownership of...
-
Data Engineering Lead
3 days ago
Pune, Maharashtra, India PubMatic Full timeAbout the Role:We are looking for a highly skilled Data Engineering Lead to lead our big data ecosystem efforts at PubMatic. As a key member of our engineering team, you will be responsible for designing, developing, and testing complex data systems and applications.Duties and Responsibilities:Big Data Ingestion and Processing: You will work on testing and...