Big Data Specialist
4 weeks ago
Please fill this form for quick response:-
Please fill this: - if it is not opening you can paste it on google and fill it.
Experience Range - 5 to 12 yrs
Skills - Big Data- Pyspark
Job Location: Chennai, Pune, Noida
- Spark PRIMARY SKILL
- Deep expertise in Spark Job optimisations tuning
- Debugging bottlenecks through Spark UI
- Resource utilization of instances
- Increasing throughput
- Experience working with EMR EKS AWS
- Understanding of OSS DeltaDelta lakeOpen Source StorageGeneral Spark job tuning involves optimizing configurations and parameters to enhance throughput and maximize resource utilization
- Programming Java Scala Python SECONDARY SKILLAbility to work with APIs
- Clean code with OOPs designs No DS algo required
- Good to have
- Familiarity with Spark Structured Streaming
- Familiarity with Scala very rare
- Familiarity with Python1Changes in SSC Socrates Streams Connector RewriteUpdate the spark job using AWS opensourced Kinesis connector to land delta tables in S3
- What is SSC and how it is deployed currently
-
Pune, India Big Infrastructures and Projects Full timeCompany DescriptionBIG INTERIORS is an Architectural and Interior Design Firm based at Coimbatore and Chennai. We have delivered a number of Creative Interior Solution, both residential and Commercial starting from concept to handover.We are a multicultural team of Passionate individuals dedicated to delivering one of a kind projects. This is always...
-
Big Data Platform Specialist
4 weeks ago
Pune, Maharashtra, India Talentmatics Full timeTalentmatics is seeking an experienced Big Data Platform Specialist to join our team in Pune or Hyderabad.Estimated Salary: ₹2,500,000 - ₹4,200,000 per annum.Job Description:We are looking for a skilled Hadoop administrator with 5-8 years of work experience to manage our Big Data platform and allied toolset. The ideal candidate should have strong...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Capco Technologies Pvt Ltd Full timeJob Title:Big Data Engineer - ETL SpecialistAbout Us:We are Capco Technologies Pvt Ltd, a leading technology firm.Salary:$120,000 - $180,000 per yearJob Description:As a Big Data Engineer - ETL Specialist, you will design, develop, and deploy data pipelines and ETL/ELT processes using AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS EMR, AWS Kinesis,...
-
Big Data Infrastructure Specialist
4 weeks ago
Pune, Maharashtra, India Talentmatics Full timeTalentmatics is seeking an experienced Big Data Infrastructure Specialist to join our team in Pune and Hyderabad locations. This role offers a competitive salary of approximately ₹2,500,000 per annum.Job Description:We are looking for a skilled professional with 5-8 years of experience in administering big data platforms and allied toolsets. The ideal...
-
Big Data Engineering Specialist
4 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...
-
Big Data Specialist
4 months ago
Pune, India Deloitte Full timeWe are looking for Candidates who are having experience in Big Data.Experience Required: 3+ years.Location: PAN IndiaResponsibilities:Design, develop and deploy solutions using different tools, design principles and conventions.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement...
-
Big Data Optimization Expert
4 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeLTIMindtree is seeking a highly skilled Big Data Optimization Expert to join their team.Job Summary:We are looking for an experienced Big Data Specialist with expertise in Spark job optimizations, tuning, and resource utilization. The ideal candidate will have a strong understanding of OSS Delta Lake and Open Source Storage.About the Role:The successful...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India Talent Pro Full timeTalent Pro is seeking a highly skilled Big Data Engineer - Distributed Architecture Specialist to join our team. As a key member of our data engineering group, you will play a crucial role in designing and implementing scalable distributed architectures using Apache Spark.The estimated salary for this position is $120,000 per year, based on industry...
-
Big Data Architect
2 weeks ago
Pune, Maharashtra, India Fincrif Full timeFinCrif's Big Data Architect Position:We are seeking a highly skilled Big Data Architect to join our Research & Insights team. As a key member of our team, you will design and implement big data solutions to drive business growth.Key Responsibilities:Design and implement big data solutions using industry-standard toolsCollaborate with cross-functional teams...
-
Big Data
7 months ago
Pune, India Virtusa Full time**Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...
-
Big data specialist
2 weeks ago
Pune, India LTIMindtree Full timePlease fill this form for quick response:- Please fill this: - if it is not opening you can paste it on google and fill it. Experience Range - 5 to 12 yrs Skills - Big Data- Pyspark Job Location: Chennai, Pune, Noida Spark PRIMARY SKILL Deep expertise in Spark Job optimisations tuning Debugging bottlenecks through Spark UI Resource...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeLTIMindtree is a leading global technology consulting and services company. We are seeking an experienced Big Data Developer to join our team.We offer a competitive salary of $120,000 per annum, commensurate with experience.About the RoleThis role involves designing and developing big data platforms using Scala and Spark technologies. The ideal candidate...
-
Big Data Professional
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking a highly skilled Big Data Professional to join our team at LTIMindtree. As a key member of our analytics group, you will be responsible for designing and implementing data-driven solutions using big data technologies.The ideal candidate will have a strong background in big data processing with Spark, including experience with PySpark and EMR...
-
Big Data Architect
3 weeks ago
Pune, Maharashtra, India HiLabs Full timeAbout the Job: We are seeking a highly experienced Big Data Architect to join our team at HiLabs. The successful candidate will design and implement scalable big data solutions to support our business growth.">Responsibilities:">">Design and implement big data architectures using tools like Apache Hadoop, Spark, or NoSQL databases.">Collaborate with...
-
Pune, Maharashtra, India LTIMindtree Full timeAbout the Role">We are seeking a highly skilled Big Data Specialist to join our team at LTIMindtree. As a Big Data Expert, you will be responsible for driving business growth through data insights and optimization of big data processing.">Key Responsibilities">">Design and implement efficient big data processing pipelines using Spark and AWS EMR">Develop...
-
Big Data Expert for Advanced Analytics
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeWe are seeking an experienced Big Data Specialist to join our team at LTIMindtree in Chennai, Pune, or Noida. The successful candidate will have a strong background in working with big data and proficiency in PySpark.The ideal candidate should have at least 5 years of experience in handling large datasets and expertise in optimizing Spark jobs. Knowledge of...
-
Big Data Developer
2 weeks ago
Pune, Maharashtra, India Corner Tree Consulting P Ltd Full timeJob Title: Big Data DeveloperAbout Us: Corner Tree Consulting P Ltd is a leading consulting firm that provides innovative solutions to businesses.Job Description:We are seeking a skilled Big Data Developer to join our team. The ideal candidate will have 4-10 years of experience in big data technologies, including pySpark, Hadoop, and Hive.The successful...
-
Big data developer
4 weeks ago
Pune, India Recro Full timeTo be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...
-
Big Data Engineer
3 weeks ago
Pune, Maharashtra, India Where U Elevate Full timeSenior Big Data Engineer JobWe are seeking a seasoned Senior Big Data Engineer to join our team at Where U Elevate. This role requires someone who can design and implement robust data architecture, work with cross-functional teams, and ensure high-quality data products.Your Responsibilities:Design and implement scalable data architectureCollaborate with...
-
Big Data Developer
4 weeks ago
Pune, India Recro Full timeTo be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...