Big data specialist

6 days ago


Delhi, India LTIMindtree Full time
Please fill this form for quick response:-
Please fill this: - if it is not opening you can paste it on google and fill it.
Experience Range - 5 to 12 yrs
Skills - Big Data- Pyspark
Job Location: Chennai, Pune, Noida
Spark PRIMARY SKILL
Deep expertise in Spark Job optimisations tuning
Debugging bottlenecks through Spark UI
Resource utilization of instances
Increasing throughput
Experience working with EMR EKS AWS
Understanding of OSS Delta Delta lake Open Source Storage General Spark job tuning involves optimizing configurations and parameters to enhance throughput and maximize resource utilization
Programming Java Scala Python SECONDARY SKILLAbility to work with APIs
Clean code with OOPs designs No DS algo required
Good to have
Familiarity with Spark Structured Streaming
Familiarity with Scala very rare
Familiarity with Python1 Changes in SSC Socrates Streams Connector Rewrite Update the spark job using AWS opensourced Kinesis connector to land delta tables in S3
What is SSC and how it is deployed currently

  • Delhi, Delhi, India Freelancer Recruiter Full time

    Job RequirementsWe are seeking an experienced Big Data Infrastructure Specialist to manage and maintain complex Big Data application stacks. The ideal candidate will have a deep understanding of HDFS, YARN, Spark, Hive, and HBase, as well as experience with infrastructure configurations, high availability, and resource allocation.Key Responsibilities:Design...

  • Senior Data Engineer

    2 weeks ago


    Delhi, Delhi, India PRONEXUS CONSULTING PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineer - Big Data Pipeline SpecialistAt Pronexus Consulting Private Limited, we are seeking an experienced and highly skilled Senior Data Engineer - Big Data Pipeline Specialist to join our team. This role will involve designing, developing, and implementing large-scale data pipelines using various technologies such as Spark,...

  • Cloud Data Engineer

    4 hours ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Job Role: Cloud Data Engineer - Big Data Solutions SpecialistAbout the Role: Tata Consultancy Services is seeking a skilled Cloud Data Engineer to join our team in Chennai. As a key member of our big data solutions team, you will be responsible for developing and deploying scalable big data pipelines on Google Cloud Platform (GCP).Responsibilities: Develop...


  • Delhi, Delhi, India Emperen Technologies Full time

    About the Role">We are seeking a highly skilled Big Data Quality Assurance Specialist to join our team at Emperen Technologies. This is an exciting opportunity for a motivated individual to work on cutting-edge projects and contribute to the development of high-quality data solutions.Key Responsibilities">The successful candidate will be responsible for...

  • Big data specialist

    6 days ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:-Please fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- Scala SparkJob Location: Bangalore, Chennai, Pune, Hyderabad, MumbaiScala Spark Job Description:Mainly Scala+Spark ex perience needed.5+ years of experienceExpertise in Data...

  • Big Data Specialist

    23 hours ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:- fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- Scala SparkJob Location: Bangalore, Chennai, Pune, Hyderabad, MumbaiScala Spark Job Description:- Mainly Scala+Spark experience needed.- 5+ years of experience- Expertise in Data Engineering....

  • Big Data Specialist

    6 days ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:-fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- Scala SparkJob Location: Bangalore, Chennai, Pune, Hyderabad, MumbaiScala Spark Job Description:Mainly Scala+Spark ex perience needed.5+ years of experienceExpertise in Data Engineering. Hands-on...

  • Big data specialist

    5 days ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:-AMCv4 D07Please fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- Scala SparkJob Location: Bangalore, Chennai, Pune, Hyderabad, MumbaiScala Spark Job Description:Mainly Scala+Spark ex perience needed.5+ years of experienceExpertise in Data...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India Max life insurance co ltd Full time

    **About the Role**Max Life Insurance Co Ltd is seeking an experienced Data Engineer - Cloud Big Data Specialist to join our team. This role requires a skilled professional who can design, implement, and maintain scalable data pipelines and infrastructure on AWS cloud platform.In this position, you will be responsible for architecting large-scale data...

  • Big Data Specialist

    10 hours ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:-Please fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- PysparkJob Location: Chennai, Pune, NoidaSpark PRIMARY SKILLDeep expertise in Spark Job optimisations tuningDebugging bottlenecks through Spark UIResource utilization of instancesIncreasing...

  • Big Data SME

    24 hours ago


    Delhi, India Tech Consulting Full time

    **Onsite Opportunity- In-Office**Mumbai, IndiaOur company is seeking to hire a top-level Big Data Developer to help support our Big Data technical consultants within our business. It is a very competitive employment market and we are doing everything we can to improve our technical consultants’ chances of succeeding on projects. We are looking for a senior...

  • Big Data Specialist

    8 hours ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:- fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- PysparkJob Location: Chennai, Pune, Noida- Spark PRIMARY SKILL- Deep expertise in Spark Job optimisations tuning- Debugging bottlenecks through Spark UI- Resource utilization of instances-...

  • Big Data Specialist

    6 days ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:-fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- PysparkJob Location: Chennai, Pune, NoidaSpark PRIMARY SKILLDeep expertise in Spark Job optimisations tuningDebugging bottlenecks through Spark UIResource utilization of instancesIncreasing...

  • Big Data Developer

    10 hours ago


    Delhi, India Impetus Full time

    Lead Software EngineerLocations- Indore, Noida, HyderabadJob DescriptionWe are looking for a Lead Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets.Roles & ResponsibilitiesKey Responsibilities- Architect Data Solutions: Design...

  • Big Data Engineer

    3 weeks ago


    delhi, India Pert Telecom Solutions Full time

    Job Description:We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for this...

  • Big Data Engineer

    3 weeks ago


    Delhi, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big Data Engineer

    3 weeks ago


    delhi, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Big data engineer

    3 weeks ago


    Delhi, India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in Py Spark, Python, My SQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...

  • Big data specialist

    5 days ago


    Delhi, India LTIMindtree Full time

    Please fill this form for quick response:-AMCv4 D07Please fill this: - if it is not opening you can paste it on google and fill it.Experience Range - 5 to 12 yrsSkills - Big Data- PysparkJob Location: Chennai, Pune, NoidaSpark PRIMARY SKILLDeep expertise in Spark Job optimisations tuningDebugging bottlenecks through Spark UIResource utilization of...

  • Big Data Engineer

    3 weeks ago


    Delhi, India Pert Telecom Solutions Full time

    Job Description:We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for this...