Big Data Lead

3 days ago


pune, India DemandMatrix Full time

Company Description At DemandMatrix, our vision is to disrupt the $100 billion sales and marketing intelligence industry by using domain knowledge, machine learning and AI. Fortune 100 companies like Microsoft, Google, Adobe, Amazon, IBM trust us to identify their next customer. Job Description What will you do?To help us go to the next level we are looking to onboard a hands-on SME in leveraging big data tech to solve the most complex data issues. You will spend almost half of time with hands-on coding.It involves large scale text data processing, event driven data pipelines, in-memory computations, optimization considering CPU core to network IO to disk IO.You will be using cloud native services in AWS and GCP.Who Are You? Solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.Designed and built multiple big data modules and data pipelines to process large volume. Genuinely excited about technology and worked on projects from scratch. Must have:7+ years  of hands-on experience in Software Development with a focus on big data and large data pipelines.Minimum 3 years of experience to build services and pipelines using Python.Expertise with a variety of data processing systems, including streaming, event, and batch (Spark, Hadoop/MapReduce)Understanding of at least one NoSQL stores like MongoDB, Elasticsearch, HBaseUnderstanding of how data models, sharding and data location strategies for distributed data stores in large scale high-throughput and high-availability environments and their effect in non-structured text data processingExperience with running scalable & high available systems with AWS or GCP.Good to have:Experience with Docker / KubernetesExposure with CI/CDKnowledge of Crawling/Scraping Additional InformationEntire Work From HomeBirthday LeaveRemote Work 


  • Big Data Lead

    3 days ago


    Pune, India Populace World Solutions Full time

    Designation: Big Data Lead Location: Pune Experience: 8-10 years Reports To Product Engineering Head Job Overview We are looking to hire a talented big data engineer to develop and manage our companys Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with...

  • Big Data Lead

    1 week ago


    Pune, Maharashtra, India Populace World Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Designation: Big Data LeadLocation: PuneExperience: 8-10 yearsReports To – Product Engineering HeadJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with...

  • Big Data Lead

    6 days ago


    Pune, Maharashtra, India Persistent Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...


  • Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Big Data Senior Developer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).  • Bachelor...


  • Pune, India Devlats Pvt Ltd Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features which would helpcustomers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization...

  • Big Data Lead

    1 week ago


    Pune, Maharashtra, India DemandMatrix Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description At DemandMatrix, our vision is to disrupt the $100 billion sales and marketing intelligence industry by using domain knowledge, machine learning and AI. Fortune 100 companies like Microsoft, Google, Adobe, Amazon, IBM trust us to identify their next customer. Job Description What will you do?To help us go to the next level we are looking...


  • Pune, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Big Data Developer

    2 weeks ago


    Pune, India airtel Full time

    Job profiles - Big Data Developer (Senior Manager)Experience - 7-10 yrsLocation - PuneJob DescriptionWe are seeking a highly skilled Lead Big Data Developer to architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building and leading...

  • Big Data Developer

    2 weeks ago


    Pune, India airtel Full time

    Job profiles - Big Data Developer (Senior Manager) Experience - 7-10 yrsLocation - PuneJob DescriptionWe are seeking a highly skilled Lead Big Data Developer to architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building and...

  • Big Data Developer

    2 weeks ago


    Pune, India airtel Full time

    Job profiles - Big Data Developer (Senior Manager) Experience - 7-10 yrsLocation - PuneJob DescriptionWe are seeking a highly skilled Lead Big Data Developer to architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building...