Big Data Lead

24 hours ago

Pune, Maharashtra, India DemandMatrix Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Company Description

At DemandMatrix, our vision is to disrupt the $100 billion sales and marketing intelligence industry by using domain knowledge, machine learning and AI. Fortune 100 companies like Microsoft, Google, Adobe, Amazon, IBM trust us to identify their next customer.

Job Description

What will you do?

  • To help us go to the next level we are looking to onboard a hands-on SME in leveraging big data tech to solve the most complex data issues. You will spend almost half of time with hands-on coding.
  • It involves large scale text data processing, event driven data pipelines, in-memory computations, optimization considering CPU core to network IO to disk IO.
  • You will be using cloud native services in AWS and GCP.

Who Are You? 

  • Solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.
  • Designed and built multiple big data modules and data pipelines to process large volume. 
  • Genuinely excited about technology and worked on projects from scratch. 

Must have:

  • 7+ years  of hands-on experience in Software Development with a focus on big data and large data pipelines.
  • Minimum 3 years of experience to build services and pipelines using Python.
  • Expertise with a variety of data processing systems, including streaming, event, and batch (Spark, Hadoop/MapReduce)
  • Understanding of at least one NoSQL stores like MongoDB, Elasticsearch, HBase
  • Understanding of how data models, sharding and data location strategies for distributed data stores in large scale high-throughput and high-availability environments and their effect in non-structured text data processing
  • Experience with running scalable & high available systems with AWS or GCP.

Good to have:

  • Experience with Docker / Kubernetes
  • Exposure with CI/CD
  • Knowledge of Crawling/Scraping
Additional Information
  • Entire Work From Home
  • Birthday Leave
  • Remote Work 

  • Big Data Lead

    2 weeks ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data

    7 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...

  • Big Data Developer Lead

    4 days ago

    Pune, Maharashtra, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Our is Client is a largest Top 5 Software giant in India, with over 11.3 USD billion dollars revenue, Global work force 2,40,000 employees, It delivers end-to-end technology, consulting, and business process services to clients across the globe, Presence: 60+ countries and Publicly traded company NSE & BSE (India), NYSE (USA).· Job Title: Big Data Developer...

  • Big Data Solution Architect

    2 weeks ago

    Pune, Maharashtra, India Emergys Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Work Location:PuneNotice Period:Immediate to 30 DaysExperience:8+ YearsMust Have Skills:Hadoop Ecosystem Expertise – Strong hands-on experience with core Hadoop components and related big data technologies.DevOps & Cloud (Preferably Azure) – Experience using DevOps tools and CI/CD processes on cloud platforms, with a preference for Microsoft...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Vodafone Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Design, develop, and maintain scalable data pipelines for processing structured and unstructured data. Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses. Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows. Ensure high performance and...

  • Big Data Specialist

    4 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Work Location:Pune(Work-from-Office)Notice Period:Immediate to 30 DaysExperience:8+ YearsMust Have Skills:Data Architecture & Design – Expertise in designing scalable and resilient data architectures for batch and streaming systems.Data Modeling & Integration – Strong ability to build efficient data models and integrate data from multiple sources.Big...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.Must Have Skills:- AWS, Spark & Scala.Experience Required: 3 to 6 YearsJob Locations: Pune, Hyderabad, Greater Noida Only.Send your CV to: For queries, contact via WhatsApp: Key Responsibilities:-• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale,...

  • Big Data Developer

    24 hours ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    This Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide an unprecedented visibility into the user experience. The Data Engineer will collaborate with other engineers and product managers to enhance WiFi AIOps models. This...