Big Data Engineer

1 week ago

Pune, Maharashtra, India Vodafone Full time

Design, develop, and maintain scalable data pipelines for processing structured and unstructured data. Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses. Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows. Ensure high performance and scalability through parallel processing, distributed computing, and caching strategies. Implement monitoring, alerting, and automated scaling mechanisms for big data systems. Maintain data quality and governance by applying validation, cleansing, and enrichment processes. Collaborate with data scientists, analysts, and engineers to align data solutions with business objectives. Document system architecture and processes, and provide training and support to stakeholders. Graduate or Postgraduate in Computer Science, Engineering, or a related technical field. Over 5 years of experience in building cloud-based data engineering solutions. Proficient in SQL and programming languages such as Python, Java, or Scala. Hands-on experience with big data technologies including Apache Hadoop, Spark, Flink, and Kafka. Familiar with cloud platforms such as AWS, GCP, or Azure. Experienced in streaming tools like Amazon Kinesis, Apache Kafka, Flink, or Pulsar. Strong understanding of distributed systems and database management principles. Excellent communication and collaboration skills with a proactive approach to problem-solving. Ability to work independently and manage multiple priorities in a fast-paced environment. Familiarity with ITIL practices and experience in large global organisations is desirable. If you are excited about this role but your experience does not align exactly with every aspect of the job description, you are encouraged to apply. You may be the right candidate for this or another opportunity, and the recruitment team will support you in exploring where your skills fit best.

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India airtel Full time

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Specialist

    2 days ago

    Pune, Maharashtra, India Emergys Full time

    Work Location:Pune(Work-from-Office)Notice Period:Immediate to 30 DaysExperience:8+ YearsMust Have Skills:Data Architecture & Design – Expertise in designing scalable and resilient data architectures for batch and streaming systems.Data Modeling & Integration – Strong ability to build efficient data models and integrate data from multiple sources.Big...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India Talent Worx Full time

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Senior Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India LTIMindtree Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job description:Mandate Skills: Scala, Spark, SQLResponsibility:Overall, more than 5 Yrs of experience in Big Data projects.Experience in Scala programming languagesExperience in Big Data technologies including Spark Scala and KafkaWho have a good understanding of data structures and algorithmsHas worked in Implementation projects building data pipelines...

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Analyst - Big Data, Analytics and ML

    2 days ago

    Pune, Maharashtra, India MRO Full time

    We are seeking a Big Data Developer (Internally known as Analyst - Big Data, Analytics and ML) with experience in Python, Java, Cloud-based data engineering, and modern Big Data ecosystems. The ideal candidate will have a background in building batch and real-time integration frameworks, optimizing large-scale distributed systems, and working with...

  • Lead Big Data Engineer Manager

    4 days ago

    Pune, Maharashtra, India CIRCANA Full time

    What will you be doing?As a part of this team, youll work alongside the brightest minds. As a Big Data Lead evaluate domain, financial and technical feasibility of solution ideas with help of all key stakeholders.Design, develop, and maintain highly scalable data processing applications.Job Responsibilities:Write efficient, reusable and well documented...

  • Big Data Specialist

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Emergys Full time

    Work Location: Pune (Work-from-Office)⏳ Notice Period: Immediate to 30 Days Experience: 8+ Years Must Have Skills:Data Architecture & Design – Expertise in designing scalable and resilient data architectures for batch and streaming systems.Data Modeling & Integration – Strong ability to build efficient data models and integrate data from multiple...