Big Data Specialist

3 days ago


New Delhi, India Atomic North Full time

Big Data EngineerLocation: Pune/Nagpur (WFO)Experience Required: 8+ Years**Long term onsite to Abu Dhabi**Job Summary:- We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. - The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability.Key Responsibilities:• Design, develop, and maintain data pipelines using PySpark and related Big Data technologies.• Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem.• Write efficient HiveQL and SQL queries to handle large-scale datasets.• Perform performance tuning and optimization of distributed data systems.• Collaborate with cross-functional teams in an Agile environment to deliver high-quality solutions. • Manage and schedule workflows using Apache Airflow or Oozie.• Troubleshoot and resolve issues in data pipelines to ensure reliability and accuracy.Required Skills:• Proven experience in Big Data Engineering with a focus on PySpark.• Strong knowledge of HDFS, Hive, Sqoop, and related tools.• Proficiency in SQL/HiveQL for large datasets.• Expertise in performance tuning and optimization of distributed systems.• Familiarity with Agile methodology and collaborative team practices.• Experience with workflow orchestration tools (Airflow/Oozie).• Strong problem-solving, analytical, and communication skills.Good to Have:• Knowledge of data modeling and data warehousing concepts.• Exposure to DevOps practices and CI/CD pipelines for data engineering.• Experience with other Big Data frameworks such as Spark Streaming or Kafka.


  • Big Data Developer

    2 weeks ago


    New Delhi, India airtel Full time

    Job Title:Big Data Developer (Manager) Location: PuneExperience: 3-5 yearsJob Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Developer

    5 days ago


    New Delhi, India airtel Full time

    Job profiles- Big Data Developer (Senior Manager)Experience- 7-10 yrs Location- PuneJob DescriptionWe are seeking a highly skilledLead Big Data Developerto architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building and leading...

  • Big Data Developer

    2 weeks ago


    New Delhi, India Kresta Softech Private Limited Full time

    Role Highlights:Position: Big Data Engineer Experience:5+ years Location:Hyderabad - Hybrid Notice Period:Immediate/7 days joiners mandateJob Overview:Must have skills- Big Data, Scala, AWS and Python

  • Big Data Developer

    7 days ago


    New Delhi, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity to join a...

  • Big Data Engineer

    1 day ago


    New Delhi, India People Prime Worldwide Full time

    About the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Position: Data...

  • Big Data Developer

    3 days ago


    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS is currently hiring for the position of Big Data Developer.- **Role:** Big Data Developer- **Desired Experience Range:** 5-10 years- **Location:** BangaloreJob descriptionMust Have- 2-4 in development projects involving below technologies - Strong knowledge in Core Java - - Strong knowledge on Python, Hive, HDFS, Scala, Impala, Yarn,...

  • Big Data Developer

    7 days ago


    New Delhi, India IntraEdge Full time

    Role: Big Data + GCP Engineer.Location: Bengaluru, KA (Hybrid)Type: FulltimeWe are looking for energetic, high-performing and highly skilled Big Data + GCP Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global...

  • Big Data

    2 weeks ago


    New Delhi, India Tata Consultancy Services Full time

    Greetings from TATA CONSULTANCY SERVICES!WALK-IN-DRIVE "Big Data"Interview Date: 8th November 2025Years of Experience: 5 - 10 yearsLocation: ChennaiJob Description:-- Hands on experience in installation, configuration, supporting and managing Hadoop clusters using Hortonworks distribution - Hands on experience on clusters migration /Azure Cloud - Upgrading...


  • New Delhi, India Andor Tech Full time

    Andor Tech is looking for a highly skilled Senior Big Data Engineer with 8–15 years of experience to join our dynamic team. If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!Location: Deployment to a Product-Based Retail MNCImmediate Joiners PreferredKey Skills Required:- Strong expertise in...


  • New Delhi, India Andor Tech Full time

    Andor Techis looking for a highly skilledSenior Big Data Engineerwith8–15 years of experienceto join our dynamic team. If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!Location : Deployment to a Product-Based Retail MNC Immediate Joiners PreferredKey Skills Required : Strong expertise...