Big Data Developer

1 day ago

Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Job Title:
Big Data Developer (Manager)

Location: Pune

Experience: 3-5 years

Job Description:

Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.

Key Responsibilities:

  • Design, develop, and maintain big data solutions using Java and Apache Spark.
  • Develop and manage APIs for data ingestion, processing, and extraction.
  • Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions.
  • Optimize and tune big data workflows for performance and scalability.
  • Implement data engineering best practices to ensure data quality, integrity, and security.
  • Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed.
  • Troubleshoot and resolve issues related to data processing and workflows.
  • Stay updated with the latest trends and advancements in big data technologies and tools.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 4-8 years of experience in big data development and data engineering.
  • Proficiency in Java and experience with Apache Spark.
  • Experience in API development and integration.
  • Strong understanding of data engineering principles and big data concepts.
  • Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka.
  • Experience with SQL and NoSQL databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Experience with cloud platforms such as, Spark, Data/Delta lakes, Modern Data stack.
  • Knowledge of containerization technologies like Docker and Kubernetes.
  • Experience with continuous integration and continuous deployment (CI/CD) pipelines.
  • Familiarity with machine learning frameworks and libraries.

Benefits:

  • Competitive salary and benefits package.
  • Opportunity to work with cutting-edge technologies in a dynamic and collaborative environment.
  • Professional growth and development opportunities.

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Senior Big Data Developer

    6 days ago

    Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per year

    We are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes

  • Big Data Lead

    3 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Architect

    1 day ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...

  • Big Data Developer

    6 days ago

    Pune, Maharashtra, India Impetus Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionYear of Experience - 1 to 3 yearsLocation - Indore, Pune, Noida, Hyderabad, Bangalore, GurugramRequired Skills:Python Programming: Strong ability to write clean and efficient code.Spark SQL: Good understanding of Spark SQL for distributed data processing.Data Processing: Experience with large datasets and structured data manipulation.SQL...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Greetings from TCS!Skill: Big DataYears of Experience: 6 - 8 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...