Big Data Developer

5 hours ago

Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Job Title:
Big Data Developer (Manager)

Location: Pune

Experience: 3-5 years

Job Description:

Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.

Key Responsibilities:

  • Design, develop, and maintain big data solutions using Java and Apache Spark.
  • Develop and manage APIs for data ingestion, processing, and extraction.
  • Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions.
  • Optimize and tune big data workflows for performance and scalability.
  • Implement data engineering best practices to ensure data quality, integrity, and security.
  • Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed.
  • Troubleshoot and resolve issues related to data processing and workflows.
  • Stay updated with the latest trends and advancements in big data technologies and tools.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 4-8 years of experience in big data development and data engineering.
  • Proficiency in Java and experience with Apache Spark.
  • Experience in API development and integration.
  • Strong understanding of data engineering principles and big data concepts.
  • Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka.
  • Experience with SQL and NoSQL databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Preferred Qualifications:

  • Experience with cloud platforms such as, Spark, Data/Delta lakes, Modern Data stack.
  • Knowledge of containerization technologies like Docker and Kubernetes.
  • Experience with continuous integration and continuous deployment (CI/CD) pipelines.
  • Familiarity with machine learning frameworks and libraries.

Benefits:

  • Competitive salary and benefits package.
  • Opportunity to work with cutting-edge technologies in a dynamic and collaborative environment.
  • Professional growth and development opportunities.

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    This Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide an unprecedented visibility into the user experience. The Data Engineer will collaborate with other engineers and product managers to enhance WiFi AIOps models. This...

  • Senior Big Data Developer

    6 days ago

    Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per year

    We are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes

  • Big Data Lead

    2 weeks ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Designation: Big Data LeadLocation: PuneExperience: 8-10 yearsReports To – Product Engineering HeadJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with...

  • Big Data Lead

    4 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Developer

    6 days ago

    Pune, Maharashtra, India Impetus Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionYear of Experience - 1 to 3 yearsLocation - Indore, Pune, Noida, Hyderabad, Bangalore, GurugramRequired Skills:Python Programming: Strong ability to write clean and efficient code.Spark SQL: Good understanding of Spark SQL for distributed data processing.Data Processing: Experience with large datasets and structured data manipulation.SQL...

  • Big Data Specialist

    1 week ago

    Pune, Maharashtra, India Atomic North Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Big Data EngineerLocation: Pune/Nagpur (WFO)Experience Required: 8+ Years**Long term onsite to Abu Dhabi**Job Summary:We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Uplers Full time ₹ 60,000 - ₹ 1,80,000 per year

    Experience: yearsSalary: Confidential (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Office (Pune)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Nexus Cognitive)**(*Note: This is a requirement for one of Uplers' client - Nexus Cognitive)**What do you need for...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Vodafone Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Design, develop, and maintain scalable data pipelines for processing structured and unstructured data. Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses. Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows. Ensure high performance and...