Big Data Developer

4 days ago

Pune, Maharashtra, India Emergys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Experience: 5 to 7 years

Location: Pune, Kothrud

Job Description:

Must Have
:

  • Proficiency in at least one of the following programming languages: Java/Scala/Python
  • Good understanding of SQL
  • Experience of development and deployment of at least one end-to-end data storage/processing pipeline
  • Strong Experience in Spark development with batch and streaming
  • Intermediate level expertise in HDFS and Hive
  • Experience with Pyspark and Data Engineering
  • ETL implementation and migration to spark
  • Experience of working with Hadoop cluster
  • Python, PySpark, Data Bricks developer with knowledge of cloud
  • Experience with Kafka and Spark streaming (Dstream and Structured Streaming)
  • Experience with using Jupyter notebooks or any other developer tool
  • Experience with Airflow or other workflow engines
  • Good communication skills and logical skills

Good to Have Skills
:

  • Prior experience of writing Spark jobs using Java is highly appreciated
  • Prior experience of working with Cloudera Data Platform (CDP)
  • Hands-on experience with NoSQL databases like HBase, Cassandra, Elasticsearch, etc.
  • Experience of using maven and git
  • Agile scrum methodologies
  • Flink and Kudu streaming
  • Automation of workflows CI/CD
  • Nifi streaming and transformation

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Big Data DeveloperLocation : Pune, IndiaExperience : 7 YearsAbout the Role : We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Senior Big Data Developer

    4 hours ago

    Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per year

    We are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...

  • Big Data Engineer

    4 hours ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Greetings from TCS!Skill: Big DataYears of Experience: 6 - 8 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...

  • Big Data Architect

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities. Responsibilities:Architect Data...

  • Big Data Architect

    1 week ago

    Pune, Maharashtra, India Citi Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.Responsibilities:Architect Data solutions...