Big Data Developer

3 weeks ago

Pune, Maharashtra, India Emergys Full time

Experience: 5 to 7 years

Location: Pune, Kothrud

Job Description:

Must Have :

  • Proficiency in at least one of the following programming languages: Java/Scala/Python
  • Good understanding of SQL
  • Experience of development and deployment of at least one end-to-end data storage/processing pipeline
  • Strong Experience in Spark development with batch and streaming
  • Intermediate level expertise in HDFS and Hive
  • Experience with Pyspark and Data Engineering
  • ETL implementation and migration to spark
  • Experience of working with Hadoop cluster
  • Python, PySpark, Data Bricks developer with knowledge of cloud
  • Experience with Kafka and Spark streaming (Dstream and Structured Streaming)
  • Experience with using Jupyter notebooks or any other developer tool
  • Experience with Airflow or other workflow engines
  • Good communication skills and logical skills

Good to Have Skills :

  • Prior experience of writing Spark jobs using Java is highly appreciated
  • Prior experience of working with Cloudera Data Platform (CDP)
  • Hands-on experience with NoSQL databases like HBase, Cassandra, Elasticsearch, etc.
  • Experience of using maven and git
  • Agile scrum methodologies
  • Flink and Kudu streaming
  • Automation of workflows CI/CD
  • Nifi streaming and transformation

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job Title Big Data DeveloperLocation Pune IndiaRole Description Deutsche Bank is actively renewing its digital channels and has started many strategic and challenging projects Next to some major technological changes Deutsche Bank has decided to step into the Agile software development methodology in order to improve its agility and reduce time to...

  • Principal Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    About the RoleWe are seeking a highly skilled and motivated Data Engineer with over 5 years of experience in big data technologies, specializing in Spark, Python, and Hadoop.The ideal candidate will have a strong track record of designing, building, and maintaining scalable data pipelines and solutions.In this role, you will develop and optimize robust data...

  • Big Data Professional

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job TitleWe are currently seeking a highly skilled Big Data professional to join our team. The ideal candidate will have 6-12 years of experience in Big Data and related technologies.Key Skills:More than 5.8 years of experience in data engineering and architecture.Proficiency in Spark, Scala, Java, and SQL.Strong understanding of data structures and...

  • Big Data Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Expert - Big Data SpecialistDescription:We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.Main Responsibilities:Data Solutions: Design and implement robust...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...