Big Data Developer

2 weeks ago

Pune, Maharashtra, India MRO Full time

Analyst - Big Data Developer

We are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.

The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.

You will be responsible for designing, implementing, and maintaining robust data solutions in a cloud environment.

Key Responsibilities :

- Data Solution Development : Design and implement batch and real-time big data integration frameworks and applications using technologies such as Hadoop, Apache Spark, and related tools.

- Performance Optimization : Identify performance bottlenecks and apply best practices to optimize and fine tune big data frameworks.

- Programming : Develop and maintain code in multiple programming languages including Java, Scala, and Python.

- Ensure code quality and adhere to best practices.

- Schema Design : Apply principles and best practices in schema design to various big data technologies, including Hadoop, YARN, HIVE, Kafka, Oozie, and NoSQL databases like Cassandra and HBase.

- Cloud Integration : Work with cloud platforms, preferably GCP, to deploy and manage big data solutions.

- Linux Environment : Utilize system tools and scripting languages to work effectively in a Linux environment and integrate with various frameworks and tools.

- Collaboration : Collaborate with cross-functional teams to understand requirements and deliver solutions that meet business needs.

- Troubleshooting Diagnose and resolve issues related to big data applications and frameworks.

- Ensure data integrity and system reliability.

- Documentation Maintain comprehensive documentation of development processes, configurations, and operational procedures.

Required Skills and Qualifications :


- Education bachelor's degree in engineering, Computer Science, or a related field, or equivalent qualification.

- Experience : Minimum of 2 to 5 years of experience in a recognized global IT services or consulting company, with hands-on expertise in big data technologies.

- Big Data Technologies : Over 2 years of experience with Hadoop ecosystem, Apache Spark, and associated tools.

- Experience with modern big data technologies and frameworks such as Spark, Impala, and Kafka.

- Programming : Proficiency in Java, Scala, and Python with the ability to code in multiple languages.

- Cloud Platforms : Experience with cloud platforms, preferably GCP.

- Linux Environment : At least 2 years of experience working in a Linux environment, including system tools, scripting languages, and integration frameworks.

- Schema Design : Extensive experience applying schema design principles and best practices to big data technologies.

- Hadoop Distributions Knowledge of Hadoop distributions such as EMR, Cloudera, or Hortonworks.

Preferred Skills :


- Experience with additional big data tools and technologies.

- Certification in relevant big data or cloud technologies.

(ref:hirist.tech)

  • Big Data Developer

    12 hours ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    10 hours ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job Title Big Data DeveloperLocation Pune IndiaRole Description Deutsche Bank is actively renewing its digital channels and has started many strategic and challenging projects Next to some major technological changes Deutsche Bank has decided to step into the Agile software development methodology in order to improve its agility and reduce time to...

  • Principal Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    About the RoleWe are seeking a highly skilled and motivated Data Engineer with over 5 years of experience in big data technologies, specializing in Spark, Python, and Hadoop.The ideal candidate will have a strong track record of designing, building, and maintaining scalable data pipelines and solutions.In this role, you will develop and optimize robust data...

  • Big Data Expert

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Big Data DeveloperThis role is ideal for a skilled and ambitious professional with expertise in big data technologies. As a Big Data Developer, you will play a key part in designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and NoSQL databases.Key Responsibilities:Develop scalable data pipelines using Apache Kafka,...

  • Big Data Professional

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job TitleWe are currently seeking a highly skilled Big Data professional to join our team. The ideal candidate will have 6-12 years of experience in Big Data and related technologies.Key Skills:More than 5.8 years of experience in data engineering and architecture.Proficiency in Spark, Scala, Java, and SQL.Strong understanding of data structures and...

  • Big Data Developer Opportunities

    2 weeks ago

    Pune, Maharashtra, India beBeeHadoop Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job OverviewWe are seeking an experienced Big Data developer to join our team. The ideal candidate will have a strong background in Scala, Spark, Hive, and Hadoop, as well as solid understanding of object-oriented programming and HDFS concepts.About the RoleDevelop and work on performance enhancement using Scala, Spark, and Hadoop.Collaborate with...

  • Big Data Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Expert - Big Data SpecialistDescription:We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.Main Responsibilities:Data Solutions: Design and implement robust...

  • Big Data

    1 week ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...