Big Data Developer

6 days ago

Navi Mumbai, Maharashtra, India Smartavya Analytica Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Job Title: Big Data Developer

Location: Navi Mumbai, India

Exp: 5+ Years

Department: Big Data and Cloud

Job Summary: Smartavya Analytica Private Limited is seeking a skilled Hadoop Developer to join our team and contribute to the development and maintenance of large-scale Big Data solutions. The ideal candidate will have extensive experience in Hadoop ecosystem technologies and a solid understanding of distributed computing, data processing, and data management.

Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, insurance, and capital markets. We are leaders in Big Data, Cloud and Analytics projects with super specialization in very large Data Platforms.

https://smart-

Empowering Your Digital Transformation with Data Modernization and AI

Requirements:

Min 3 years of experience in developing, testing & implementing Big data projects using Hadoop, Spark, Hive.

Hands-on experience playing lead role in Big data projects, responsible for implementing one or more tracks within projects, identifying and assigning tasks within the team and providing technical guidance to team members.

Experience in setting up Hadoop services, implementing ETL/ELT pipelines, working with Terabytes of data ingestion & processing from varied systems

Experience working in onshore/offshore model, leading technical discussions with customers, mentoring and guiding teams on technology, preparing HDD & LDD documents.

Skills:

Must to have Pyspark, Hadoop ecosystem including Hive, Sqoop, Impala, Oozie, Hue, Java, Python, SQL, bash (shell scripting)

Apache Kafka, Storm, Distributed systems, good understanding of networking, security (platform & data) concepts, Kerberos

Understanding of Data Governance concepts and experience implementing metadata capture, lineage capture, business glossary

Experience implementing CICD pipelines and working experience with tools like SCM tools such as GIT, Bit bucket, etc

Ability to assign and manage tasks for team members, provide technical guidance, work with architects on HDD, LDD, POCs.

Hands on experience in writing data ingestion pipelines, data processing pipelines using spark and sql, experience in implementing SCD type 1 & 2, auditing, exception handling mechanism

Data Warehousing projects implementation with either Java, or Scala based Hadoop programming background.

Proficient with various development methodologies like waterfall, agile/scrum.

Exceptional communication, organization, and time management skills

Collaborative approach to decision-making & Strong analytical skills

Good To Have - Certifications in any of GCP, AWS or Azure, Cloudera 12. Work on multiple Projects simultaneously, prioritizing appropriately

  • Senior Big Data Developer

    2 weeks ago

    Navi Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Key Responsibilities: Design, develop, and maintain large-scale data processing systems using HDFS, Hive, Kafka Spark, and SQL. Solve complex issues related to operating clusters with strong technical expertise. Collaborate with cross-functional teams to build stream-processing systems using Python and relevant technologies. Ensure excellent communication...

  • Big Data Engineer

    6 days ago

    Navi Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 25,00,000

    Enterprise Data EngineerWe are seeking a skilled and experienced Enterprise Data Engineer to design, develop, and implement efficient data models, data pipelines, and data integration solutions.This role involves collaboration with cross-functional teams to drive business growth through data-driven insights. The ideal candidate will possess strong analytical...

  • Big Data Developer

    4 weeks ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Role Overview:We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices. The ideal candidate will have deep technical expertise in Azure, AWS, CI/CD pipelines, ETL processes, and modern data platforms like Databricks,...

  • Big Data Developer

    3 weeks ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Role Overview: We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices. The ideal candidate will have deep technical expertise in Azure, AWS, CI/CD pipelines, ETL processes, and modern data platforms like Databricks,...

  • Big Data Developer

    6 days ago

    Mumbai, Maharashtra, India Tech Consulting Full time US$ 1,50,000 - US$ 2,00,000 per year

    Role Overview:We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices. The ideal candidate will have deep technical expertise in Azure, AWS, CI/CD pipelines, ETL processes, and modern data platforms like Databricks,...

  • Big Data Development Lead

    6 days ago

    Mumbai, Maharashtra, India beBeeSpark Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title : Senior Big Data EngineerWe are looking for experienced professionals to lead our big data initiatives. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities :Design,...

  • Python Developer

    6 days ago

    Navi Mumbai, Maharashtra, India Big Data Exchange Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a skilled and passionate Python Developer with Flask expertise to join our dynamic development team. You will be responsible for designing, developing, and maintaining web applications and automation tools to support our data center operations and digital services. Role & responsibilitiesPreferred candidate profileDesign, develop, and deploy...

  • Big Data Engineer

    5 days ago

    Mumbai, Maharashtra, India beBeePySpark Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Engineer - Spark DevelopmentJob DescriptionWe are seeking a skilled Big Data Engineer with expertise in PySpark to join our team. The ideal candidate will have hands-on experience with distributed computing, data processing, and big data technologies.Key Responsibilities:

  • Big Data Expert

    1 day ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Expert We are seeking a skilled Big Data Expert to join our team. This role involves working with large datasets to extract valuable insights and inform strategic business decisions. The ideal candidate will have expertise in handling and processing big data, as well as experience with related technologies such as Apache Spark, SQL,...

  • Big Data Architect

    5 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Description:As a seasoned data architect, you will play a pivotal role in designing and implementing large-scale data processing systems that drive business growth and innovation.The ideal candidate will possess a deep understanding of big data technologies and best practices, as well as the ability to work with large amounts of data from various...