Senior Big Data Developer

4 days ago

Kolkata Delhi Mumbai, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000
Software Engineer OpportunityJob Description:

We are seeking a highly skilled Software Engineer to join our team.

  • Develop, test, and deploy data processing applications using Apache Spark and Scala.
  • Optimize and tune Spark applications for better performance on large-scale data sets.
  • Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
  • Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
  • Design and implement high-performance data processing and analytics solutions.
  • Ensure data integrity, accuracy, and security across all processing tasks.
  • Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
  • Implement version control and CI/CD pipelines for Spark applications.
Required Skills and Qualifications:

Experience:

  • Minimum 8 years of experience in application development.

Skills:

  • Strong hands-on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
  • Ability to troubleshoot and optimize Spark and Cloudera platform performance.
  • Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).
,

  • Senior Big Data Developer

    3 days ago

    Delhi, Kolkata, Mumbai, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking an experienced PySpark Data Engineer to drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate with diverse data...

  • Senior Big Data Engineer

    3 days ago

    Kolkata, Delhi, Mumbai, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 30,00,000

    We are currently seeking a highly skilled Data Engineer to lead our data platform development team and drive the creation of robust, scalable data processing solutions.Job Description:Data Engineering Development:Design, develop, and test complex data processing applications using Apache Spark to handle large-scale datasets from various sources, including...

  • Big Data Engineer

    6 days ago

    Delhi, Mumbai, Kolkata, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Data Engineer for Big Data ProcessingWe are seeking an experienced data engineer to drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and...

  • Big Data Development Lead

    2 days ago

    Mumbai, Maharashtra, India beBeeSpark Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title : Senior Big Data EngineerWe are looking for experienced professionals to lead our big data initiatives. The ideal candidate will have hands-on expertise in big data processing using Apache Spark with Scala, along with proficiency in workflow management tools like Oozie and data flow platforms such as Apache NiFi.Key Responsibilities :Design,...

  • Big Data Developer

    4 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time

    Position Overview: We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent. You...

  • Big Data Developer

    6 days ago

    Navi Mumbai, Mumbai City, Mumbai, India Future Focus Infotech Full time

    Job DescriptionOverview:We are seeking a highly motivated and detail-oriented individual to join our team as a Big Data Developer. This role requires a dynamic professional who can adapt to evolving business needs and drive value through their expertise.Key Responsibilities:- Provide support and expertise in the domain of Big Data Developer.- Collaborate...

  • Big Data Developer

    20 hours ago

    Navi Mumbai, Maharashtra, India Smartavya Analytica Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Big Data DeveloperLocation: Navi Mumbai, IndiaExp: 5+ YearsDepartment: Big Data and CloudJob Summary: Smartavya Analytica Private Limited is seeking a skilled Hadoop Developer to join our team and contribute to the development and maintenance of large-scale Big Data solutions. The ideal candidate will have extensive experience in Hadoop ecosystem...

  • Senior Big Data Engineer

    1 day ago

    Mumbai, Maharashtra, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Big Data EngineerJob Summary:Data Engineers design, develop and maintain large-scale data processing systems. In this role, you will work with our team to build scalable data pipelines using PySpark and ensure the smooth operation of our data infrastructure.About the Role:The ideal candidate will have strong experience in building data...

  • Senior Big Data Developer

    1 day ago

    Delhi, Delhi, India beBeeDeveloper Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Big Data Development ExpertThis position is open for a seasoned professional with a strong background in designing, developing and maintaining large-scale distributed data pipelines. The ideal candidate will have a deep understanding of Apache Spark and Scala, as well as experience working with UNIX shell scripting, Hive, Sqoop, and Impala.Key...

  • Big Data Developer

    3 weeks ago

    Mumbai, Maharashtra, India Tech Consulting Full time

    Role Overview:We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices. The ideal candidate will have deep technical expertise in Azure, AWS, CI/CD pipelines, ETL processes, and modern data platforms like Databricks,...