Big Data Solutions Leader

2 days ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Big Data Engineer Leader Position

">

We are looking for an experienced and skilled big data engineer leader to lead the design, development, and deployment of scalable big data solutions. The ideal candidate will work closely with cross-functional teams to deliver high-quality data processing pipelines and analytics platforms.

">

Job Description

">

The successful candidate will have:

">
  • ">
  • Hands-on experience in Scala programming with a deep understanding of functional programming concepts.">
  • Extensive experience with Apache Spark (RDDs, DataFrames, Datasets) and Databricks platform.">
  • Proficient in Python and PySpark for big data processing.">
  • Experience in building and optimizing large-scale ETL pipelines and data workflows.">
  • Solid understanding of distributed computing and big data ecosystem.">
  • Familiarity with cloud platforms such as AWS, Azure, or GCP, especially Databricks on cloud.">
  • Experience with version control systems (Git) and CI/CD tools.">
">

Key Responsibilities

">
  • ">
  • Lead the development and implementation of big data solutions using Scala and Apache Spark on Databricks.">
  • Design, develop, and optimize Spark jobs and ETL pipelines using Scala, Python, and PySpark.">
  • Collaborate with data engineers, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.">
  • Mentor and guide junior developers and team members on best practices in Scala and Spark development.">
  • Ensure code quality, performance tuning, and scalability of Spark applications.">
  • Participate in architectural discussions and contribute to technology roadmap decisions.">
  • Troubleshoot and resolve production issues related to Spark jobs and data pipelines.">
  • Implement CI/CD pipelines for Spark applications and automate deployment processes.">
">

Benefits

">
  • ">
  • Opportunity to work on challenging big data projects.">
  • Chance to mentor and grow junior team members.">
  • Competitive salary and benefits package.">
">

How to Apply

">

Please submit your resume and cover letter to apply for this exciting opportunity.

  • Big Data Engineering Leader

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled professional to lead our data engineering initiatives. As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using PySpark and HiveDevelop and maintain big data applications using Spark, HBase, and DQ...

  • Senior Big Data Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Big Data Solutions Architect RoleWe are seeking a seasoned Big Data Solutions Architect to join our team. The successful candidate will have a deep understanding of big data technologies and be able to design, develop, and implement scalable solutions.Key Responsibilities:Design and implement data platforms using Databricks Unified Data Analytics...

  • Big Data Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Description:LUMI is a large-scale Big Data Platform designed for computationally and data-intensive processing applications.As a cornerstone platform, it provides a challenging environment for engineers to build world-class products.We are embarking on a journey to move to public cloud - GCP, and you will be part of a fast-paced Agile team, designing,...

  • Big Data Solutions Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Solutions Architect">About the Role:"We are seeking a highly skilled and experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing complex data solutions using Azure Data Factory, Azure Databricks, and Cosmos DB."""The ideal candidate...

  • Big Data Innovator

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to build complex data pipelines and develop models that provide unique insights into our data.The ideal candidate will be responsible for collaborating with our data science team to develop and implement data solutions that clean, transform, and aggregate data from disparate...

  • Lead Big Data Professional

    2 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Are you passionate about working with big data?We are seeking a skilled Big Data Developer to join our team!Greetings from our organization, a global leader in the technology arena.We offer a challenging and rewarding career opportunity for a talented individual who can help us drive growth and innovation in the field of big data.About the Role:This is a...

  • Senior Big Data Solutions Developer

    7 days ago

    Chennai, Tamil Nadu, India beBeeDataLeader Full time ₹ 33,12,100 - ₹ 3,31,21,000

    Job OpportunitySeeking a seasoned professional to lead the development of big data solutions using Hadoop, HDFS, Hive, and Spark. This individual will be responsible for end-to-end development, testing, and implementation of data products and APIs.Key ResponsibilitiesBusiness: Responsible for requirements analysis, engineering, and solution design. Tasks...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Amazon Full time

    Profit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation data and Business...

  • Big Data Solutions Specialist

    5 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 30,00,000

    Job OpportunityWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa.About the Role:Design, build, and support data applications using Spark, Sqoop, and Hive.Work with large data sets and high-capacity big data processing platforms.Develop strong expertise in Unix and Shell scripting.Gain in-depth knowledge of the Hadoop ecosystem and...

  • Senior IT Manager: Big Data Solutions

    6 days ago

    Chennai, Tamil Nadu, India beBeeExperience Full time ₹ 33,121

    We are seeking a senior manager to lead our development team under finance and tax departments.Key Responsibilities:Requirements analysis and engineeringEnd-to-end development covering analysis, design, development, data management, devops integration using pipeline build and maintenance, solutioning for other non-functional requirementsInfrastructure...