Lead Big Data Engineer

19 hours ago

Mysore, Karnataka, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

We are seeking a highly skilled Lead Big Data Engineer to join our team as a Databricks expert. This is a key role in our mission to empower clients with data-driven insights and innovative digital solutions.

This role requires overall 6+ years of experience in development and maintenance in a data engineering project, including:

  • Collaborating with stakeholders to understand data requirements and translate them into technical solutions
  • Designing, developing, and deploying scalable data pipelines and ETL processes using Databricks
  • Optimizing Spark jobs and ensuring efficient data processing and storage
  • Developing and maintaining Databricks notebooks, workflows, and dashboards
  • Building and optimizing data pipelines and workflows in Databricks

You will work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services, and stay current with the latest Databricks and big data technologies and trends. Experience working in any one ETL tool like Informatica is good to have. Cloud experience and knowledge of programming languages such as Python and Scala are also required.

This role involves providing expertise on Databricks and its ecosystem, as well as architecting and implementing data pipelines that meet the needs of our clients. You will work closely with cross-functional teams to ensure seamless integration of data solutions with business applications.

The ideal candidate will have a strong background in big data engineering, with a focus on distributed computing and data processing. They should have hands-on experience with Databricks, as well as knowledge of cloud-based data platforms and tools.

In addition to technical skills, this role requires excellent communication and problem-solving skills. The successful candidate will be able to effectively communicate complex technical concepts to both technical and non-technical stakeholders, and work collaboratively to resolve issues.

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are passionate about big data engineering and want to make a meaningful impact, we encourage you to apply for this exciting opportunity.

  • Cloud Native Big Data Architecture Lead

    1 week ago

    Mysore, Karnataka, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Big Data Engineer LeaderWe are seeking a highly experienced and strategic leader to head our Big Data platform team. The ideal candidate will have deep expertise in cloud-native environments, Azure Cloud Services, and Databricks.Key Responsibilities:Lead and mentor a team of data engineers working on large-scale distributed data systems.Architect and...

  • Big Data Engineer

    3 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistThe ideal candidate will have 6–12 years of experience in big data technologies, including PySpark/Scala Spark/Java Spark SQL. A strong understanding of data structures and algorithms is also required.Required Skills:Big data projects with more than 5.8 years of experienceExperience in implementing data pipelines,...

  • Big Data Specialist

    1 week ago

    Mysore, Karnataka, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Engineer">Job DescriptionWe are seeking a skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.">Required Skills and QualificationsHands on experience in Python and PySparkExperience in building pySpark...

  • Senior Data Engineering Lead

    7 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,10,000

    Job OverviewThis is a senior data engineering position that involves leading a team of big data engineers.The ideal candidate will have excellent problem analysis skills and experience with at least one cloud infra provider such as Azure or AWS.They will also be proficient in building data pipelines using batch processing with Apache Spark or Hive query...

  • Lead Data Engineer

    2 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 2,50,00,000 - ₹ 3,20,00,000

    Engineering Manager - Data PositionThis is an exciting opportunity to lead cross-functional teams in delivering complex data engineering initiatives using agile methods and frameworks.About the RoleWe are seeking a skilled Engineering Manager to join our organization. The successful candidate will be responsible for providing technical leadership, guidance,...

  • Big Data Solutions Specialist

    53 minutes ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled and experienced data engineer to join our team. The ideal candidate will have a deep understanding of big data technologies and AWS cloud services.Job Responsibilities:Design, develop, and optimize complex big data architectures leveraging AWS services for large-scale data processing.Build and...

  • Data Engineering Strategist

    19 hours ago

    Mysore, Karnataka, India beBeeEngineering Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Job Overview:">We are seeking a skilled data engineer with expertise in SQL, big data processing, and modern data platforms to lead our data engineering initiatives.">Key Responsibilities:">Drive the design, development, and optimization of scalable data projectsDesign, build, and optimize data pipelines for large-scale structured and unstructured...

  • High-Performance Data Engineering Lead

    3 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe're seeking a seasoned data engineering professional to lead the development of high-performance, scalable data pipelines.The successful candidate will collaborate with cross-functional teams to design and implement data models, ETL processes, and data warehousing solutions that meet our business needs.This role requires a strong...

  • Senior Data Engineer Leader

    3 days ago

    Mysore, Karnataka, India beBeeDataLead Full time US$ 10,00,000 - US$ 15,00,000

    Job DescriptionAs a Data Applications Lead, you will be responsible for the end-to-end delivery of data modules and platforms that power core business use cases across real-time bidding, reporting, and analytics.You will lead a small team of engineers and work closely with data science, analytics, and platform engineering teams to design, optimize, and...

  • Big Data Solutions Architect

    21 hours ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Big Data Solutions ArchitectAt our organization, we are seeking a highly skilled Senior Data Engineer to join our team.As a key member of our data engineering team, the successful candidate will be responsible for designing and building large-scale data systems, implementing data integration and ingestion solutions, and driving implementation...