Senior Data Engineer

2 days ago

Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking an experienced Big Data Engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, as well as hands-on experience with distributed data systems and cloud-based solutions.

The successful candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and distributed data processing systems. They will also work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

  • Key Responsibilities:
  • - Design and develop large-scale data pipelines and distributed data processing systems.
  • - Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • - Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • - Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • - Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • - Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • - Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • - Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • - Contribute to product development with a focus on scalability, maintainability, and performance.
Required Skills and Qualifications

The ideal candidate will possess the following skills and qualifications:

  • Mandatory Skills:
  • - Scala – Minimum 3+ years of hands-on experience.
  • - Strong expertise in Spark (PySpark) and Python.
  • - Hands-on experience with Apache Kafka.
  • - Knowledge of NiFi / Airflow for orchestration.
  • - Strong experience in Distributed Data Systems (5+ years).
  • - Proficiency in SQL and query optimization.
  • - Good understanding of Cloud Architecture.
  • Preferred Skills:
  • - Exposure to messaging technologies like Apache Kafka or equivalent.
  • - Experience in designing intuitive, responsive UIs for data analytics visualization.
  • - Familiarity with Splunk or other monitoring/alerting solutions.
  • - Hands-on experience with CI/CD tools (Git, Jenkins).
  • - Strong grasp of software engineering concepts, data modeling, and optimization techniques.
Benefits

As a Big Data Engineer at our company, you can expect a dynamic and challenging work environment, opportunities for professional growth and development, and a competitive salary and benefits package.

  • Senior Data Engineering Lead

    2 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,10,000

    Job OverviewThis is a senior data engineering position that involves leading a team of big data engineers.The ideal candidate will have excellent problem analysis skills and experience with at least one cloud infra provider such as Azure or AWS.They will also be proficient in building data pipelines using batch processing with Apache Spark or Hive query...

  • Senior Data Engineering Specialist

    2 days ago

    Mysore, Karnataka, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineering SpecialistWe are seeking a highly skilled and experienced Data Engineering Specialist to lead the development of our data pipeline architecture. As a key member of our team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Apache Beam and Databricks.About the Role:The ideal...

  • Senior Data Engineer

    3 days ago

    Mysore, Karnataka, India HCLTech Full time

    Role: Azure Data EngineerExperience required: 6+ Years Location: Pan India Notice Period: Immediate - 30 DaysWe are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, data architecture, and data integration. Experience and skills:Over 6 years experience as a Data Engineer or...

  • Data Engineering Expertise Wanted

    3 days ago

    Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to contribute to the development of our data solutions.With a strong background in data engineering, the successful candidate will be responsible for designing and maintaining cloud-based data architectures on Azure, AWS, or GCP with a focus on performance, security, and...

  • Highly Skilled Data Engineer Required

    2 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineering PositionWe are seeking a highly skilled Senior Data Engineer to lead our data engineering team in designing and developing scalable data pipelines using PySpark.The ideal candidate will have strong expertise in PySpark, proficient programming skills with a solid understanding of Python fundamentals, data structures, algorithms, and...

  • Data Visualization Engineer

    2 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a visionary Data Visualization Engineer to join our pioneering project in AI & LLM training. This is an exceptional opportunity to lead and innovate in the intersection of data, visualization, and artificial intelligence. As a key member of our team, you will be responsible for designing and developing high-quality visualizations using Python...

  • Senior Data Architect

    2 days ago

    Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned Data Engineering professional to lead our team. As a Technical Lead-Data Engineer, you will be responsible for designing and implementing large-scale data engineering solutions.The ideal candidate will have 8+ years of experience in Enterprise-level Data Engineering roles, with expertise in OLAP design, data...

  • Senior Data Platform Specialist

    3 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title:Achieving Excellence in Data EngineeringWe're seeking a highly skilled Senior Data Engineer to design, build, and maintain our modern data platform.">This role is perfect for someone with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced, engineering-driven environment.You'll work...

  • Senior Data Architect

    4 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectWe are seeking a skilled and experienced Senior Data Architect to lead the design, development, and implementation of our data architecture strategy.The ideal candidate will have a strong background in data engineering, data science, and cloud computing, with experience in designing and implementing large-scale data...

  • Senior Data Solutions Architect

    4 days ago

    Mysore, Karnataka, India beBeeDataSolutions Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Solutions ArchitectAbout the RoleWe are seeking a highly skilled and experienced Senior Data Solutions Architect to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes on Databricks.Key ResponsibilitiesDesign and...