Senior Data Engineer

20 hours ago

Bengaluru Bangalore Hyderabad Secunderabad Telangana Chennai, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878
About the Role

We are seeking a seasoned professional to lead our software development initiatives. As a key member of our engineering team, you will be responsible for designing, developing, and deploying high-performance data processing applications using Apache Spark and Scala.

Our ideal candidate has a strong background in application development, with a minimum of 8 years of experience in distributed data processing using Spark and Cloudera Hadoop ecosystem. You should have hands-on experience with CDH components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop, as well as familiarity with other Big Data technologies like Apache Kafka, Flume, Oozie, and Nifi.

You will work closely with our data scientists, business analysts, and other developers to understand data requirements and deliver solutions that meet our business objectives. Your ability to troubleshoot and optimize Spark and Cloudera platform performance is essential to ensuring data integrity, accuracy, and security across all processing tasks.

Required Skills and Qualifications
  • Minimum 8 years of experience in application development.
  • Strong hands-on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
  • Ability to troubleshoot and optimize Spark and Cloudera platform performance.
Benefits
  • Opportunity to work on high-impact projects that drive business growth.
  • Collaborative and dynamic work environment.
  • Professional development opportunities to enhance your skills and knowledge.
About Us

We are a leading IT services and consulting company, dedicated to delivering innovative solutions that meet our clients' evolving needs. Our engineering team is passionate about leveraging technology to drive business success, and we are looking for talented professionals like you to join our ranks.

  • Senior Data Engineer

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Job Title: Senior Data EngineerKey Responsibilities:We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and implementation of large-scale data pipelines using Python, Pyspark, and SQL. The ideal candidate will have strong technical expertise in data engineering concepts, with the ability to handle multiple...

  • Senior Data Engineer

    13 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    About the RoleThis is a senior data engineering position focused on utilizing business acumen to work with stakeholders and other data engineers to define, design, and implement data solutions that support the organization s data initiatives. The ideal candidate will have experience in designing and building pipelines using cloud technology for extracting,...

  • Senior Data Engineer

    3 days ago

    Chennai, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, India beBeeSeniorDataEngineer Full time US$ 80,000 - US$ 1,20,000

    Job Overview:A Senior Data Engineer position is available for an expert in ETL processes using SSIS. The successful candidate will have a strong background in SQL and experience with cloud-based data warehousing.Develop and implement ETL solutions using SSIS, ensuring data integrity and accuracy.Collaborate with cross-functional teams to design and deploy...

  • Data Engineering Specialist

    3 days ago

    Hyderabad / Secunderabad, Telangana, Chennai, Bengaluru / Bangalore, India beBeeData Full time

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team. This is a challenging role that requires technical expertise in data processing, architecture, and engineering.Job Description:Design, develop, test, and deploy scalable data processing applications using Apache Spark and Scala.Collaborate with cross-functional teams to...

  • Senior Data Engineer

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Job Description:This is a senior data engineering role responsible for the detailed design, development, and delivery of pipeline solutions to address business needs. The ideal candidate will have a strong background in data engineering with experience in big data platforms and be able to lead cross-functional teams.The key responsibilities of this role...

  • Azure Data Engineering Leader

    3 days ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, Chennai, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Azure Data EngineerThe role involves overseeing the development and implementation of data engineering solutions using Azure technologies. 5+ years of experience in relevant hands-on development as a data engineer in Azure.Azure expertise including ADB, ADF, SQL, PySpark, Python, Synapse, Delta Tables, Unity Catalog.

  • Data Engineer

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. This role involves designing, implementing and maintaining large-scale data processing systems.Job Description:Develop and maintain high-quality, scalable data pipelines using Informatica, SQL and Unix.Design and implement efficient data warehousing solutions for complex...

  • Cloud Data Engineering Expert

    5 days ago

    Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, Chennai, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Job OverviewAs a senior cloud data engineer, you will play a crucial role in designing and implementing scalable data pipelines using Python and Spark in Azure Databricks.Key ResponsibilitiesDevelop and optimize efficient data orchestration workflows using DatabricksImplement CI/CD pipelines with GitHub for seamless automated deploymentsDesign and manage...

  • Big Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer - Big DataWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, excellent programming skills, and the ability to work independently as well as mentor junior developers.Key Responsibilities:Design and develop large-scale data processing pipelines...

  • Senior Data Engineer

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    Data Engineering Manager RoleWe are seeking a seasoned Data Engineering Manager to lead our end-to-end data strategy and execution for regulatory product submissions, lifecycle management, and compliance reporting.This role will be embedded in a cross-functional Regulatory Integrated Product Team (IPT) and serve as the data and technology lead, driving...