Big Data Leader

1 week ago

Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Summary:

A Big Data Leader is required to head a team of data engineers. This person will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.

Key Responsibilities

In this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and the implementation of standardized Data Model, single view of customer. You will develop data pipelines for new sources, data transformations within the Data Lake , implementing graphql , work on no sql database, CI/CD and data delivery as per the business requirements.

You will

  • be responsible for building pipelines to bring in wide variety of data from multiple sources within the organization as well as from social media and public data sources,
    collaborate with cross functional teams to source data and make it available for downstream consumption,
    work with the team to provide an effective solution design to meet business needs,
    ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks/issues that have either not yet been identified or are not being progressed,
    and ensure dependencies and challenges (risks) are escalated and managed.

Requirements

We are looking for someone with

  • experience working with at least one Cloud Infra provider (Azure/AWS),
    experience in building data pipelines using batch processing with Apache Spark (Spark SQL, Dataframe API) or Hive query language (HQL),
    experience in building streaming data pipeline using Apache Spark Structured Streaming or Apache Flink on Kafka & Delta Lake,
    knowledge of NOSQL databases, specifically Cosmos DB, Restful API's and GraphQL,
    knowledge of Big data ETL processing tools, Data modelling and Data mapping,
    experience with Hive and Hadoop file formats (Avro / Parquet / ORC),
    basic knowledge of scripting (shell / bash),
    experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), NoSQL / document databases, flat files,
    basic understanding of CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops,
    basic understanding of DevOps practices using Git version control,
    ability to debug, fine tune and optimize large scale data processing jobs.

  • Senior Big Data Architect

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ArchitectJob Summary:About this Role:We are seeking an experienced and strategic technology leader with expertise in designing and delivering scalable data solutions using Microsoft Azure, Databricks, and Big Data platforms.The ideal candidate will lead a team of talented engineers to architect and oversee the development of...

  • Big Data Solutions Specialist

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Big Data ExpertWelcome to a role where you will be responsible for developing and implementing Big Data solutions using PySpark and Hive.This position is ideal for experts in data analytics who are passionate about working with large datasets and extracting valuable insights from them.Develop and implement Big Data solutions using PySpark and Hive.Work on...

  • Senior Big Data ETL Tester

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataValidator Full time ₹ 10,00,000 - ₹ 20,00,000

    Big Data ETL ValidatorThe role of Big Data ETL Validator involves ensuring the accuracy and integrity of data across various layers in a Databricks environment.Main Responsibilities:Create comprehensive test plans to validate data transformations, ingestion, and processing logic.Develop complex SQL queries to verify data consistency and adherence to business...

  • Senior Big Data Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000

    We are seeking an experienced professional to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks.The ideal candidate will have strong expertise in big data environments, ETL/ELT workflows, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases.

  • Big Data Database Administration Role

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDatabaseAdministrator Full time ₹ 15,00,000 - ₹ 20,00,000

    Database Administrator PositionThis is a senior-level role that requires in-depth knowledge of database systems and technologies. We are seeking an experienced professional to join our Big Data team, where they will be responsible for analyzing existing databases, recommending improvements, and ensuring high availability and performance.The ideal candidate...

  • Big Data Engineer Manager

    3 days ago

    Tirupati, Andhra Pradesh, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Engineer Manager - Cloud ArchitectureOverviewWe are seeking a highly experienced and strategic engineering manager to lead our team of data engineers. The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The successful candidate will design and deliver scalable data pipelines and analytics...

  • Engineering Manager – Big Data, Azure

    3 days ago

    Tirupati, Andhra Pradesh, India DataE2E Technologies Full time

    Technical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented data engineers to design and...

  • Big Data Architect

    5 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer - Large Scale Data PlatformsWe are seeking a seasoned Senior Data Engineer to design and build robust data pipelines for ingestion, transformation, and analytics. The ideal candidate will have expertise in the GCP ecosystem and hands-on experience with Big Data tools such as Hadoop, Spark, and Kafka.The selected professional will be responsible...

  • Data Engineering Leader

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeTechnicalLead Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Technical LeadAbout the JobWe are seeking an experienced Technical Lead to join our team. As a Technical Lead, you will be responsible for building and maintaining large-scale engineering products.The successful candidate will have a strong background in data engineering, with experience in designing and developing distributed components using Big...

  • Highly Experienced Big Data Systems Architect

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeAdministrator Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a skilled Kafka Administrator to lead the deployment and management of our production-grade Kafka clusters. The ideal candidate will have extensive experience in designing, deploying, and maintaining high-availability and fault-tolerant Kafka infrastructure.Key Responsibilities:Deploy and upgrade production-grade Kafka clusters to...