Big Data Specialist

2 days ago

Hyderabad, Telangana, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Big Data Specialist

We are seeking a highly skilled professional to design, develop and maintain large-scale data pipelines.

  • Design and develop ETL/ELT data pipelines to ingest data from databases and flat files into the data warehouse.
  • Utilize cloud services for data ingestion and transformation processes.
  • Develop and optimize stored procedures to implement complex business logic and data transformations.
  • Manage and monitor scheduled data workflows using workflow orchestration tools.
  • Work closely with stakeholders to understand project requirements and translate them into technical solutions.
  • Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.
  • Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation and obtaining user acceptance testing approvals.

A solid understanding of data warehousing concepts is essential. Practical experience in data engineering and excellent problem-solving skills are required.

Key Responsibilities:

  • Data Pipeline Design and Development: Design and develop scalable and efficient ETL/ELT data pipelines to extract, transform and load data from various sources into the data warehouse.
  • Cloud Service Utilization: Utilize cloud services such as AWS Lambda, AWS DMS and AWS Glue for data ingestion and transformation processes.
  • Stored Procedure Optimization: Develop and optimize stored procedures to implement complex business logic and data transformations.
  • Workflow Orchestration: Manage and monitor scheduled data workflows using Apache Airflow or similar tools.

Requirements:

  • Strong proficiency in SQL scripting.
  • Experience with Apache Airflow for workflow orchestration.
  • Hands-on experience with cloud services such as AWS Cloud.

Preferred Skills:

  • Solid understanding of data warehousing concepts.
  • Practical experience in data engineering.
  • Excellent problem-solving skills.

  • Big Data Specialist

    4 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data SpecialistWe are seeking a highly skilled Big Data Specialist to join our team. As a key member of our organization, you will be responsible for managing and analyzing large datasets to help us make informed business decisions.Key Responsibilities:1. Design, develop, and maintain large-scale data processing systems using technologies such...

  • Big Data Analytics Specialist

    2 days ago

    Hyderabad, Telangana, India beBeeAnalytics Full time ₹ 33,60,000 - ₹ 40,80,000

    Big Data Analytics SpecialistJoin our team as a Big Data Analytics Specialist and contribute to the success of our clients.Lead and Deliver: Drive technical aspects of analytics projects and solutions for our esteemed clients.Build and Configure: Establish data science environments, algorithms, and data feeds to drive business growth.Support and Consult:...

  • Big Data Specialist

    4 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

    Job Title: Big Data SpecialistAbout the Role:We are seeking an experienced Data Engineer to join our team.The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies.Our ideal candidate will have a strong background in PySpark, with experience in building efficient...

  • Big Data Specialist

    2 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock the Power of Big DataWe're seeking an exceptional data expert to lead our team in designing and developing cutting-edge, large-scale data processing systems.The Ideal CandidateExpert-level proficiency in PySpark and HiveStrong background in Spark and HBaseExcellent problem-solving skills and passion for working with complex datasetsExperience in data...

  • Big Data Developer

    4 days ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data DeveloperWork Location: Hyderabad, Telangana (TG), IndiaExperience Range: 6–8 YearsSkill Area: Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing,...

  • Big Data Expert

    4 days ago

    Hyderabad, Telangana, India beBeeDataScience Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking a highly skilled and experienced big data expert to design, develop, and maintain scalable big data systems and data processing frameworks.Main Responsibilities:Design, develop, and maintain scalable and efficient big data architectures and data pipelines.Implement and optimize data processing frameworks using...

  • Big Data Developer

    2 days ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data Developer Work Location: Hyderabad, Telangana (TG), India Experience Range: 6–8 Years Skill Area: Digital – Big Data and Hadoop Ecosystems Job Description: We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in...

  • Big Data Architect

    5 days ago

    Hyderabad, Telangana, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Big Data ArchitectWe are seeking a highly skilled professional to lead the design and implementation of our big data infrastructure.Responsibilities:Develop and maintain high-performance big data applications using Python, PySpark, and Spark Dataframes.Design and implement scalable data architectures to process huge volumes of data.Collaborate...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India RandomTrees Full time

    Job Title: Big Data Engineer Experience: 5–9 Years Location: Hyderabad-Hybrid Employment Type: Full-Time Job Summary: We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL,...

  • Senior Big Data Specialist

    2 days ago

    Hyderabad, Telangana, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced Big Data Engineer to lead the design, development, and maintenance of scalable big data systems and data processing frameworks.Main Responsibilities:Design and implement large-scale data processing architectures and pipelines using Hadoop, Apache Spark, and Hive.Develop and optimize ETL processes for high-quality...