Big Data Professional

18 hours ago

Hyderabad Secunderabad Telangana, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000
Big Data Engineer Opportunity

We are seeking a skilled Big Data Engineer to join our team.

">
  • Develop and maintain big data pipelines and ETL workflows using PySpark, Hadoop (HDFS, MapReduce, Hive, HBase).
  • Design and implement data ingestion, transformation, and integration processes on Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, and Cloud Storage.
  • Ensure high-quality, secure, and governed data across all pipelines.
  • Monitor and troubleshoot performance issues in data pipelines and storage systems.
  • Collaborate with data scientists and analysts to understand data needs and deliver clean, processed datasets.
  • Implement batch and real-time data processing solutions.
  • Write efficient, reusable, and maintainable code in Python and PySpark.
  • Automate deployment and orchestration using tools like Airflow, Cloud Composer, or similar.
Requirements:
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 3+ years of experience in big data engineering or related roles.
  • Strong hands-on experience with Google Cloud Platform (GCP) services for big data processing.
  • Proficiency in Hadoop ecosystem tools: HDFS, MapReduce, Hive, HBase, etc.
  • Expert-level knowledge of PySpark for data processing and analytics.
  • Experience with data warehousing concepts and tools such as BigQuery.
  • Good understanding of ETL processes, data modeling, and pipeline orchestration.
  • Programming proficiency in Python and scripting.
  • Familiarity with containerization (Docker) and CI/CD pipelines.
Desirable Skills:
  • Experience with streaming data platforms like Kafka or Pub/Sub.
  • Knowledge of data governance and compliance standards (GDPR, HIPAA).
  • Familiarity with ML workflows and integration with big data platforms.
  • Experience with Terraform or other infrastructure-as-code tools.

  • Azure Big Data Professional

    2 days ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Title: Azure Big Data ProfessionalAzure big data engineer is responsible for managing and maintaining large-scale data systems on Azure cloud platform. They design, develop, test, deploy, and maintain data pipelines to extract, transform, load, and process data for various business applications.Required Skills and Qualifications:4+ years of experience...

  • Big Data Analytics Lead

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Analytics ProfessionalWe are seeking an experienced Big Data Analytics professional to lead our team in designing and implementing a cutting-edge analytics architecture. The ideal candidate will have a strong background in Data Warehousing, Big Data, and Hadoop implementation in Azure environments.Key Responsibilities:Design and implement...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Big Data Engineer PositionWe are seeking a skilled big data engineer to join our organization in India. The ideal candidate will have a strong background in data engineering with extensive experience in building and maintaining large-scale data pipelines and infrastructure to support our business decisions.Key ResponsibilitiesDesign, develop, and maintain...

  • Big Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data EngineerLead the development and implementation of scalable data pipelines using Hadoop ecosystem tools.Design, build, and maintain ETL/ELT pipelines for efficient data processing.Write complex Hive queries to transform and analyze large datasets.Collaborate with cross-functional teams to deliver solutions that meet business...

  • Senior Big Data Analyst

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Opportunity OverviewOur organization is seeking a highly skilled professional to fill a challenging role.The ideal candidate will possess expertise in big data, with experience in working with Hive, Spark, or Snowflake, and Kafka. Proficiency in Python for data processing is also required.Additionally, the candidate should have strong knowledge of SQL...

  • Big Data Analyst

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionAs a skilled professional, you will contribute to the design and implementation of big data ingestion and curation processes using Spark, Hive, HDFS, Kafka, Pig, Oozie, Sqoop, Flume, Zookeeper, Kerberos, Sentry, Impala, and CDP 7.x.Key responsibilities include supporting the build/implementation of data ingestion and curation processes...

  • Big Data Engineer

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to design and develop scalable data processing solutions using Apache Spark and related technologies.About the Role:This role involves working on large-scale data processing, real-time analytics, and building efficient data pipelines for various business use cases.Critical Skills:Create...

  • Big Data Developer

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    **Job Title:** Big Data DeveloperWe are seeking a skilled and experienced Big Data Developer to join our team.As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Spark and Java. You will work with our team of experts to create efficient and scalable solutions that meet the...

  • Big Data Engineer

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer - Big DataWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, excellent programming skills, and the ability to work independently as well as mentor junior developers.Key Responsibilities:Design and develop large-scale data processing pipelines...

  • Senior Big Data Developer

    5 days ago

    Hyderabad / Secunderabad, Telangana, Pune, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Development ExpertWe are seeking an experienced Big Data Development Expert to join our team. As a key member of our organization, you will play a crucial role in designing and implementing scalable data pipelines using big data technologies.Job Description:The successful candidate will have experience working with Hadoop and related processing...