Principal Big Data Specialist

1 week ago

Hyderabad Secunderabad Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878
Senior Data Engineer

Job Summary:

  • Develop, implement, and maintain data pipelines to achieve high reliability and efficiency.
  • Collaborate with the engineering team to design and develop proof-of-concept solutions for data infrastructure.
  • Work closely with product teams to create new data products that meet business needs.
  • Ensure accurate documentation of the Data Warehouse and other data systems.
  • Design, develop, test, and maintain code related to data engineering.
  • Provide thought leadership and expertise on various projects.
  • Guide junior data engineers in best practices and ensure they meet their deliverables.

Required Skills and Qualifications:

  • Master's degree in Computer Science or equivalent work experience.
  • Strong knowledge of SQL and relational databases; familiarity with non-relational databases is beneficial.
  • Deep understanding and prior experience with Spark and PySpark.
  • Understanding of data warehouse table design, star schemas, and similar concepts.
  • Previous experience in architecting and building data pipelines from various sources.
  • Strong problem-solving skills, adaptability, proactivity, and willingness to take ownership.
  • Commitment to quality, architecture, and documentation.
  • Experience with AWS cloud services (S3, Athena, EMR, Kinesis).
  • Experience with data pipeline technologies (Airflow, Luigi) is a plus.
  • Experience with Kafka streaming is beneficial.
  • Familiarity with business intelligence tools (Tableau, Qlik) is a plus.
  • Experience with Databricks/DBT is advantageous.

  • Principal Big Data Specialist

    6 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeBigDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job TitleWe are seeking a highly skilled professional to join our team as a Big Data Engineer.This is an exciting opportunity for a talented individual who is passionate about working with big data and has experience in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design, develop, and maintain scalable data...

  • Big Data Cluster Specialist

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Overview:We are seeking a highly skilled Big Data Cluster Specialist to join our team. In this role, you will be responsible for designing and administering high-performance Hadoop clusters to meet the data processing needs of our organization.Key Responsibilities:Design and implement scalable Hadoop cluster architectures to support large-scale data...

  • Big Data Analytics Specialist

    7 days ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,50,000 - ₹ 28,00,000

    Job Title: Big Data Analytics Specialist\Hadoop Spark and Hive are at the core of our big data strategy. As a Big Data Analytics Specialist, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.\Key Responsibilities:\\Design and develop ETL processes using Hadoop and Spark...

  • Big Data Professional

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data Engineer OpportunityWe are seeking a skilled Big Data Engineer to join our team.">Develop and maintain big data pipelines and ETL workflows using PySpark, Hadoop (HDFS, MapReduce, Hive, HBase).Design and implement data ingestion, transformation, and integration processes on Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, and...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data DeveloperWe are seeking a skilled Big Data Developer to design and develop robust and scalable data pipelines using Pyspark/Python. The ideal candidate will have experience working on AWS/AWS CLI, with AWS Glue being highly desirable. You should possess hands-on SQL experience and be well-versed with Big Data concepts.Data Pipeline Development:...

  • Big Data Engineer

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data EngineerLead the development and implementation of scalable data pipelines using Hadoop ecosystem tools.Design, build, and maintain ETL/ELT pipelines for efficient data processing.Write complex Hive queries to transform and analyze large datasets.Collaborate with cross-functional teams to deliver solutions that meet business...

  • Big Data Strategist

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a highly skilled and results-driven Data Architect to lead our team in the development of innovative data strategies and solutions.The ideal candidate will have a strong background in designing, implementing, and maintaining large-scale data systems, as well as experience with big data technologies such as Hadoop, Spark, and NoSQL...

  • Advanced Big Data Specialist

    1 week ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data EngineerAt our organization, we're looking for an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Required Skills:Programming: Proficiency in Python is mandatory, as well as experience with other...

  • Senior Big Data Developer

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeBigDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Description:As a Big Data Engineer, you will play a key role in designing and implementing data ingestion and curation processes using cutting-edge tools such as Spark, Hive, HDFS, Kafka, Pig, and Oozie. Your primary responsibility will be to contribute towards supporting the build/implementation of these processes under the guidance of senior team...

  • Big Data Developer

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 4,50,000 - ₹ 5,50,000

    Job TitleData Engineer - Large Scale Data Processing Solutions\We are seeking a highly skilled and experienced data engineer to join our team. As a data engineer, you will design, develop, and implement large-scale data processing solutions using Java, Spark Streaming, Spark Batch, and Hadoop.Develop and optimize data storage and retrieval systems using...