Principal Big Data Specialist

6 days ago

Hyderabad Secunderabad Telangana, India beBeeBigDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878
Job Title

We are seeking a highly skilled professional to join our team as a Big Data Engineer.

  • This is an exciting opportunity for a talented individual who is passionate about working with big data and has experience in designing, building, and maintaining large-scale data processing systems.

Key Responsibilities:

  1. Design, develop, and maintain scalable data processing architectures using PySpark and Apache Spark.
  2. Work with large datasets in distributed computing environments, ensuring high performance and efficiency.
  3. Develop and implement data pipelines using Python for data processing and automation.
  4. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
  5. Stay up-to-date with industry trends and emerging technologies, applying that knowledge to improve our data processing capabilities.

Requirements:

  • A minimum of 3 years of experience in big data engineering, with a strong focus on PySpark and Apache Spark development.
  • Proficiency in Python for data processing and automation.
  • Expertise in SQL for querying, transformation, and performance tuning.
  • Hands-on experience with Databricks or similar cloud-based big data platforms.
  • Strong understanding of data engineering best practices, including version control, CI/CD, and testing.
  • Knowledge of data modeling, ETL frameworks, and workflow orchestration tools.
  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Familiarity with Delta Lake, Lakehouse architecture, or data warehousing concepts.
  • Excellent problem-solving and communication skills.

Benefits:

  • A competitive salary and benefits package.
  • The opportunity to work on challenging projects with a talented team.
  • A collaborative and dynamic work environment.

  • Big Data Cluster Specialist

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Overview:We are seeking a highly skilled Big Data Cluster Specialist to join our team. In this role, you will be responsible for designing and administering high-performance Hadoop clusters to meet the data processing needs of our organization.Key Responsibilities:Design and implement scalable Hadoop cluster architectures to support large-scale data...

  • Big Data Analytics Specialist

    7 days ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,50,000 - ₹ 28,00,000

    Job Title: Big Data Analytics Specialist\Hadoop Spark and Hive are at the core of our big data strategy. As a Big Data Analytics Specialist, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.\Key Responsibilities:\\Design and develop ETL processes using Hadoop and Spark...

  • Big Data Professional

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data Engineer OpportunityWe are seeking a skilled Big Data Engineer to join our team.">Develop and maintain big data pipelines and ETL workflows using PySpark, Hadoop (HDFS, MapReduce, Hive, HBase).Design and implement data ingestion, transformation, and integration processes on Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, and...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Big Data DeveloperWe are seeking a skilled Big Data Developer to design and develop robust and scalable data pipelines using Pyspark/Python. The ideal candidate will have experience working on AWS/AWS CLI, with AWS Glue being highly desirable. You should possess hands-on SQL experience and be well-versed with Big Data concepts.Data Pipeline Development:...

  • Big Data Engineer

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data EngineerLead the development and implementation of scalable data pipelines using Hadoop ecosystem tools.Design, build, and maintain ETL/ELT pipelines for efficient data processing.Write complex Hive queries to transform and analyze large datasets.Collaborate with cross-functional teams to deliver solutions that meet business...

  • Principal Big Data Specialist

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data EngineerJob Summary:Develop, implement, and maintain data pipelines to achieve high reliability and efficiency.Collaborate with the engineering team to design and develop proof-of-concept solutions for data infrastructure.Work closely with product teams to create new data products that meet business needs.Ensure accurate documentation of the Data...

  • Big Data Strategist

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a highly skilled and results-driven Data Architect to lead our team in the development of innovative data strategies and solutions.The ideal candidate will have a strong background in designing, implementing, and maintaining large-scale data systems, as well as experience with big data technologies such as Hadoop, Spark, and NoSQL...

  • Senior Big Data Developer

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeBigDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Description:As a Big Data Engineer, you will play a key role in designing and implementing data ingestion and curation processes using cutting-edge tools such as Spark, Hive, HDFS, Kafka, Pig, and Oozie. Your primary responsibility will be to contribute towards supporting the build/implementation of these processes under the guidance of senior team...

  • Advanced Big Data Specialist

    1 week ago

    Bengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data EngineerAt our organization, we're looking for an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems.Required Skills:Programming: Proficiency in Python is mandatory, as well as experience with other...

  • Big Data Developer

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 4,50,000 - ₹ 5,50,000

    Job TitleData Engineer - Large Scale Data Processing Solutions\We are seeking a highly skilled and experienced data engineer to join our team. As a data engineer, you will design, develop, and implement large-scale data processing solutions using Java, Spark Streaming, Spark Batch, and Hadoop.Develop and optimize data storage and retrieval systems using...