Big Data Engineer

2 days ago

Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Description:

To design, develop and maintain large-scale data systems that meet business needs.

You will create efficient pipelines against multiple data sources such as SQL, Big Data on cloud platforms.

Large, complex datasets will be processed to meet both functional and non-functional business requirements.

Existing data models, pipelines, related infrastructure, and processes will be analyzed and improved.

Analytics tools utilizing the data pipeline will provide actionable insights into customer acquisition, operational efficiency, and key business performance metrics.

Data quality and governance policies will be monitored and improved.

Collaboration with stakeholders including executive, product, data, and design teams will assist with data-related technical issues and support their data infrastructure needs.

Tools for analytics and data scientist team members will be created to assist them in building and optimizing our product.

The data platform will be worked on with data and analytics experts to strive for greater functionality.

Key skills include:

  • 5+ years of experience working with distributed data technologies (e.g., Hadoop, MapReduce, Spark, Kafka, Flink etc.) for building efficient, large-scale 'big data' pipelines;
  • Strong software engineering experience with proficiency in at least one of the following programming languages: Java, Scala, Python or equivalent;
  • Implementing data ingestion pipelines both real-time and batch using best practices;
  • Experience with building stream-processing applications using Apache Flink, Kafka Streams or others;
  • Cloud computing experience with Azure, Amazon AWS, Google Cloud etc.;
  • Experience supporting and working with cross-functional teams in a dynamic environment;
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with ELK stack.

Key Requirements-

  • Experience in building distributed, high-volume data services;
  • Big data processing and analytics experience with AWS: EMR, S3, EC2, Athena, Kinesis, Lambda, Quicksight etc.;
  • Knowledge of data science tools and their integration with data lakes;
  • Container technology experience like Docker.

Education:

Bachelor of Science in Computer Science or equivalent technical training and professional experience.

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India RandomTrees Full time

    Job Title: Big Data Engineer Experience: 5–9 Years Location: Hyderabad-Hybrid Employment Type: Full-Time Job Summary: We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL,...

  • Big Data engineer

    5 days ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Big Data engineer

    2 days ago

    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark and Databricks. Key Responsibilities:Design and implement scalable data architectures using PySpark and Databricks.Develop and optimize Spark applications using Spark UI and performance tuning techniques.Work with large...

  • Senior Big Data Engineer

    5 hours ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 16,32,000 - ₹ 21,66,000

    Big Data Engineer RoleAs a skilled Big Data Engineer, you will be responsible for developing, constructing, testing and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This role is ideal for those who enjoy working with big data and have experience in handling large datasets.Responsibilities:Develop data...

  • Big Data Engineer

    24 hours ago

    Hyderabad, Telangana, India Vaakruthi Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role & responsibilitiesJob Description : Big Data EngineerAnalyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidentsRequired Qualifiactions:years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS,...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India TECHOAKS IT SOLUTIONS PRIVATE LIMITED Full time

    Full-time with Info ServicesClient: Disney (Offshore)Job Description :Java with Big DataMust have skills :- 8+ years of total work experience is expected.- Java, Big Data, Spring, Kafka, AWS, Scala, and Spark: All these are needed to be strong.Roles & Responsibilities :- Design and Development: Architect, design, and develop high-performance, scalable, and...

  • Senior Data Engineer

    9 hours ago

    Hyderabad, Telangana, India beBeeBigData Full time ₹ 15,00,000 - ₹ 28,00,000

    **Job Opportunity:**We are seeking a skilled Big Data professional to join our team.The ideal candidate will have 2+ years of experience in big data engineering with expertise in Scala, AWS, and Python or Java.**Key Responsibilities:**Design and implement big data solutions using Hadoop and SparkDevelop and deploy scalable data processing...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...