Big Data Engineer

2 weeks ago


Hyderabad, Telangana, India Vaakruthi Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Role & responsibilities

Job Description : Big Data Engineer

  • Analyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidents

Required Qualifiactions:

  • years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS, Spark, MapReduce framework
  • Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices
  • Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
  • Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
  • Must have Linux experience (Shell scripting/Python)

Prefferred Qualification:

  • Additonally: Good to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
  • Good to have experience creating CI/CD pipelines Maven, Gradle, Jenkins, Artifactory, AWSCodeCommit Cloudformation

Preferred candidate profile

"Pyspark

Scala / Java

AWS

Jenkins"


  • Big Data engineer

    2 weeks ago


    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Big Data engineer

    2 weeks ago


    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...


  • Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark and Databricks. Key Responsibilities:Design and implement scalable data architectures using PySpark and Databricks.Develop and optimize Spark applications using Spark UI and performance tuning techniques.Work with large...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 16,32,000 - ₹ 21,66,000

    Big Data Engineer RoleAs a skilled Big Data Engineer, you will be responsible for developing, constructing, testing and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This role is ideal for those who enjoy working with big data and have experience in handling large datasets.Responsibilities:Develop data...


  • Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data engineering professional to spearhead the development and implementation of cutting-edge big data analytics platforms.Key Responsibilities:Design and implement robust big data pipelines utilizing Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Develop expertise in graph databases such as Neo4j,...


  • Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 36,00,000

    Job Title:Big Data Engineering LeaderWe are seeking a Big Data Engineering Leader to join our team. As a key member of our engineering organization, you will be responsible for delivering roadmap features of our Enterprise TruRisk Platform.This platform helps customers Measure, Communicate and Eliminate Cyber Risks. You will work closely with...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India beBeeBigData Full time ₹ 15,00,000 - ₹ 28,00,000

    **Job Opportunity:**We are seeking a skilled Big Data professional to join our team.The ideal candidate will have 2+ years of experience in big data engineering with expertise in Scala, AWS, and Python or Java.**Key Responsibilities:**Design and implement big data solutions using Hadoop and SparkDevelop and deploy scalable data processing...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:To design, develop and maintain large-scale data systems that meet business needs.You will create efficient pipelines against multiple data sources such as SQL, Big Data on cloud platforms. Large, complex datasets will be processed to meet both functional and non-functional business requirements.Existing data models, pipelines, related...