Big Data Engineer

23 hours ago

Hyderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Architect

Data architects play a crucial role in designing and implementing large-scale data systems that enable business growth. As a seasoned professional in the field of big data, you will be responsible for leading the development of data infrastructure that drives performance tuning of Spark jobs.

Key Responsibilities:

  • Expert-level understanding of distributed computing principles
  • Hands-on programming with Python, Apache Spark, and Hadoop v2
  • Proficiency with HDFS, Sqoop, MapReduce, and Big Data querying tools like Hive and Impala
  • Experience with building stream-processing systems using Apache Storm or Spark-Streaming
  • Good understanding of messaging systems like Kafka and RabbitMQ
  • Integration of data from multiple sources including RDBMS, ERP, and Files
  • Knowledge of ETL techniques and frameworks
  • Designing and implementing big data solutions
  • Practitioner of Agile methodology

Requirements:

  • 8-12 years of experience in big data and related technologies
  • Expert-level knowledge of Apache Spark
  • Proficiency in Python and Hadoop v2
  • Good understanding of SQL queries, joins, stored procedures, and relational schemas
  • Experience with NoSQL databases like HBase, Cassandra, and MongoDB
  • Ability to lead a team efficiently

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India RandomTrees Full time

    Job Title: Big Data Engineer Experience: 5–9 Years Location: Hyderabad-Hybrid Employment Type: Full-Time Job Summary: We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL,...

  • Big Data engineer

    7 days ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Big Data engineer

    4 days ago

    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Senior Big Data Engineer

    1 day ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark and Databricks. Key Responsibilities:Design and implement scalable data architectures using PySpark and Databricks.Develop and optimize Spark applications using Spark UI and performance tuning techniques.Work with large...

  • Senior Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 16,32,000 - ₹ 21,66,000

    Big Data Engineer RoleAs a skilled Big Data Engineer, you will be responsible for developing, constructing, testing and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This role is ideal for those who enjoy working with big data and have experience in handling large datasets.Responsibilities:Develop data...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Vaakruthi Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role & responsibilitiesJob Description : Big Data EngineerAnalyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidentsRequired Qualifiactions:years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS,...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India TECHOAKS IT SOLUTIONS PRIVATE LIMITED Full time

    Full-time with Info ServicesClient: Disney (Offshore)Job Description :Java with Big DataMust have skills :- 8+ years of total work experience is expected.- Java, Big Data, Spring, Kafka, AWS, Scala, and Spark: All these are needed to be strong.Roles & Responsibilities :- Design and Development: Architect, design, and develop high-performance, scalable, and...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeBigData Full time ₹ 15,00,000 - ₹ 28,00,000

    **Job Opportunity:**We are seeking a skilled Big Data professional to join our team.The ideal candidate will have 2+ years of experience in big data engineering with expertise in Scala, AWS, and Python or Java.**Key Responsibilities:**Design and implement big data solutions using Hadoop and SparkDevelop and deploy scalable data processing...