Big Data Engineer

2 weeks ago

Chennai Hyderabad, India Orcanexgen Full time ₹ 1,04,000 - ₹ 1,30,878 per year

BigData Engineer

Hyderabad, Chennai

Hybrid mode

5+ years of experience

Job Description:

Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques. Candidate will possess experience in developing highly scalable Big Data pipelines, strong technical knowledge, thought leadership, and a passion for creating scalable, high-performance systems.

Must Skillsets : Big Data, Scala, AWS, CICD, Python

Key Responsibilities

  • Design, develop, and optimize distributed systems and BigData solutions.
  • Implement and maintain pipelines using Scala, Python, AWS, CICD
  • Build and maintain CI/CD pipelines to ensure efficient code deployment and integration.
  • Apply design patterns, optimization techniques, and locking principles to enhance system performance and reliability.
  • Scale systems and optimize performance

Required Qualifications

  • Proven experience working with distributed systems and Big Data technologies.
  • Proficiency in Scala, Python, Java, C++ and related tools.
  • In-depth understanding of design patterns and system optimisation principles.
  • Hands-on experience with batch and streaming datapipelines.
  • Familiarity with CI/CD pipelines

  • Big Data Engineer

    2 weeks ago

    Chennai, Hyderabad, India Trustklub Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Roles and Responsibilities :Design, develop, and maintain large-scale data pipelines using PySpark on AWS cloud platform.Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions that meet business needs.Develop scalable data processing applications using Python programming language and integrate them with existing...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Impacteers Full time

    Position Overview :We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The role involves working with large datasets, integrating diverse data sources, and ensuring data availability for analytics, machine learning, and business intelligence. The ideal candidate will...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Chennai, Hyderabad, India Artech Full time US$ 9,00,000 - US$ 12,00,000 per year

    Job Title: Data Engineer (Python, PySpark, PL/SQL)Work Location: Chennai, Tamil NaduExperience Required: 4 to 6 YearsJob Description:We are seeking a skilled and motivated Data Engineer with 4-6 years of experience to join our team in Chennai. The ideal candidate will have hands-on experience with Python, PySpark, and PL/SQL, along with a strong...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...

  • Big Data Engineer

    3 hours ago

    Hyderabad, India Allegis Group Full time

    Role & responsibilities Consult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables. Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors. Contribute to the...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark and Databricks. Key Responsibilities:Design and implement scalable data architectures using PySpark and Databricks.Develop and optimize Spark applications using Spark UI and performance tuning techniques.Work with large...