Big Data Engineer

4 days ago

Hyderabad, Telangana, India Allegis Global Solutions (AGS) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist.

In this role, you will:

  1. Candidate should have strong knowledge on Linux Administration
  2. We are looking for a bigdata Engineer who will be working in our team for deploying and maintaining the Application on bigdata platform.
  3. Candidate should have experience in bigdata technologies the workloads by following the industry best practices of bigdata on Cloudera.
  4. Candidate should have experience in bigdata scanning and fix vulnerabilities where required.
  5. Candidate will have to work with existing cloud Automation team & follow the existing processes and procedures to deliver the automation and maintain the existing Cloud Environments.
  6. Should be able to work with different teams (spread across in multiple location) to develop a scalable, reliable, and resilient software running in the GKE.

To be successful in this role, you should meet the following requirements:

  • Candidate should have experience in Bigdata/ GKE
  • Knowledge of ISTIO will be an added advantage
  • Experience in different deployment strategies
  • Should have experience in Cloud monitoring & logging
  • Knowledge of Vault for Secrets storage (will be an added advantage)
  • Strong Linux administration experience within a complex multi-tier enterprise infrastructure environment (OAT, NAS, NetBackup and Puppet)
  • Knowledge and hands on experience on Ansible Tower.
  • DevOps hands-on tooling experience GITHUB, Jenkins, Ansible & Ansible Tower, Groovy, etc.
  • In-depth automation and scripting skills including use of a scripting languages such as BASH, Python, YAML. PowerShell would also be advantageous
  • Knowledge of CICD (Continuous Integration Continuous Deployment)
  • Experience of working in an Agile team and knowledge of Jira/Confluence (will be an added advantage)
  • Good Analytical skills in issue diagnosis
  • Good communication skill
  • Identify, plan, and deliver IT Initiatives.
  • Coordinate planning & delivery of business changes.
  • Overlook Production support, manage support roaster and xMatter setup.
  • Periodic renewal of BIA, DSS, Data Clinic, BRETT, DR Exemption.
  • Manage Change Order implementation.
  • Manage Incidents communication, SOTN update, representation in Retro calls, PIR meetings.
  • Review and Approve CRs raised by Platform team for patching, SSP activities. Do IA and plan activities accordingly.
  • Requirement gathering & developing PYSPARK, PENTAHO & Control-M jobs.
  • BFF SPOC for Awards & Recognition pillar.
  • Any degree with Strong Finance and Accounting background.
  • PYSPARK, Bigdata knowledge is preferrable
  • Bigdata, Pentaho, PYSPARK,Linux shell scripting.,Python programming., Control M scheduling.

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Sky Systems, Inc. (SkySys) Full time

    Role:Big Data EngineerPosition Type:Full-Time Contract (40hrs/week)Contract Duration:Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilledBig Data Engineer (5+ years' experience)to join Experian's dynamic data engineering team. You will design and optimize scalable data pipelines,...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.Roles and ResponsibilityDesign and develop scalable big data systems using Pyspark and Azure Data Bricks.Implement and manage...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Incedo Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineers – Big Data Platform At Incedo, we're looking for experienced Big Data Engineers (5–8 years) to join our AI & Data team in Hyderabad — and be part of building cutting-edge data ecosystems for the Banking domain. What You'll Do • Design, develop & optimize large-scale data pipelines using Hadoop, Hive, HDFS, and Kafka •...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Vaakruthi Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesJob Description : Big Data EngineerAnalyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidentsRequired Qualifiactions:years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS,...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Operations Engineer

    2 days ago

    Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title:Big Data DeveloperWork Location:Hyderabad, Telangana (TG), IndiaExperience Range:6–8 YearsSkill Area:Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-drivenBig Data Developerto join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing, developing, and...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...