Senior/Lead Big Data Engineer

1 week ago


Hyderabad, Telangana, India Softility Full time

Big Data Developer

Job Description :

- Participate in the design and implementation phases for data projects to help translate high level business requirements into technical solutions

- Provide technically sound solutions for the ingestion, storage, transformation, and presentation of enterprise data, including ETL design, data storage strategies, data access and security

- Driving the design of scalable solutions while considering recoverable and resiliency requirements

- Participate in DevOps related activities, including involvement with continuous integration, automated deployment, automated testing, and continuous monitoring to enhance performance and product quality

- Provide timely support for troubleshooting and resolving production issues

Required Technical and Professional Expertise :

- Experience with any of the following : Big Data technologies, Analytics, Hadoop ecosystems, DataLakes, or Data Migration

- Experience with cloud platforms such as AWS, Azure, or Google Cloud

- Experience with Java, Scala, Spark

- Strong database integration and management skills

- Strong ETL skills, including database performance tuning and optimization

- Familiar with Shell scripting skills and Unix/Linux knowledge

- Exceptional analytical and problem-solving skills

- Running diagnostic tests and performing debugging procedures

- Documenting application development processes, procedures, and standards

- Excellent leadership and interpersonal skills

- Strong communication and team working skills

- Able to analyze complex situations and derive workable actions

- Flexibility to adjust to multiple demands, shifting priorities, ambiguity and rapid change

Preferred Technical And Professional Expertise :

- Knowledge of DevOps and related tooling such as Jenkins, Ansible etc.

- Experience with Big Data technologies such as Apache Hadoop, HBase, Hive, Spark, Flink or Flume

- Strong coding skills in one of Python/Java/Scala

- Familiar with event management technologies such as Apache Kafka or Apache Airflow

- Familiar with container technologies such as Docker or Kubernetes

- Demonstrable experience coaching junior members of your teams

(ref:hirist.tech)

  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, Telangana, India Micron Semiconductor Asia Operations Pte. Ltd Full time

    We are looking for leaders with strong technical experience in Big Data and Cloud Data warehouse technologies. This role will work primarily in Cloud data warehouse like Snowflake and GCP platforms, monitoring solutions such as Splunk and automation and machine learning using Python.Key Skills and Qualifications:10+ years developing, delivering, and/or...


  • Hyderabad, Telangana, India Talescope Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Talescope. As a key member of our engineering team, you will be responsible for leading the design and implementation of complex, scalable data pipelines using AWS services. You will work closely with cross-functional teams to understand their data needs and translate them...


  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Welcome to TATA CONSULTANCY SERVICES LIMITEDWe are seeking an experienced Big Data Engineer to join our team.About the Role:This is a senior-level position requiring 5-8 years of experience in designing and implementing big data solutions using Azure Databricks, Azure Data Factory, and Azure Synapse Analytics.Main Responsibilities:Lead the development of...

  • AWS Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...

  • Big Data Engineer

    5 days ago


    Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job Title : Big Data Engineer (Dynatrace)Location : Chennai, Bangalore, HyderabadExperience : 6-10 YearsRequired skills : Big Data, DynatraceJob Description : We are looking for an experienced Big Data Engineer (Dynatrace) with building scalable data pipelines and ensuring performance optimization through Dynatrace monitoring. This role requires a seasoned...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...


  • Hyderabad, Telangana, India HSBC Full time

    Job Title: Senior Consultant Specialist - Big DataJob Summary:This role involves designing and implementing big data solutions using Pyspark and GCP technologies. The successful candidate will have a strong background in software engineering, data architecture, and cloud computing, with excellent problem-solving and analytical skills.Key...

  • Big data engineer

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...


  • Hyderabad, Telangana, India Info Services Full time

    Job DescriptionTitle: Big Data EngineerLocation: Financial District, Hyderabad - HybridType: OffshoreShift Timings: 1:00pm - 10:00pm ISTMode: Fulltime Role.We are looking for someone who can:- Support large data distributed pipelines that span across Airflow, Databricks and Snowflake. Some knowledge with Airflow is good to have to understand how the DAGs...


  • Hyderabad, Telangana, India Anblicks Full time

    We are seeking a highly skilled Data Engineer to join our team at Anblicks. As a Senior Data Engineering Lead, you will play a key role in designing and developing scalable data solutions using Python and PySpark.Key Responsibilities:Design and develop ETL/ELT data pipelines using Python and PySparkBuilt and maintain large-scale data processing frameworks...


  • Hyderabad, Telangana, India Info Services Full time

    Title : Big Data Engineer. Location : Financial District, Hyderabad Hybrid. Type : Offshore. Shift Timings : 1:00pm 10:00pm IST. Mode : Fulltime Role.We are looking for someone who can : - Support large data distributed pipelines that span across Airflow, Databricks and Snowflake. - Some knowledge with Airflow is good to have to understand how the DAGs work,...


  • Hyderabad, Telangana, India Info Services Full time

    Title : Big Data Engineer. Location : Financial District, Hyderabad Hybrid. Type : Offshore. Shift Timings : 1:00pm 10:00pm IST. Mode : Fulltime Role.We are looking for someone who can : - Support large data distributed pipelines that span across Airflow, Databricks and Snowflake. - Some knowledge with Airflow is good to have to understand how the DAGs work,...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Questsphere Private ltd. Full time

    Our client is looking to deploy big data engineer at one of the worlds top product company R&D centre based out of Hyderabad. As a Big Data Engineer, you are going to work with cross-functional collaboration and communication with members from other teams.As an Engineer, you are responsible to analyze large data sets to identify errors . You are responsible...

  • Big data Lead

    2 days ago


    Hyderabad, Telangana, India Tata Consultancy Services Limited Full time

    Job DescriptionRole- Big data LeadJob DescriptionDesired Competencies (Technical/Behavioral Competency)- Big data- Spark- Scala- Project ManagementResponsibilities- Good experience in MQ or kafka or Rabbit MQ- Exp in .Terraform, Kubernete- CI/CD, Cloud- Good stakeholder management exp


  • Hyderabad, Telangana, India Live Connections Full time

    Job DescriptionWe are seeking a seasoned Data Engineering Manager with extensive experience in Python and Big Data technologies to lead our analytics team in Hyderabad. As a key member of our organization, you will be responsible for driving data strategies that empower our business intelligence capabilities and contribute to data-driven decision-making...


  • Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...

  • Big Data Engineer

    7 days ago


    Hyderabad, Telangana, India Apollo HealthAxis Full time

    Job DescriptionAs a Big Data Engineer at Apollo HealthAxis, you will be responsible for designing and implementing large-scale data processing systems using distributed computing technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective data architecture and...


  • Hyderabad, Telangana, India Payoda Technologies Pvt. Ltd Full time

    A global company in innovation, Payoda is at the forefront of digital transformation to enable enterprises across industries to use cutting-edge technology in the areas of cloud, advanced analytics, and user experience. Does the challenge of driving decisions in a dynamic environment excite you? Are you seeking an environment where you can drive innovation?...