Technical Consultant for Data Engineering and Hadoop

1 day ago


Hyderabad, Telangana, India Evernorth Health Services Full time

About Evernorth Health Services:

Evernorth Health Services is committed to elevating health for all, recognizing that health is the foundation for human potential and progress. As a champion for affordable, predictable, and simple healthcare, we tackle problems others don't, won't, or can't.

Our innovation hub in India enables us to collaborate with the right talent, expand our global presence, enhance our competitive edge, and deliver on our promises to stakeholders more effectively. We are passionate about improving healthcare by providing world-class solutions that make a real difference.

We look upward, starting with finding the right talent to help us achieve our goals.

Job Title: Software Engineering Advisor

Job Responsibilities:

  • Collaborate with business and technical leaders to understand requirements.
  • Design solutions meeting the requirements and document them.
  • Ability to write high-quality, performant code for data extraction, transformations, and loading using Spark, Py-Spark.
  • Perform data modeling as needed for the requirements.
  • Write efficient queries using Teradata SQL, Hive SQL, and Spark SQL against Teradata and Hive.
  • Implement dev-ops pipelines to deploy code artifacts on designated platforms/servers like AWS or Hadoop Edge Nodes.
  • Implement Hadoop job orchestration using Shell scripting, Apache Oozie, CA7 Enterprise Scheduler, and Airflow.
  • Troubleshoot issues, provide effective solutions, and monitor jobs in the production environment.
  • Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos, and retrospectives.

Experience Required:

A minimum of 8-10 years of experience.

Desired Skills and Experience:

  • Proficiency in Jira and Confluence.
  • Familiarity with the healthcare domain is a plus.
  • Excellent work experience with Hadoop as a data warehouse.
  • Experience in Agile and working knowledge of DevOps tools.

Primary Skills and Qualifications:

  • Expertise in Spark, Py-Spark, Shell scripting, Teradata, Hive, and Hadoop.
  • Knowledge of SQLs (using Teradata SQL, Hive SQL, and Spark SQL) and stored procedures.
  • Proficiency in Git, Jenkins, Artifactory.
  • Unix/Linux Shell scripting (KSH) and basic Unix server administration.
  • CA7 Enterprise Scheduler.
  • AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch).
  • Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration).

Estimated Annual Salary:$120,000 - $180,000 based on location and experience.


  • Data Engineer

    17 hours ago


    Hyderabad, Telangana, India People Tech Group Inc Full time

    Job Title: Data Engineer - Hadoop and Big Data Expert About People Tech Group IncWe are a leading technology solutions provider, dedicated to delivering innovative and effective solutions to our clients. As a result-driven organization, we strive to stay ahead of the curve in terms of technological advancements, ensuring that our services meet the evolving...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Description:We are seeking an experienced Data Engineer to join our team in Hyderabad, India. This is a challenging role that requires strong expertise in designing, building, and supporting large-scale data applications using Hadoop ecosystem components.About the Role:Designing and Developing Data Applications: Develop complex software requirements to...


  • Hyderabad, Telangana, India Virtusa Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.ResponsibilitiesDesign and implement data processing pipelines using Python...


  • Hyderabad, Telangana, India ValueMomentum Full time

    About ValueMomentum's Engineering CenterAt ValueMomentum, we're a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through a strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...


  • Hyderabad, Telangana, India Anblicks Full time

    Job DescriptionWe are seeking an experienced Data Architect to join our team at Anblicks. This role involves designing and implementing data solutions using Hadoop technologies.About the Role:Design and develop large-scale data processing pipelines using Hadoop ecosystem tools such as HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, and...


  • Hyderabad, Telangana, India ValueMomentum Full time

    {"Responsibilities": "Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.Evaluate the performance and scalability of our data ingestion processes and...


  • Hyderabad, Telangana, India Aricent Full time

    Job DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...


  • Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job SummaryAt SMARTWORK IT SERVICES, we are seeking a skilled Hadoop Developer to join our team. The ideal candidate will have strong expertise in Hadoop, MapReduce, and either Java or Python, along with Data Structures and Algorithms knowledge.Key Responsibilities- Develop and evolve highly scalable, fault-tolerant distributed components using Hadoop...


  • Hyderabad, Telangana, India Virtusa Full time

    Virtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...


  • Hyderabad, Telangana, India Evernorth Health Services Full time

    Evernorth Health ServicesElevate Health for All as a Senior Technical AdvisorAbout EvernorthWe champion affordable, predictable and simple health care. Our innovation hub in India enables us to work with top talent, expand globally, improve competitiveness, and deliver on our promises to stakeholders.We're passionate about making healthcare better by...

  • Data Architect

    1 month ago


    Hyderabad, Telangana, India NTT DATA Business Solutions Full time

    A Data Architect at NTT DATA Business Solutions plays a pivotal role in designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Key Responsibilities:Designing and Implementing ETL Processes:Develop scalable data pipelines and create efficient Extract, Transform, Load (ETL)...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Job Title: Senior Big Data EngineerAbout Us: Tata Consultancy Services, a global leader in IT services and consulting, is seeking an experienced Senior Big Data Engineer to join our team.Estimated Salary: ₹1,200,000 - ₹1,500,000 per annum (dependent on location and experience).Job Description:The successful candidate will have hands-on experience with...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    About Tata Consultancy ServicesTata Consultancy Services is a leading IT services company that empowers global businesses through its cutting-edge technology and innovative solutions.Compensation PackageThe estimated salary for this role is around $120,000 - $180,000 per annum, depending on the location and individual qualifications.About the RoleJob...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job DescriptionVidpro Consultancy Services is seeking a qualified Big Data Engineer JavaPython DSA to join our team.Responsibilities:As a senior member of our team, you will be responsible for designing and implementing large-scale Big Data architectures.You will have hands-on experience in programming languages like Java, Python, or Scala.The ideal...


  • Hyderabad, Telangana, India People Tech Group Inc Full time

    Job DescriptionWe are seeking an experienced Data Engineering Specialist to join our team at People Tech Group Inc.About the RoleThe ideal candidate will have a strong background in big data technologies, including Hadoop Eco System – Spark, Python, Hive, Impala, Unix, Python and OOPs programming languages (Scala preferrable), SQL, and Agile...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    At Tata Consultancy Services, we are looking for an experienced Enterprise Data Engineer to join our team.We offer a competitive salary in the range of 12-18 lakhs per annum, depending on your experience and qualifications.The ideal candidate should have more than 6 years of experience in working with big data environments, specifically with Spark/Scala....


  • Hyderabad, Telangana, India DBS Bank Full time

    Data Engineer for Big Data PlatformWe are looking for a Data Engineer to join our team and work on our Big Data platform. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data architecture, ensuring data quality, and optimizing data processing pipelines.Key Responsibilities:Design and develop data pipelines using...