Technical Consultant for Data Engineering and Hadoop
1 day ago
About Evernorth Health Services:
Evernorth Health Services is committed to elevating health for all, recognizing that health is the foundation for human potential and progress. As a champion for affordable, predictable, and simple healthcare, we tackle problems others don't, won't, or can't.
Our innovation hub in India enables us to collaborate with the right talent, expand our global presence, enhance our competitive edge, and deliver on our promises to stakeholders more effectively. We are passionate about improving healthcare by providing world-class solutions that make a real difference.
We look upward, starting with finding the right talent to help us achieve our goals.
Job Title: Software Engineering Advisor
Job Responsibilities:
- Collaborate with business and technical leaders to understand requirements.
- Design solutions meeting the requirements and document them.
- Ability to write high-quality, performant code for data extraction, transformations, and loading using Spark, Py-Spark.
- Perform data modeling as needed for the requirements.
- Write efficient queries using Teradata SQL, Hive SQL, and Spark SQL against Teradata and Hive.
- Implement dev-ops pipelines to deploy code artifacts on designated platforms/servers like AWS or Hadoop Edge Nodes.
- Implement Hadoop job orchestration using Shell scripting, Apache Oozie, CA7 Enterprise Scheduler, and Airflow.
- Troubleshoot issues, provide effective solutions, and monitor jobs in the production environment.
- Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos, and retrospectives.
Experience Required:
A minimum of 8-10 years of experience.
Desired Skills and Experience:
- Proficiency in Jira and Confluence.
- Familiarity with the healthcare domain is a plus.
- Excellent work experience with Hadoop as a data warehouse.
- Experience in Agile and working knowledge of DevOps tools.
Primary Skills and Qualifications:
- Expertise in Spark, Py-Spark, Shell scripting, Teradata, Hive, and Hadoop.
- Knowledge of SQLs (using Teradata SQL, Hive SQL, and Spark SQL) and stored procedures.
- Proficiency in Git, Jenkins, Artifactory.
- Unix/Linux Shell scripting (KSH) and basic Unix server administration.
- CA7 Enterprise Scheduler.
- AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch).
- Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration).
Estimated Annual Salary:$120,000 - $180,000 based on location and experience.
-
Data Engineer
17 hours ago
Hyderabad, Telangana, India People Tech Group Inc Full timeJob Title: Data Engineer - Hadoop and Big Data Expert About People Tech Group IncWe are a leading technology solutions provider, dedicated to delivering innovative and effective solutions to our clients. As a result-driven organization, we strive to stay ahead of the curve in terms of technological advancements, ensuring that our services meet the evolving...
-
Innovative Big Data Solutions Engineer
1 week ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Data Engineer for Hadoop Ecosystem
1 week ago
Hyderabad, Telangana, India Virtusa Full timeJob Description:We are seeking an experienced Data Engineer to join our team in Hyderabad, India. This is a challenging role that requires strong expertise in designing, building, and supporting large-scale data applications using Hadoop ecosystem components.About the Role:Designing and Developing Data Applications: Develop complex software requirements to...
-
Hyderabad, Telangana, India Virtusa Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.ResponsibilitiesDesign and implement data processing pipelines using Python...
-
Senior Hadoop Developer
4 weeks ago
Hyderabad, Telangana, India ValueMomentum Full timeAbout ValueMomentum's Engineering CenterAt ValueMomentum, we're a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through a strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery...
-
Hyderabad, Telangana, India data Full timeUnlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...
-
Big Data Systems Engineer
4 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Data Architect with Hadoop Specialization
4 days ago
Hyderabad, Telangana, India Anblicks Full timeJob DescriptionWe are seeking an experienced Data Architect to join our team at Anblicks. This role involves designing and implementing data solutions using Hadoop technologies.About the Role:Design and develop large-scale data processing pipelines using Hadoop ecosystem tools such as HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, and...
-
Hadoop Software Quality Engineer
4 weeks ago
Hyderabad, Telangana, India ValueMomentum Full time{"Responsibilities": "Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.Evaluate the performance and scalability of our data ingestion processes and...
-
Hyderabad, Telangana, India Aricent Full timeJob DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...
-
Expert Hadoop Developer
3 weeks ago
Hyderabad, Telangana, India SMARTWORK IT SERVICES Full timeJob SummaryAt SMARTWORK IT SERVICES, we are seeking a skilled Hadoop Developer to join our team. The ideal candidate will have strong expertise in Hadoop, MapReduce, and either Java or Python, along with Data Structures and Algorithms knowledge.Key Responsibilities- Develop and evolve highly scalable, fault-tolerant distributed components using Hadoop...
-
Senior Big Data Developer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeVirtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...
-
Senior Technical Advisor
1 week ago
Hyderabad, Telangana, India Evernorth Health Services Full timeEvernorth Health ServicesElevate Health for All as a Senior Technical AdvisorAbout EvernorthWe champion affordable, predictable and simple health care. Our innovation hub in India enables us to work with top talent, expand globally, improve competitiveness, and deliver on our promises to stakeholders.We're passionate about making healthcare better by...
-
Data Architect
1 month ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full timeA Data Architect at NTT DATA Business Solutions plays a pivotal role in designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Key Responsibilities:Designing and Implementing ETL Processes:Develop scalable data pipelines and create efficient Extract, Transform, Load (ETL)...
-
Senior Big Data Engineer
5 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob Title: Senior Big Data EngineerAbout Us: Tata Consultancy Services, a global leader in IT services and consulting, is seeking an experienced Senior Big Data Engineer to join our team.Estimated Salary: ₹1,200,000 - ₹1,500,000 per annum (dependent on location and experience).Job Description:The successful candidate will have hands-on experience with...
-
Big Data Engineering Lead
2 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeAbout Tata Consultancy ServicesTata Consultancy Services is a leading IT services company that empowers global businesses through its cutting-edge technology and innovative solutions.Compensation PackageThe estimated salary for this role is around $120,000 - $180,000 per annum, depending on the location and individual qualifications.About the RoleJob...
-
Senior Data Engineering Specialist
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob DescriptionVidpro Consultancy Services is seeking a qualified Big Data Engineer JavaPython DSA to join our team.Responsibilities:As a senior member of our team, you will be responsible for designing and implementing large-scale Big Data architectures.You will have hands-on experience in programming languages like Java, Python, or Scala.The ideal...
-
Data Engineering Specialist
17 hours ago
Hyderabad, Telangana, India People Tech Group Inc Full timeJob DescriptionWe are seeking an experienced Data Engineering Specialist to join our team at People Tech Group Inc.About the RoleThe ideal candidate will have a strong background in big data technologies, including Hadoop Eco System – Spark, Python, Hive, Impala, Unix, Python and OOPs programming languages (Scala preferrable), SQL, and Agile...
-
Enterprise Data Engineer
1 day ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeAt Tata Consultancy Services, we are looking for an experienced Enterprise Data Engineer to join our team.We offer a competitive salary in the range of 12-18 lakhs per annum, depending on your experience and qualifications.The ideal candidate should have more than 6 years of experience in working with big data environments, specifically with Spark/Scala....
-
Data Engineer for Big Data Platform
1 month ago
Hyderabad, Telangana, India DBS Bank Full timeData Engineer for Big Data PlatformWe are looking for a Data Engineer to join our team and work on our Big Data platform. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data architecture, ensuring data quality, and optimizing data processing pipelines.Key Responsibilities:Design and develop data pipelines using...