Senior Big Data Engineer for Enterprise Data Domain
2 weeks ago
DBS Bank is a leading financial institution that operates with a strong focus on innovation and customer satisfaction. We strive to provide our customers with the best possible experience by leveraging cutting-edge technology and expertise.
Job Description
We are seeking a highly skilled Senior Big Data Engineer to join our team in Hyderabad, India. As a key member of our Institutional Banking Group Technology, you will play a vital role in designing and implementing large-scale data processing systems using big data technologies such as Spark and Hadoop. Your primary responsibility will be to extract data from source systems, transform it into a suitable format, and load it onto our Enterprise Data Domain tables and Data Marts.
Key Responsibilities
* Design, develop, and implement big data processing pipelines using Spark, Scala, and Hive
* Extract data from source systems (Open/Mainframes) to Data Lake (Hive/Parquet)
* Translate complex transformation logic into Hive/Spark-SQL queries to load data onto Enterprise Data Domain tables and Data Marts
* Work with live streaming datasets using Kafka/Spark Streaming
* Collaborate with cross-functional teams to deliver high-quality solutions on time
Requirements
* 2-4 years of hands-on experience with Spark Core, Spark-SQL, Scala-programming, and streaming datasets in Big Data platforms
* Extensive working experience in Hive and other components of Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)
* Strong understanding of complex transformation logic and ability to translate them into Spark-SQL queries
* Unix Shell Scripting and setting up CRON jobs
* Experience with Cloudera distribution framework, Oozie Workflow (or any scheduler), Jenkins (or any version controller)
* Prior experience in Consumer Banking Domain and agile delivery method is an advantage
* Excellent understanding of technology life cycles and concepts required to build big data solutions
* Familiarity with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
* Core Java skillset and Microservices understanding is an added advantage
* Good knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus
* Bachelor of Engineering, Bachelor of Technology, MCA (or equivalent master's degree)
Estimated Salary
The estimated salary for this position is around ₹1,200,000 - ₹1,800,000 per annum, depending on qualifications and experience.
Benefits
* Comprehensive health insurance
* Retirement plan with employer matching contributions
* Flexible work arrangements
* Opportunities for career growth and professional development
-
Innovative Big Data Solutions Engineer
1 day ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Systems Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India NTT DATA Services Full timeData Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...
-
Data Modeling Expert
4 weeks ago
Hyderabad, Telangana, India data Full timeWhat drives innovation in data-driven products?We are looking for an experienced data engineer to join our team and contribute to the development of innovative analytics and data products. As a big data engineer, you will be part of a collaborative team that uses agile methodologies and open-source technologies to build cutting-edge data processing programs....
-
Data Engineer for Big Data Solutions
4 weeks ago
Hyderabad, Telangana, India DBS Bank Full timeJob Title: Data Engineer for Big Data SolutionsRole Overview:As a Data Engineer for Big Data Solutions, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Big Data technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective...
-
Hyderabad, Telangana, India data Full timeUnlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...
-
Senior Big Data Engineer
2 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob DescriptionAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale big data environments using PySpark.Key Responsibilities:Design and implement complex big data...
-
Data Engineer
4 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAbout UnitedHealth GroupAt UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone–of every race, gender, sexuality, age, location and income–deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India The Modern Data Company Full timeJob Description :The Senior Data Engineer will provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Findernest Software Services Pvt Ltd Full timeAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team at Findernest Software Services Pvt Ltd. As a Senior Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable big data solutions that drive business growth and decision-making.Key ResponsibilitiesDesign and implement big data...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Nisum Full timeJob Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at Nisum. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop, Python, and other big data technologies.Key Responsibilities:- Design...
-
Senior Big Data Engineer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...
-
Data Intelligence Specialist
2 days ago
Hyderabad, Telangana, India data Full timeAbout the RoleWe are seeking a highly skilled Data Intelligence Specialist to join our engineering team in Hyderabad, India.The ideal candidate will have a strong passion for data analysis and quality monitoring, with a deep understanding of complex datasets and statistical measurements.Key ResponsibilitiesTake full ownership of data.ai core intelligence...
-
Data Engineer, Enterprise Data Solutions
1 month ago
Hyderabad, Telangana, India DBS Bank Full timeJob SummaryDBS Bank is seeking a Senior Associate, Data Engineer, Enterprise Data to join our Group Technology and Operations team. As a key member of our team, you will be responsible for building, deploying, and managing data security products to secure and implement governance policies on our organization's data assets.Key Responsibilities• Design and...
-
GCP Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Tiger Analytics Full timeAbout the Role:Tiger Analytics is looking for a Senior Data Engineer to join our Chennai office. As a Senior Data Engineer, you will be responsible for designing and building solutions for near real-time stream processing and batch processing on the Big Data platform.Responsibilities:Design and build solutions for near real-time stream processing and batch...
-
Data Analyst Position
4 weeks ago
Hyderabad, Telangana, India data Full timeA Career Defining Role in Data IntelligenceAs a Data Analyst, you will play a pivotal role in helping us uncover hidden insights and trends within our vast dataset. Your expertise will be instrumental in ensuring the accuracy and quality of our data, enabling us to make informed decisions that drive business growth.ResponsibilitiesTake ownership of data.ai's...
-
Big Data Solutions Architect
2 days ago
Hyderabad, Telangana, India Tiger Analytics Full timeJob DescriptionWe are looking for a Senior Data Engineer to join our Tiger Analytics team based out of Chennai, Bangalore & Hyderabad offices.This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will design and build solutions for near real-time stream processing as well...
-
Data Engineer for Big Data Concepts
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Data Platform EngineerJob Summary:Job Description: We are seeking a talented Senior Data Platform Engineer to join our team at Virtusa. As a Senior Data Platform Engineer, you will be responsible for designing, developing, and maintaining large-scale data platforms using Python. You will work closely with cross-functional teams to...