Data Engineer

4 days ago


Hyderabad, Telangana, India DBS Bank Full time

About the Role

The Data Engineer will be responsible for designing, developing, and maintaining large-scale data processing systems to support the Consumer Banking Group's technology infrastructure. This includes extracting data from source systems, transforming it into a usable format, and loading it into data warehouses and data marts.

Responsibilities

  • Design and develop scalable data pipelines using Spark and Scala to extract data from source systems and load it into data warehouses and data marts.
  • Develop and maintain complex data transformation logic using Hive and Spark-SQL to ensure data integrity and quality.
  • Work with Kafka and Spark Streaming to handle real-time data processing and event-driven systems.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Maintain and improve the overall data engineering infrastructure to ensure high performance, scalability, and reliability.

Requirements

  • 6+ years of experience in designing and developing large-scale data processing systems using Spark, Scala, and Hive.
  • Extensive experience in working with Hadoop ecosystem components, including HBase, ZooKeeper, Kafka, and Flume.
  • Strong understanding of data transformation logic and ability to translate it into Spark-SQL queries.
  • Unix Shell Scripting and CRON job management experience.
  • Experience with Cloudera distribution framework, Oozie Workflow, and Jenkins.
  • Prior experience in Consumer Banking Domain and agile delivery methods is an advantage.

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...

  • Big Data Engineer

    7 days ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...

  • Big Data Engineer

    4 days ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: 291171NTT DATA Services is a global leader in business and technology services, committed to helping clients innovate, optimize and transform for long-term success.We are seeking a skilled Data Engineer to join our team in Hyderabad, Telangana, India, to design, implement and maintain Azure Synapse data pipelines and transformation for data...

  • Data Analyst

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    Job Title: Data AnalystAs a Data Analyst at data.ai, you will play a crucial role in analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals. You will be empowered to work independently with the support of team members spread across APAC, AMER, and EMEA.Key Responsibilities:Take full responsibility for...

  • Data Analyst Position

    2 weeks ago


    Hyderabad, Telangana, India data Full time

    A Career Defining Role in Data IntelligenceAs a Data Analyst, you will play a pivotal role in helping us uncover hidden insights and trends within our vast dataset. Your expertise will be instrumental in ensuring the accuracy and quality of our data, enabling us to make informed decisions that drive business growth.ResponsibilitiesTake ownership of data.ai's...


  • Hyderabad, Telangana, India data Full time

    Data Quality and InsightsWe are seeking a skilled Data Insights Analyst to join our team at data.ai. As a Data Insights Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key Responsibilities:Take full responsibility for data.ai core intelligence data qualityDeep...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Intelligence Specialist to join our team at data.ai. As a Data Intelligence Specialist, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data...

  • Data Modeling Expert

    2 weeks ago


    Hyderabad, Telangana, India data Full time

    What drives innovation in data-driven products?We are looking for an experienced data engineer to join our team and contribute to the development of innovative analytics and data products. As a big data engineer, you will be part of a collaborative team that uses agile methodologies and open-source technologies to build cutting-edge data processing programs....


  • Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Data Engineering SpecialistStatistics & Data Corporation (SDC), a specialized contract research organization (CRO), is seeking a skilled Data Engineering Specialist to join our team. With a strong focus on clinical trials, we provide top-tier services to pharmaceutical, biologic, and medical device/diagnostic companies.Job SummaryAs a Data Engineering...

  • Data Scientist

    1 week ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Analyst to join our engineering team at data.ai. As a Data Analyst, you will play a vital role in delivering high-quality app market data to app professionals.The successful candidate will be responsible for data profiling, data cleansing, data quality monitoring, and root cause analysis. You will work...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India The Modern Data Company Full time

    Job Title: Senior Analytics EngineerAt The Modern Data Company, we are seeking a highly skilled Senior Analytics Engineer to join our team. The ideal candidate will have a strong background in data engineering, architecture, and analytics, with a passion for designing and implementing scalable data solutions.Key Responsibilities:Provide technical expertise...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Business Solutions Full time

    A Senior Data Engineer plays a pivotal role in technology-driven organizations, responsible for designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Responsibilities:Designing and Implementing ETL Processes:Develop and maintain scalable data pipelines.Create efficient Extract,...