Data Engineer

2 months ago


Bengaluru Karnataka India, Karnataka Suitable.AI Full time

Job Description :

- (SCALA) 3+ YRS.

Role Objective :

Data Engineer will be responsible for expanding and optimizing our data and database architecture, as well as optimizing data flow- and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys- optimizing data systems and building.

The Data Engineer will support our software developers, database architects, data analysts- and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.

Roles & Responsibilities :

- Sound knowledge in Spark architecture and distributed computing.

- Proficient in Spark - including RDD and Dataframes core functions, troubleshooting and performance tuning.

- Good understanding in object-oriented concepts and hands on experience on Scala or on java with excellent programming logic and technique.

- Good in functional programming and OOPS concept on Scala.

- Good experience in SQL - should be able to write complex queries.

- Managing the team of Associates and Senior Associates and ensuring the utilization is maintained across the project.

- Able to mentor new members for onboarding to the project.

- Understand the client requirement and able to design, develop from scratch and deliver.

- AWS cloud experience would be preferable.

- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services DynamoDB, RedShift, Kinesis, Lambda, S3, etc.

Prefered :

- Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments (prefered).

- Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS (prefered).

- Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements.

- Managing project timing, client expectations and meeting deadlines.

- Should have played project and team management roles.

- Facilitate meetings within the team on regular basis.

- Understand business requirement and analyze different approaches and plan deliverables and milestones for the project.

- Optimization, maintenance, and support of pipelines.

- Strong analytical and logical skills.

- Ability to comfortably tackling new challenges and learn.

EXPERTISE AND QUALIFICATIONS :

Must have Skills :

- Scala.

- Spark.

- AWS preferable/Any cloud.

- SQL (Intermediate to advanced level).

- Object-Oriented Programming.

- Good knowledge on ETL/ELT processes and tools.

Good to Have Skills :

- AWS Certification.

- Basic knowledge of streaming.

- Knowledge on hive, Hadoop, Kafka, Streaming.

- Git/similar version control tool.

- Knowledge in CI/CD, Microservices.

(ref:hirist.tech)
  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Visualization EngineerJob Summary:Data Visualization Engineer - NTT DATAData visualization engineers utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 301470NTT DATA is seeking a skilled Data Engineer to partner with stakeholders across business units to develop analyses and documentation in a collaborative way.The ideal candidate will have three or more years of experience with Python, SQL, and data visualization/exploration tools, as well as familiarity with the AWS ecosystem.About...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryReq ID: 302206NTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India.Job PurposeThe Senior Data Engineer will play a key role within the Data & Analytics team, designing, building, and maintaining systems and infrastructure for processing, collecting, storing, and analyzing large volumes of data.Key...

  • Data Systems Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...

  • Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionKey Skills and Qualifications:Cloud Platforms: Proficient in AWS.Programming Languages: Expert in SQL and Python.ETL Tools: Experience with ETL tools and frameworks.Requirements:Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Skills:Proven experience in using Snowflake for data...

  • Senior Data Engineer

    1 month ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • Data Engineer Lead

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Data Engineer for Power BI Development to join our team in India.The ideal candidate will have extensive experience with Power BI reporting development, a solid understanding of relational and distributed database systems, and strong analytical skills.Key Responsibilities:Develop and implement Power BI...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the JobThis position requires a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using Databricks on AWS. The ideal candidate will have strong experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development.Key ResponsibilitiesDesign, build, and maintain...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services.About the Role:The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing automated data pipelines, analyzing complex datasets, and providing actionable insights.Key Responsibilities:Develop and maintain...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...

  • Data Engineer

    1 month ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:As a Data Engineer at NTT DATA, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure data factory and Azure databricks. You will work closely with cross-functional teams to ensure data quality, integrity, and security.Key Responsibilities:Design and implement data...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Senior Data Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...