Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Optimum Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year
  • 7-10 years experience in design, architecture or development in Analytics and Data Warehousing.
  • Experience in building end-to-end solutions with the Big data platform, Spark or scala programming.
  • 5 years of Solid experience in ETL pipeline building with spark or sclala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
  • Experience in Big data platform for ETL development with AWS cloud platform.
  • Proficiency in AWS cloud services, specifically EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DynamoDB, IAM, Secret Manager, Step functions, SQS, SNS, Cloud Watch.
  • Excellent skills in Python-based framework development are mandatory.
  • Should have experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
  • Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
  • Analytics & BI Architecture appreciation and broad experience across all technology disciplines.
  • Experience in working within a Data Delivery Life Cycle framework & Agile Methodology.
  • Extensive experience in large enterprise environments handling large volume of datasets with High SLAs
  • Good knowledge in developing UNIX scripts, Oracle SQL/PL-SQL, and Autosys JIL Scripts.
  • Well versed in AI Powered Engineering tools like Cline, GitHub Copilot
  • Experience in solution design would be good.
  • Self-starter, autonomous working
  • Strong analytical skills and Strong interpersonal & communication skills
  • Be creative, innovative, pro-active in terms of finding solutions

Skills

  • Problem solving advanced conceptual, analytical and problem-solving skills to analyze complex information for key insights and present as meaningful information to senior management
  • Communication – expert oral and written communication skills with ability to lead discussions with a varied stakeholder across levels
  • Risk Mindset –All CommBank employees are expected to proactively identify and understand, openly discuss and act on current and future risks.

Your QualificationsRole & responsibilities

Essential:

  • Bachelor's in computer science, B. Tech IT, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience.

Desirable:

  • Experience across Enterprise BI/Big Data/DW/ETL technologies such as Teradata, Hadoop, Tableau, SAS, Hyperion or Business Objects.
  • Prior experience on Banking Domain / Financial Services related projects would be a great value add.
  • Hands on experience on Ab Initio is highly desirable.
  • Good to have experience in Python.
  • Exposure to JIRA/ Confluence would be beneficial.
  • Experience in CI/CD, Test Automation

Additional industry or product certification

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Sr. Data Engineer Data Science

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Req ID: 344005NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Design,...