Data Engineer- AWS
4 days ago
Project Description:Support one of the top Australian banks as they seek to modernise their data and analytics platform. You will be working directly with IT and business stakeholders in Data and Platform team to implement banks data strategy to become the best AI bank of the world.Skills required: Total Years of experience in the range of 4 to 7 years in the following skills: We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all, but experience or exposure with some of these (or equivalents) will set you up for success in this team- • Extensive experience in designing, building, and delivering enterprise-wide data ingestion, data integration, and data pipeline solutions • Strong Data Architecture expertise, including different data modelling techniques and design patterns (conceptual, logical, physical, semantic is preferred) • Strong knowledge of data governance, such as data lineage, technical metadata, data quality, and reconciliation • Ability to drive platform efficiency through automation and AI capabilities • AWS Data Stack: EMR, Glue, Redshift, Athena, S3, Lambda, ECS • Data Orchestration & Pipelines: Airflow, Dataform • Data Formats & Modelling: Iceberg, JSON, XML, CSV, Data Modelling • Programming & DevOps: Python, SQL, Git, GitHub Actions, Team City, Jenkins, Octopus, Unix shell scripting • ETL & Ingestion: File ingress/egress solutions in AWS • Security and Observability: DevSecOps, Artifactory, Observability tooling • Testing & Automation: test automation frameworks, Jupyter Notebooks • Familiarity with data warehousing and build experience in Teradata, Oracle • Experience in visualisation tools such as Power BI, Tableau • Familiarity and experience with Agile processes • AWS Data Engineer Associate certificationNice To Have: - AWS Solution Architect certification - Containerisation (Docker, Kubernetes) - Data visualisation tools and integration to Tableau, Power BI - Alation - Observability tools (i.e., Observe, Splunk, or Prometheus/Grafana). - Ab initio or DBT tooling - Experience with Parquet File Format, Iceberg tables - Glue Data Catalogue & AWS DataZone - Markets domain knowledgeResponsibilities: • Design, build, and deliver a new cloud data solution to transform our international regulatory reporting requirements • Lead the design and delivery of cost-effective, scalable data solutions aligned with strategic goals that meet performance, security, and operational requirements. • Drive solution architecture decisions, ensuring alignment with enterprise architecture principles and business priorities • Engineer robust data product assets and pipelines in AWS (S3, Glue, Iceberg, Kinesis, Airflow, Sagemaker, Redshift) that integrate with other applications, including SaaS reporting applications, eg, Axiom • Provide technical data governance and risk management, • Lead a team of data engineers providing technical guidance, reviewing work, and mentoring team members to deliver high-quality data products • Define and implement engineering standards, including data modelling, ingestion, transformation, and egression patterns and reviews • Collaborate across teams to ensure a secure, efficient, and well-documented solution. • Learn and contribute to continuous improvement initiatives within the team.
-
Data Engineering Subject Matter Expert
2 weeks ago
bangalore, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/Monthly About the Opportunity We are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms. What We're Looking For Minimum 9-15 years of experience in...
-
AWS Data Engineer
1 week ago
bangalore, India Ztek Consulting Full timeHi, I would like to share an excellent opening Contact “AWS Data Engineer” do go through the details and kindly send me the updated resume. Location : Bangalore /Mumbai Type of Hire : Contract Mode of interview : WebEx / Teams Job Description Skills: ETL + Python + PySpark + SQL + Cloud (AWS) Technologies: Python, AWS CloudWatch, AWS IAM, Amazon S3, AWS...
-
AWS Data Engineer
1 week ago
bangalore, India Ztek Consulting Full timeHi,I would like to share an excellent opening Contact "AWS Data Engineer" do go through the details and kindly send me the updated resume.Location : Bangalore /MumbaiType of Hire : ContractMode of interview : WebEx / TeamsJob DescriptionSkills: ETL + Python + PySpark + SQL + Cloud (AWS) Technologies: Python, AWS CloudWatch, AWS IAM, Amazon S3, AWS DevOps,...
-
AWS Data Engineer
3 days ago
bangalore, India Virtusa Full timeWe are looking for an experienced AWS Data Engineer to design and build scalable data pipelines and cloud-based data solutions. The role involves developing ETL/ELT workflows, managing data lakes and warehouses, and ensuring high-quality, reliable data for analytics and business insights. Key Responsibilities Build and maintain data pipelines using AWS Glue,...
-
AWS Data Engineer
2 days ago
bangalore, India Virtusa Full timeWe are looking for an experienced AWS Data Engineer to design and build scalable data pipelines and cloud-based data solutions. The role involves developing ETL/ELT workflows, managing data lakes and warehouses, and ensuring high-quality, reliable data for analytics and business insights.Key ResponsibilitiesBuild and maintain data pipelines using AWS Glue,...
-
AWS Data Engineer
1 week ago
bangalore, India ACL Digital Full timeHello connections! We have urgent openings for AWS Data Engineer. Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and support of ETL/ELT pipelines in a cloud-based environment. The ideal candidate will have a strong background in designing, deploying, and maintaining data pipelines...
-
AWS Data Engineer
20 hours ago
bangalore, India Emids Full timeWe are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions that enable advanced analytics, machine learning, and business intelligence across the...
-
AWS Data Engineer
1 day ago
bangalore, India Emids Full timeWe are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions that enable advanced analytics, machine learning, and business intelligence across the...
-
AWS Data Engineer
3 weeks ago
bangalore, India People Prime Worldwide Full timeData Engineer (L4) – Python & AWS Total Experience: 7–10 years Location : Hyderabad Job Overview We are looking for a Senior Data Engineer with strong expertise in Python and AWS . You will design and build scalable data pipelines, manage cloud-based data platforms, ensure data quality, and support analytics/AI use cases across the organization. Total...
-
AWS Data Engineer
1 week ago
bangalore, India Tata Consultancy Services Full timeJob Title: AWS Data Engineer Exp Range: 5-14 Years Job Location: Bangalore or Bhubaneswar or Hyderabad Job Description: •Bachelor's degree in Engineering , Technology computer science, statistics, biostatistics, mathematics, biology or other health related field or equivalent experience that provides the skills and knowledge necessary to perform the job....