AWS Data Engineer Leader

12 hours ago

Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

Job Description

We are seeking an experienced Data Engineer to join our team at Coders Brain Technology Private Limited. As a Data Engineer, you will design, develop, and maintain scalable data pipelines using Amazon Redshift, Python, and AWS.

Key Responsibilities:

  • Design and develop robust ETL/ELT pipelines using Python, Apache Airflow, and dbt to extract, transform, and load data from various sources into Amazon Redshift.
  • Manage and optimize Amazon Redshift clusters to ensure the warehouse can handle large-scale data efficiently.
  • Develop solutions to integrate external APIs for data ingestion, ensuring proper data extraction, transformation, and integration into our data infrastructure.
  • Create and maintain scalable data models in Redshift that support analytics and reporting needs, including designing star and snowflake schemas for optimized querying.
  • Leverage AWS services such as S3, Lambda, EC2, and CloudWatch to build and maintain a scalable and cost-efficient data architecture.
  • Use dbt to manage and automate SQL transformations, ensuring modular, reusable, and well-documented data transformation logic.
  • Utilize Apache Airflow to orchestrate and automate data workflows, ensuring reliable data pipelines and scheduled jobs.
  • Implement and maintain data validation checks and testing frameworks to ensure data integrity, accuracy, and compliance across all data pipelines.

Required Skills & Qualifications:

  • Bachelor's/Master's degree in Computer Science, Engineering, Data Science, or a related field.
  • 3+ years of experience in data engineering with expertise in Amazon Redshift, Python, and AWS.
  • Strong experience with Apache Airflow for workflow scheduling and orchestration.
  • Hands-on experience with dbt (Data Build Tool) for managing SQL transformations and data models.
  • Proficiency in API development and integration, including the use of RESTful APIs for data ingestion.
  • Extensive experience with AWS services such as S3, Lambda, EC2, RDS, and CloudWatch.
  • Expertise in data modeling concepts and designing efficient data structures (e.g., star schemas, snowflake schemas) in a data warehouse environment.
  • Advanced knowledge of SQL for querying and optimizing large datasets in Redshift.
  • Experience building ETL/ELT pipelines and integrating data from multiple sources, including structured and unstructured data.

Estimated Salary: ₹1000000 - ₹2000000 per annum

Benefits:

  • Competitive salary
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment
  • Flexible working hours
  • Recognition and rewards for outstanding performance

  • Data Analytics Leader

    3 weeks ago

    Bengaluru, Karnataka, India AWS India - Karnataka - D11 Full time

    Job OverviewAWS India - Karnataka - D11 seeks a seasoned Data Analytics Leader to spearhead business intelligence initiatives and drive strategic decision-making. As a key member of the team, you will leverage your expertise in data analysis, machine learning, and business acumen to unlock insights that fuel business growth.About the RoleThe ideal candidate...

  • AI Data Science and Engineering Leader

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: AI Data Science and Engineering LeaderAbout the Role:We are seeking a highly skilled Ai Data Science and Engineering Leader to join our team in Bangalore, India. This is an excellent opportunity for a talented individual to lead our data science and engineering efforts.Responsibilities:Develop and implement traditional machine learning algorithms...

  • Data Engineer Leader

    1 month ago

    Bengaluru, Karnataka, India PERFIOS SOFTWARE SOLUTIONS PRIVATE LIMITED Full time

    Data Engineering Leadership RoleWe are seeking a seasoned Data Engineer Leader with a robust technical background and leadership experience to spearhead our data engineering efforts.This role demands a deep expertise in Python, PySpark, and Shell scripting, along with a comprehensive understanding of AWS cloud services.As a Tech Lead, you will manage a team...

  • Senior AWS Data Engineer Leader

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the Role:We are seeking an experienced Senior AWS Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering group, you will be responsible for designing and building scalable data pipelines on the AWS platform.Responsibilities:Work closely with cross-functional teams to understand project requirements and...

  • Strategic Analytics Leader

    4 weeks ago

    Bengaluru, Karnataka, India AWS India - Karnataka - D11 Full time

    Job Description:AWS India - Karnataka - D11 seeks an experienced Strategic Analytics Leader to lead the IN-ECCF Operations Analytics team. This role involves managing a team of Business Analysts, Data Engineers, and Data Scientists to drive business growth through data-driven insights.About AWS Sales, Marketing, and Global Services (SMGS)AWS SMGS drives...

  • Cloud Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...

  • Cloud Data Engineer Leader

    1 week ago

    Bengaluru, Karnataka, India Teamware Solutions ( A division of Quantum Leap Co Full time

    About the RoleTeamware Solutions, a division of Quantum Leap Co, is seeking an experienced Cloud Data Engineer Leader to join our innovative team in Bangalore. We offer a competitive salary package, including a base salary of ₹1,200,000 per annum.Job DescriptionWe are looking for a skilled professional with 6 years of experience in AWS development to...

  • AWS Data Engineer

    11 hours ago

    Bengaluru, Karnataka, India Mouri Tech (P) Ltd Full time

    AWS Data Engineer PositionMouri Tech (P) Ltd is seeking an experienced AWS Data Engineer to join our team. This individual will be responsible for designing, building, and maintaining scalable and secure data processing systems on Amazon Web Services (AWS).The ideal candidate will have experience with AWS services such as Redshift, Glue, S3, Lambda, and API...

  • Cloud Solutions Architect Leader

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewNTT DATA Services is seeking a highly experienced Cloud Solutions Architect Leader to join our team in Bangalore, India. This role involves leading the design and implementation of enterprise cloud solutions using Azure, AWS, and GCP.About the RoleThis is a leadership position that requires strong technical expertise in cloud architecture, as...

  • Cloud Engineer

    3 weeks ago

    Bengaluru, Karnataka, India AWS India - Karnataka Full time

    About the RoleWe are seeking a highly skilled Cloud Support Engineer to join our team at Amazon Web Services (AWS) India - Karnataka. As a key member of our support organization, you will be responsible for providing exceptional customer service and technical expertise to our global customers.Key ResponsibilitiesLeverage your extensive experience in network,...

  • Data Engineering Leader

    1 month ago

    Bengaluru, Karnataka, India Kloud9 Full time

    Job DescriptionAt Kloud9, we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining our data pipelines and ETL processes.Main Responsibilities:Collaborate with cross-functional teams to understand data requirements and design optimal data solutions on...

  • Data Engineering Leader

    4 weeks ago

    Bengaluru, Karnataka, India Wipro Full time

    About WiproWipro is a leading global information technology, consulting and business process services company.We are looking for a talented Data Engineering Leader to join our team!About the RoleThe successful candidate will be responsible for leading our data engineering efforts and driving innovation in modern data platforms and data product programs. They...

  • AWS Support Manager

    4 weeks ago

    Bengaluru, Karnataka, India AWS India - Karnataka Full time

    AWS Support Manager Job DescriptionDrive technical excellenceAWS India Support is seeking an experienced AWS Support Manager to lead a team of 15-20 Support Engineers in India. As a Support Manager, you will be responsible for managing day-to-day operations, ensuring SLA commitments are met, and driving personnel management to ensure engineers have what they...

  • Cloud Data Engineer Advisor Position

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role We are seeking a skilled Cloud Data Engineer Advisor to join our team in Bangalore, India. This is an excellent opportunity for someone who wants to work with cutting-edge technology and contribute to the success of our clients. Responsibilities Collaborate with technical development teams to understand application capabilities and design...

  • Data Engineering Leader

    2 weeks ago

    Bengaluru, Karnataka, India Collabera Digital Full time

    About the RoleWe are seeking an exceptional Data Engineer to join our team at Collabera Digital.As a Data Engineer, you will be responsible for designing and developing large-scale data pipelines, data warehouses, and business intelligence solutions using cutting-edge technologies like AWS RDS and AWS Fargate.You will work closely with cross-functional teams...

  • Data Engineering Leader for AI

    2 weeks ago

    Bengaluru, Karnataka, India Continental Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Leader to spearhead our AI and analytics initiatives. As part of our team at Continental, you will be responsible for designing and implementing cutting-edge data platforms that drive business growth and innovation.The ideal candidate will have extensive experience in leading data engineering...

  • Senior Enterprise Data Engineering Leader

    1 week ago

    Bengaluru, Karnataka, India Emids Full time

    We are seeking a highly skilled Senior Enterprise Data Engineering Leader to join our team at Emids. This role offers a unique opportunity to shape the future of data engineering and drive business growth through innovative solutions.As a Senior Enterprise Data Engineering Leader, you will be responsible for leading and managing the development of...

  • Data Engineering Leader

    1 week ago

    Bengaluru, Karnataka, India CareerXperts Consulting Full time

    At CareerXperts Consulting, we're seeking a seasoned technical leader to shape our client's data strategy and drive growth within their ecosystem.About the RoleThis pivotal position involves leading the charge in advancing our client's data capabilities and infrastructure. As a Principal Software Engineer - Data, you'll be responsible for designing and...

  • AWS Data Engineer Walkin Interview

    3 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About UsTata Consultancy Services (TCS) is a global leader in IT services and consulting. We are a trusted partner to our clients, enabling them to succeed through innovative solutions.Job DescriptionWe are seeking an experienced AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, building, and maintaining...

  • Snowflake Data Engineer and Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...