Senior AWS Data Engineer

2 weeks ago

Remote, IN Quantumbricks Full time

Job Summary.

We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives.

The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data processing.

You will collaborate with cross-functional teams to design, build, and maintain robust, scalable, and efficient data infrastructure and analytics solutions.

Key Responsibilities :

Data Pipeline Design and Development :

- Architect and build large-scale, distributed data processing pipelines on AWS using services such as AWS Glue, Lambda, Kinesis, S3, and Redshift.

- Develop and optimize ETL processes to extract, transform, and load data from a variety of structured and unstructured data sources.

- Design real-time and batch data integration workflows using tools such as AWS Data Pipeline, Kafka, or Apache Airflow.

Data Architecture and Modeling :

- Design, implement, and maintain data architectures (i.e., data lakes, data warehouses) that are scalable, flexible, and cost-efficient.

- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical designs.

- Develop complex data models that support various analytical and business intelligence (BI) requirements.

Cloud Infrastructure Management :

- Manage and optimize AWS infrastructure for data processing, including EC2, EMR, RDS, DynamoDB, and other relevant AWS services.

- Implement monitoring, logging, and alerting systems to ensure the availability, reliability, and scalability of data solutions.

- Ensure security and compliance by implementing best practices such as encryption, IAM roles, VPC configurations, and monitoring.

Performance Optimization and Automation :

- Automate data pipeline deployment and monitoring using CI/CD tools such as Jenkins or AWS CodePipeline.

- Tune performance of AWS services like Redshift, Athena, and EMR to handle large volumes of data efficiently.

- Perform root cause analysis of data pipeline failures and implement preventive measures.

Collaboration and Mentorship :

- Work closely with engineering teams, product managers, and business stakeholders to deliver scalable and efficient data solutions.

- Mentor junior data engineers and provide technical leadership across the team.

- Participate in design reviews, code reviews, and architecture discussions.

Required Skills & Qualifications :


- 10+ years of experience in Data Engineering, with a strong focus on cloud platforms and distributed data systems.

- Deep expertise in AWS cloud services, especially S3, Redshift, Glue, Kinesis, Lambda, EMR, and DynamoDB.

- Strong hands-on experience with ETL/ELT processes, data integration, and transformation.

- Proficient in programming languages such as Python, Java, or Scala.

- Experience with orchestration tools like AWS Step Functions, Airflow, or similar.

- Strong knowledge of SQL and database design for data lakes and data warehouses.

- Familiarity with big data processing frameworks such as Apache Spark, Hadoop, or Kafka.

- Hands-on experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools such as Terraform or CloudFormation.

- Experience with data governance, data quality, and metadata management in a cloud environment.

- Strong problem-solving, communication, and collaboration skills.

(ref:hirist.tech)

  • Senior AWS Data Engineer

    3 weeks ago

    Remote, IN Kooe Private Limited Full time

    Required Skills : - 3+ years of professional experience in any one of the Cloud providers such as AWS, Azure or GCP- 3+ years experience in engineering data pipelines using data technologies (Python, Databricks, pySpark, Kafka) on large scale data sets- Experience building or maintaining a Data Platform that supports multiple engineering teams and processes...

  • Data Engineer

    3 weeks ago

    Remote, IN Petals Careers Full time

    Responsibilities : - Design, build, and operationalize large-scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3 Glue.- Design and develop scalable data pipelines using Databricks and Azure Data Factory. - Implement and optimize data warehousing solutions and Synapse...

  • Data Engineer

    5 days ago

    Remote/Bangalore, IN Creative Technostructure Full time

    Role : AWS Data EngineerLocation : Remote Timings : Day Shift Notice Period : Immediate Joiner or maximum up to 15 days. Experience : 2.5 to 4 YearsJob Description : Required Skills and Qualifications :- 2+ years of experience in data engineering, with a focus on AWS and Python.- Strong proficiency in Python for scripting and building data workflows.-...

  • Senior Data Engineer

    2 weeks ago

    Remote, IN Quantumbricks Full time

    Job Summary : We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...

  • Sycamore Informatics

    1 day ago

    Remote, IN Sycamore Informatics Inc. Full time

    Experienced Senior DevOps Engineer to lead cloud administration for our clients, including managing AWS billing, ensuring best practices, and being the go-to person for all cloud-related tasks. The ideal candidate will have strong client interaction skills and be capable of overseeing and guiding a small team of DevOps engineers.Key Responsibilities :- Lead...

  • Senior Spark Developer

    3 weeks ago

    Remote, IN Overture Rede Private Limited. Full time

    Responsibilities :- Design, develop, and implement data pipelines and data lakes using Spark, EMR, and Hadoop.- Build and optimize data processing workflows on the AWS cloud platform.- Develop and maintain data ingestion and transformation processes using AWS Glue, EMR, Lambda functions, SQS, and SNS.- Implement real-time data processing solutions using AWS...

  • CAW Studios

    2 weeks ago

    Remote, IN CAW Studios Pvt Ltd Full time

    Job Title : Senior Data Analytics Engineer Reports To : Technical Architect (Data & Analytics), India Employment Type : Contract to Hire Job Summary :This role requires a skilled Data Analytics Engineer with a strong background in data analysis, data engineering, analytics development and administration of data analytics platforms. The candidate will have...

  • CodeKart - Data Engineer - ETL/Data Warehousing

    3 weeks ago

    Remote, IN CodeKart Full time

    Role : Data Engineer. Experience :3 yr.Location : Remote.Responsibilities :- Provide ongoing support and monitoring for AWS-based data engineering infrastructure. - Ensure the smooth operation of data pipelines and applications in a production environment. - Develop and maintain data pipelines, ETL processes, and data warehouses using AWS services. - Design...

  • Data Engineer

    3 weeks ago

    Remote, IN Comtek Solution Full time

    About us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community.You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers,SUMMARY OF...

  • Data Engineer

    3 weeks ago

    Remote, IN Prime Infosoft Full time

    Job Description :IDC Global is a software development company specializing in web development services for the real estate industry through distributed database technology. While our core models are real estate web search and back-office CRM-based tools, we also focus on database and data processing in order to solve problems and improve the performance of...

  • Protegrity - Senior Data Analytics Engineer - Business Intelligence

    3 weeks ago

    Remote, IN PROTEGRITY INDIA PRIVATE LIMITED Full time

    Protegrity is seeking a passionate and talented Senior Data Analytics Engineer to join our Business Intelligence Team. This position is a remote role.As a Senior Data Analytics Engineer, you will be responsible for strengthening Protegritys data analytics and information reporting capabilities, using modern techniques and tools to ensure efficient...

  • CAW Studios

    2 weeks ago

    Remote/Hyderabad, IN CAW Studios Pvt Ltd Full time

    Job Title : Senior Data Analytics Engineer Reports To : Technical Architect (Data & Analytics), India Employment Type : Contract to Hire Job Summary :This role requires a skilled Data Analytics Engineer with a strong background in data analysis, data engineering, analytics development and administration of data analytics platforms. The candidate will have...

  • Senior Cloud Architect

    2 weeks ago

    Remote, IN Nlineaxis Full time

    Senior Cloud Architect (AWS)Working Hours : 7:00 AM- 4:00 PMEmployment Type : Full timeExperience : 12-15 yearsKey Responsibilities :- Collaborate with cross-functional teams to identify business requirements and design solutions that meet commercial needs.- Develop infrastructure as code (IaC) using tools like Terraform or CloudFormation.- Ensure data...

  • Senior Data Architect

    3 weeks ago

    Remote, IN HNM Solutions Full time

    Job Description :- Design and implement scalable data architectures to support complex analytics and business intelligence requirements.- Develop data models, data flow diagrams, and data integration strategies.- Create and maintain comprehensive data dictionaries and metadata repositories.- Lead the development and optimization of data pipelines using...

  • Senior Azure Data Engineer

    2 weeks ago

    Remote, IN Quantumbricks Full time

    Job Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...

  • D-TechWorks - Senior Data Engineer - ETL

    3 weeks ago

    Remote/Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full time

    We are looking for Senior Data Engineer - Gurgaon, Remote , India Position : Senior Data Engineer Experience : 4 to 7 YrLocation : Gurgaon, Remote , India - 5-7 years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics, and data science. - Experience working with Spark,...

  • Data Engineer

    3 weeks ago

    Remote, IN Cloudcover Consultancy Private Limited Full time

    Job Overview :The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts,...

  • Kubernetes Infrastructure Engineer

    3 weeks ago

    Remote, IN Top Talent Technologies Pvt Ltd Full time

    Job Description : We are seeking a skilled Kubernetes Infrastructure Engineer to join our team. As an Kubernetes Infrastructure Engineer, you will be responsible for designing, deploying, and managing Kubernetes clusters on the cloud platform (AWS/Azure/GCP).You will collaborate with cross-functional teams to ensure the successful implementation and...

  • AWS SageMaker Developer

    3 weeks ago

    Remote, IN MindTrilogy IT Solutions Pvt. Ltd Full time

    About the Role :We are seeking experienced AWS SageMaker Developers to join our team and build cutting-edge machine learning solutions. You will be responsible for designing, developing, and deploying ML models on the AWS platform.Responsibilities :- Develop and deploy machine learning models using Amazon SageMaker.- Optimize model performance and efficiency...

  • TVARIT - Data Engineer - ETL

    3 weeks ago

    Remote/Pune, IN TVARIT Full time

    JD of Senior Data Engineer : TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and...