Senior AWS Data Engineer

1 month ago

Remote, IN Quantumbricks Full time

Job Summary.

We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives.

The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data processing.

You will collaborate with cross-functional teams to design, build, and maintain robust, scalable, and efficient data infrastructure and analytics solutions.

Key Responsibilities :

Data Pipeline Design and Development :

- Architect and build large-scale, distributed data processing pipelines on AWS using services such as AWS Glue, Lambda, Kinesis, S3, and Redshift.

- Develop and optimize ETL processes to extract, transform, and load data from a variety of structured and unstructured data sources.

- Design real-time and batch data integration workflows using tools such as AWS Data Pipeline, Kafka, or Apache Airflow.

Data Architecture and Modeling :

- Design, implement, and maintain data architectures (i.e., data lakes, data warehouses) that are scalable, flexible, and cost-efficient.

- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical designs.

- Develop complex data models that support various analytical and business intelligence (BI) requirements.

Cloud Infrastructure Management :

- Manage and optimize AWS infrastructure for data processing, including EC2, EMR, RDS, DynamoDB, and other relevant AWS services.

- Implement monitoring, logging, and alerting systems to ensure the availability, reliability, and scalability of data solutions.

- Ensure security and compliance by implementing best practices such as encryption, IAM roles, VPC configurations, and monitoring.

Performance Optimization and Automation :

- Automate data pipeline deployment and monitoring using CI/CD tools such as Jenkins or AWS CodePipeline.

- Tune performance of AWS services like Redshift, Athena, and EMR to handle large volumes of data efficiently.

- Perform root cause analysis of data pipeline failures and implement preventive measures.

Collaboration and Mentorship :

- Work closely with engineering teams, product managers, and business stakeholders to deliver scalable and efficient data solutions.

- Mentor junior data engineers and provide technical leadership across the team.

- Participate in design reviews, code reviews, and architecture discussions.

Required Skills & Qualifications :


- 10+ years of experience in Data Engineering, with a strong focus on cloud platforms and distributed data systems.

- Deep expertise in AWS cloud services, especially S3, Redshift, Glue, Kinesis, Lambda, EMR, and DynamoDB.

- Strong hands-on experience with ETL/ELT processes, data integration, and transformation.

- Proficient in programming languages such as Python, Java, or Scala.

- Experience with orchestration tools like AWS Step Functions, Airflow, or similar.

- Strong knowledge of SQL and database design for data lakes and data warehouses.

- Familiarity with big data processing frameworks such as Apache Spark, Hadoop, or Kafka.

- Hands-on experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools such as Terraform or CloudFormation.

- Experience with data governance, data quality, and metadata management in a cloud environment.

- Strong problem-solving, communication, and collaboration skills.

(ref:hirist.tech)

  • Data Engineer

    2 months ago

    Remote, IN Petals Careers Full time

    Responsibilities : - Design, build, and operationalize large-scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3 Glue.- Design and develop scalable data pipelines using Databricks and Azure Data Factory. - Implement and optimize data warehousing solutions and Synapse...

  • Data Engineer

    4 weeks ago

    Remote/Bangalore, IN Creative Technostructure Full time

    Role : AWS Data EngineerLocation : Remote Timings : Day Shift Notice Period : Immediate Joiner or maximum up to 15 days. Experience : 2.5 to 4 YearsJob Description : Required Skills and Qualifications :- 2+ years of experience in data engineering, with a focus on AWS and Python.- Strong proficiency in Python for scripting and building data workflows.-...

  • Senior Data Engineer

    1 month ago

    Remote, IN Quantumbricks Full time

    Job Summary : We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...

  • Sycamore Informatics

    4 weeks ago

    Remote, IN Sycamore Informatics Inc. Full time

    Experienced Senior DevOps Engineer to lead cloud administration for our clients, including managing AWS billing, ensuring best practices, and being the go-to person for all cloud-related tasks. The ideal candidate will have strong client interaction skills and be capable of overseeing and guiding a small team of DevOps engineers.Key Responsibilities :- Lead...

  • CodeKart - Data Engineer - ETL/Data Warehousing

    1 month ago

    Remote, IN CodeKart Full time

    Role : Data Engineer. Experience :3 yr.Location : Remote.Responsibilities :- Provide ongoing support and monitoring for AWS-based data engineering infrastructure. - Ensure the smooth operation of data pipelines and applications in a production environment. - Develop and maintain data pipelines, ETL processes, and data warehouses using AWS services. - Design...

  • Data Engineer

    2 months ago

    Remote, IN Comtek Solution Full time

    About us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community.You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers,SUMMARY OF...

  • Protegrity - Senior Data Analytics Engineer - Business Intelligence

    2 months ago

    Remote, IN PROTEGRITY INDIA PRIVATE LIMITED Full time

    Protegrity is seeking a passionate and talented Senior Data Analytics Engineer to join our Business Intelligence Team. This position is a remote role.As a Senior Data Analytics Engineer, you will be responsible for strengthening Protegritys data analytics and information reporting capabilities, using modern techniques and tools to ensure efficient...

  • Senior Cloud Architect

    1 month ago

    Remote, IN Nlineaxis Full time

    Senior Cloud Architect (AWS)Working Hours : 7:00 AM- 4:00 PMEmployment Type : Full timeExperience : 12-15 yearsKey Responsibilities :- Collaborate with cross-functional teams to identify business requirements and design solutions that meet commercial needs.- Develop infrastructure as code (IaC) using tools like Terraform or CloudFormation.- Ensure data...

  • Senior Data Architect

    2 months ago

    Remote, IN HNM Solutions Full time

    Job Description :- Design and implement scalable data architectures to support complex analytics and business intelligence requirements.- Develop data models, data flow diagrams, and data integration strategies.- Create and maintain comprehensive data dictionaries and metadata repositories.- Lead the development and optimization of data pipelines using...

  • CAW Studios

    1 month ago

    Remote/Hyderabad, IN CAW Studios Pvt Ltd Full time

    Job Title : Senior Data Analytics Engineer Reports To : Technical Architect (Data & Analytics), India Employment Type : Contract to Hire Job Summary :This role requires a skilled Data Analytics Engineer with a strong background in data analysis, data engineering, analytics development and administration of data analytics platforms. The candidate will have...

  • Senior Azure Data Engineer

    1 month ago

    Remote, IN Quantumbricks Full time

    Job Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...

  • D-TechWorks - Senior Data Engineer - ETL

    2 months ago

    Remote/Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full time

    We are looking for Senior Data Engineer - Gurgaon, Remote , India Position : Senior Data Engineer Experience : 4 to 7 YrLocation : Gurgaon, Remote , India - 5-7 years of experience in Solution, Design and Development of Cloud based data models, ETL Pipelines and infrastructure for reporting, analytics, and data science. - Experience working with Spark,...

  • Kubernetes Infrastructure Engineer

    2 months ago

    Remote, IN Top Talent Technologies Pvt Ltd Full time

    Job Description : We are seeking a skilled Kubernetes Infrastructure Engineer to join our team. As an Kubernetes Infrastructure Engineer, you will be responsible for designing, deploying, and managing Kubernetes clusters on the cloud platform (AWS/Azure/GCP).You will collaborate with cross-functional teams to ensure the successful implementation and...

  • Data Engineer

    2 months ago

    Remote, IN Cloudcover Consultancy Private Limited Full time

    Job Overview :The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts,...

  • Senior Google Cloud Platform Engineer

    2 months ago

    Remote, IN Infometry Full time

    Experience : 8 - 10 yrsWe are seeking a highly skilled Senior Data Engineer with extensive experience in data engineering, particularly in building and maintaining data pipelines. This role requires strong expertise in GCP, Dataflow, Apache Beam SDK, and PySpark, along with a deep understanding of Google Cloud Platform (GCP) services. The ideal candidate...

  • TVARIT - Data Engineer - ETL

    2 months ago

    Remote/Pune, IN TVARIT Full time

    JD of Senior Data Engineer : TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and...

  • Data Engineer

    2 months ago

    Remote, IN ThinkMove Solutions Full time

    Salary : 14 - 18 LPA Overview :We are seeking a skilled and experienced Data Engineer with a specialization in DataBricks to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing and analytics. Your...

  • Snowflake Engineer

    2 months ago

    Remote, IN InCommon Full time

    Position Summary :We are looking for seasoned Snowflake Architects and Engineers to join our team and lead the design and implementation of large-scale data solutions on the Snowflake platform. This role is suited for professionals with deep expertise in data architecture and extensive experience with Snowflake.Key Responsibilities : - Lead the architecture,...

  • Senior Big Data Engineer

    3 weeks ago

    Remote, IN AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position : Senior Big Data Engineer (GCP)Experience : 5+ YrsShift Time : EST Shift 5 : 30 PM to 2 : 30 AMRemote / Hybrid - Full TimeWe are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate...

  • Implementation Engineer

    2 months ago

    Remote, IN Calyptus Full time

    Role & Responsibilities : - Create and maintain data pipelines that transfer data from select location (maintaining security protocols) into our Big Data financial crime solution Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and reporting - Develop and implement data models and schemas to support...