AWS Data Engineer/Senior Engineer

2 months ago


Ahmedabad, India Arrow Electronics Full time

Description

:

Responsibilities:  

Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift. Implement data modelling techniques to optimize data storage and retrieval processes. Develop and deploy data processing and transformation frameworks to support both real-time and batch processing requirements. Ensure data pipelines are scalable, reliable, and performant to handle large-scale data sizes. Implement data documentation and observability tools and practices to monitor and troubleshoot data pipeline performance issues. Adhere to privacy and security development best practices to ensure data integrity and compliance with regulatory requirements. Collaborate with the DevOps team to automate deployment processes using AWS Code Pipeline.

Requirements:  

Bachelor's degree in Computer Science, Engineering, or a related field. 5+ years of experience working in data modelling and building real-time and batch processing data pipelines for large-scale data sizes. Strong proficiency in Python programming language. Extensive experience with AWS serverless or managed services such as S3, Glue, EMR, Lambda, DynamoDB, Athena, and RedShift. Solid understanding of privacy and security development best practices. Excellent problem-solving skills and ability to troubleshoot complex data pipeline issues. Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment. Experience with Agile development methodologies is a plus.

Location:

IN-GJ-Ahmedabad, India-Ognaj (eInfochips)

Time Type:

Full time

Job Category:

Engineering Services

  • Ahmedabad, Gujarat, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...


  • Ahmedabad, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3,...


  • Ahmedabad, India Arrow Electronics Full time

    Description:Responsibilities:Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.Implement data...

  • Senior Data Engineer

    2 weeks ago


    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Senior Data Engineer

    2 weeks ago


    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Senior Data Engineer

    2 weeks ago


    Ahmedabad, Gujarat, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Sr. Data Engineer

    4 days ago


    Ahmedabad, India Simform Full time

    We are looking for a Data Engineer who is passionate about managing large amounts of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from youRoles and Responsibilities:· Experience working with AWS...

  • Sr. Data Engineer

    5 days ago


    ahmedabad, India Simform Full time

    We are looking for a Data Engineer who is passionate about managing large amounts of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you Roles and Responsibilities: · Experience working with AWS...

  • Sr. Data Engineer

    5 days ago


    Ahmedabad, India Simform Full time

    We are looking for a Data Engineer who is passionate about managing large amounts of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you Roles and Responsibilities: · Experience working with...

  • Sr. Data Engineer

    5 days ago


    Ahmedabad, India Simform Full time

    We are looking for a Data Engineer who is passionate about managing large amounts of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from youRoles and Responsibilities:  · Experience working with...


  • Ahmedabad, India Simform Full time

    We are looking for a Data Engineer who is passionate about managing large amounts of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you.Roles and Responsibilities :- Experience working with AWS...


  • Ahmedabad, Gujarat, India Simform Full time

    We are looking for a Data Engineer who is passionate about managing large amounts of data, eager to learn and accept challenges, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you.Roles and Responsibilities :- Experience working with AWS...


  • Pune/Ahmedabad/Bangalore/Indore, India eInfochips (An Arrow Company) Full time

    Role : AWS Data EngineerExperience : 5+ yearsLocation : Pune/Ahmedabad/Indore/ bangaloreCompany Overview :eInfochips, an Arrow company, is a global leader in product engineering and semiconductor design services. Renowned for our technological innovations, we've developed over 500 products, achieving 40M deployments across 140 countries. Our expertise...


  • Ahmedabad, India IT Company Full time

    We are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...


  • Ahmedabad, India IT Company Full time

    We are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...


  • Ahmedabad, Gujarat, India IT Company Full time

    We are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...

  • Lead DevOps Engineer

    4 weeks ago


    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...


  • Ahmedabad, India VOLANSYS (An ACL Digital Company) Full time

    Technical Skills:Bachelor's degree in Computer Science, Engineering, or related field.Proficiency in Python programming language and its data manipulation libraries (Pandas, NumPy).Experience with Apache Spark (PySpark) for large-scale data processing.Knowledge of Apache Airflow for workflow automation.Strong SQL skills for data querying and...


  • Ahmedabad, India VOLANSYS (An ACL Digital Company) Full time

    Technical Skills:Bachelor's degree in Computer Science, Engineering, or related field.Proficiency in Python programming language and its data manipulation libraries (Pandas, NumPy).Experience with Apache Spark (PySpark) for large-scale data processing.Knowledge of Apache Airflow for workflow automation.Strong SQL skills for data querying and...

  • Lead DevOps Engineer

    1 month ago


    Ahmedabad, India Crest Data Systems Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...