AWS Data Engineer/Senior Engineer
1 month ago
Responsibilities:Â
- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.
- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.
- Implement data modelling techniques to optimize data storage and retrieval processes.
- Develop and deploy data processing and transformation frameworks to support both real-time and batch processing requirements.
- Ensure data pipelines are scalable, reliable, and performant to handle large-scale data sizes.
- Implement data documentation and observability tools and practices to monitor and troubleshoot data pipeline performance issues.
- Adhere to privacy and security development best practices to ensure data integrity and compliance with regulatory requirements.
- Collaborate with the DevOps team to automate deployment processes using AWS Code Pipeline.
Requirements:Â
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience working in data modelling and building real-time and batch processing data pipelines for large-scale data sizes.
- Strong proficiency in Python programming language.
- Extensive experience with AWS serverless or managed services such as S3, Glue, EMR, Lambda, DynamoDB, Athena, and RedShift.
- Solid understanding of privacy and security development best practices.
- Excellent problem-solving skills and ability to troubleshoot complex data pipeline issues.
- Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Experience with Agile development methodologies is a plus.
-
AWS Data Engineer/Senior Engineer
1 month ago
Ahmedabad, Gujarat, India Arrow Electronics Full timePosition:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...
-
AWS Data Engineer/Senior Engineer
4 weeks ago
Ahmedabad, India Arrow Electronics Full timeDescription:Responsibilities:Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.Implement data...
-
Senior Data Engineer
2 days ago
Ahmedabad, India Ridgeant Techonologies Full timeJob Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...
-
Senior Data Engineer
1 day ago
Ahmedabad, Gujarat, India Ridgeant Techonologies Full timeJob Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...
-
Senior Data Engineer
2 days ago
Ahmedabad, India Ridgeant Techonologies Full timeJob Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...
-
AWS Data Engineer/Senior Engineer
1 month ago
Ahmedabad, India Arrow Electronics Full timeDescription : Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and...
-
Senior DevOps Engineer
1 month ago
Ahmedabad, India Crest Data Systems Full timeSenior DevOps Engineer Engineering Job Location(s) Ahmedabad and Pune, India Job Type Full time, Employee Duties and Responsibilities: Utilize various open source technologies Use various tools to orchestrate solutions Working closely with Development teams to implement and automate systems and architectures ...
-
eInfochips - AWS Data Engineer - Data Pipeline
2 weeks ago
Pune/Ahmedabad/Bangalore/Indore, India eInfochips (An Arrow Company) Full timeRole : AWS Data EngineerExperience : 5+ yearsLocation : Pune/Ahmedabad/Indore/ bangaloreCompany Overview :eInfochips, an Arrow company, is a global leader in product engineering and semiconductor design services. Renowned for our technological innovations, we've developed over 500 products, achieving 40M deployments across 140 countries. Our expertise...
-
Lead DevOps Engineer
2 weeks ago
ahmedabad, India Crest Data Full timeCompany Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...
-
International Sales Coordinator
1 week ago
Ahmedabad, India KCR Engineer Full timePlanning and strategizing meetings with the prospective clients and clearing all their doubts on the products and services. - Assign qualified opportunities to the appropriate sales managers for further development and closure. - Research for opportunities that enhance sales, identify key players and generate interest. - Maintain and expand our database of...
-
DataSlush - Data Engineer - SQL/Python
4 weeks ago
Ahmedabad, India IT Company Full timeWe are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...
-
DataSlush - Data Engineer - SQL/Python
4 weeks ago
Ahmedabad, Gujarat, India IT Company Full timeWe are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...
-
DataSlush - Data Engineer - SQL/Python
4 weeks ago
Ahmedabad, India IT Company Full timeWe are looking for a Senior Data Engineer to join our team to help our customers solve data engineering problems. You will be responsible for designing, implementing, and maintaining data pipelines, databases, and data warehouses.Responsibilities :- Design and implement data pipelines, ETL processes, and data integration solutions.- Manage and maintain our...
-
Lead DevOps Engineer
3 weeks ago
Ahmedabad, India Crest Data Systems Full timeCompany Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...
-
▷ (Only 24h Left) Lead DevOps Engineer
7 days ago
Ahmedabad, India Crest Data Full timeCompany Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...
-
Lead DevOps Engineer
4 weeks ago
Ahmedabad, India Crest Data Systems Full timeCompany Overview: Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...
-
Senior DevOps Engineer
1 month ago
Ahmedabad, Gujarat, India Arrow Electronics Full timePosition:Senior DevOps EngineerJob Description:Job Location:Ahmedabad, Pune, IndoreRoles & Responsibilities:As a DevOps Engineer, you will work together with other cloud engineers, architects, developers, and customer engineering teams to:Should have experience in designing and building cloud native solutions using AWS services for product development in...
-
ReactJS Engineer/Senior Engineer
1 month ago
Ahmedabad, Gujarat, India Arrow Electronics Full timePosition:ReactJS Engineer/Senior EngineerJob Description:Mandatory skills (need proficiency):5 to 8 years to total experienceReact JS, Javascript ES6, Typescript, HTML, CSSDeployment using DevOpsDebugging, Troubleshooting on ReactJS / Angular / Vue JS and backend servicesCreating responsive designTest frameworkGood to have skills:Restful APIs (.Net / Node /...
-
Software Engineer
1 day ago
ahmedabad, India WeatherPromise Full timeSoftware / Data Engineer Exp: 1+ years Location: Ahmedabad Must Have: Python, SQL Good to have: Exp with AWS, Spark, Airflow, Docker, Kubernetes, Kafka, Redshift, Athena, BigQuery, and ETL / ELT pipelines in general.
-
Senior DevOps Engineer
1 month ago
Ahmedabad, India Arrow Electronics Full timePosition:Senior DevOps EngineerJob Description:Job Location:Ahmedabad, Pune, IndoreRoles & Responsibilities:As a DevOps Engineer, you will work together with other cloud engineers, architects, developers, and customer engineering teams to:Should have experience in designing and building cloud native solutions using AWS services for product development in...