AWS Data Engineer
5 days ago
JD : AWS Data EngineerJob location : HyderabadMust Have :- Design and develop efficient data pipelines using Python and orchestrate workflows with Airflow, ensuring reliable data ingestion, transformation, and storage.- Utilize Spark (Glue, EMR) for largescale data processing tasks, optimizing for performance and scalability.- Implement and manage streaming data solutions with Kafka, managing high-volume data with proficiency in SQS and Event Bridge for even- driven architectures.- Leverage AWS services extensively, including S3 for data storage, ensuring best practices in cloud-based data handling and security.- Work closely with data architects, analysts, and other stakeholders, providing technical expertise and support in data-related projects and initiatives.Good to Have :- Knowledge of Data Warehousing (DW) concepts and Data Integration (DI) methodologies.- Experience with data modelling and familiarity with ETL processes and tools.- Experience in API integration, with a solid understanding of RESTful services.- Developing and consuming APIs to facilitate seamless data exchange and system :- Bachelor's degree in computer science, Engineering, Data Science, or related field.- 4-8 years of relevant experience in data engineering, with a proven track record of developing and managing data solutions.- Strong proficiency in Python and experience with Airflow for data pipeline management.- Expertise in Spark for big data processing, with experience in Glue and/or EMR.- Demonstrated experience with Kafka for real-time data streaming and familiarity with AWS messaging services like SQS and Event Bridge.- In-depth knowledge of AWS cloud services, especially S3, and best practices in cloud security and data management. (ref:hirist.tech)
-
AWS Data Engineer
3 weeks ago
Hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)RemoteHyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out...
-
AWS Data Engineer
3 weeks ago
Hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)RemoteHyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out...
-
AWS Data Engineer
3 weeks ago
Hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)RemoteHyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out...
-
AWS Data Engineer
1 week ago
hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions in...
-
AWS Data Engineer
1 week ago
Hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions in...
-
AWS Data Engineer
1 week ago
Hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions in...
-
AWS Data Engineer
1 week ago
Hyderabad, India Insight Global Full timeJob Details:Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions in...
-
AWS Data Engineer
5 days ago
Hyderabad, India Insight Global Full timeJob Details :Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions...
-
AWS Data Engineer
7 days ago
Hyderabad, India Insight Global Full timeJob Details :Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions...
-
Aws data engineer
7 days ago
Hyderabad, India Insight Global Full timeJob Details :Data Engineer (AWS)HyderabadWe are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain scalable data pipelines and infrastructure in the cloud. The ideal candidate will have experience working with AWS services, relational databases, and ETL processes, as well as expertise in building out solutions in...
