AWS Data Engineer

2 weeks ago

Pune, India AAR Consultancy Full time

Role : AWS Data Engineer


Job Description :

Your role includes :

- Collect, manage and convert raw data into usable information for business analysts

- Improve data reliability and quality by combining raw information from different sources to create consistent and machine-readable formats

- Able to integrate various data types and sources (stream, API, various data formats, file formats) into AWS environment

- Development of efficient processing and ETL pipelines for Automotive, Customer, Web, Sales and Media Data

- Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling

- Data-driven product development in the Customer & Digital Marketing segment

- Conduct complex data analysis and report on results

- Support in turning proof-of-concept projects into production ready and scalable software solutions

- Automation through CI/CD pipelines of the delivery of the data science products in our cloud environment

- Troubleshoot and resolve issues in production environments

Qualifications :

- Preferably completed studies with a relevant specialization in Computer Science or equivalent fields

- 3 + years' Work experience as Data Engineer

- Deep expertise in Python.

- Good hands on experience on AWS Glue, AWS S3, AWS Athena, AWS Redshift, AWS Lambda, AWS Step Function, AWS Quicksight& AWS Analytics services.

- Extensive experience in cloud technologies and platforms such as AWS, Azure or Google

- Hands-on experience with containerization technologies like Docker and platforms such as Kubernetes

- Understanding of DevOps principles and good experience with CI/CD tools (Git, Jenkins, Terraform, Ansible, CloudFormation, etc.)

- Software development experience.

- Knowledge about web services, APIs, RESTful services

- Basic knowledge of system administration in Linux/Unix or Windows, virtual networking, DNS, TCP/IP etc.

- Experience and knowledge about networking and security in cloud environments

- Data engineering knowledge and experience in tools such as Kafka, Spark streaming, Pentaho Data Integration, Talend, Apache Hudi, etc.

- SQL and NOSQL database engine knowledge such as Oracle, MySQL, SQLServer, Cassandra, MongoDB, AWS DynamoDB, AWS Athena, etc.

- Familiar with the concepts of monitoring, metrics, capacity management (Grafana, Prometheus, ELK)

- Strong focus on Code Quality, Robustness, Automation, Testing and Monitoring

(ref:hirist.tech)

  • AWS Data Engineer

    3 weeks ago

    Pune, India Virtusa Full time

    AWS Data Engineer - CREQ188160 Description Responsibilities:Create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using AWS native services (such as GLUE, Lambda) or using data management technologies (such as Talend or Informatica)Design and optimize data models on AWS Cloud using AWS data...

  • AWS Data Engineer

    3 weeks ago

    pune, India Virtusa Full time

    AWS Data Engineer - CREQ188160 Description Responsibilities:Create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using AWS native services (such as GLUE, Lambda) or using data management technologies (such as Talend or Informatica)Design and optimize data models on AWS Cloud using AWS data...

  • Data Engineer

    1 month ago

    Pune, India Global Pharma Tek Full time

    Mandatory Skills- AWS Services,Data Engineer Python,SQL,Redshift.Description: We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experience with AWS services, particularly Redshift, and demonstrate a proactive,...

  • Data Engineer

    2 months ago

    pune, India Global Pharma Tek Full time

    Mandatory Skills - AWS Services,Data Engineer Python,SQL,Redshift.Description: We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experience with AWS services, particularly Redshift, and demonstrate a proactive,...

  • Data Engineer

    2 months ago

    Pune, India Global Pharma Tek Full time

    Mandatory Skills - AWS Services,Data Engineer Python,SQL,Redshift. Description: We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experience with AWS services, particularly Redshift, and demonstrate a proactive,...

  • AWS Data Engineer

    1 month ago

    Pune, India Techno Wise Full time

    We are looking for aAWS Data Engineerwho will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources.Key ResponsibilitiesPerform technical assessment...

  • AWS Data Engineer

    2 months ago

    Pune, India Techno Wise Full time

    We are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform technical...

  • AWS Data Engineer

    2 months ago

    pune, India Techno Wise Full time

    We are looking for a AWS Data Engineer who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building a Enterprise Data Lake on AWS Cloud platform and build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. Key Responsibilities Perform...

  • Senior Data Engineer

    4 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    2 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • AWS Data Engineer

    2 months ago

    pune, India Voyager Partners Full time

    Company : Mastek Digital (https :// Overview :We are looking for a talented AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform. Your expertise in AWS services and data engineering will be critical in building scalable,...

  • AWS Data Engineer

    4 weeks ago

    Pune, India Voyager Partners Full time

    Company : Mastek Digital (https ://www.mastek.com/)Role Overview :We are looking for a talented AWS Data Engineer to join our team. As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on the AWS platform. Your expertise in AWS services and data engineering will be critical in...

  • Data Engineer PySpark AWS

    4 days ago

    Pune, India Fusemachines Full time

    About Fusemachines Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees)....

  • AWS Data engineer

    1 day ago

    Pune, India YASH Technologies Full time

    Experience4 - 6 YearsJob Description Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields. • Minimum 5+ Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies: • AWS Data & Analytics Services: Athena, Glue,...

  • AWS Data engineer

    2 days ago

    Pune, India YASH Technologies Full time

    Experience4 - 6 YearsJob Description Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields. • Minimum 5+ Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies: • AWS Data & Analytics Services: Athena, Glue,...

  • AWS Data Engineer

    1 week ago

    pune, India Krishna Global Services Pvt. Ltd Full time

    Job Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Engineer

    5 days ago

    Pune, India Krishna Global Services Pvt. Ltd Full time

    Job Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Engineer

    1 week ago

    Pune, India Krishna Global Services Pvt. Ltd Full time

    Job Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Engineer

    4 hours ago

    Pune, Maharashtra, India Krishna Global Services Pvt. Ltd Full time

    Job Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Engineer

    2 weeks ago

    pune, India AAR Consultancy Full time

    Role : AWS Data Engineer Job Description : Your role includes : - Collect, manage and convert raw data into usable information for business analysts- Improve data reliability and quality by combining raw information from different sources to create consistent and machine-readable formats- Able to integrate various data types and sources (stream, API,...