AWS Data Engineer

1 month ago

india Change Leaders Full time

Job Description : AWS Glue + Python Pyspark

Job Overview :

Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location : India (Most Preferrable - Bangalore)

Experience Level : 5-12 years

Role Overview :

We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team. As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS. Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.

Primary Skills :


- AWS PySpark Python programming. He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation :

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management :

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure :

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes :

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills :

- Familiarity with Python for scripting and automation tasks is a plus.

Willingness to Work Late Hours :

The role involves working until 12:30 AM IST (Indian Standard Time) due to global project requirements. Flexibility in working hours is essential.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

If you are passionate about cloud data engineering, thrive in a collaborative environment, and are ready to take on exciting challenges, we encourage you to apply

(ref:hirist.tech)

  • AWS Data Engineer

    2 days ago

    india Deloitte Full time

    As an AWS Data Engineer Consultant at Deloitte, you will be a key player in designing, implementing, and optimizing data solutions on the Amazon Web Services (AWS) cloud platform. This role involves working closely with clients from various industries, understanding their data needs, and delivering robust data engineering solutions. Your role will involve:...

  • Aptus Data Labs

    2 weeks ago

    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • AWS Data Engineer

    3 days ago

    india Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Full time

    Job Description: As an AWS Data Engineer, you will play a critical role in building and maintaining the data infrastructure that powers our organization & applications and services. You will leverage your expertise in data engineering principles and AWS services to design, develop, and deploy scalable, secure, and reliable data pipelines. Responsibilities:...

  • AWS Data Engineer

    2 weeks ago

    india Krishna Global Services Pvt. Ltd. Full time

    Job Title: AWS Data Engineer Location: Pune Experience Required: 6-9 Years Job Description: We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • AWS Data Engineer

    2 weeks ago

    india Krishna Global Services Pvt. Ltd. Full time

    Job Title: AWS Data Engineer Location: Pune Experience Required: 6-9 Years Job Description: We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...

  • Data Engineer

    5 days ago

    india Talhive HR Management LLP Full time

    About Loopio :Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters. We do this by giving both our...

  • Data Engineer

    5 days ago

    india Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • AWS Data engineer

    1 month ago

    india Astrosoft Technologies Full time

    Title: AWS Database Migration Service (DMS) Specialist Responsibilities: Migration Planning: Assess existing database environments and develop migration strategies tailored to specific business requirements and constraints. Implementation: Configure and deploy AWS DMS resources to facilitate the migration of databases from on-premises or other cloud...

  • AWS Data Engineer

    2 days ago

    india HTC Global Services Full time

    AWS Data Engineer Experience: 5+ years Location: Chennai Notice Period: Immediate to 30 days Job Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplines Strong Knowledge in SQL and Python v3.x Language Can analyse new source data, model entities, and write complex SQL. Minimum 5 years of Overall...

  • Aptus Data Labs

    2 weeks ago

    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • AWS Data engineer

    3 days ago

    india YASH Technologies Full time

    Experience 4 - 6 Years Job Description Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields. • Minimum 5+ Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies: • AWS Data & Analytics Services: Athena, Glue,...

  • Senior Data Engineer

    2 weeks ago

    india mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek...

  • Operations Specialist

    7 days ago

    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    6 days ago

    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Operations Specialist

    5 days ago

    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • AWS Big Data Engineer

    2 months ago

    india Bosch Full time

    Job Description Technical skills ETL development experience with overall 4 to 7 years in AWS , Big data engineering related application Minimum 2 end to end ETL project implementation Proficient in PySpark, Python4. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks5. Expert in AWS to develop, deploy and maintain ETL...

  • Data Engineer

    5 days ago

    Anywhere in India/Multiple Locations Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Lead Data Engineer

    2 days ago

    india HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.- 3+ years' Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.- 3+ years' Experience with the...

  • Senior Data Engineer

    1 week ago

    india Accelya Group Full time

    For more than 40 years, Accelya has been the industry’s partner for change, simplifying airline financial and commercial processes and empowering the air transport community to take better control of the future. Whether partnering with IATA on industry-wide initiatives or enabling digital transformation to simplify airline processes, Accelya drives the...

  • Snowflake Data Engineer

    3 days ago

    india Lapis Data Analytics Full time

    Company Description Lapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...