AWS Data Engineer

3 weeks ago


PuneChennaiMumbaiBangaloreDelhi NCRHyderabad, IN Change leaders Full time

Job Description : AWS Glue + Python Pyspark

Job Overview :

Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location : India (Most Preferrable - Bangalore)

Experience Level : 5-12 years

Role Overview :

We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team. As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS. Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.

Primary Skills :


- AWS PySpark Python programming. He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation :

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management :

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure :

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes :

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills :

- Familiarity with Python for scripting and automation tasks is a plus.

Willingness to Work Late Hours :

The role involves working until 12:30 AM IST (Indian Standard Time) due to global project requirements. Flexibility in working hours is essential.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

If you are passionate about cloud data engineering, thrive in a collaborative environment, and are ready to take on exciting challenges, we encourage you to apply

(ref:hirist.tech)
  • AWS Data Engineer

    3 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Pune/Chennai, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • AWS Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN Huquo Full time

    Role : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...

  • Data Engineer

    3 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • AWS Data Architect

    3 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • AWS Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN Huquo Full time

    Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Cochin/Kochi/Noida/Hyderabad/Pune/Chennai, IN SPG Consulting Solutions Pvt.Ltd Full time

    - 5-7 years of Data engineering experience.- Must have hands-on experience in AWS Aurora RDS Postgre SQL, AWS S3, AWS Athena and AWS Quicksight, AWS protegrity etc.- Strong knowledge on Creating objects , data modeling tuning, Interface , ETL and reporting.- Should have knowledge on SQL Queries with Databases like Oracle, MySQL etc.- Strong knowledge on...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Remote, IN Geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...

  • Python Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...

  • Data Architect

    3 weeks ago


    Chennai/Bangalore/Gurgaon/Gurugram, IN DXC Luxoft Full time

    About Luxoft :Luxoft, a DXC Technology Company is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN TalentPulse Consultant Full time

    Overview :- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.- This position is essential for...

  • TransOrg Analytics

    3 weeks ago


    Bangalore/Delhi NCR/Mumbai, IN TransOrg Analytics Full time

    Roles and Responsibilities :1. Design and implement data engineering projects. 2. Integrate multiple data sources to create data lake/data mart Perform data ingestion and ETL processes using SQL, Scoop, Spark or Hive 3. Knowledge of new components and various emerging technologies in on-premises and Cloud (AWS/Azure/Google)4. Collaborate with various...

  • Data Engineer

    3 weeks ago


    Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full time

    JD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...


  • Delhi NCR/Mumbai/Pune/Bangalore, IN Huquo Consulting Full time

    Job Description :Key Responsibilities & Skillsets : Common Skillsets :- 3+ years of experience in Data Engineering : SQL(MySQL preferred), DWH (Redshift or Snowflake), Python and associated data engineering jobs.- Good to have working experience on RESTful API frameworks (Flask/FastAPI)- Experience with AWS core technologies Lambda, S3, ECS(Fargate), IAM,...

  • AWS Platform Engineer

    3 weeks ago


    Hyderabad/pune,chenn, IN Antal International Full time

    Job Description :We are looking for an AWS Platform Engineer who carries experience in architecture of Enterprise Data Warehouse implementation on AWS IAM, Redshift, S3, Glue, VPC, CloudWatch and other relevant services including cluster and node topology, configuration, and sizing. An ideal candidate will be responsible for managing, maintaining, and...


  • Bangalore/Delhi NCR/Chennai/Hyderabad/Mumbai, IN Grizmo Labs Full time

    Job Description : We are looking for : - 6-8 years of overall experience and 4 yrs or more into Data Science projects, ML Engineering and Modelling- Hands on experience with Python programming and managing the environment for python projects. - Implementation experience of algorithm categories like Classification, Regression, Parametric and Non-Parametric...

  • Big Data Engineer

    3 weeks ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • AWS Cloud Architect

    3 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Responsibilities : Data Architecture and Cloud Strategy :Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs.Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.Utilize AWS services (S3, Glue, EMR,...