AWS Data Engineer

3 weeks ago


BangalorePuneChennai, IN Change leaders Full time

Job Description : AWS Glue + Python Pyspark

Job Overview :

- Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform.

- This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the organization's data requirements.

Location : India (Most Preferrable - Bangalore)

Experience Level : 5-12 years

Role Overview :

- We are seeking a highly skilled and motivated Senior Cloud Data Engineer to join our dynamic team.

- As a key member of our cloud engineering group, you will play a crucial role in designing, implementing, and maintaining data pipelines and workflows on AWS.

- Your expertise in AWS Glue, AWS Redshift, AWS Managed Airflow, SQL, and optionally Python will be essential in ensuring the success of our data-driven projects.

Primary Skills :

- AWS PySpark Python programming.

- He has to do coding in day to day activities and also expected to review the code developed by the team.

- Must be aware of AWS services like Glue, redshift, S3, Airflow etc.

- Candidate is expected to manage stakeholder management along with mentoring the offshore team.

- Candidate must have technical expertise to advise effective solutions to the client on AWS platform.

Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain ETL processes using AWS Glue to extract, transform, and load data from various sources (including S3, ORC/Parquet/Text files) into AWS Redshift.

- Optimize data pipelines for performance, scalability, and reliability.

- Implement data aggregation, consolidation, and enrichment.

Workflow Automation :

- Utilize AWS Managed Airflow (Apache Airflow) to orchestrate complex data workflows.

- Schedule, monitor, and manage data processing tasks efficiently.

Database Management :

- Leverage your strong SQL skills to create and optimize database queries.

Cloud Infrastructure :

- Collaborate with architecture teams to design and implement AWS cloud infrastructure.

- Ensure security, scalability, and cost-effectiveness of cloud resources.

Support Project Processes :

- Work closely with cross-functional teams to understand project requirements and deliverables.

- Provide technical support during project execution and troubleshoot issues as needed.

Optional Python Skills :

- Familiarity with Python for scripting and automation tasks is a plus.

Willingness to Work Late Hours :

- The role involves working until 12:30 AM IST (Indian Standard Time) due to global project requirements.

- Flexibility in working hours is essential.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are advantageous.

- Strong problem-solving skills and ability to work independently.

- Excellent communication and collaboration skills.

Benefits :

- Competitive salary and benefits package.

- Opportunity to work on cutting-edge cloud technologies.

- Career growth and professional development.

(ref:hirist.tech)
  • AWS Data Engineer

    3 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • AWS Data Engineer

    4 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Remote, IN Geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...

  • Data Architect

    3 weeks ago


    Chennai/Bangalore/Gurgaon/Gurugram, IN DXC Luxoft Full time

    About Luxoft :Luxoft, a DXC Technology Company is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN TalentPulse Consultant Full time

    Overview :- The AWS Data Engineer plays a crucial role in our organization by designing and implementing scalable, reliable, and secure data solutions in the AWS cloud environment.- They are responsible for developing and maintaining data pipelines, optimizing data workflows, and ensuring the quality and integrity of our data.- This position is essential for...

  • AWS Data Architect

    3 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • AWS Data Engineer

    3 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Cochin/Kochi/Noida/Hyderabad/Pune/Chennai, IN SPG Consulting Solutions Pvt.Ltd Full time

    - 5-7 years of Data engineering experience.- Must have hands-on experience in AWS Aurora RDS Postgre SQL, AWS S3, AWS Athena and AWS Quicksight, AWS protegrity etc.- Strong knowledge on Creating objects , data modeling tuning, Interface , ETL and reporting.- Should have knowledge on SQL Queries with Databases like Oracle, MySQL etc.- Strong knowledge on...

  • AWS Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN Huquo Full time

    Role : Data EngineerMust-Have : - 4 to 6 years of Relevant experience in Data Engineering and delivery.- 3 to 4 years of relevant work experience in large-scale Data applications- AWS Glue is mandatory.- Strong 4-6 years of working experience in SQL Spark Python, Snowflake, and AWS cloud knowledge.- Good aptitude, strong problem-solving abilities, and...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

  • Data Engineer

    3 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Big Data Engineer

    3 weeks ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • AWS Cloud Architect

    3 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Responsibilities : Data Architecture and Cloud Strategy :Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs.Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.Utilize AWS services (S3, Glue, EMR,...

  • AWS Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN Huquo Full time

    Job Description :- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, Event Bridge, EC2, SQS, SNS, Lake Formation, Cloud Watch, Cloud Trail- Programming experience with Python, Shell scripting, and SQL- Responsible for...

  • Data Engineer

    3 weeks ago


    Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full time

    JD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...

  • DevOps Engineer

    3 weeks ago


    Bangalore/Pune, IN Talent Corner HR Full time

    Job Description Roles and Responsibilities :- Design, implement, and manage robust code pipelines for seamless software delivery and deployment on AWS infrastructure.- Strong experience with serverless architectures, particularly using AWS Lambda.- Configure and optimize CI/CD processes to automate software builds, testing, and deployments.- Familiarity with...

  • Data Engineer

    4 weeks ago


    Bangalore/Pune, IN Gethyr Full time

    We are seeking a talented and motivated Data Engineer stream processing, particularly utilizing Flink and Kafka, alongside expertise in Spark and AWS technologies. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust stream processing solutions to handle large volumes of data in real-time, ensuring high...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Cloud Data Architect

    3 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Huquo Full time

    1. Data Architecture and Cloud Strategy - MUST HAVE : - Develop and maintain a comprehensive data architecture and cloud strategy that aligns with the organization's goals and needs.- Design, implement and manage cloud-based data infrastructure on AWS, ensuring scalability, reliability, and cost-efficiency.- Utilize AWS services (S3, Glue, EMR, Redshift,...

  • Python Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...