AWS Data Engineer

12 hours ago

Bengaluru Gurugram Pune, India cc0e728b-c91e-4439-9e23-ffa35eadb479 Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Profile:

experience building data pipelines

* highly proficient in python, Data frames

* experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB

* highly proficient in SQL Query

* Snowflake or experience with similar analytics database

* experience extracting data from SQL and NoSQL databases.

* Experience with CI/CD pipeline to release the code in different environment

Nice to have

* AWS CDK

* Experience with upgrading Python version and all the linked connector in AWS environment using CDK

* experience with other modern ETL platforms

* Snowpipe - to move data from S3 bucket to Snowflake

Job Description:

  • Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc.
  • Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data
  • Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers.
  • Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues.
  • Business Continuity: Remain available to help diagnose and troubleshoot issues.  On-call shifts rotate on a regular basis.

What Youll Bring

  • Bachelor's degree or equivalent work experience
  • Knowledge of Agile Methodologies, such as Scrum is helpful
  • Experience with relational databases (Snowflake, SQL Server)
  • Experience with NoSQL databases (DynamoDb)

. Experience with API calls

. Experience with software upgrade like Python, Py odbc, snowflake connector etc

  • Experience designing and implementing with Data warehouse solutions leveraging Snowflake.
  • Knowledge of design patterns, refactoring and unit testing

  • AWS Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Aws Data Engineer

    1 week ago

    Bengaluru, Gurugram, Mumbai, India ERM Placement Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job role: AWS Data EngineerLocation: PAN IndiaJob descriptionKey ResponsibilitiesDesign and build data pipelines & Data lakes to automate ingestion of structured and unstructured data that provide fast, optimized, and robust end-to-end solutions Knowledge about the concepts of data lake and dat warehouse Experience working with AWS big data technologies...

  • Big Data Consultant, Data

    1 day ago

    Gurugram, India AWS ProServe IN - Karnataka Full time

    AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: AWS Data Engineer Company Name: NCSi Job Description: NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with...

  • Aws Data Engineer

    4 days ago

    Pune, Maharashtra, India Viraaj HR Solutions Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Industry & Sector:IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients.Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and...

  • AWS Data Engineer

    24 hours ago

    Pune, India Talent Worx Full time

    Senior AWS Data Engineer Overview: We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages. Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...

  • Aws Data Engineer

    2 weeks ago

    Bengaluru, Hyderabad, Pune, India Genpact Full time ₹ 1,20,00,000 - ₹ 2,40,00,000 per year

    We are inviting applications for the role of Data Engineer Extensive hands-on experience working with data using SQL, Python (PySpark), building ETL in AWS & AWS Services like GLUE OR ATHENAWe are looking for an experienced AWS Data Engineering to join our team. The successful candidate will be responsible for leading the development and implementation of...

  • Data Scientist

    24 hours ago

    Bengaluru, India AWS ProServe IN - Karnataka Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector.AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud...

  • AWS Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NCS Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: AWS Data EngineerCompany Name: NCSiJob Description:NCSi is seeking a skilled AWS Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing and building robust data pipelines, developing data integration processes, and optimizing database performance in cloud environments. You will work collaboratively with data...

  • AWS Data Engineer

    1 week ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...