Senior Engineer, Data Engineering

1 day ago

Bangalore, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. Bachelor’s degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server) · Experience with NoSQL databases (DynamoDb) . Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior DevOps Engineer

    10 hours ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    18 hours ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Senior Data Engineer

    23 hours ago

    bangalore, India MeghGen Technologies Full time

    Company DescriptionMeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...

  • Senior Engineer, Data Engineering

    1 week ago

    Bangalore, India USEReady Full time

    Job Title: Senior Databricks Engineer Experience Level: 5-8 Years As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable...

  • Senior Data Engineer

    1 week ago

    bangalore, India PASO Co Full time

    Job description We’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-Time About the Role One of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...

  • Senior Data Engineer

    11 hours ago

    bangalore, India MeghGen Technologies Full time

    Company Description MeghGen Technologies is a trusted technology solutions partner specializing in data engineering, cloud-native applications, and cloud migrations. We design and implement end-to-end cloud solutions to help businesses modernize infrastructure, scale applications, and harness the power of their data. Our expertise extends to AI-powered...

  • Senior Data Engineer

    23 hours ago

    bangalore, India LogixHealth Full time

    Job Title: Senior Data EngineerLocation: Bengaluru/CoimbatoreJob Type: Full-TimeImmediate joiners or notice period of less than 10days are needed.Job Role:As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-edge solutions that directly improve the healthcare industry. You’ll...

  • Senior Data Engineer

    10 hours ago

    bangalore, India LogixHealth Full time

    Job Title: Senior Data Engineer Location: Bengaluru/Coimbatore Job Type: Full-Time Immediate joiners or notice period of less than 10days are needed. Job Role: As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-edge solutions that directly improve the healthcare industry. You’ll...