Senior Data Engineer

6 hours ago

Bangalore Division, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment Nice to have * AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake Job Description A Typical Day The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You’ll Bring · Bachelor’s degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server)· Experience with NoSQL databases (DynamoDb) . Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior Data Engineer

    1 week ago

    Bangalore Division, India USEReady Full time

    Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...

  • Senior Data Engineer

    1 week ago

    Bangalore Division, India Societe Generale Global Solution Centre Full time

    Responsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize...

  • Senior DevOps Engineer

    4 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    2 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    3 days ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    4 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior Data Engineer

    1 week ago

    Bangalore Division, India Zeta Full time

    About Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015. Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core...

  • Azure Data Engineer

    7 hours ago

    Bangalore Division, India LTIMindtree Full time

    Role Senior Data Engineer 8 years of experience Key responsibilities Build reusable utilities templates and automation pipelines Design scalable data engineering frameworks standards and best practices Provide architectural guidance cost optimization and performance tuning support for Data Engineering solutions mainly on Azure Evaluate and onboard new...

  • Senior Data Engineer

    7 hours ago

    Bangalore Division, India Accolade Full time

    About Accolade The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront. We are building the industry's first AI-native Operations Centralization Platform, designed to streamline complex processes, unlock new efficiencies, and create better experiences for residents and operators alike. Our platform uses...

  • Principal Data Engineer

    1 week ago

    Bangalore Division, India Autodesk Full time

    #25WD9141 Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform , which powers Autodesk’s Analytics Data Platform (ADP). This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-on leadership in...