(15h Left) Senior Data Engineer

1 day ago

Bengaluru, India Sonata Software Full time

Mandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code in different environment Nice to have * AWS CDK * Experience with upgrading Python version and all the linked connector in AWS environment using CDK * Experience with other modern ETL platforms * Snowpipe - to move data from S3 bucket to Snowflake Job Description A Typical Day The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data structures and ETL skill sets that support the IT development path. The Senior Application Developer will: · Data Integration: Design, develop, and maintain integrations between pennymac loan origination systems, using AWS Fargate, Lambda, Kinesis, SQS, Snowpipe etc. · Data Quality: Implement data quality rules, matching algorithms, and cleansing routines to ensure the accuracy and completeness of loan production data · Performance Optimization: Monitor and optimize the performance of all data pipelines and their integrations to ensure efficient data processing and access, especially in relation to real-time analytic consumers. · Collaboration: Work closely with data engineers, architects, business stakeholders, and teams managing or consuming production data to gather requirements, design solutions, and troubleshoot production incidents and issues. · Business Continuity: Remain available to help diagnose and troubleshoot issues. On-call shifts rotate on a regular basis. What You'll Bring · Bachelor's degree or equivalent work experience · 5+ years of relevant work experience · Knowledge of Agile Methodologies, such as Scrum is helpful · Experience with relational databases (Snowflake, SQL Server) · Experience with NoSQL databases (DynamoDb) . Experience with API calls . Experience with software upgrade like Python, Py odbc, snowflake connector etc · Experience designing and implementing with Data warehouse solutions leveraging Snowflake. · Knowledge of design patterns, refactoring and unit testing · Financial services experience, especially related to mortgages and mortgage backed securities, is desirable

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India JRD Systems Full time

    We are seeking a Senior Data Engineer with deep expertise in AWS Cloud Development . This role is critical to both the development of new data products and the modernization of existing platforms. The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both...

  • (15h Left) Data Engineer

    7 days ago

    Bengaluru, India People Prime Worldwide Full time

    Job Title: Senior Data Engineer Skills: Data Engineering, AgenticAI, Python, SQL, Api’s, Azure cloud services, SQL and NoSQL ,Docker, Kubernetes. Location: Pan India Job Type: Full-Time Experience Level: 4-11 Years About the Role: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a...

  • Senior Data Engineer

    1 day ago

    Bengaluru, India Avathon Full time

    Who We Are & Why Join Us Avathon is revolutionizing industrial AI with a powerful platform that enables businesses to harness the full potential of their operational data. Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-degree operational view that enhances decision-making and efficiency. With advanced capabilities...

  • (15h Left) Senior Data Engineer

    1 week ago

    Bengaluru, India Amazon Full time

    Worldwide Fulfillment by Amazon (WW FBA) empowers millions of sellers to scale globally through Amazon's leading fulfillment network. FBA sellers deliver fast, reliable Prime-eligible shipping and hassle-free returns to customers worldwide—enabling them to focus exclusively on business growth while Amazon handles operational logistics. The WW FBA Central...

  • ▷ 15h Left: Senior Data Engineer

    3 weeks ago

    Bengaluru, India Truecaller Full time

    Hello, Truecaller is calling you from Bangalore, India! Ready to pick up? Our goal is to make communication smarter, safer, and more efficient, while building trust across the world. With our roots in Sweden and a global reach, we deliver smart services that create meaningful social impact. We are committed to protecting you from fraud, harassment, scam...

  • ▷ 15h Left: Senior Data Engineer

    3 weeks ago

    Bengaluru, India SG Analytics Full time

    The Data Engineer should have strong data infrastructure and data architecture skills, a proven track record of administration for data engineering teams, strong operational skills to drive efficiency and speed, strong project management skills, and a core value base for how analytics can proactively improve organizations. You will be part of the Data &...

  • ▷ [15h Left] Cloud Engineer

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Make sure you have a valid EP number before the interview. To create an EP...

  • ▷ 15h Left! Data Engineer Intern

    5 days ago

    Bengaluru, India Jobted IN C2 Full time

    Overview: Emmes Group: Building a better future for us all. Emmes Group is transforming the future of clinical research, bringing the promise of new medical discovery closer within reach for patients. Emmes Group was founded as Emmes more than 47 years ago, becoming one of the primary clinical research providers to the US government before expanding into...

  • Data Scientist

    1 week ago

    Bengaluru, India Acme Services Full time

    Job Description Key Responsibilities: - Data Analysis & Interpretation: - Analyze large datasets to uncover trends, patterns, and insights that support business objectives. - Perform statistical analysis and data cleaning to ensure data quality and integrity. - Translate complex data findings into clear, actionable insights for business stakeholders. -...

  • 15h Left! Data Engineer

    3 days ago

    Bengaluru, India Mastek Full time

    Data Engineer – NiFi / Cloudera / Iceberg / Snowflake / Databricks Overview We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS/Hive/Impala) into Apache Iceberg tables, with downstream integration into Snowflake and Databricks. The ideal candidate will have...