Senior Data Engineer

4 days ago

Pune, India Globner Consulting LLP Full time

Responsibilities : - Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools.- Understanding of banking data models, financial reporting, and regulatory compliance.- Integrate data from legacy banking platforms into modern data lakes and warehouses.- Collaborate with business analysts, architects, and operations teams to understand core banking workflows and data requirements.- Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, Synapse (Azure SQL DW), and Azure Data Lake.- Perform data analysis and transformation using PySpark on Azure Databricks or Apache Spark.- Design and implement data models optimized for storage and various query patterns.- Work with structured, semi-structured, and unstructured data.- Utilize various database technologies including Traditional RDBMS, MPP, and NoSQL.- Ensure compliant handling and management of data.- Experience in building end-to-end data pipelines in a cloud environment.- Mentor junior engineers and contribute to the development of best practices and reusable frameworks.Skills Expected : - 8+ years of relevant IT experience in the BI/DW domain with hands-on experience on the Azure modern data platform.- Strong knowledge and experience with the Python programming language- Experience using version control systems like Git, bitbucket.- Experience in data analysis and transformation using PySpark on Azure Databricks or Apache Spark.- Good knowledge of Distributed Processing using Databricks or Apache Spark.- Experience in creating data structures optimized for storage and various query patterns.- Experience of integrating Unity Data Catalog with the Databricks and registering data assets etc.- Understanding of CI/CD pipelines.- Knowledge of Agile/Scrum methodologies. (ref:hirist.tech)

  • Senior Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    4 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    14 hours ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...

  • Senior Data Engineer

    2 weeks ago

    pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    1 week ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...