Senior Data Engineer

2 weeks ago

Pune, Maharashtra, India M&G Full time ₹ 15,00,000 - ₹ 20,00,000 per year
Job DescriptionJob TitleJob FunctionReports toLocationOverall Job PurposeAccountabilities/Responsibilities
  • Build and operationalize data solutions for business using Azure services in combination with custom solutions – Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2, Azure SQL etc
  • Experience in migrating on-premise data warehouses to data platforms on AZURE cloud
  • Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks
  • Proficient in Py-Spark
  • Experience in building Python based APIs on Azure Function Apps
  • Experience on Azure Logic apps
  • Experience in Lakehouse/Datawarehouse implementation using modern data platform architecture
  • Capacity Planning and Performance Tuning on ADF & Databricks pipelines
  • Support data visualization development using Power BI
  • Exposure across all the SDLC process, including testing and deployment
  • Experience in relational and dimensional modelling, including big data technologies
  • Experience in Azure DevOps – Build CI/CD pipelines for ADF, ADLS, Databricks, Azure SQL DB etc
  • Experience of working in secured Azure environments using Azure KeyVaults, Service Principals, and Managed Identities
  • Understanding of data masking, encryption and other practices used in handling sensitive data
  • Ability to interact with Business for requirement gathering and query resolutions
  • Working on off shore office based development teams, collaborating within a team environment and participating in typical project lifecycle activities such as requirement analysis, testing and release
  • Develop Azure Data skills within the team through knowledge sharing sessions, articles, etc.
  • Adherence to organisations Risk & Controls requirements
  • Participate in various initiatives/forums/groups and contribute effectively from idea creation to proto-type development. Support Strategic programs
  • Good to have knowledge on Apigee (Googles API Management)
Knowledge & Skills:
  • Azure Data Factory,
  • Azure Data Lake Storage V2
  • Azure SQL
  • Azure DataBricks
  • Pyspark
  • Azure DevOps
  • Power BI Report
  • Confidence & excellent communication
Experience:
  • Overall 6-8 years of experience in Azure Data Engineering
Educational Qualification:
  • Graduate/Post-graduate. Preferably with specialisation in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline

M&G

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionReq ID:330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior QE Engineer to join our team in Pune, Mahrshtra (IN-MH), India (IN).Senior Quality Engineer I...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...

  • Senior Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time US$ 1,20,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a Senior Software Engineer to join our team in Pune. As a key member of our engineering group, you will play a crucial role in the entire software development lifecycle, from initial design to hands-on development. You will work with cross-functional teams to create innovative solutions that are scalable and reliable. This...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Senior Data Engineer">Job Description:As a senior data engineer, you will be responsible for designing and building robust data pipelines that process and transform data from diverse sources.Key Responsibilities:Design and build efficient data pipelines that ensure data quality, reliability, and availability across the pipeline...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionAbout the Role:We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing and maintaining large-scale data warehouses that support our analytics and intelligence platform.Design and develop advanced SQL queries, stored...

  • Senior Data Quality Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataQuality Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Quality Engineer PositionWe are seeking a skilled Senior Data Quality Engineer with expertise in data testing automation, Python, PySpark, and SQL. The ideal candidate will be instrumental in ensuring the quality and reliability of our data pipelines through robust testing.

  • Data Operations Engineer

    2 weeks ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NCSI Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Senior Data Engineer Company Name: NCSi Job Description: NCSi is seeking a highly skilled Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines and architectures to support our data-driven initiatives. You will collaborate with cross-functional teams to...