Urgent) Sr. Data Engineer

2 days ago

Pune, Maharashtra, India VidPro Consultancy Services Full time
Job Description

Experience: 5-8 Years

Work Mode: Pune & Hyderabad

Job Type: Fulltime

Mandatory Skills: Python, Pyspark, SQL, Snowflake, Airflow, ETL, Data Pipelines, Elastic Search, or AWS.

Role Overview

We are looking for a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes.

Responsibilities

- Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
- Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
- Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
- Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
- Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
- Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
- Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
- Contribute to the development and enhancement of our data warehouse architecture

Required Skills

- Bachelor&aposs degree in Computer Science, Engineering, or a related field.
- 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
- At least 3+ years of exp in Snowflake data warehousing technologies.
- At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
- Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
- Working experience with Elastic Search and its application in data pipelines.
- Proficiency in SQL and experience with data modelling techniques.
- Strong understanding of cloud-based data storage solutions such as AWS S3.
- Experience working with NFS and other file storage systems.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.

Skills: data,pipelines,etl,skills,snowflake,aws,search,etl,airflow,data warehouse,data engineering,python,pyspark,sql,elasticsearch

  • Sr. Data Engineer

    4 days ago

    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical)Required Skills- Bachelor's / Engineering degree in Computer Science or Information Technology.- Postgraduate degree or diploma in Computer Science / Data Science is an added advantage.- AWS, SQL, Databricks, and Apache Spark certifications are a plus.- Strong foundation in data analytics and engineering,...

  • Sr. Data Engineer

    2 days ago

    Pune, Maharashtra, India ADP Full time

    ADP is hiring Sr. Data Engineer (Sr. Member Technical) Required Skills Bachelor's / Engineering degree in Computer Science or Information Technology. Postgraduate degree or diploma in Computer Science / Data Science is an added advantage. AWS, SQL, Databricks, and Apache Spark certifications are a plus. Strong foundation in data analytics and...

  • Sr. Data Engineer

    4 weeks ago

    Pune, Maharashtra, India LUMIQ Full time

    Sr. Azure Data EngineerLocation: Pune5 Days WFOWho we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM,...

  • Sr. Generative AI Engineer

    4 weeks ago

    Pune, Maharashtra, India Earth Solutions Pvt. Ltd. Full time

    Company DescriptionEstablished in 2009, Earth Solutions Pvt. Ltd. is a fast-growing offshore software development company based in Pune, India. We offer world-class services including Technology Consulting, Software Design, Development, Middleware Implementation, and Support. Our team of industry experts is committed to providing meaningful business...

  • Sr. Generative AI Engineer

    4 weeks ago

    Pune, Maharashtra, India Earth Solutions Pvt. Ltd. Full time

    Company DescriptionEstablished in 2009, Earth Solutions Pvt. Ltd. is a fast-growing offshore software development company based in Pune, India. We offer world-class services including Technology Consulting, Software Design, Development, Middleware Implementation, and Support. Our team of industry experts is committed to providing meaningful business...

  • Urgent Search Data Engineer–azure

    12 hours ago

    Pune, Maharashtra, India Admin Looks Full time

    Urgently looking for a for a talented and experienced Data Engineer with expertise in Azure data technologies to join our team on a contractual basis for a minimum of six months The ideal candidate will have a solid background in designing building and maintaining scalable data solutions using Azure tools This role is fully remote and requires a...

  • Sr. Data Engineer

    4 days ago

    Pune, Maharashtra, India Concord Full time

    Job Title: Snowflake & DBT Data EngineerExperience: 5–10 yearsEmployment Type: Full-timeJob Summary:We are seeking a highly skilled Data Engineer with strong hands-on experience in Snowflake and dbt (Data Build Tool) to join our data engineering team. The ideal candidate will be responsible for designing and developing scalable data pipelines, performing...

  • Sr. Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Concord Full time

    Job Title: Snowflake & DBT Data Engineer Experience: 5–10 years Employment Type: Full-time Job Summary: We are seeking a highly skilled Data Engineer with strong hands-on experience in Snowflake and dbt (Data Build Tool) to join our data engineering team. The ideal candidate will be responsible for designing and developing scalable data pipelines,...

  • Sr. Data Engineer

    3 weeks ago

    Pune, Maharashtra, India Concord Full time

    Job Title: Microsoft Fabric Data EngineerLocation: Pune/BangaloreNo. of Positions: 1Experience: 3+ years overall, with 2+ year in Microsoft FabricEmployment Type: Full-time Job Overview:We are seeking a passionate and skilled Microsoft Fabric Data Engineer to design, build, and scale modern data applications on the Microsoft Fabric platform. This role is...

  • Sr. Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Concord Full time

    Job Title: Microsoft Fabric Data Engineer Location: Pune/Bangalore No. of Positions: 1 Experience: 3+ years overall, with 2+ year in Microsoft Fabric Employment Type: Full-time Job Overview: We are seeking a passionate and skilled Microsoft Fabric Data Engineer to design, build, and scale modern data applications on the Microsoft Fabric platform. This...