Lead Data Pipeline Engineer

11 hours ago

Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878
Job Title

This is a Data Engineering position in which you will design, develop and maintain ETL pipelines using Informatica Power Center and SQL Stored Procedures.

The ideal candidate will have hands-on experience working with SQL Server databases, gain a deep understanding of existing data and architecture at a granular level, monitor the performance of ETL jobs, resolve issues and improve performance metrics as needed.

  • Diagnose system performance issues related to data processing and implement solutions to address them.
  • Collaborate with other teams to ensure the successful integration of data pipelines into larger system architecture requirements.
  • Maintain integrity and quality across all pipelines and environments.

You will work closely with business users to bring closure to their requests. A Bachelor's degree in Computer Science, Mathematics, Statistics, Finance or a related technical field is required, or equivalent work experience.

Key Responsibilities:

  • Design, develop and maintain ETL pipelines.
  • Monitor the performance of ETL jobs and resolve issues as needed.
  • Collaborate with other teams to ensure the successful integration of data pipelines.

Required Skills and Qualifications:

  • Strong background in software development with experience in ingesting, transforming and storing data from large datasets.
  • Hands-on experience in designing and developing ETL pipelines.
  • Relevant years of exposure and proficiency in data warehousing concepts.
  • Proficient in SQL and database design concepts.

Bonus Points:

  • Knowledge of SSIS ETL packages.
  • Familiarity with Azure cloud computing platforms.
  • Experience with Databricks, ADF and PySpark.
Benefits

This role offers a competitive salary package, excellent benefits and opportunities for professional growth and development.

We are an equal opportunities employer and welcome applications from all qualified candidates.

  • Data Pipeline Engineer

    1 week ago

    Gurgaon, Haryana, India beBeeDataPipeline Full time ₹ 9,00,000 - ₹ 12,00,000

    Job SummaryWe are seeking a highly skilled Data Pipeline Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining complex data pipelines that enable us to extract insights from large datasets.About the RoleThis is a fantastic opportunity for someone who has experience with ETL tools and technologies, as well...

  • Lead Data Engineer

    4 days ago

    Gurgaon, Haryana, India Vipsa Talent Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    • Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production data platform

  • Lead Data Engineer

    4 days ago

    Gurgaon, Haryana, India CBRE Full time US$ 1,50,000 - US$ 2,00,000 per year

    Gurgaon - Haryana - India, Hyderabad - Telangana - India, Noida - Uttar Pradesh - IndiaAbout The RoleAs a Senior Lead Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipeline and infrastructure. You will work closely with stakeholders, analysts, and other to ensure data integrity, availability, and security. This...

  • Senior Cloud Engineer for Data Pipelines

    4 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity:We are seeking a seasoned Senior Cloud Engineer to join our team. As a key member, you will be responsible for designing, developing, and maintaining scalable data pipelines.The ideal candidate will have a deep understanding of cloud design patterns, experience working with Snowflake as a data warehouse solution, and hands-on expertise with...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term...

  • Data Engineering Lead

    2 days ago

    Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Chief Data Engineering PositionThis key leadership role involves overseeing the design and execution of large-scale data engineering initiatives.Key Responsibilities:Maintaining a strong team to develop, deploy, and optimize scalable data pipelines.Enhancing existing pipelines for increased efficiency and reliability.Designing robust data validation...

  • Senior/Lead Data Engineer

    2 days ago

    Gurgaon, Haryana, India Srijan Technologies PVT LTD Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.We use deep human insights, design innovation and data to create experiences...

  • Senior/Lead Data Engineer

    13 hours ago

    Gurgaon, Haryana, India Srijan Technologies Pvt Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About US:-We turn customer challenges into growth opportunities.Material is a global strategy partner to the world's most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.We use deep human insights, design innovation and data to create experiences...

  • Data Pipeline Architect

    3 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Overview:We are seeking a skilled professional to fill the role of Senior Data Engineer, responsible for designing and implementing data pipelines and extracting information from various sources.Key Responsibilities:Data Extraction and Parsing: Develop automated systems to extract relevant data from websites, ensuring accuracy and uptime.Pipeline...

  • Data Pipeline Developer

    4 days ago

    Gurgaon, Haryana, India ScoreMe Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Data Engineer with expertise in MuleSoft APIs, Azure Data Factory, and GoAnywhere Managed File Transfer services.Resource will be responsible for developing, implementing, and maintaining various applications and systems to support our state agencies. This role also includes operations and support activities, such as fielding and resolving customer tickets...