Senior Data Engineer

6 days ago

Noida, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Job Description:

We are seeking a highly skilled Data Engineer to join our team. As a Senior ETL and Data Streaming Engineer, you will play a pivotal role in designing, developing, and maintaining our robust data pipelines.

The ideal candidate will have deep expertise in both batch ETL processes and real-time data streaming technologies, coupled with extensive hands-on experience with AWS data services. A proven track record of working with Data Lake architectures and traditional Data Warehousing environments is essential.

Key Responsibilities:
  • Design, develop, and implement highly scalable, fault-tolerant, and performant ETL processes using industry-leading ETL tools to extract, transform, and load data from various source systems into our Data Lake and Data Warehouse.
  • Architect and build batch and real-time data streaming solutions using technologies like Talend, Informatica, Apache Kafka or AWS Kinesis to support immediate data ingestion and processing requirements.
  • Utilize and optimize a wide array of AWS data services.
  • Collaborate with data architects, data scientists, and business stakeholders to understand data requirements and translate them into efficient data pipeline solutions.
  • Ensure data quality, integrity, and security across all data pipelines and storage solutions.
  • Monitor, troubleshoot, and optimize existing data pipelines for performance, cost-efficiency, and reliability.
  • Develop and maintain comprehensive documentation for all ETL and streaming processes, data flows, and architectural designs.
  • Implement data governance policies and best practices within the Data Lake and Data Warehouse environments.
  • Mentor junior engineers and contribute to fostering a culture of technical excellence and continuous improvement.
  • Stay abreast of emerging technologies and industry best practices in data engineering, ETL, and streaming.
Qualifications:
  • 10+ years of progressive experience in data engineering, with a strong focus on ETL, ELT and data pipeline development.
  • Deep expertise in ETL Tools: Extensive hands-on experience with commercial ETL tools (Talend).
  • Strong proficiency in Data Streaming Technologies: Proven experience with real-time data ingestion and processing using platforms such as AWS Glue,Apache Kafka, AWS Kinesis, or similar.
  • Extensive AWS Data Services Experience:
    • Proficiency with AWS S3 for data storage and management.
    • Hands-on experience with AWS Glue for ETL orchestration and data cataloging.
    • Familiarity with AWS Lake Formation for building secure data lakes.
    • Good to have experience with AWS EMR for big data processing.
  • Data Warehouse (DWH) Knowledge: Strong background in traditional data warehousing concepts, dimensional modeling (Star Schema, Snowflake Schema), and DWH design principles.
  • Programming Languages: Proficient in SQL and at least one scripting language (e.g., Python, Scala) for data manipulation and automation.
  • Database Skills: Strong understanding of relational databases and NoSQL databases.
  • Version Control: Experience with version control systems (e.g., Git).
  • Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail.
  • Communication: Strong verbal and written communication skills, with the ability to articulate complex technical concepts to both technical and non-technical audiences.

  • Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Senior Cloud Engineer Advisor

    3 weeks ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionReq ID:304573NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Cloud Engineer Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Preferred...

  • Systems Engineering Senior Specialist

    1 week ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionReq ID:314375NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Engineering Senior Specialist - AD DNS and WINS to join our team in Noida, Uttar Pradesh (IN-UP),...

  • Senior Data Engineer

    5 days ago

    Noida, Uttar Pradesh, India Dhurin Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role : Senior Data EngineerAbout The CompanyDhurin is a fast-growing data science consulting firm focused on the BFSI sector. We partner with banks, fintech and financial institutions mainly in Indian market to solve complex challenges in risk, fraud, collections, marketing, sales, and operations.Were a niche, analytics-driven team where your work directly...

  • Senior Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Dhurin Full time

    Role : Senior Data Engineer About the Company :Dhurin is a fast-growing data science consulting firm focused on the BFSI sector. We partner with banks, fintech and financial institutions mainly in Indian market to solve complex challenges in risk, fraud, collections, marketing, sales, and operations.Were a niche, analytics-driven team where your work...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000

    **Job Title:** Senior Data Engineer**Job Summary:** We are seeking an experienced data engineer to join our team. As a senior data engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.**Key Responsibilities:Design and develop scalable data processing architectures using technologies such as Hadoop,...

  • Senior Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Hexaconcepts Full time

    Client : A data science consulting firm that specializes in delivering impactful solutions for businesses. Their approach focuses on insight and prediction, diagnostic analysis, and data engineering to help organizations unlock value from their data.Role : Senior Data EngineerLocation : Noida (Work from Office only)Experience : 7y - 10yJoining : ...

  • Senior Lead Data Engineer

    4 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewData Engineers play a vital role in designing, developing, and maintaining large-scale data systems. As a Senior Staff Engineer, you will be responsible for leading the design and implementation of complex data engineering solutions.

  • Senior Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India TechnePlus Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Company DescriptionAt TechnePlus, we believe technology is most powerful when it brings people together and solves real-world challenges. Our diverse and passionate team partners with clients to create digital solutions that drive growth, efficiency, and meaningful change. We specialize in a full spectrum of consulting and IT services, including Digital...

  • Senior Data Engineering Leader

    6 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job OverviewWe are seeking a highly skilled and experienced Senior Staff Engineer to lead our Data Engineering efforts.This is an exceptional opportunity for a talented professional to drive innovation, mentor junior team members, and contribute to the development of scalable data pipelines and ETL processes.