Lead Data Engineer

4 days ago

Bengaluru, Karnataka, India GIST Impact Full time ₹ 15,00,000 - ₹ 28,00,000 per year

Role Description:

As a Data Engineering Lead, you will play a crucial role in overseeing the design, development, and maintenance of our organization's data architecture and infrastructure. You will be responsible for designing and developing the architecture for the data platform that ensures the efficient and effective processing of large volumes of data, enabling the business to make informed decisions based on reliable and high-quality data.

The ideal candidate will have a strong background in data engineering, excellent leadership skills, and a proven track record of successfully managing complex data projects.

Responsibilities:

Data Architecture and Design:

  • Design and implement scalable and efficient data architectures to support the organization's data processing needs

  • Work closely with cross-functional teams to understand data requirements and ensure that data solutions align with business objectives

ETL Development:

  • Oversee the development of robust ETL processes to extract, transform, and load data from various sources into the data warehouse

  • Ensure data quality and integrity throughout the ETL process, implementing best practices for data cleansing and validation

Big Data Technologies:

  • Stay abreast of emerging trends and technologies in big data and analytics, and assess their applicability to the organization's data strategy

  • Implement and optimize big data technologies to process and analyze large datasets efficiently

Cloud Integration:

  • Collaborate with the IT infrastructure team to integrate data engineering solutions with cloud platforms, ensuring scalability, security, and performance

Performance Monitoring and Optimization:

  • Implement monitoring tools and processes to track the performance of data pipelines and proactively address any issues

  • Optimize data processing workflows for improved efficiency and resource utilization

Documentation:

  • Maintain comprehensive documentation for data engineering processes, data models, and system architecture

  • Ensure that team members follow documentation standards and best practices.

Collaboration and Communication:

  • Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and deliver solutions that meet those requirements

  • Communicate effectively with technical and non-technical stakeholders, providing updates on project status, challenges, and opportunities.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 6-8 years of professional experience in data engineering
  • In-depth knowledge of data modeling, ETL processes, and data warehousing.
  • In-depth knowledge of building the data warehouse using Snowflake
  • Should have experience in data ingestion, data lakes, data mesh and data governance
  • Must have experience in Python programming
  • Strong understanding of big data technologies and frameworks, such as Hadoop, Spark, and Kafka.
  • Experience with cloud platforms, such as AWS, Azure, or Google Cloud.
  • Familiarity with database systems like SQL, NoSQL, and data pipeline orchestration tools.
  • Excellent problem-solving and analytical skills.
  • Strong communication and interpersonal skills.
  • Proven ability to work collaboratively in a fast-paced, dynamic environment.

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Lead Data Scientist

    4 days ago

    Bengaluru, Karnataka, India Data Science Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to know the team GrabFin is an aggregate of FinTech businesses spread across 6 countries in S.E. Asia, in the Lending, Payments and Insurance domains. We are excited to provide innovative financial services to all participants of the Grab Ecosystem be it our Drivers, Consumers or Merchants. Our products are built on fundamental market insights combined...

  • Lead Data Scientist

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Scientist - Computer Vision Generative AI to join our team in Bangalore Karn taka IN-KA India IN We are seeking a...

  • Lead Data Scientist

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Data Scientist - Computer Vision & Generative AI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). We are seeking...

  • Data Engineer

    7 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Digital Engineering Lead Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job Duties: Job Title: Data Science & AIML, GenAI Lead/EngineerKey Responsibilities: Develop and implement traditional machine learning algorithms. Deploy at least one model in a production environment. Write and maintain Python code for data science and machine learning projects.Minimum Skills Required: Preferred Qualifications: Knowledge of Deep Learning...

  • Gcp Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 298270NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a GCP Lead Engineer to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Primary Skill ...

  • Lead Data Scientist

    1 week ago

    Bengaluru, Karnataka, India Aptus Data Labs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Description: Senior/lead Data ScientistLocation: Bangalore/WFHEmployment Type: Full-timeAbout the RoleWe are seeking a highly skilled Senior /lead Data Scientist with strong expertise in Artificial Intelligence (AI), Machine Learning (ML), Deep Learning, and Natural Language Processing (NLP). The ideal candidate will also have hands-on exposure to...

  • Lead Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Lead Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Lead Data Scientist

    1 week ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Lead Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...