Lead Data Engineer

3 weeks ago

Bengaluru, Karnataka, India Pylon Management Consulting Full time

Key Responsibilities :

- Cloud Data Architecture : Architect and deploy large-scale data solutions on Azure, AWS, or GCP.

- CI/CD for Data Pipelines : Define and implement CI/CD strategies using Terraform, Azure DevOps, or GitHub Actions.

- Data Governance : Implement and maintain data cataloging, lineage tracking, and access control solutions (Unity Catalog, Collibra, Alation).

- Compliance & Security : Ensure compliance with GDPR, CCPA, and other industry-specific data security and privacy standards.

- Scalability & Performance : Develop strategies for distributed computing, parallel processing, and caching mechanisms to improve performance.

- Collaboration : Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver robust data :

- 7+ years of experience in data engineering, cloud data platforms, and distributed systems.

- Strong hands-on experience with Databricks and Apache Spark.

- Proficiency with at least one major cloud provider (Azure, AWS, GCP).

- Experience with CI/CD pipelines and IaC tools (Terraform, Azure DevOps, GitHub Actions).

- Familiarity with data governance tools (Unity Catalog, Collibra, Alation).

- Strong knowledge of data privacy and compliance frameworks (GDPR, CCPA, HIPAA preferred).

- Proven ability to optimize large-scale distributed systems for performance and reliability.

- Excellent problem-solving skills, strong communication, and collaborative :

- Knowledge of Kubernetes and containerized workloads.

- Experience with streaming platforms (Kafka, Event Hubs, Kinesis).

- Exposure to machine learning workflows on Databricks.

(ref:hirist.tech)

  • Technical Lead- Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Lead Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Scientist - Computer Vision Generative AI to join our team in Bangalore Karn taka IN-KA India IN We are seeking a...

  • Digital Engineering Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 299336NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Bangalore Karn xc4 x81taka IN-KA India IN How We Will Help...

  • Lead Data Scientist

    2 days ago

    Bengaluru, Karnataka, India Aptus Data Labs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Description: Senior/lead Data ScientistLocation: Bangalore/WFHEmployment Type: Full-timeAbout the RoleWe are seeking a highly skilled Senior /lead Data Scientist with strong expertise in Artificial Intelligence (AI), Machine Learning (ML), Deep Learning, and Natural Language Processing (NLP). The ideal candidate will also have hands-on exposure to...

  • Lead Data Scientist

    1 week ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Lead Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Lead Data Scientist

    20 hours ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Lead Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Data Entry Operator

    6 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Senior Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    22 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...