Lead Data Engineer

2 months ago


India Pro5.ai (formerly Mangtas) Full time

Job Description:

  • Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.
  • The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing demands.
  • This hands-on role requires technical expertise to deliver data and analytical services, including data ingestion, transformation, storage, and reporting and strives to continuously develop new and improved data engineering capabilities.


Key Accountabilities:

  • Design data solutions to meet business, technical and user requirements. This includes building modern data pipelines that meet functional/non-functional business requirements and provide end-to-end data solutions
  • Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialisation
  • Contribute to ongoing management of the platform, including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
  • Identify, design, and implement process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability
  • Technical ownership for data and data pipelines to ensure compliance with data standards, architectural standards, and achievement of business requirements
  • Build a strong understanding of platform architecture and the best way to leverage it to achieve effective outcomes for a given project
  • Support compliance with data, information and security management requirements


Techstack:

  1. A strong understanding and experience across modern data stacks - airbyte/melanto/AWS DMS/AWS App flow, Apache Kafka / Aws Kinesis, Postgres / AWS redshift, DuckDB, DBT, Trino, / Athena, Clickhouse, cubeJs, metabase / looker / AWS Quicksight
  2. AWS platform networking, IAM, security, EKS
  3. Understand and read Elixir, Python, Typescript
  4. Proficient in Spark, SQL, Python, EKS / Kubernetes / Terraform


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...


  • India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Lead Data Engineer

    5 days ago


    india Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Data Engineer

    2 months ago


    india dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse...


  • india Lapis Data Analytics Full time

    Company Description Lapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • india IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...


  • india Chryselys Full time

    Job Description: As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding...


  • india Concentrix Full time

    Experience: 6 Years - 10 Years Job Location: Bengaluru (Hybrid- currently remote) Notice Period: Immediate/ 30 Days (Looking for someone to start from May or Mid June) Shift Timings: 02:00 PM to 11:00 PM (IST)/ 03:00 PM to 12:00 AM (IST) Job Description: We are seeking an experienced and talented Data Engineering Team Lead who can manage a...

  • Lead Data Engineer

    1 month ago


    india Recro Full time

    Position: Data Engineer(Lead) Location: WFO-Bangalore Experience Level: 8+ years Job Description: Summary: We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a...

  • Lead Data Engineer

    2 months ago


    India Pro5.ai (formerly Mangtas) Full time

    Job Description : Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...

  • Lead Data Engineer

    2 weeks ago


    india Coders Connect Full time

    Job Description Coders Connect and Sanofi are joining forces to bring an electrifying twist to the bio pharmaceutical world! Work with a rhythm that suits your style (2 days remote and 3 days onsite magic).Language: Proficiency in English is required for this role to ensure effective communication within our diverse, global team.About Sanofi: We're not...

  • Lead Data Engineer

    1 week ago


    india Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...


  • india Apolis Consulting Pvt Ltd Full time

    Apolis is actively looking to hire a Data QA Lead & Data QA Engineer role to join our team. This will be 4-6 months contractual role. Location: Remote Job description Data QA Testing (1-Lead and 5- Data QA Tester) PST 3 hours overlaps-Rest are flexible. 4-6 months- Contractors. Must have done Data Validation Must have Data QA experience. Working with...

  • Lead Data Engineer

    2 weeks ago


    india EXL Full time

    Must have: Experience: 5+ years 5/6+ years of experience in Data Engineering, Architecture & Solutioning areas in large-scale distributed systems 3+ years of experience across Cloud Platforms, AWS preferred. 2+ years of experience in creating solutions for clients/products Hands on coding experience in Oracle / Teradata / SQL Server platform. Hands on...

  • Lead Data Engineer

    2 weeks ago


    India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...

  • Lead Data Engineer

    2 weeks ago


    india Akivna Technologies Pvt. Ltd. Full time

    Company Description Akivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients. Job Description: We are seeking a skilled and...

  • Aptus Data Labs

    2 weeks ago


    india Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Lead Data Engineer

    2 months ago


    india Tredence Full time

    MUST HAVE • Minimum of 4+ years of Azure DE experience • In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...


  • india K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...