Lead Data Engineer

6 days ago

Greater Bengaluru Area, India KPI Partners Full time ₹ 8,00,000 - ₹ 12,00,000 per year

KPI Partners is seeking a highly skilled and motivated Lead Data Engineer to join our dynamic team. You will be responsible for designing, developing, and maintaining scalable data pipelines and architectures. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data solutions meet business requirements and drive strategic decision-making.

Key Responsibilities:

  • Design, build, and maintain efficient and reliable data pipelines for processing large volumes of data.
  • Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications.
  • Ensure data quality and integrity by implementing data validation processes and monitoring systems.
  • Optimize data storage and processing solutions to improve performance and reduce costs.
  • Develop and maintain documentation for data architectures, processes, and workflows.
  • Stay current with industry trends and technologies related to data engineering and contribute to the continuous improvement of our data practices.
  • Mentor and guide junior data engineers in best practices and technical skills.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
  • 7+ years of experience in data engineering or a related field.
  • Strong experience on Pyspark, Python, Spark, SQL, Azure, Databricks.
  • Strong proficiency in SQL and experience with data modelling and database design.
  • Familiarity with big data technologies such as Hadoop, Spark, or cloud-based data platforms (e.g., AWS, Azure, Google Cloud).
  • Proficient in programming languages such as Python, Pyspark.
  • Experience with ETL tools and data integration methods.
  • Strong analytical and problem-solving skills with a detail-oriented mindset.
  • Excellent communication skills and the ability to work collaboratively in a team environment.

  • Lead- Data Engineer

    2 weeks ago

    Greater Bengaluru Area, India Kaleidofin Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Who we are?Kaleidofin is a fintech focused on the mission to build a digital ecosystem ensuring finance for everyone, everywhere. We provide the ki credit platform, combining credit health assessment (ki score), middleware rails and best-in-class risk management (ki view) to enable the financial ecosystem to serve customers better. Via credit health scores...

  • Data Engineer Technical Lead(Azure)

    1 day ago

    Greater Bengaluru Area, India Sigmoid Full time

    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data...

  • Data Engineer Technical Lead(Azure)

    1 day ago

    Greater Bengaluru Area, India Sigmoid Full time

    Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data...

  • Data & AI Lead

    2 weeks ago

    Greater Bengaluru Area, India QBurst Full time

    Description:We are seeking an experienced Leadto drive our data and AI streams. The ideal candidates are not just technical experts but also strategic thinkers who can act as independent consultants, guiding projects from concept to production. They should have a proven track record of designing, developing, and deploying robust, scalable, and real-world AI...

  • Lead Data Engineer

    2 days ago

    Greater Bengaluru Area, India Impetus Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking good Sr GCP Leads for Bangalore & Gurgaon Location.These folks should be able to drive and lead migration from On Prem to GCP.Roles & Responsibilities7-12 years of experience in the role of implementation of high end software products.Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and...

  • Lead Snowflake Data Engineer

    7 days ago

    Greater Chennai Area, India Firstwave Technologies Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We're Hiring: Lead Snowflake Data EngineerLocation:Chennai / HyderabadEmployment Type:Full-TimeExperience:7+ Years (Minimum 5 Years in Snowflake)Notice Period:Immediate – 15 Days About the RoleWe are seeking a highly skilledLead Snowflake Data Engineerwith strong hands-on experience inSnowflake, Medallion Architecture, ADF-based ELT pipelines, and...

  • Associate Product Manager

    2 weeks ago

    Greater Bengaluru Area, India LEAD Group Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    This role is for someone who wants to be at the centre of product and execution. It's not about managing Jira tickets, it's about taking ownership of meaningful problems and doing whatever it takes to solve them.What You'll DoPartner with me to define and drive product success across our full suite of school solutionsDeeply understand how our products are...

  • Data Engineer

    1 day ago

    Greater Bengaluru Area, India VIDA Digital Identity Full time

    At VIDA we’re building the future of digital identity. As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You’ll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make extensive use of Scala Spark, dbt, and...

  • Data Engineer

    1 day ago

    Greater Bengaluru Area, India VIDA Digital Identity Full time

    At VIDA we’re building the future of digital identity. As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You’ll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make extensive use of Scala Spark, dbt, and Terraform....

  • Data Engineer

    23 hours ago

    Greater Bengaluru Area, India VIDA Digital Identity Full time

    At VIDA we’re building the future of digital identity. As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You’ll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection . We run on AWS and make extensive use of Scala Spark, dbt, and...