Lead Data Engineer

4 weeks ago


Mumbai, Maharashtra, India Sampoorna Consultants Pvt. Ltd Full time

Client is looking out for a technical delivery leader on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.

The role will drive the development of data processing frameworks and architectural approaches that scale to handle the business's growing demands.

This hands-on role requires technical expertise to deliver data and analytical services, including data ingestion, transformation, storage, and reporting and strives to continuously develop new and improved data engineering capabilities.

The key accountabilities:

- Design data solutions to meet business, technical and user requirements. This includes building modern data pipelines that meet functional/non-functional business requirements and provide end-to-end data solutions

- Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialisation

- Contribute to ongoing management of the platform, including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues

- Identify, design, and implement process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability

- Technical ownership for data and data pipelines to ensure compliance with data standards, architectural standards, and achievement of business requirements

- Build a strong understanding of platform architecture and the best way to leverage it to achieve effective outcomes for a given project

- Support compliance with data, information and security management requirements

Technical qualifications & skills:

- Experience in building and maintaining real-time data pipelines.

- Expected experience using the following tech stack:

1. dbt

2. SQL

3. SQLSpark

4. Python

5. Dagster/Airflow

Preferred but not mandatory:

- Kubernetes and Terraform

- CI/CD - Github actions, CircleCI

- Datadog / Cloudwatch - Logging

- Prior work with stream-processing systems (e.g., Kafka, Kinesis).

- Exposure to Trino, Dagster, Cubejs, metabase/looker will be advantageo

(ref:hirist.tech)
  • Team Lead

    4 weeks ago


    Mumbai, Maharashtra, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :- We are seeking a highly skilled and motivated individual to join our team as a team lead - azure data engineer.- The ideal candidate will have a strong background in azure data technologies, a proven track record of leading data engineering teams, and the ability to design and implement scalable and efficient data solutions.- The team lead...


  • Thane/Mumbai/Navi Mumbai, Maharashtra, India Ventura Securities Ltd. Full time

    Job description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...

  • Lead Data Engineer

    1 week ago


    Mumbai, Maharashtra, India Freelancer Full time

    Job Description :We're hiring for one of our clients that is based out in Mumbai (Andheri East) and is a UK based world's leading venture builder company in digital product space in FinTech, EdTech, Govt.Tech, Media, Sports and more!It is driven by a mission to empower visionaries to lead, innovate, and build disruptive solutions to support their...

  • Data Engineering Lead

    4 weeks ago


    Mumbai, Maharashtra, India GAMIFi Consulting Services Ltd Full time

    Job Description : One of the leading Internet Market Places Platforms is on the search out for Data Engineering Lead who has experience in GCP, Bigquerry, Python, Pubsub, Bigdata, Spark, Hive skills for their Development Centre based at Mumbai. This is a Permanent & Onsite Job and to be operated from Office (5 days week).Inviting applications from Internet /...


  • Mumbai, Maharashtra, India Cornerstone OnDemand Full time

    We are seeking a Senior DataEngineer with expertise in Looker and Google Cloud Platform (GCP) to join ourinnovative team. With at least 10 years of overall experience in dataengineering, including a minimum of 5 years working with Looker and GCP, theideal candidate will lead the design, development, and maintenance of LookMLmodels and dashboards. This role...

  • Lead Data Engineer

    4 weeks ago


    Mumbai/Pune/Maharashtra/Navi Mumbai, Maharashtra, India xl advisors Full time

    About us:JSW One Platforms is a venture founded by the world-renowned JSW group. JSW One is our integrated technology platform that seeks to transform India through increased transparency, trust, and ease-of-business. The JSW One Platforms are home to JSW One MSME and JSW One Homes. JSW One MSME, is a one-stop, multi-product digital marketplace, for MSMEs...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Developing and implementing a comprehensive social media strategy aligned with the company's overall marketing objectives, which includes setting specific goals, identifying target audiences, and selecting appropriate social media platforms2. Initiating and participating in...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Developing and implementing a comprehensive social media strategy aligned with the company's overall marketing objectives, which includes setting specific goals, identifying target audiences, and selecting appropriate social media platforms2. Initiating and participating in...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Developing and implementing a comprehensive social media strategy aligned with the company's overall marketing objectives, which includes setting specific goals, identifying target audiences, and selecting appropriate social media platforms2. Initiating and participating in...

  • Data Engineer II

    1 week ago


    Bangalore/Mumbai, Maharashtra, India Xaltworks Consulting Full time

    Job Requirement : What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support- Collaborate with data scientists and analysts to understand their data needs and develop data solutions that meet those needs- Design, build, and maintain scalable data platforms and pipelines to support the needs of the business-...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Checking creatives and content made by content writers and designers for grammar and spelling2. Posting and scheduling the creatives on clients' pages3. Working on setting up the lead generation ads for a client4. Sending reports every week to the clients for social media...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Checking creatives and content made by content writers and designers for grammar and spelling2. Posting and scheduling the creatives on clients' pages3. Working on setting up the lead generation ads for a client4. Sending reports every week to the clients for social media...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Checking creatives and content made by content writers and designers for grammar and spelling2. Posting and scheduling the creatives on clients' pages3. Working on setting up the lead generation ads for a client4. Sending reports every week to the clients for social media...


  • Mumbai, Maharashtra, India Freelancer Full time

    Job Description :We're hiring for one of our clients that is based out in Mumbai (Andheri East) and is a UK based world's leading venture builder company in digital product space in FinTech, EdTech, Govt.Tech, Media, Sports and more!It is driven by a mission to empower visionaries to lead, innovate, and build disruptive solutions to support their...

  • Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Huquo Full time

    Position : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Making a company's digital marketing strategy, including planning, development, implementation, and management2. Working with internal marketing teams and digital agencies to achieve company goals, such as lead generation, brand engagement, conversions, and increasing digital sales...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Making a company's digital marketing strategy, including planning, development, implementation, and management2. Working with internal marketing teams and digital agencies to achieve company goals, such as lead generation, brand engagement, conversions, and increasing digital sales...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Making a company's digital marketing strategy, including planning, development, implementation, and management2. Working with internal marketing teams and digital agencies to achieve company goals, such as lead generation, brand engagement, conversions, and increasing digital sales...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Making a company's digital marketing strategy, including planning, development, implementation, and management2. Working with internal marketing teams and digital agencies to achieve company goals, such as lead generation, brand engagement, conversions, and increasing digital sales...


  • Mumbai, Maharashtra, India Lead Mines Media Full time

    About the internship:Selected intern's day-to-day responsibilities include:1. Checking creatives and content made by content writers and designers for grammar and spelling2. Posting and scheduling the creatives on clients' pages3. Working on setting up the lead generation ads for a client4. Sending reports every week to the clients for social media...