Technical Lead

1 week ago

Pune, Maharashtra, India NCSI Technologies Full time ₹ 1,20,000 - ₹ 3,00,000 per year

1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks

2 Ensure data pipelines run smoothly and efficiently

3 Developing scalable and re-usable frameworks for ingesting of data sets

4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times

5 Working with event based / streaming technologies to ingest and process data

6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search)

7 Evaluating the performance and applicability of multiple tools against customer requirements

8 Technically competent in Cloud and Databricks to provide technical advice to the team and to be involved in issue resolution

9 Provide on-call support and afterhours/weekend support as needed

10 Fulfill Service Requests related to Data Analytics platform

11 Lead and drive optimization and continuous improvement initiatives

12 Play gate-keeping role and conduct technical review of the changes as part of release management

13 Understand various data security standards and adhere to the required data security controls in the platform

14 Lead the design, development, and deployment of advanced data pipelines and analytical workflows on the Databricks Lakehouse platform.

15 Collaborate with data scientists, engineers, and business stakeholders to build and scale end-to-end data solutions.

16 Own architectural decisions and ensure adherence to data governance, security, and compliance requirements.

17 Mentor a team of data engineers, providing technical guidance and career development.

Implement CI/CD practices for data engineering pipelines using tools like Azure DevOps, GitHub Actions, or Jenkins.

Roles and Responsibilities

Essential for this role:

Education and Qualifications:

• Bachelor's degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent.

• Minimum seven plus years of experience in data analytics field

• Experience with Azure/AWS Databricks

• Experience in building and optimizing data pipelines, architectures and data sets

• Excellent experience in Scala or Python, PySpark and SQL

• Ability to troubleshoot and optimize complex queries on the Spark platform

• Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques

• Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS

• Hands on experience in performance tuning and optimizing code running in Databricks environment

• Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment

Technical / Professional Skills :


• Excellent communication skills / should interact directly with the customer

• Azure/AWS Databricks

• Python / Scala / Spark / PySpark

• HIVE / HBase / Impala / Parquet

• Sqoop, Kafka, Flume

• Very Strong SQL and RDBMS

• Airflow

• Jenkins / Bamboo

• Github / Bitbucket

• Nexus

• Knowledge on Delta Live Tables (DLT) will be an added advantage

Good to have:

• Relevant accredited certifications for Azure, AWS, Cloud Engineering, and/or Databricks

• Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure

  • Technical Lead

    2 weeks ago

    Pune, Maharashtra, India Growth Centric Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Technical Lead / Technical Architect in .NET, SQL Server (on-premise), & AWSHiring for our client: Innovation Center of an insurtech organizationLocation: Pune, IndiaOur client is seeking a highly skilled Technical Lead / Technical Architect to drive the architecture, development, seamless integrations with multiple insurance carriers. This role requires...

  • Technical Lead

    2 days ago

    Pune, Maharashtra, India HCL Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...

  • Technical Lead

    2 days ago

    Pune, Maharashtra, India HCL Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...

  • Technical Lead

    5 days ago

    Pune, Maharashtra, India Inspirit Vision Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    DescriptionCompany Description :Inspirit Vision specializes in delivering enterprise-grade Identity and Access Management (IAM) solutions across leading platforms including Ping Identity, Forgerock, Sailpoint, Okta, Saviynt, and others.We focus on innovative IAM implementations, including self-sovereign identity, Zero Trust architectures, and advanced...

  • Technical Lead

    1 week ago

    Pune, Maharashtra, India Parentpay Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled Technical Lead with expertise in .NET Core, Angular, and cloud-based architectures to lead our development team. The ideal candidate will have strong technical leadership, hands-on coding abilities, and proven experience in delivering scalable enterprise applications. Key ResponsibilitiesLead a team of developers in...

  • Technical Lead

    2 days ago

    Pune, Maharashtra, India HCL Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...

  • Technical Lead

    7 days ago

    Pune, Maharashtra, India EduFund Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionWe are seeking a Technical Lead to drive the technical vision and hands-on delivery of EduFund's core product platform.ResponsibilitiesDefining and implementing architectural guardrails for scalability, reliability, and security.Leading the engineering team to deliver features and platform improvements at speed.Mentoring and upskilling engineers,...

  • Technical Lead

    2 days ago

    Pune, Maharashtra, India Paexskin solutions Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Company Profile: We are a leading e-learning company dedicated to creating engaging and effective online learning experiences. With a focus on innovative instructional design and cutting-edge technology, we empower learners and organizations to achieve their educational goals.Position: Technical LeadCurrent Opening: 1Experience Level: 8+ yearsJob Location:...

  • TECHNICAL LEAD

    1 week ago

    Pune, Maharashtra, India Xperteez Technology Full time ₹ 35,000 - ₹ 70,000 per year

    Budget: 35 LPA | Pune (Hybrid) We are looking for a hands-on Technical Lead who can design, build and lead large-scale applications using the modern Microsoft + JavaScript stack, microservices, cloud, and DevOps.If you've been waiting for that perfect role where you can lead architecture, mentor teams, and still stay deeply technical — this is the one....

  • Technical Lead

    2 weeks ago

    Pune, Maharashtra, India HCL Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...