Technical Lead
7 days ago
1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks
2 Ensure data pipelines run smoothly and efficiently
3 Developing scalable and re-usable frameworks for ingesting of data sets
4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
5 Working with event based / streaming technologies to ingest and process data
6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
7 Evaluating the performance and applicability of multiple tools against customer requirements
8 Technically competent in Cloud and Databricks to provide technical advice to the team and to be involved in issue resolution
9 Provide on-call support and afterhours/weekend support as needed
10 Fulfill Service Requests related to Data Analytics platform
11 Lead and drive optimization and continuous improvement initiatives
12 Play gate-keeping role and conduct technical review of the changes as part of release management
13 Understand various data security standards and adhere to the required data security controls in the platform
14 Lead the design, development, and deployment of advanced data pipelines and analytical workflows on the Databricks Lakehouse platform.
15 Collaborate with data scientists, engineers, and business stakeholders to build and scale end-to-end data solutions.
16 Own architectural decisions and ensure adherence to data governance, security, and compliance requirements.
17 Mentor a team of data engineers, providing technical guidance and career development.
Implement CI/CD practices for data engineering pipelines using tools like Azure DevOps, GitHub Actions, or Jenkins.
Roles and Responsibilities
Essential for this role:
Education and Qualifications:
• Bachelor's degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent.
• Minimum seven plus years of experience in data analytics field
• Experience with Azure/AWS Databricks
• Experience in building and optimizing data pipelines, architectures and data sets
• Excellent experience in Scala or Python, PySpark and SQL
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques
• Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
• Hands on experience in performance tuning and optimizing code running in Databricks environment
• Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
Technical / Professional Skills :
• Excellent communication skills / should interact directly with the customer
• Azure/AWS Databricks
• Python / Scala / Spark / PySpark
• HIVE / HBase / Impala / Parquet
• Sqoop, Kafka, Flume
• Very Strong SQL and RDBMS
• Airflow
• Jenkins / Bamboo
• Github / Bitbucket
• Nexus
• Knowledge on Delta Live Tables (DLT) will be an added advantage
Good to have:
• Relevant accredited certifications for Azure, AWS, Cloud Engineering, and/or Databricks
• Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure
-
Technical Lead
7 days ago
Pune, Maharashtra, India Ishan Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearRole Overview : - We are urgently seeking a highly technical and experienced Tech Lead to be the lead player-coach for our AI & Data Services practice. - This role is for a deeply technical expert who loves to solve complex problems, write code, and lead by example. - You will be responsible for architecting and building sophisticated AI/ML...
-
Technical Lead
2 days ago
Pune, Maharashtra, India Birlasoft Limited Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per yearTechnical Lead We Birlasoft is hiring Technical Lead. Experience: 4+ years Required Skills:Deep understanding of PHC and CDM data models, especially for Product and Customer domains. Experience with Oracle EFF, item class configuration, and customer hierarchy mapping. Configure workflows, publish mechanisms, and cross-reference tables in...
-
Technical Lead
2 days ago
Pune, Maharashtra, India HCL Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...
-
Technical Lead
2 days ago
Pune, Maharashtra, India HCL Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout HCLTechHCLTech is a global technology company, spread across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing,...
-
Technical Lead
2 weeks ago
Pune, Maharashtra, India Parentpay Full time ₹ 8,00,000 - ₹ 25,00,000 per yearWe are seeking a highly skilled Technical Lead with expertise in .NET Core, Angular, and cloud-based architectures to lead our development team. The ideal candidate will have strong technical leadership, hands-on coding abilities, and proven experience in delivering scalable enterprise applications. Key ResponsibilitiesLead a team of developers in...
-
Technical Lead
7 days ago
Pune, Maharashtra, India EduFund Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescriptionWe are seeking a Technical Lead to drive the technical vision and hands-on delivery of EduFund's core product platform.ResponsibilitiesDefining and implementing architectural guardrails for scalability, reliability, and security.Leading the engineering team to deliver features and platform improvements at speed.Mentoring and upskilling engineers,...
-
Technical Lead
2 weeks ago
Pune, Maharashtra, India Quick Heal Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAbout Quick HealQuick Heal Technologies Ltd.is India's most trusted name in cybersecurity innovation. With a legacy of over 30 years, we've grown from a garage-born antivirus start-up to a globally respected, publicly listed cybersecurity product company with a market capitalization of INR 2,500 Cr and revenues approaching INR 400 Cr.Quick Heal has...
-
Technical Lead
2 days ago
Pune, Maharashtra, India Paexskin solutions Full time ₹ 12,00,000 - ₹ 25,00,000 per yearCompany Profile: We are a leading e-learning company dedicated to creating engaging and effective online learning experiences. With a focus on innovative instructional design and cutting-edge technology, we empower learners and organizations to achieve their educational goals.Position: Technical LeadCurrent Opening: 1Experience Level: 8+ yearsJob Location:...
-
Technical Lead
7 days ago
Pune, Maharashtra, India ITC Infotech Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: AWS Cloud Tech LeadExperience: yearsJob Description:React (FE)/ Typescript (BE) PostGreSQL are a must Fargate is a plusEveryone should be rest API thinking by default.Tech stack: AWS Cloudfront, S3 buckets, , typescript, , , , Aurora Postgres SQL, uses Rest APIs,uses Databricks as Data Lake, Auth0 for access/login Does this help? its microservice...
-
Technical Lead
2 weeks ago
Pune, Maharashtra, India HCL Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearTechnical Lead Experience 7-9 Years Skill (Primary) Domain Competencies (APPS)-Insurance - Package Solution-Guidewire - Billingcenter Qualification Bachelor of Technology/ Engineering Location Pune Job Family Development Job Description (Posting). Candidate should have the best experience with Guidewire BillingCenter config and...