Senior Lead Data Engineer
15 hours ago
Senior Lead Software Engineer
We are seeking a highly skilled Senior Lead Data Engineer to join our R&D Data Engineering Team. In this role, you will be a key player in shaping the architecture and technical direction of our data platform, ensuring that it meets the evolving needs of the business while adhering to best practices and industry standards. If you're looking for an opportunity to combine your technical skills with strategic thinking and make a real difference, we want to hear from you.
About You – experience, education, skills, and accomplishments:
- Bachelor's Degree or equivalent
- At least 7 years of Relevant Experience
- At least 5 Years in Software Development: Demonstrated experience in software development, with a focus on Big Data technologies.
- At least 3 Years in Distributed Data Processing: Proven experience in building scalable distributed data processing solutions.
- At least 3 Years in Database Design: Expertise in database design and development, with a strong focus on data model design.
- Strong Proficiency with Apache Spark and Airflow: Extensive hands-on experience with these technologies, leveraging them for data processing and orchestration.
- Python Proficiency: Advanced proficiency in Python for data processing and building services.
- Experience with Databricks and Snowflake: Practical experience with these platforms, including their use in cloud-based data pipelines.
- Familiarity with Delta Lake or Apache Iceberg: Experience working with these data storage to decouple storage from processing engines.
- Cloud-Based Solutions Expertise: Proven experience in designing and implementing cloud-based data pipelines, with specific expertise in AWS services such as S3, RDS, EMR, and AWS Glue.
- CI/CD Best Practices: Strong understanding and application of CI/CD principles
It would be great if you also had:
- Knowledge of Additional Technologies: Familiarity with Cassandra, Hadoop, Apache Hive, Jupyter notebooks, BI tools: Tableau and Power BI.
- Experience with PL/SQL and Oracle GoldenGate: Additional experience in these areas is advantageous
- Knowledge on any of these technologies/tools: Cassandra, Hadoop, Apache Hive, Snowflake, Jupiter notebook, Databricks stack,
- AWS services, EC2, ECS, RDS, EMR, S3, AWS Glue, Airflow
What will you be doing in this role?
- Provide Technical Leadership: Offer strategic guidance on technology choices, comparing different solutions to meet business requirements while considering cost control and performance optimization.
- Communicate Effectively: Exhibit excellent communication skills, with the ability to clearly articulate complex technical concepts to both technical and non-technical stakeholders.
- Design and Maintain Data Solutions: Develop and maintain the overall solution architecture for the Data Platform, demonstrating deep expertise in integration architecture and design across multiple platforms at an enterprise scale.
- Enforce Best Practices: Implement and enforce best practices in Big Data management, from software selection to architecture design and implementation processes.
- Drive Continuous Improvement: Contribute to the continuous enhancement of support and delivery functions by staying informed about technology trends and making recommendations for improving application services.
- Lead Technical Investigations: Conduct technical investigations and proofs of concept, both individually and as part of a team, including hands-on coding to provide technical recommendations.
- Knowledge Sharing: Actively spread knowledge and best practices within the team, fostering a culture of continuous learning and improvement
About the Team
We are team located in India, US, and Europe.
Hours of Work
Regular working timing in India.
At Clarivate, we are committed to providing equal employment opportunities for all qualified persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
Experience LevelSenior Level-
Lead Data Scientist
4 days ago
R-Bangalore, India Clarivate Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLead Software Engineer We are seeking a highly skilled Lead Data Scientist to drive advanced analytics, machine learning, and AI initiatives across the organization. The Lead Data Scientist will work closely with tech & data professionals, business leaders, and translate complex data into actionable insights that directly impact strategic decision-making....
-
Senior Software Engineer- Data Engineer
4 days ago
R-Bangalore, India Clarivate Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Software Engineer- Data Engineer We are looking for a Senior Software Engineer- Data Engineer to join our team in India. This is an amazing opportunity to work on different project with our Data engineering team having different competencies to compete and learn together. We have a great skill set in the team related to Pypark, AWS, Apahe,...
-
Lead Data Engineer
1 week ago
bangalore, India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Lead Data Engineer
1 week ago
India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Lead Data Engineer
1 week ago
India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Lead Data Engineer
7 days ago
India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Lead Data Engineer
7 days ago
India Eucloid Data Solutions Full timeEucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Lead data engineer
1 week ago
India Talent Corner HR Services Pvt Ltd Full timeJob Description: Senior Data Engineer Lead Location: Remote (India) Experience Level: 8–12 years Employment Type: Full-time About the Role We are looking for a highly skilled Senior Data Engineer Lead who can take ownership of end-to-end data initiatives — from ingestion and transformation to advanced analytics and AI-driven solutions. This...
-
Sr. Data Science
1 day ago
Bangalore, India NTT DATA Full timeJob Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...
-
Lead Data Engineer
1 week ago
bangalore, India Talent Corner HR Services Pvt Ltd Full timeJob Description: Senior Data Engineer LeadLocation: Remote (India)Experience Level: 8–12 yearsEmployment Type: Full-timeAbout the RoleWe are looking for a highly skilled Senior Data Engineer Lead who can take ownership of end-to-end data initiatives— from ingestion and transformation to advanced analytics and AI-driven solutions.This role requires...