Lead Data Engineer
11 hours ago
Position: Lead Data Engineer Location: Bengaluru Experience: 10+ years Job Summary: We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using PySpark and Spark. Perform data wrangling, transformation, and integration across diverse data sources. Optimize the performance and reliability of data processing workflows. Implement data quality frameworks to ensure data accuracy and integrity. Develop and maintain data architectures and data models to support business needs. Collaborate with cross-functional teams including data analysts, software engineers, and business stakeholders to understand data requirements. Stay updated with the latest advancements in Big Data tools, frameworks, and best practices. Mentor and guide junior data engineers in technical and professional growth. Required Skills and Qualifications: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering roles. Expertise in PySpark and Spark for large-scale data processing. Strong understanding of Big Data ecosystems and technologies (e.g., Hadoop, Hive). Hands-on experience with ETL development, data modeling, and data warehousing. Proficiency in programming languages such as Python, Scala, or Java. Experience with cloud platforms like AWS, Azure, or Google Cloud. Strong problem-solving skills and a detail-oriented mindset. Excellent communication and collaboration skills. Preferred Qualifications: Experience with containerization and orchestration tools like Docker and Kubernetes. Knowledge of SQL and relational database management systems. Familiarity with data orchestration tools like Airflow, Prefect, or similar.
-
Lead GCP Data Engineer
2 weeks ago
bangalore district, India Impetus Full timeJob Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location: Bengaluru Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...
-
Enterprise Data Architect
9 hours ago
bangalore district, India Aptus Data Labs Full timeEnterprise Data Architect – Job Description Location: Bangalore (Hybrid) Experience : 15+ years in Data Engineering & Data Platforms Employment Type: Full-time About Aptus Data Labs Aptus Data Labs is a global Data Engineering and AI solutions partner helping enterprises build modern, scalable, and intelligence-driven organizations. With deep expertise...
-
Lead Data Engineer
10 hours ago
bangalore district, India Eltropy Full timeRole Overview: We’re looking for a Lead data engineer and ML Analyst with 5+ years of experience in data engineering, analytics, and ML-based solutions. Job Responsibilities Design and manage scalable ETL/ELT pipelines using AWS Glue, Redshift, S3, and Kafka/Kinesis. Architect and implement data lake and warehouse solutions following best practices. Build...
-
Technical Lead-Data Engineer
16 hours ago
bangalore district, India Best Infosystems Ltd. Full timeTechnical Lead-Data Engineer_Full-Time_Bangalore/Pune/Navi Mumbai/Noida/Hyderabad/Chennai Job Title: Technical Lead-Data Engineer Location: Bangalore/Pune/Navi Mumbai/Noida/Hyderabad/Chennai Job Type: Full-Time Experience: 8+ years Qualifications: Bachelor’s/relevant exp - with Snowpro Certification Job Description: Must Have Skills: •Overall – 8+...
-
IT Global Team lead
1 week ago
bangalore district, India Continental Full time-Lead and manage the global IT team for data engineering that develops all technical artefacts as code, implemented in professional IDEs, with full version control and CI/CD automation. This team combines both lakehouse modeling of common and business use ase artefacts & semantics, as well as generalist data integration & metadata services. -Ensure...
-
Sr Operations Data Lead
7 days ago
hyderabad district, India Data Unveil Full timeJOB DESCRIPTION: Position Title: Sr Operations Data Lead Experience: 4 Years to 6 Years Location: Hyderabad, Telangana Hire Type: Full Time, On-site Start Date: Immediate Overview: The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations...
-
Lead Data Engineer
2 weeks ago
bangalore district, India ANSR Full timeANSR is hiring for one of its clients. About Dr. Martens: Dr. Martens is an iconic British brand founded in 1960 in Northamptonshire. Produced originally for workers looking for tough, durable boots, the brand was quickly adopted by diverse youth subcultures and associated musical movements. Dr. Martens has since transcended its working-class roots while...
-
Senior Data Engineer
1 week ago
gurgaon district, India Pacific Data Integrators Full timeRole: Senior Data Engineer Location: Remote Job Type: Full-time Shift time: Open to work in EST shift (5PM to 2AM IST) Key Responsibilities Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC). Develop, document, unit test, and maintain high-quality ETL applications...
-
IT engineer Data Lakehouse
11 hours ago
bangalore district, India KnowledgeTrek Consulting Full timeCompany Description: Continental develops pioneering technologies and services for sustainable and connected mobility of people and their goods. Founded in 1871, the technology company offers safe, efficient, intelligent, and affordable solutions for vehicles, machines, traffic and transportation. In 2023, Continental generated sales of €41.4 billion and...
-
Lead Data Engineer
6 days ago
Bangalore, India Cimpress Full timeOur Team: Enterprise Business Solutions Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain, and HR functions. The cross-functional team includes product owners, analysts, technologists, data engineers and more – all focused on providing Vista with...