Data Engineering Lead
5 days ago
We are looking for an experienced professional with a strong background in data engineering and a proven track record of delivering high-quality solutions. The ideal candidate will have hands-on experience with frameworks such as PySpark, and be proficient in leveraging Python for complex data processing tasks.
The role requires an expert understanding of SAS SQL logic, along with the ability to convert it into Python code effectively. Key Responsibilities:
- Design and Develop ETL Pipelines: Lead the development of efficient and scalable ETL pipelines on AWS EMR using Python and PySpark.
- SAS to Python Translation: Convert and optimize complex SAS SQL logic into Python code, ensuring high performance and maintainability.
- Data Transformation: Work with large data sets to transform raw data into meaningful insights and ensure the integrity and accuracy of the transformed data.
Required Skills & Experience:
- Experience: 8 years of hands-on experience in Python development, particularly in data engineering and building ETL pipelines.
- Strong knowledge of AWS EMR, PySpark, and related cloud technologies.
- Experience working with large datasets and data warehouses.
- Proficiency in converting SAS SQL logic into Python code.
- In-depth knowledge of SQL, including complex data queries and optimization.
-
Data Engineering Lead
6 days ago
India ENABLE DATA TECHNOLOGIES PRIVATE LIMITED Full time**Job Description:**We're looking for a seasoned Senior Spark/Java Developer to join our team at Enable Data Technologies Private Limited.This role requires a deep understanding of software engineering principles, particularly in designing and developing large-scale data processing systems using Spark-based frameworks.As a member of our team, you'll work...
-
Data Engineering Lead
6 days ago
India HNM Solutions Full timeData Engineering LeadHNM Solutions is seeking a highly experienced Data Engineering Lead to lead our data engineering team. As a key member of our leadership team, you will be responsible for leading the design, development, and deployment of our data engineering pipelines.The successful candidate will have a strong background in data engineering, including...
-
Data Engineering Lead
1 day ago
India D2N Solutions Full timeData Engineering Lead Job SummaryWe are seeking a Data Engineering Lead to lead our team in designing and implementing data engineering solutions on Google Cloud Platform (GCP). As a Data Engineering Lead, you will be responsible for leading a team of engineers in developing and deploying data engineering solutions that meet the organization's technical and...
-
Data Engineering Lead
4 days ago
India Dhwani Rural Information Systems Full timeDhwani Rural Information Systems is on the lookout for an experienced Data Engineering Lead to spearhead our data engineering efforts. This role will involve designing and implementing scalable data architectures, leading a team of data engineers, and collaborating with cross-functional teams to drive business growth.About the Role:Design and implement...
-
Lead Data Engineer
1 week ago
India Founding Teams Full timeCompany DescriptionFoundingTeams.ai is an AI accelerator and talent platform. We enable AI and Tech founders to hire commercial and technical teams for their startups. We also hold a demo day in front of Angel and VC investors.We work with startups from top accelerators like Ycombinator and TechStars. We are currently hiring for avsolutions.org.uk . This is...
-
Lead Data Engineer
1 week ago
India Founding Teams Full timeCompany Overview Founding Teams.ai is an AI accelerator and talent platform. We enable AI and tech founders to hire commercial and technical teams for their startups, as well as host demo days in front of angel and VC investors. We work with startups from top accelerators like Y Combinator and TechStars, and are currently partnering with avsolutions.org.uk,...
-
Data Engineering Lead
6 days ago
India Quadrangle Full time**Job Overview at Quadrangle**We are seeking a highly skilled Data Engineering Manager to lead our data engineering team and drive the design, development, and implementation of our data models.Maintain and improve existing systemsDevelop new solutions to meet business needsCollaborate with stakeholders to identify data requirementsEnsure data quality and...
-
Data Engineering Lead
5 days ago
India TALENTOLA SOLUTIONS PRIVATE LIMITED Full timeJob OverviewTalentola Solutions Private Limited is seeking an experienced Data Engineering Lead to spearhead the design, development, and maintenance of robust ETL and ELT pipelines. The ideal candidate will have a strong background in cloud-based data platforms like Snowflake and a passion for building scalable data solutions.As a Data Engineering Lead, you...
-
Data Engineering Lead
6 days ago
India AMBIENCE HR LLP Full timeAbout the RoleWe are looking for an experienced Data Engineer to lead our data engineering efforts. As a Data Engineer Lead, you will be responsible for designing and implementing data architecture and infrastructure to support business needs.You will develop and maintain scalable data pipelines, ensuring high-quality data delivery and supporting advanced...
-
Data Engineering Lead
7 days ago
India MindBrain Full timeJob Title: Data Engineering LeadMindBrain is seeking a seasoned Data Engineering Lead to spearhead the development and maintenance of our data pipelines and ETL processes in cloud environments.Key Responsibilities:Design, develop, and optimize ETL/ELT pipelines using Informatica IICS and Snowflake.Implement data integration solutions ensuring high...
-
Data Engineering Lead
6 days ago
India SMARTWORK IT SERVICES Full timeAbout the RoleWe are seeking an experienced Data Engineering Lead to join our team at SMARTWORK IT SERVICES. This role will involve driving innovation, operational excellence, and strategic growth within Data Engineering & Analytics programs.Manage large and complex programs encompassing multiple Data, BI, and AI/ML solutions.Lead the design, development,...
-
Lead Data Engineer
5 days ago
India Decision Point Full timeJob Description : What would a typical day at your work be like? - You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals. - Build & support data ingestion and processing pipelines. - This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and...
-
Data Engineering Lead
6 days ago
India Orion Innovation Full timeOrion Innovation is a leading digital transformation and product development services firm. Our global team of 6,000 associates delivers transformative business solutions rooted in digital strategy, experience design, and engineering. We empower our clients to operate with agility on a scale.Job DescriptionLead the design, architecture, and implementation of...
-
Lead Data Engineer
3 days ago
India Falcon Full timeKey Responsibilities : Data Engineering & Architecture : - Design and implement scalable, high-performance data pipelines on AWS. - Optimize ETL/ELT processes using AWS Glue, Apache Spark, EMR, and Lambda. - Build and maintain data lakes and warehouses (Redshift, Snowflake). - Ensure data governance, security, and compliance best practices. Technical...
-
Lead Data Engineer
5 days ago
India TALENTOLA SOLUTIONS PRIVATE LIMITED Full timeTitle - Sr. Engineering Manager - Data Engineering Overview : We are looking for an experienced Engineering Manager with a strong background in Data Engineering - ETL / ELT processes, cloud-based data platforms like Snowflake, and have a passion for building scalable data solutions. As an Engineering Manager, you will guide the team, oversee data...
-
Lead Data Engineer
6 days ago
India Orion Innovation Full timeWork Location : Kochi, Chennai, Coimbatore Who are we : Orion is a leading digital transformation and product development services firm. Headquarters in Edison, NJ, we have a global team of 6,000 associates, with engineers in 12 major delivery centers across North America, Europe, Asia and Latin America. For over 25 years. In India, our delivery centers are...
-
Data Engineering Leader for BI Solutions
5 days ago
India NTT DATA Full timePosition Summary:We are looking for a talented Cloud Engineer to join our team at NTT DATA. The successful candidate will be responsible for designing and implementing data warehousing solutions using Redshift, Airflow, and Python. Responsibilities:Design and implement data warehousing solutions using Redshift and Airflow.Develop and maintain complex data...
-
Lead Data Engineer
6 days ago
India Kadel Labs Private Limited Full timeRole : Lead Data Engineer Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergistic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180 employees and expanding) and served 200 Customers. At the core, KL is a people's company. We serve...
-
Lead Data Engineer
6 days ago
India BlueByte Technologies Full timeJob Description : - Lead and mentor a team while remaining hands-on with development and problem-solving. - Work closely with stakeholders to understand business requirements and translate them into technical solutions. - Design, develop, and optimize complex SQL queries for data extraction, transformation, and analysis. - Utilize Python for automation,...
-
Data Engineer Lead
6 days ago
India Hunarstreet Technologies Full timeJob DescriptionHunarstreet Technologies is seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and building parts of our data pipeline architecture using the latest Big Data technologies.Key Responsibilities:- Design and build scalable data pipelines for extraction,...