Data Engineering Lead
3 weeks ago
About the Role
We are seeking a highly skilled and experienced Data Engineering Lead to join our team at EXL Analytics.
Job Description
- Collaborate with cross-functional teams to design and maintain a stable reporting infrastructure, leveraging ETL, data modeling, metric design, and reporting expertise.
- Embark on research projects to enhance data processing and optimize machine learning frameworks used by the team.
- Promote Data Engineering best practices within the team, ensuring adherence to industry standards.
- Develop new skills and knowledge, fostering a dynamic environment that encourages collaboration and innovation.
- Mentor team members to share knowledge, best practices, and elicit documentation of system requirements.
- Understand business and technical requirements to design effective software solutions.
- Create conceptual architectures and detailed designs for software solutions.
- Apply various data warehousing concepts to build data warehouses for reporting purposes.
- Construct data pipelines to ingest and transform data into our Data platform.
- Implement large-scale distributed systems and pipelines that process high volumes of data.
- Assist Data Science / Modeling teams in setting up data pipelines & monitoring daily jobs.
- Develop and test ETL components to high standards of data quality, acting as a hands-on development lead.
- Oversee the creation and maintenance of relevant data artifacts (data lineages, source to target mappings, high-level designs, interface agreements, etc.).
About You
- You have 9+ years of experience in a data engineering role in an analytics environment.
- You are comfortable coding in Python and advanced SQL.
- You have 5+ years of experience in big data engineering.
- You hold a Bachelor's degree in a technical field (Computer Science degree preferred but not mandatory); a Master's degree is a plus.
- You possess working knowledge of Relational Database Management Systems (RDBMS) like Oracle, Teradata, SQL server, etc. (Knowledge of BigQuery would be a plus).
- You are an expert in building data pipelines in big data platforms; you have a good understanding of Data warehousing concepts.
- You have knowledge of Shell scripting, SQL, Python, and some standard data science packages (Pandas, Numpy, etc.).
- You have working knowledge of cloud platforms (GCP exposure would be a plus).
- You possess strong verbal and business communication skills.
- You have strong business acumen and demonstrated aptitude for analytics that incite action.
What We Offer
- A fast-paced and innovative environment that brings together sharp and entrepreneurial professionals eager to influence business decisions.
- The opportunity to work closely with highly experienced, world-class analytics consultants from day one.
- Training in all aspects of analytics, including leading analytical tools and techniques.
- A mentoring program that assigns a senior professional advisor to each junior employee.
- The potential for growth and development within the company and beyond.
Estimated Salary: $120,000 - $180,000 per year
-
Cloud Data Engineering Lead
4 weeks ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
Lead Masters AI | Java Software Engineer | india
2 months ago
india Lead Masters AI Full timeCompany Description LeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...
-
Data engineer
2 weeks ago
India Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...
-
Data Engineer
2 weeks ago
India Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...
-
Data Engineer
2 weeks ago
India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...
-
Data Engineer
2 weeks ago
India Pacific Data Integrators Full timeJob Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...
-
Pyspark data engineer
2 weeks ago
India ITI Data Full timeLocation : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are...
-
ITI Data | PySpark Data Engineer
3 weeks ago
india ITI Data Full timeLocation : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...
-
ITI Data | PySpark Data Engineer
3 weeks ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
Java software engineer
2 months ago
India Lead Masters AI Full timeCompany Description Lead Masters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. Lead...
-
Data Engineering Lead
1 month ago
India Welspun Transformation Services Limited Full timeAs a Data Engineering Lead, you will be responsible for managing and leading the data engineering team in our IT department. You will play a crucial role in designing, building, and maintaining our data infrastructure, data processing systems, and data pipelines. You will also be responsible for implementing data visualization tools and techniques to help...
-
Data Engineering Lead
4 weeks ago
India Lamipak Full timeLamipak is a leading innovator in the field of Al applications and dashboards, seeking an experienced Data Engineering Lead to spearhead the development and maintenance of scalable data pipelines.As a key member of our team, you will collaborate closely with data scientists and engineers to ensure seamless data integration across platforms, implement ETL...
-
PySpark Data Engineer
3 weeks ago
India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
PySpark Data Engineer
3 weeks ago
India ITI Data Full timeLocation : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...
-
Data Engineering Lead
2 weeks ago
India Markovate Full timeJob Title: Data Engineering LeadWe are seeking an experienced Data Engineering Lead to join our team at Markovate. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines for data ingestion, processing, and storage.This role demands a proactive individual skilled in designing,...
-
Data Engineering Lead
4 days ago
India EXL Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at EXL Analytics. As a key member of our organization, you will be responsible for designing and implementing large-scale data processing systems.Key Responsibilities:Develop and maintain data pipelines using Big Data platforms such as Hadoop and Spark.Create conceptual...
-
Data Platform Engineer
4 weeks ago
India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data Platform Engineer
3 weeks ago
India OSD Data Services Full timeData Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Ness Digital Engineering | Data Engineer
3 weeks ago
india Ness Digital Engineering Full timeWhy Ness We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most...
-
Ness Digital Engineering | Data Engineer
3 weeks ago
india Ness Digital Engineering Full timeWhy NessWe know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most...