Data Engineer Lead

3 days ago

Chennai, Tamil Nadu, India Alp Consulting Ltd. Full time

Job Title: Senior Data Engineer

About Alp Consulting Ltd.

We are a leading consulting firm specializing in data engineering and machine learning solutions. Our team is passionate about leveraging cutting-edge technologies to drive business growth and innovation.

Job Description:

We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a critical role in designing, developing, and maintaining scalable data pipelines using Python and Py-Spark. You will work closely with cross-functional teams to ensure seamless integration of data solutions and support the implementation of Microsoft Fabric.

Your Key Responsibilities:

  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Python and Py-Spark to extract, transform, and load data from various sources.
  • SQL Query Optimization: Implement and optimize SQL queries for efficient data extraction and transformation.
  • Azure Data Factory Integration: Utilize Azure Data Factory for orchestrating data workflows and ensuring smooth deployment and operation of data solutions.
  • Collaboration and Communication: Collaborate with DevOps teams to ensure successful project execution and communicate effectively with stakeholders to resolve issues and address concerns.

Required Skills and Qualifications:

To succeed in this role, you must have:

  • Proficiency in Python and Py-Spark;
  • Strong knowledge of SQL and experience with data extraction and transformation;
  • Familiarity with Azure Data Factory and GIT for version control;
  • Understanding of DevOps practices and tools;
  • Experience with machine learning frameworks and libraries;
  • Excellent problem-solving skills and attention to detail;
  • Strong communication and collaboration skills;

Education and Experience:

We require a Bachelor's or Master's Degree in Computer Science, Information Systems, or demonstrated equivalent education and relevant work experience. Additionally, you should have at least 10-13 years of total work experience, with a minimum of 9 years of IT-specific experience as a Business Intelligence Developer and 5 years of knowledge and experience working on enterprise applications.

Language and Work Environment:

You must be able to effectively communicate in English, both verbally and in writing, and be proficient in MS Office applications, such as Word, Excel, PowerPoint, etc. The work environment is primarily office-based, with moderate noise levels and occasional travel required.

Compensation and Benefits:

The estimated salary for this position is $120,000-$150,000 per year, depending on location and experience. We offer a comprehensive benefits package, including health insurance, retirement plans, and paid time off.

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...

  • Data Engineering Director

    3 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    OverviewWelcome to Wavicle Data Solutions, a leading provider of innovative data management solutions. We are seeking an experienced Data Engineering Director to join our team and lead the development of our data engineering initiatives.

  • Data Scientist Lead

    3 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE.Our flagship platform, maya.ai, helps enterprises across the Banking, Fin-tech, and Travel industries create and capture sustainable revenue streams by unlocking the value of data.

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Huntsmen and barons Full time

    Data Engineering Lead We are seeking a highly skilled Data Engineering Lead to join our team at Huntsmen and barons. The ideal candidate will be responsible for leveraging expertise in Apache Spark, Scala, and Hadoop ecosystem for efficient data management and storage. This is a great opportunity for an experienced data engineer looking to take on a...

  • Data Engineering Lead

    16 hours ago

    Chennai, Tamil Nadu, India Bahwan CyberTek Full time

    Join Bahwan CyberTek, a leading IT solutions provider, as we seek an experienced Data Engineering Lead to drive the development and implementation of our data architecture. The successful candidate will have at least 7-10 years of experience in designing and implementing robust, scalable data architectures, with hands-on expertise in data modeling and...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India VIDPRO CONSULTANCY SERVICES Full time

    About Vidpro Consultancy Services: We are a leading consultancy services firm that provides expertise in AI/ML, data engineering, and cloud native architecture. We are seeking an experienced Data Engineering Lead to join our team.Job Description:Lead efforts to architect and develop complex data pipelines using cutting-edge technologies like in-memory data...

  • Data Engineering Lead

    3 days ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    About the Role:We are seeking an experienced Data Engineering Lead to join our team at Tiger Analytics. As a key member of our organization, you will be responsible for overseeing the development and implementation of data engineering solutions that drive business growth and innovation.Key Responsibilities:Design and implement data pipelines and...

  • Data Engineering Lead

    4 weeks ago

    Chennai, Tamil Nadu, India LTIMindtree Full time

    About the RoleWe are seeking an experienced Data Engineer to lead our big data platform team at LTIMindtree. The successful candidate will have a strong background in designing and developing scalable data engineering solutions.Key Responsibilities:Design, develop, and deploy big data platforms using Spark and Scala.Collaborate with cross-functional teams to...

  • Cloud Data Engineering Lead

    2 days ago

    Chennai, Tamil Nadu, India Onward Technologies Limited Full time

    Job Title: Cloud Data Engineering LeadWe are seeking a highly skilled and experienced Cloud Data Engineering Lead to join our dynamic team at Onward Technologies Limited.About the RoleThis is a pivotal position that requires designing, developing, and implementing robust cloud-based data solutions. As a Cloud Data Engineering Lead, you will play a key role...

  • Data Engineering Team Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Collabera Full time

    Data Engineering Team LeadThis is a full-time on-site role for a Data Engineering Team Lead at Collabera Digital in Pune or Chennai/Mumbai.The successful candidate will be responsible for leading engineering teams, team leadership, software development, project management, and integration on a day-to-day basis.Position Details:Experience: 10+ YearsSalary:...

  • Cloud Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Growth Gamut Pvt Ltd Full time

    Job Title: Cloud Data Engineering LeadEstimated Salary: $150,000 - $200,000 per yearAbout the Role:We are seeking a highly experienced Cloud Data Engineering Lead to join our team at Growth Gamut Pvt Ltd. As a key member of our DevOps/Cloud team, you will be responsible for designing, developing, and deploying cloud solutions using AWS Glue and Amazon...

  • Senior Data Engineering Lead

    1 day ago

    Chennai, Tamil Nadu, India Recro Full time

    At Recro, we are seeking an experienced Senior Data Engineering Lead to spearhead our data engineering initiatives. With a strong background in Big Data and cloud solutions, you will be responsible for designing and implementing scalable data engineering solutions that drive business growth.Estimated Salary: $150,000 - $200,000 per annum, depending on...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Resourcetree Full time

    **Program Delivery Role**We are looking for a seasoned Program Lead/Technology Consultant to lead our program delivery efforts at Resourcetree. As a key member of our team, you will be responsible for ensuring successful program outcomes.Salary Range: $180,000 - $300,000 per year**Job Description:**In this role, you will drive problem discovery, scoping,...

  • Senior Machine Learning Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...

  • Senior Data Engineering Lead

    1 month ago

    Chennai, Tamil Nadu, India QBrainX Full time

    Job Title - Senior Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at QBrainX. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining our data pipelines.Estimated Salary: $120,000 - $180,000 per yearResponsibilities:Design, develop, and maintain scalable...

  • Data Engineering Lead for Cloud and Big Data

    4 weeks ago

    Chennai, Tamil Nadu, India Agilisium Full time

    About the RoleAt Agilisium, we are seeking an experienced Data Engineer to lead our cloud and big data initiatives. This is a unique opportunity to shape our data engineering team and contribute to the growth of our organization.

  • Data Engineering Technical Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Golden Hues Consultant Full time

    Job Title: Senior Technical Lead - Data EngineeringOverview:A seasoned technical leader is sought to drive the technical vision of our data engineering teams. Collaborating closely with product managers, architects, and delivery managers, this individual will ensure alignment with product objectives and business needs.

  • Senior Data Engineering Lead

    1 month ago

    Chennai, Tamil Nadu, India Orion Innovation Full time

    Job DescriptionOrion Innovation is seeking an experienced Data Architect to lead our data engineering team. As a key member of our organization, you will be responsible for designing and implementing scalable data architectures using Databricks, Unity Catalog, Azure Data Lakehouse, Medallion Architecture, and Azure Data Factory.About the RoleLead and mentor...

  • Data Engineering Team Lead

    2 weeks ago

    Chennai, Tamil Nadu, India Fedrus global Full time

    About UsFedrus Global is a technology-driven organization that offers exciting opportunities for career growth and development.Job SummaryWe are seeking a talented Senior Data Engineer to join our team. This role involves leading data engineering efforts, designing and implementing data pipelines, and collaborating with cross-functional teams to deliver...

  • Data Architect and Engineer Lead

    3 weeks ago

    Chennai, Tamil Nadu, India Resourcetree Full time

    Company OverviewResourcetree is a cutting-edge technology company that provides innovative solutions to its clients. We are dedicated to delivering high-quality products and services, and we are looking for talented individuals to join our team.Job SummaryWe are seeking an experienced Data Architect and Engineer Lead to lead our data engineering team. The...