Lead Data Engineer

4 weeks ago


India Wavicle Data Solutions Full time

Job Description:

  • We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.
  • As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.
  • Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.

Key Responsibilities:

  • Lead and manage data engineering projects, overseeing the design and development of data pipelines.
  • Architect scalable and efficient data solutions using Python and PySpark.
  • Utilize cloud platforms such as AWS to build and maintain data infrastructure.
  • Work with Databricks or Snowflake for advanced data processing and warehousing.
  • Perform data modeling and design complex data structures.
  • Write and optimize SQL queries and scripts for data transformation.
  • Collaborate with cross-functional teams to define data strategies and deliver solutions.
  • Proficiency in AWS Glue for ETL processes.
  • Previous experience with ETL tools like Talend or Informatica is preferred.
  • Troubleshoot and optimize data pipelines for maximum performance and scalability.
  • Ensure data quality, accuracy, and reliability throughout the data lifecycle.
  • Stay updated on industry trends and emerging technologies in data engineering.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Expertise in Python, PySpark, AWS, Databricks, and SQL.
  • Strong data modeling skills and deep understanding of data warehousing.
  • Proficiency in AWS Glue for ETL processes is preferred.
  • Previous experience with ETL tools like Talend or Informatica is a plus.
  • Proven leadership and project management skills.
  • Excellent problem-solving, analytical, and communication skills.



  • india Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • India Data Warehouse Engineer Full time

    Experience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.


  • India Data Warehouse Engineer Full time

    About the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.

  • Lead data engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Lead Data Engineer

    4 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...


  • India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...


  • India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • india Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • india Lead Masters AI Full time

    Company Description LeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...

  • Data Engineer

    11 hours ago


    India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • Data Engineer

    16 hours ago


    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Data Engineer

    52 minutes ago


    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...


  • India Lead Masters AI Full time

    Company Description Lead Masters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. Lead...


  • india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...


  • india ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...