Cloud Data Engineering Lead

4 days ago


India ITI Data Full time

ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.

This is an exceptional opportunity to join our team as a Cloud Data Engineering Lead where you will work closely with cross-functional teams to drive innovation and excellence in data engineering. As a key member of our data engineering team, you will have the chance to design, build, and deploy large-scale data pipelines using AWS Glue ETL jobs, Lambda functions, and other cloud-native services.

Key Responsibilities:

  • Design, build, and unit test applications on Spark framework on Python, ensuring high-performance and scalability.
  • Develop Python and PySpark-based applications to integrate data from relational databases (e.g., Oracle), NoSQL databases (e.g., DynamoDB, MongoDB), and filesystems (e.g., S3, HDFS).
  • Build AWS Lambda functions on Python runtime, leveraging libraries such as pandas, json, boto3, requests, and avro.
  • Create PySpark-based data pipeline jobs on AWS Glue ETL, requiring in-depth knowledge of AWS Glue Dynamic Frames and Options.
  • Develop event-driven integration with Kafka Topics, utilizing Confluent Kafka libraries.
  • Design and build generic, reusable utility applications in Python, optimizing performance for data access requirements.
  • Configure S3 buckets, tiers, lifecycle policies, and strategic storage layers for

  • Lead data engineer

    2 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Lead Data Engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...


  • India HTC Global Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineering Lead to join our team at HTC Global Services. As a key member of our organization, you will be responsible for leading and guiding our data engineering team technically and sharing best practices with the team.


  • India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • india Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • India Manuh Technologies Full time

    Job DescriptionWe are seeking a highly skilled Data Engineering Lead with expertise in cloud technologies to join our team at Manuh Technologies. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines, databases, and data infrastructure to enable efficient data collection,...


  • India Intuitive Full time

    About Intuitive.CloudWe are a rapidly growing cloud solutions company, recognized for delivering measurable value and key business outcomes to our global enterprise customers.Our areas of expertise include:DataOps & AI/MLCloud Native, AppSecOps, DevSecOpsCloud Migration & TransformationCloud FinOpsCybersecurity (App/Data/Infra) & GRCSDx & Digital WorkspaceWe...

  • Data Engineering Lead

    2 weeks ago


    India Hyperion AI Full time

    Data Engineering Lead - Cloud Native ArchitectureWe are seeking a seasoned Data Engineering Lead with expertise in cloud-native architecture to lead the design and implementation of scalable data processing pipelines using Java and Spark. The ideal candidate will work closely with cross-functional teams to build data-intensive applications and drive best...


  • india Syren Cloud Inc Full time

    Interpret data, analyze results using statistical techniques and provide ongoing reports · Develop and implement databases, data collection systems, data analytics, and other strategies that optimize efficiency and quality · Acquire data from primary or secondary data sources and maintain databases/data systems · Work with business stakeholders,...

  • Lead data engineer

    4 weeks ago


    India Intuitive.Cloud Full time

    About us: Intuitive. Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - Data Ops & AI/ML - Cloud Native, App Sec Ops, Dev Sec Ops - Cloud...

  • Data Engineering Lead

    14 hours ago


    India Lamipak Full time

    Lamipak is a leading innovator in the field of Al applications and dashboards, seeking an experienced Data Engineering Lead to spearhead the development and maintenance of scalable data pipelines.As a key member of our team, you will collaborate closely with data scientists and engineers to ensure seamless data integration across platforms, implement ETL...

  • Lead Data Engineer

    1 month ago


    India Intuitive.Cloud Full time

    About us: Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - DataOps & AI/ML - Cloud Native, AppSecOps, DevSecOps - Cloud...

  • Lead Data Engineer

    4 weeks ago


    india Intuitive.Cloud Full time

    About us: Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - DataOps & AI/ML - Cloud Native, AppSecOps, DevSecOps - Cloud Migration &...

  • Lead Data Engineer

    1 month ago


    India Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Lead Data Engineer

    1 month ago


    india Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Lead Data Engineer

    4 weeks ago


    india Intuitive.Cloud Full time

    About us: Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - DataOps & AI/ML - Cloud Native, AppSecOps, DevSecOps - Cloud Migration &...

  • Lead Data Engineer

    4 weeks ago


    India Intuitive.Cloud Full time

    About us: Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - DataOps & AI/ML - Cloud Native, AppSecOps, DevSecOps - Cloud...