ETL+Kafka Lead Developer
1 week ago
Role OverviewWe seek a Senior Data Engineer specializing in cloud-native ETL/ELT pipelines, modern orchestration, and real-time stream processing to build scalable data platforms. The role focuses on designing, implementing, and optimizing data workflows using AWS Glue, Google Dataflow, Azure Data Factory, Airflow, Dagster, Prefect, Apache Flink, Spark Structured Streaming, and managed services like Confluent Cloud, Fivetran + Snowflake, Informatica Cloud, Databricks Delta Live Tables, or StreamSets.Key ResponsibilitiesDevelop and maintain cloud-native ETL/ELT pipelines with AWS Glue, Google Dataflow, or Azure Data Factory for batch and incremental data processing.Orchestrate complex workflows using Airflow, Dagster, or Prefect, integrating with Kafka for real-time streaming via Flink, Spark Structured Streaming, or Materialize.Implement fully managed solutions like Confluent Cloud for Kafka transforms, Fivetran + Snowflake for ELT, Informatica Cloud, Databricks Delta Live Tables, or StreamSets to reduce operational overhead.Optimize data pipelines for performance, cost, and reliability; monitor, troubleshoot, and scale systems in multi-cloud environments (AWS, Azure, GCP).Collaborate with data scientists, analysts, and platform teams to ensure data quality, governance, and integration with downstream BI tools.Required Skills & Experience5+ years in data engineering with hands-on expertise in cloud-native ETL/ELT (AWS Glue, Google Dataflow, Azure Data Factory).Proficiency in modern orchestration (Airflow, Dagster, Prefect) and streaming (Flink, Spark Structured Streaming, Materialize, Kafka).Experience with managed platforms: Confluent Cloud, Fivetran + Snowflake, Informatica Cloud, Databricks Delta Live Tables, StreamSets.Strong programming in Python, SQL, PySpark; familiarity with data lakes, warehouses (Snowflake, Delta Lake), and CI/CD for data pipelines.Bachelor's/Master's in Computer Science, Engineering, or related field; proven track record in production-scale data systems.
-
ETL+Kafka Lead Developer
2 days ago
bangalore, India Tekskills Inc. Full timeRole Overview We seek a Senior Data Engineer specializing in cloud-native ETL/ELT pipelines, modern orchestration, and real-time stream processing to build scalable data platforms. The role focuses on designing, implementing, and optimizing data workflows using AWS Glue, Google Dataflow, Azure Data Factory, Airflow, Dagster, Prefect, Apache Flink, Spark...
-
ETL+Kafka Lead Developer
22 hours ago
bangalore, India Tekskills Inc. Full timeRole Overview We seek a Senior Data Engineer specializing in cloud-native ETL/ELT pipelines, modern orchestration, and real-time stream processing to build scalable data platforms. The role focuses on designing, implementing, and optimizing data workflows using AWS Glue, Google Dataflow, Azure Data Factory, Airflow, Dagster, Prefect, Apache Flink, Spark...
-
ETL Developer
1 week ago
bangalore, India Tekskills Inc. Full time8+ years of experience in Data warehouse and Data Lake Implementations as a Data Engineer/ETL DeveloperDeep understanding of Kafka architecture, concepts (topics, partitions, clustering,brokers), and related tools (Kafka Connect, Kafka Streams, Schema Registry).Strong experience with relevant AWS services for data streaming and infrastructure management...
-
ETL Lead
1 week ago
bangalore, India Nice Software Solutions Pvt. Ltd. Full timeData Engineering SME – Talend / Datastage / Oracle / Cloudera Location - DUBAI (ON-SITE) Experience - 10+ Years Job Description We are looking for a highly skilled Data Engineering SME with deep expertise in Talend or Datastage , strong hands-on experience in Oracle or Cloudera/Hadoop ecosystems , and excellent SQL & data engineering skills . The ideal...
-
Kafka Developer
1 week ago
bangalore, India Tata Consultancy Services Full timeExperience Range : 8+ Years Responsibilities: 8+ years of experience in the field of data streaming and transformation. Knowledge of Kafka cluster, Kafka connect, Kafka Streams, Kafka security, Schema Registry, Java/Python, Apache Flink, REST APIs, Cloud platforms (AWS, Azure, Confluent Cloud), Kubernetes, Terraform and Ansible, Prometheus & Grafana,...
-
ETL Developer
4 weeks ago
Bangalore, India Huron Full timeHuron is a global consultancy that collaborates with clients to drive strategic growth, ignite innovation and navigate constant change. Through a combination of strategy, expertise and creativity, we help clients accelerate operational, digital and cultural transformation, enabling the change they need to own their future. Join our team as the expert you...
-
Senior ETL Developer
7 days ago
bangalore, India Accelirate Inc. Full timeJob Title: Senior ETL Developer We are seeking an experienced Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong hands-on experience with ETL/ELT development, data modeling, and modern data engineering tools. This role will focus on building reliable,...
-
ETL Architect
4 weeks ago
bangalore, India Tata Consultancy Services Full timePosition- ETL Architect Location- Bengaluru, chennai Experience- 8 to 11 Years Notice period- 0 to 6 o Days or Serving NP Job Description 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices. 6+ years Data Warehouse/Data Lake Architecture and...
-
ETL Architect
4 days ago
bangalore, India Tata Consultancy Services Full timePosition- ETL Architect Location- Bengaluru, chennai Experience- 8 to 11 Years Notice period- 0 to 6 o Days or Serving NP Job Description 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices. 6+ years Data Warehouse/Data Lake Architecture and...
-
ETL Architect
2 days ago
bangalore, India Tata Consultancy Services Full timePosition- ETL Architect Location- Bengaluru, chennai Experience- 8 to 11 Years Notice period- 0 to 6 o Days or Serving NP Job Description 6+ years of experience Developing, deploying, and monitoring end to end data integration pipelines with extensive knowledge of evaluation metrics and best practices. 6+ years Data Warehouse/Data Lake Architecture and...
