Data Engineer
2 weeks ago
Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF).- Build ETL/ELT processes that ingest, transform, and load data from various sources into data lakes, warehouses, or databases. - Implement both batch and near real-time data flows.
Create, schedule, and monitor ADF pipelines. - Implement complex data workflows, including dependency management, parameterization, and dynamic pipeline design. - Integrate ADF with other Azure services (Blob Storage, Synapse, Databricks, Key Vault, etc.). - Implement logging, alerting, and retry logic for production stability.
Analyze large datasets to identify trends, issues, and transformation needs. - Write performant SQL queries and transformations. - Collaborate with data analysts to understand data requirements and structure transformations accordingly. - Ensure data is accurate, consistent, and aligned with business logic.
Quickly diagnose and resolve data quality issues, pipeline failures, or performance bottlenecks. - Perform root cause analysis for pipeline errors and implement long-term fixes. - Debug and optimize Spark or SQL transformations in environments like Databricks.
Implement data validation and quality checks within pipelines. - Perform reconciliation and sanity checks across data sources. - Maintain data dictionaries and metadata repositories.
Work closely with data architects, analysts, BI developers, and business users. - Translate business data needs into technical implementations. - Document pipeline logic, data flows, and troubleshooting procedures.
Work closely with data architects, analysts, BI developers, and business users. - Translate business data needs into technical implementations. - Document pipeline logic, data flows, and troubleshooting procedures.
Optimize ADF pipeline execution time and cost. - Improve query performance using indexing, partitioning, and efficient transformation logic. - Recommend improvements in data infrastructure and tooling.
-
Senior Data Engineer
2 weeks ago
Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per yearJob Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...
-
Senior Data Engineer
2 weeks ago
Delhi, Delhi, India Aptus Data Labs Full timeJob Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...
-
Data Engineer
6 days ago
Delhi NCR, Delhi, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000As a data engineer, you will be responsible for designing and building scalable data pipelines and architectures. Your expertise in integrating and transforming large-scale datasets from varied sources will enable seamless collaboration with solution designers to implement data ingestion and enrichment.Key Responsibilities:Data Pipeline Development: Design,...
-
Data Engineer
2 weeks ago
Delhi, NCR, New Delhi, Noida, India Trigyn Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per yearExperience: Minimum 5 yrs.Work Location: Client office in Delhi. Remote working options are not available.We are seeking a skilled Data Engineer with at least 5 years of experience to join our data analytics team, focusing on building robust data pipelines and systems to support the creation of dynamic dashboards. The role involves designing, building, and...
-
Data Engineer Lead
1 week ago
Delhi, Delhi NCR, India beBeeData Full time US$ 90,000 - US$ 1,20,000Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to join our team.This is a senior-level data engineering position that involves driving data engineering initiatives using Dataiku for data preparation, analysis, visualization, and deploying data solutions.The ideal candidate will have extensive experience with ETL/ELT processes...
-
Data Engineer
2 weeks ago
Delhi, NCR, India SAM Manpower & Career Services Full time ₹ 9,00,000 - ₹ 12,00,000 per yearSeeking an experienced Data Engineer with expertise in AWS, SQL, Data Warehousing, PySpark, Airflow, & streaming (Kafka/Flink). Must have strong skills in data pipelines, modern frameworks, file formats (Parquet/Delta/Iceberg), &cloud data solutions.
-
Senior Data Engineer
2 weeks ago
Delhi, Delhi NCR, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000We are currently seeking an exceptional Data Engineering Professional to spearhead the design, development, and optimization of data processing pipelines on Databricks.As a key member of our team, you will be responsible for architecting scalable and efficient data models, collaborating with cross-functional teams to migrate existing solutions, and ensuring...
-
Data Engineer
2 weeks ago
Delhi, NCR, India Leewayhertz Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per yearAs a Senior Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and lakehouse architectures on AWS. You will ensure data availability, quality, lineage, and governance across analytical and operational platforms. Your expertise will enable scalable, secure, and cost-effective data solutions that power advanced...
-
Data Scientist/ ML Engineer
2 weeks ago
Delhi, NCR, New Delhi, India Sourceease Hr Services Full time US$ 1,50,000 - US$ 2,00,000 per yearLocation: New Delhi, IndiaDuration: 6 Months (Extendable)Experience Required: 6+ YearsEmployment Type: ContractAbout the RoleWe are seeking a seasoned Machine Learning Engineer with a strong background in the BFSI (Banking, Financial Services, and Insurance) domain and expertise in time series forecasting and analysis. This is a contract-based opportunity...
-
Data Engineer
7 days ago
Delhi, NCR, New Delhi, India Qween Full time ₹ 15,00,000 - ₹ 28,00,000 per yearBuild ETL/data pipelines using Python, SQL, PySpark on AWS (Glue, S3, Redshift, EMR), Snowflake. Orchestrate with Airflow. Work on RDBMS (PostgreSQL, MySQL), data modeling (ER, Dimensional), CI/CD (Git), big data tools, quality, and governance.